-- Logs begin at Mon 2022-07-25 18:55:42 UTC, end at Mon 2022-07-25 21:46:02 UTC. -- Jul 25 19:50:28.939840 n-d-845775-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 19:50:28.952487 n-d-845775-3 devstack@n-api.service[104137]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:50:28 2022] *** Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: nodename: n-d-845775-3 Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: machine: x86_64 Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: clock source: unix Jul 25 19:50:28.955779 n-d-845775-3 devstack@n-api.service[104137]: pcre jit disabled Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: detected number of CPU cores: 4 Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: current working directory: / Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: your processes number limit is 47680 Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: your memory page size is 4096 bytes Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: detected max file descriptor number: 2048 Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: lock engine: pthread robust mutexes Jul 25 19:50:28.956338 n-d-845775-3 devstack@n-api.service[104137]: thunder lock: enabled Jul 25 19:50:28.956779 n-d-845775-3 devstack@n-api.service[104137]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 19:50:28.956779 n-d-845775-3 devstack@n-api.service[104137]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:50:29.004283 n-d-845775-3 devstack@n-api.service[104137]: Python main interpreter initialized at 0x55f150ee99c0 Jul 25 19:50:29.004283 n-d-845775-3 devstack@n-api.service[104137]: python threads support enabled Jul 25 19:50:29.004283 n-d-845775-3 devstack@n-api.service[104137]: your server socket listen backlog is limited to 100 connections Jul 25 19:50:29.004283 n-d-845775-3 devstack@n-api.service[104137]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:50:29.004757 n-d-845775-3 devstack@n-api.service[104137]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:50:29.004757 n-d-845775-3 devstack@n-api.service[104137]: *** Operational MODE: preforking *** Jul 25 19:50:29.004995 n-d-845775-3 devstack@n-api.service[104137]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:50:29.004995 n-d-845775-3 devstack@n-api.service[104137]: spawned uWSGI master process (pid: 104137) Jul 25 19:50:29.005217 n-d-845775-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 19:50:29.007783 n-d-845775-3 devstack@n-api.service[104137]: spawned uWSGI worker 1 (pid: 104149, cores: 1) Jul 25 19:50:29.007783 n-d-845775-3 devstack@n-api.service[104137]: spawned uWSGI worker 2 (pid: 104150, cores: 1) Jul 25 19:50:29.007783 n-d-845775-3 devstack@n-api.service[104137]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:50:29.704167 n-d-845775-3 devstack@n-api.service[104150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:50:29.772802 n-d-845775-3 devstack@n-api.service[104149]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 19:50:30.861961 n-d-845775-3 devstack@n-api.service[104150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:50:30.861961 n-d-845775-3 devstack@n-api.service[104150]: from cryptography.utils import int_from_bytes Jul 25 19:50:30.862891 n-d-845775-3 devstack@n-api.service[104150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:50:30.862891 n-d-845775-3 devstack@n-api.service[104150]: from cryptography.utils import int_from_bytes Jul 25 19:50:31.145301 n-d-845775-3 devstack@n-api.service[104149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:50:31.145301 n-d-845775-3 devstack@n-api.service[104149]: from cryptography.utils import int_from_bytes Jul 25 19:50:31.146202 n-d-845775-3 devstack@n-api.service[104149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:50:31.146202 n-d-845775-3 devstack@n-api.service[104149]: from cryptography.utils import int_from_bytes Jul 25 19:50:33.766042 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:50:33.766691 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:50:33.766809 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:50:33.767165 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:50:33.767420 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:50:33.767813 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.768161 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.768487 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.768803 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.769132 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.769441 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.769758 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.770074 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.770398 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.770655 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.770973 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.771283 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845775-3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.771597 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.771904 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.772234 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.772554 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.772859 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.773175 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.773650 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.774588 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.775325 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.776259 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.776586 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.776934 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.777255 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.777568 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.777893 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.778206 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.778533 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.778861 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.779249 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845775-3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.779568 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.779881 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.780227 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.780643 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.780957 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.781266 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.781587 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.781909 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.782221 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.782549 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.782865 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.783188 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.783504 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.783809 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.784146 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.784463 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.784784 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.785085 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.785385 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.785638 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.785947 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.786270 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.786588 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.786908 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.787155 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.787406 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.787722 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.788065 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.788369 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.788677 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.788986 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.789291 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.789650 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.790060 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.790461 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.790869 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.791436 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.791910 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:50:33.795199 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.795766 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:50:33.796518 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.797107 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:50:33.797358 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.798555 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:50:33.798555 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:50:33.799514 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.800096 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.800096 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.800806 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801081 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801081 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801386 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801546 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801546 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801793 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801949 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.801949 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802247 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802401 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802552 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802703 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802703 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.802981 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845775-3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803410 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803561 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803561 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803814 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803988 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.803988 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.804280 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.804419 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.804419 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.804785 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.804954 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805170 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805311 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805311 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805542 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805690 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805690 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.805965 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.806112 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.806245 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.806376 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.806376 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.806637 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.807280 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.807475 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.807619 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.807770 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.807905 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808063 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808195 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845775-3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808358 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808504 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808634 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808760 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.808884 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809025 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809175 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809175 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809420 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809543 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809674 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809806 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.809959 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810277 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810437 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810574 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810703 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810788 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.810932 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811075 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811213 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811354 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811466 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811598 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811735 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.811892 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812070 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812210 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812350 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812517 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812657 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812797 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.812937 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813076 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813249 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813398 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813533 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813660 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813785 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.813927 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814065 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814280 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814425 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814564 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814700 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.814914 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815076 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815270 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815407 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815544 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815674 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815674 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.815946 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816124 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816255 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816393 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816531 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816662 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816809 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.816949 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817093 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817223 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817362 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817566 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817698 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817845 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817989 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.817989 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818215 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818374 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818522 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818672 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818822 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.818999 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819104 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819237 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819389 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819537 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819672 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819893 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.819987 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820104 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820197 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820286 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820374 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820462 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820543 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820626 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820717 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820807 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820894 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.820979 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821067 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821149 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821228 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821301 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821369 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821434 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821524 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821606 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821673 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821738 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821804 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.821869 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.821943 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.822011 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.822076 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.822148 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.822215 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.822295 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.822295 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.822484 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.823061 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.823136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.823209 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.823209 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.823349 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.823422 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.823493 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.823572 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.823654 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.823801 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.824169 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.824303 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.824744 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.824836 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.825306 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.825421 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.825815 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.825913 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.826354 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.826469 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.826685 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.826774 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.827019 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.827123 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.827383 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.827472 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.827917 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.828058 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.828267 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.828460 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.828641 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.828812 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.828975 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.829210 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.829353 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.829548 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.829700 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.829872 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.830033 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.830175 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.830308 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.830493 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.830643 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.830796 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.830936 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.831115 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.831276 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.831448 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.831592 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.831768 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.831927 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.832121 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.832280 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.832450 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.832615 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.832820 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.832978 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.833120 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.833406 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.833551 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.833912 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.834066 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.834235 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.834511 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.834672 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.834856 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.835089 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.835256 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.835510 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.835662 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.835821 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.836129 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.836231 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.836439 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.836753 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.836885 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.837061 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.837341 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.837442 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.837666 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.837921 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.838083 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.838345 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.838487 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.838656 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.838818 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.839018 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.839183 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.839408 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.839637 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.839794 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.840026 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.840192 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.840351 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.840598 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.840760 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.840960 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.841109 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.841273 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.841466 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.841602 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.841896 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.842054 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.842185 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.842316 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.842499 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.842723 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.842859 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.843124 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.843288 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.843421 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.843738 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.843890 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.844064 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.844421 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:50:33.844716 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.844716 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.844999 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845140 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845378 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845566 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845708 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845847 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.845987 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.846206 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.846367 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.846540 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.846748 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.846899 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.847167 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.847318 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.847472 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.847619 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.847800 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.848066 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.848215 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.848433 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.848592 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.848770 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849038 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849192 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849325 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849642 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849771 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.849943 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.850240 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.850335 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.850544 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.850796 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.850893 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.851142 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.851356 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.851464 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.851770 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.851917 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.852092 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.852402 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.852541 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.852708 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.853053 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.853153 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.853360 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.853734 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.853827 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.854072 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.854366 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.854455 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.854709 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.854965 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.855099 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.855338 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.855752 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.855889 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.855973 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.856146 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.856265 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.856578 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.856734 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.856906 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.857220 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.857358 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.857541 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.857852 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.857993 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.858178 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.858492 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.858638 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.858812 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.858952 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.859119 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.859435 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.859574 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.859775 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.860118 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.860228 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.860438 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.860713 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.860800 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861058 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861312 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861420 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861675 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861866 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.861982 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.862294 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.862472 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.862605 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.862924 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.863106 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.863236 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.863560 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.863727 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.863910 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.864212 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.864316 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.864596 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.864698 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.864926 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865019 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865243 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865330 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865579 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865685 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.865942 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.866160 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.866288 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.866606 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.866758 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.866942 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.867284 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.867425 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.867606 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.867797 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.867936 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.868291 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.868401 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.868614 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.868709 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.868937 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.869046 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.869801 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.869903 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.870120 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.870325 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.870486 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.870620 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.870821 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.871032 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.871162 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.871482 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.871593 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.871836 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.872170 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.872264 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.872499 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.872728 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.872817 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873127 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873249 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873445 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873575 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873770 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.873925 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.874093 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.874284 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.874435 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.874659 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.874789 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875038 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875177 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875356 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875493 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875688 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.875909 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876027 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876337 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876438 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876663 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876769 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.876995 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877153 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877316 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877509 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877678 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877846 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.877990 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.878253 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.878406 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.878578 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.878729 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.878902 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.879108 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.879358 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.879521 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.879671 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.879881 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880083 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880244 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880401 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880575 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880774 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.880895 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.881204 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.881358 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.881510 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.881678 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.881822 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.882388 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.882541 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.882698 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.882995 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883143 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883309 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883452 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883621 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883781 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.883918 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.884254 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.884405 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.884562 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.884702 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.884858 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.885646 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.885823 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886030 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886176 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886344 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886621 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886740 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.886985 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.887095 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.887302 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.887483 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.887657 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.887755 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888073 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888238 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888409 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888575 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888727 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.888878 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889029 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889169 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889312 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889469 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889622 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889776 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.889919 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890076 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890283 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890481 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890630 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890818 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.890977 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891145 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891323 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891462 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891597 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891777 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.891921 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892122 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892277 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892458 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892583 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892791 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.892937 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893135 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893303 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893463 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893606 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893746 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.893886 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894022 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894165 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894335 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894488 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894637 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894777 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.894909 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895102 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895262 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895432 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895579 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895754 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.895898 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.896147 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.896323 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.896480 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.896620 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.896853 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897007 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897156 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897301 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897448 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897589 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897730 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.897870 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898021 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898148 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898276 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898415 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898542 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898668 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898804 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.898931 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899066 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899191 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899368 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899500 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899679 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.899838 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900025 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900231 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900398 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900587 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900732 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.900916 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901071 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901249 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901404 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901566 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901708 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.901878 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902023 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902201 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902348 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902516 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902655 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902816 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.902959 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903292 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903455 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903593 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903732 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.903881 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904057 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904223 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904363 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904497 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904663 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904803 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.904976 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905127 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905285 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905409 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905592 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905727 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.905902 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906025 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906196 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906328 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906511 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906646 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.906955 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907129 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907284 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907424 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907573 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907709 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907844 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.907999 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908220 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908363 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908501 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908639 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908794 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.908932 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909071 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909270 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909417 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909556 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909709 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.909851 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910003 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910112 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910248 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910354 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910474 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910631 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910723 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.910961 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911101 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911277 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911374 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911585 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911722 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.911890 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.912064 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.912240 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.912355 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913109 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913217 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913217 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913461 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913585 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913689 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913788 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.913907 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914035 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914166 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914421 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914562 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914711 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.914850 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915005 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915147 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915305 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915444 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915588 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915727 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915869 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.915998 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916152 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916272 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916450 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916592 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916743 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.916878 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917054 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917054 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917347 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917503 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917656 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917783 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917871 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.917939 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918135 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918284 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918462 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918580 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918788 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.918923 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919123 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919261 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919432 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919590 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919794 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.919956 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.920142 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.920303 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.920426 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.920554 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.920833 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921022 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921223 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921428 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921615 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921791 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.921967 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922137 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922317 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922479 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922666 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922832 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.922978 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.923114 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.923326 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.923517 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.923683 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.923869 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924028 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924227 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924343 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924453 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924548 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924639 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924769 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.924906 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925026 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925260 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925370 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925479 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925596 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925727 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925834 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.925935 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926055 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926187 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926286 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926389 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926522 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926702 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.926817 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927005 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927184 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927325 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927451 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927611 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927765 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.927925 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928146 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928260 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928462 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928575 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928776 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.928887 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929109 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929224 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929517 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929618 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929757 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.929881 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930068 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930162 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930385 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930478 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930700 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.930790 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931011 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931115 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931314 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931403 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931625 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.931713 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.932489 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.932592 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.932805 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.932934 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933118 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933251 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933433 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933565 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933746 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.933843 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934070 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934159 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934386 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934483 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934697 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.934786 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935006 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935095 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935323 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935412 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935638 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935755 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.935949 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.936097 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.936305 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.936530 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.936739 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.936883 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937031 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937136 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937327 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937454 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937577 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937711 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.937874 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938031 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938197 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938453 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938545 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938628 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938718 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.938816 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939039 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939129 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939362 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939508 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939706 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.939871 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940017 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940199 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940340 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940484 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940644 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.940911 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941056 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941205 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941387 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941527 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941697 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.941826 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942018 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942129 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942342 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942431 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942671 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942824 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.942969 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943110 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943261 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943373 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943635 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943785 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.943975 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944120 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944320 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944463 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944622 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944755 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.944935 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.945083 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.945243 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.945424 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.945568 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.945883 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946008 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946196 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946315 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946519 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946760 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.946935 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.947215 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.947618 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.947618 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.948495 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.948625 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.948757 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.948872 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949054 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949201 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949357 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949507 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949648 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.949937 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950100 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950239 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950386 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950561 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950709 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950849 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.950968 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951162 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951309 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951459 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951598 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951766 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.951891 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952089 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952256 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952399 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952537 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952699 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.952842 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953001 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953140 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953385 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953621 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953762 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.953905 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954042 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954135 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954332 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954494 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954636 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954781 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.954922 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955060 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955248 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955384 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955550 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955704 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955834 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.955963 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956169 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956271 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956523 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956626 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956865 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.956995 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957129 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957273 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957433 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957578 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957767 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.957915 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958138 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958284 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958483 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958642 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958779 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.958921 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959060 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959204 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959339 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959481 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959623 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959829 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.959968 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960161 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960259 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960414 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960573 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960725 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.960914 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961059 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961227 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961413 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961573 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961721 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.961872 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962015 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962155 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962289 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962453 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962591 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962696 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.962953 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963127 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963256 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963418 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963560 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963685 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963848 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.963996 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.964173 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.964287 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.964503 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.964638 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.964831 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.965060 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.965265 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.965471 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.966493 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.966672 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.966815 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.966972 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967120 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967255 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967386 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967386 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967649 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967649 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.967886 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968004 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968176 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968314 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968442 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968586 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.968717 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969012 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969147 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969288 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969416 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969558 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969697 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.969864 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.970024 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.970277 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.970416 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.970656 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.971092 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.971247 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.971375 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.971500 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.971764 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.972019 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.972197 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.972434 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.972566 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.972850 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973033 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973183 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973335 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973472 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973655 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973814 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.973993 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974130 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974319 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974482 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974629 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974772 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.974977 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.975119 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.975304 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.975554 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.975706 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.975934 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.976144 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.976293 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.976624 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.976792 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.976939 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.977214 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.977372 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.977626 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.977771 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.977963 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978119 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978284 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978410 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978697 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978857 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.978998 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979125 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979288 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979501 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979637 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979772 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.979912 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980104 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980244 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980396 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980558 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980720 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.980892 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981044 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981194 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981339 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981518 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981670 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981830 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.981994 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982138 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982280 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982422 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982581 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982744 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.982880 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983019 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983147 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983340 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983469 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983669 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983819 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.983961 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984133 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984302 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984456 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984617 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984771 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.984906 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985051 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985234 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985399 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985553 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985694 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985842 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.985987 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986161 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986324 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986461 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986574 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986789 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.986924 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987108 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987321 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987468 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987639 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987777 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.987969 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.988128 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.988322 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.988464 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.988666 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.988854 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989005 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989157 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989298 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989415 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989565 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989737 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.989879 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990071 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990219 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990389 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990531 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990692 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.990808 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991038 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991131 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991309 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991428 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991631 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.991986 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.992229 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.992369 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.992369 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.992623 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.992748 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.993053 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.993205 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.993552 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.993667 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.993876 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.994156 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.994838 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995049 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995289 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995417 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995664 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995833 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.995978 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.996314 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.996500 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.996704 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.997177 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.997416 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.997416 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.997836 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.998025 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.998025 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.998407 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.998615 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.998817 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999000 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999000 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999217 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999341 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999447 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999695 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:33.999839 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.000016 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.000339 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.000473 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.000724 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.000940 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.001054 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.001250 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.001554 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.001714 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.001856 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002023 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002163 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002362 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002495 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002712 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.002842 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003042 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003182 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003351 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003498 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003654 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.003859 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004006 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004234 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004391 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004541 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004692 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004835 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.004969 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005106 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005221 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005411 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005516 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005798 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.005888 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.006123 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.006222 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.006447 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.006755 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.006845 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.007331 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.007690 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.007985 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.008199 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.008592 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.008977 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.009153 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.009299 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.009551 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.009718 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.009899 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.010719 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.010876 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.011125 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.011290 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.011434 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.011744 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.011833 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.012100 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.012418 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.012595 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.012732 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.012965 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.013106 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.013325 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.013518 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.013659 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.013933 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.014085 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.014240 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.014669 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.014774 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.015239 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.015330 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.015813 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.015904 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.016526 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.016690 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.016969 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.017088 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.017532 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.017686 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.017902 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.018202 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.018488 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.018683 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.019115 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.019272 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.019447 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.019680 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.019784 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.020057 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.020259 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.020398 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.020725 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.020839 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.021059 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.021238 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.021391 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.021728 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.021888 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.022063 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.022319 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.022469 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.022705 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.022868 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.023015 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.023348 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.023591 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.023711 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.023855 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.024135 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.024384 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.024548 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.024711 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.024932 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.025043 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.025378 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.025711 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.025954 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.026229 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.026382 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.026619 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.026770 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.026958 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.027221 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.027338 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.027610 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.027803 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.027947 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.028317 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.028438 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.028638 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.028957 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.029059 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.029284 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.029606 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.029762 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.029907 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.030203 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.030361 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.030553 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.030785 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.030931 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.031188 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.031394 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.031506 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.032021 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.032202 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.032417 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.032663 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.032838 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.033070 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.033265 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.033412 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.033724 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.033875 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.034034 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.034363 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.034515 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.034662 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.034949 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.035117 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.035297 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.035527 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.035683 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.035922 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.036142 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.036312 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.036574 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.036715 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.036892 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.037213 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.037368 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.037531 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.037828 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.037950 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.038160 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.038354 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.038506 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.038751 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.038911 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.039058 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.039205 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.039464 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.039736 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.039885 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040056 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040274 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040424 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040532 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040619 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040704 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040773 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.040942 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041087 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041259 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041420 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041576 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041713 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.041886 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042027 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042291 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042465 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042595 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042728 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.042867 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043006 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043186 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043394 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043546 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043768 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.043917 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.044112 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.044256 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.044459 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.044637 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.044771 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.045102 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.045235 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.045423 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.045679 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.045805 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.046089 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.046235 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.046415 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.046817 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.046964 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.047275 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.047385 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.047634 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.047790 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.047917 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048090 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048475 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048600 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048681 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048772 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.048907 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049010 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049230 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049320 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049569 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049683 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049864 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.049955 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050182 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050286 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050494 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050592 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050810 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.050899 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051126 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051215 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051449 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051584 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051769 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.051859 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052102 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052194 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052420 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052510 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052740 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.052838 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053059 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053154 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053376 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053464 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053694 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.053780 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054018 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054122 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054393 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054539 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054694 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.054792 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055019 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055115 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055346 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055457 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055675 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055768 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.055999 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.056130 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.056344 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.056434 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.057345 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.057447 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.057883 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.058356 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.058497 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.058694 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059045 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059146 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059377 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059570 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059785 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.059984 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.060167 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.060472 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.060637 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.060801 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.060960 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.061137 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.061462 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.061738 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.061894 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.062603 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.062738 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063022 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063022 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063178 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063313 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063456 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063613 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063759 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.063901 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.064095 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.064243 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:50:34.064381 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.064589 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.064925 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.065244 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.065560 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.065878 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.066206 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.066535 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.066857 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.067170 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.067482 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.067803 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.068138 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.068455 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.068774 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.069093 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.069410 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.069721 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.070036 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.070353 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.070664 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.070978 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.071290 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.071613 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.071926 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.072268 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.073148 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.073469 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.073785 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.074132 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.074476 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.074805 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.075136 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.075462 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.075800 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.076151 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.076481 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.076816 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.077149 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.077469 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.077813 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.078133 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.078455 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.078776 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.079105 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.079447 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.079843 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.080208 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.080440 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.080759 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.081098 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.081475 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.081779 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.082103 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.082383 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.082723 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.083041 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.083364 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.083694 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.084008 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.084353 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.084677 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.085004 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.085321 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.085649 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.085975 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.086309 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.086648 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.086967 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.087307 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.087640 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.087996 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.088383 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.088733 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.089080 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.089407 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.089724 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.090040 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:50:34.090296 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:50:34.233831 n-d-845775-3 devstack@n-api.service[104150]: INFO dbcounter [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Registered counter for database nova_api Jul 25 19:50:34.247577 n-d-845775-3 devstack@n-api.service[104149]: INFO dbcounter [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Registered counter for database nova_api Jul 25 19:50:34.264917 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_db.sqlalchemy.engines [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.268610 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_db.sqlalchemy.engines [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.272001 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writer thread running {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.277639 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writer thread running {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.331751 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.context [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=104150) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:50:34.338211 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.340772 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.342005 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.345058 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.347906 n-d-845775-3 devstack@n-api.service[104150]: INFO dbcounter [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Registered counter for database nova_cell0 Jul 25 19:50:34.355132 n-d-845775-3 devstack@n-api.service[104150]: INFO dbcounter [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Registered counter for database nova_cell1 Jul 25 19:50:34.361672 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.context [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=104149) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 19:50:34.362382 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_db.sqlalchemy.engines [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.364110 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_db.sqlalchemy.engines [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.365820 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_concurrency.lockutils [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.367428 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_concurrency.lockutils [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.368354 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_concurrency.lockutils [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:50:34.368745 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writer thread running {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.370961 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_concurrency.lockutils [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:50:34.373040 n-d-845775-3 devstack@n-api.service[104149]: INFO dbcounter [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Registered counter for database nova_cell0 Jul 25 19:50:34.378973 n-d-845775-3 devstack@n-api.service[104149]: INFO dbcounter [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Registered counter for database nova_cell1 Jul 25 19:50:34.388439 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_db.sqlalchemy.engines [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.391558 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_db.sqlalchemy.engines [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.398236 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writer thread running {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.404473 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writer thread running {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.514090 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writer thread running {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.523566 n-d-845775-3 devstack@n-api.service[104150]: INFO dbcounter [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Registered counter for database nova_cell0 Jul 25 19:50:34.536578 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_db.sqlalchemy.engines [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.544906 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writer thread running {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.561001 n-d-845775-3 devstack@n-api.service[104149]: INFO dbcounter [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Registered counter for database nova_cell0 Jul 25 19:50:34.570854 n-d-845775-3 devstack@n-api.service[104149]: DEBUG oslo_db.sqlalchemy.engines [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:50:34.577523 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writer thread running {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:50:34.905213 n-d-845775-3 devstack@n-api.service[104150]: WARNING keystonemiddleware.auth_token [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:50:34.906299 n-d-845775-3 devstack@n-api.service[104149]: WARNING keystonemiddleware.auth_token [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:50:34.912569 n-d-845775-3 devstack@n-api.service[104150]: WARNING keystonemiddleware.auth_token [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:50:34.914858 n-d-845775-3 devstack@n-api.service[104149]: WARNING keystonemiddleware.auth_token [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:50:35.258787 n-d-845775-3 devstack@n-api.service[104150]: WARNING keystonemiddleware.auth_token [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:50:35.265653 n-d-845775-3 devstack@n-api.service[104150]: WARNING keystonemiddleware.auth_token [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:50:35.270123 n-d-845775-3 devstack@n-api.service[104149]: WARNING keystonemiddleware.auth_token [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 19:50:35.271065 n-d-845775-3 devstack@n-api.service[104150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f150ee99c0 pid: 104150 (default app) Jul 25 19:50:35.273246 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:50:35.274470 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001822 Jul 25 19:50:35.274889 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Jul 25 19:50:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:50:35.276568 n-d-845775-3 devstack@n-api.service[104149]: WARNING keystonemiddleware.auth_token [None req-22817014-3d18-424a-b1f5-4f5cc96d67c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 19:50:35.282913 n-d-845775-3 devstack@n-api.service[104149]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f150ee99c0 pid: 104149 (default app) Jul 25 19:51:56.154079 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:56.155836 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Jul 25 19:51:56.156442 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:51:56.172923 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_api:SELECT=3 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:56.174390 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_cell0:SELECT=3 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:56.175464 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_cell1:SELECT=3 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:56.176776 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_cell0:SELECT=3 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:51:57.124489 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-dfda2337-c6ce-4f72-8ff3-4d565b9dbab0 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:57.160979 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-dfda2337-c6ce-4f72-8ff3-4d565b9dbab0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.997757 Jul 25 19:51:57.167619 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Jul 25 19:51:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:51:59.522242 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:51:59.525959 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-4a835b7c-7ff7-44c8-b28a-1ef6c97ce4bb None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002610 Jul 25 19:51:59.525959 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:00.081149 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-d33b4719-74c9-4218-957f-313df36bed4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:00.105938 n-d-845775-3 devstack@n-api.service[104149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:52:00.105938 n-d-845775-3 devstack@n-api.service[104149]: warnings.warn(msg) Jul 25 19:52:00.137008 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-d33b4719-74c9-4218-957f-313df36bed4b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.600553 Jul 25 19:52:00.137891 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:51:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:00.380277 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-bc0a613f-1d32-4f37-9e2b-2d200412b76a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:00.385460 n-d-845775-3 devstack@n-api.service[104150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:52:00.385460 n-d-845775-3 devstack@n-api.service[104150]: warnings.warn(msg) Jul 25 19:52:00.388749 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_api:SELECT=3 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:00.389609 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_cell0:SELECT=3 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:00.390895 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_cell1:SELECT=3 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:00.391651 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:00.458302 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-bc0a613f-1d32-4f37-9e2b-2d200412b76a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311951 Jul 25 19:52:00.464370 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Jul 25 19:52:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:02.895840 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-d33b4719-74c9-4218-957f-313df36bed4b admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:02.897445 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-d33b4719-74c9-4218-957f-313df36bed4b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 Jul 25 19:52:02.897912 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:03.949998 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-508f6d3d-e610-4114-a75d-691b8e4adff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:03.973212 n-d-845775-3 devstack@n-api.service[104150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:52:03.973212 n-d-845775-3 devstack@n-api.service[104150]: warnings.warn(msg) Jul 25 19:52:03.995999 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-508f6d3d-e610-4114-a75d-691b8e4adff7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.088645 Jul 25 19:52:04.003708 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:04.011069 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-03a89901-ce5a-4135-a79f-609e79b343ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:04.015867 n-d-845775-3 devstack@n-api.service[104149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:52:04.015867 n-d-845775-3 devstack@n-api.service[104149]: warnings.warn(msg) Jul 25 19:52:04.065356 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-03a89901-ce5a-4135-a79f-609e79b343ee admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059439 Jul 25 19:52:04.066673 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Jul 25 19:52:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:06.983492 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-508f6d3d-e610-4114-a75d-691b8e4adff7 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:06.985769 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-508f6d3d-e610-4114-a75d-691b8e4adff7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002635 Jul 25 19:52:06.989147 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:07.572350 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-0f373360-2deb-42e4-8e4a-1dc4977d858c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:07.605680 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-0f373360-2deb-42e4-8e4a-1dc4977d858c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.604314 Jul 25 19:52:07.612901 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:52:07.625108 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-16973aba-e762-44ab-a15d-3be60a472521 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:07.668916 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-16973aba-e762-44ab-a15d-3be60a472521 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048369 Jul 25 19:52:07.670972 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Jul 25 19:52:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:10.361124 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-0f373360-2deb-42e4-8e4a-1dc4977d858c admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:10.362067 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-0f373360-2deb-42e4-8e4a-1dc4977d858c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 25 19:52:10.362488 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:10.901781 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-e31130cb-b55c-42e8-afe5-34249d984890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:10.925461 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-e31130cb-b55c-42e8-afe5-34249d984890 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.555943 Jul 25 19:52:10.933929 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:10.940464 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-c1d033a0-d28b-42dc-a1d2-4b7691bb2219 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:10.979797 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-c1d033a0-d28b-42dc-a1d2-4b7691bb2219 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044109 Jul 25 19:52:10.980712 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Jul 25 19:52:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:13.310612 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-e31130cb-b55c-42e8-afe5-34249d984890 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:13.313279 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-e31130cb-b55c-42e8-afe5-34249d984890 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003569 Jul 25 19:52:13.314505 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:13.939926 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "disk": 20}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:13.971149 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.649311 Jul 25 19:52:13.972434 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:13.988498 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-da741863-80ab-4d44-a329-95c92f78cb1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:14.022048 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-da741863-80ab-4d44-a329-95c92f78cb1a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040323 Jul 25 19:52:14.022966 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Jul 25 19:52:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:16.353049 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:16.354925 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002330 Jul 25 19:52:16.355786 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:16.892837 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-be701aae-9738-4a29-88cc-653c2b2b8f35 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:16.937826 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-be701aae-9738-4a29-88cc-653c2b2b8f35 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.574764 Jul 25 19:52:16.939004 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Jul 25 19:52:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:52:19.386008 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:19.387267 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-1ad431ec-ddf1-46f7-b51e-04180640daa8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jul 25 19:52:19.387896 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:52:19.927459 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-0b662281-45ae-4e3e-a7eb-e5dbe810bc9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:19.954468 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-0b662281-45ae-4e3e-a7eb-e5dbe810bc9d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.559892 Jul 25 19:52:19.955470 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:52:19.967861 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-58c5c408-4fde-4433-a8d5-dd9f159adb40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:19.994763 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-58c5c408-4fde-4433-a8d5-dd9f159adb40 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030470 Jul 25 19:52:19.995353 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Jul 25 19:52:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:22.402641 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-0b662281-45ae-4e3e-a7eb-e5dbe810bc9d admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:22.403600 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-0b662281-45ae-4e3e-a7eb-e5dbe810bc9d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 25 19:52:22.404015 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:22.935735 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-01597e29-661d-4fe5-9749-1a2cc92d09ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:22.956861 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-01597e29-661d-4fe5-9749-1a2cc92d09ad admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.546519 Jul 25 19:52:22.957428 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:52:22.973676 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-e1c9d5bd-9db9-432d-9ba7-09a63e293ad7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:23.001168 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-e1c9d5bd-9db9-432d-9ba7-09a63e293ad7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034964 Jul 25 19:52:23.001751 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Jul 25 19:52:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:25.546961 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-01597e29-661d-4fe5-9749-1a2cc92d09ad admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:25.547982 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-01597e29-661d-4fe5-9749-1a2cc92d09ad admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 25 19:52:25.548416 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:26.066651 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-43e727d9-4ffd-4d00-b631-e627265188c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "id": "3"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:26.093303 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-43e727d9-4ffd-4d00-b631-e627265188c4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.538785 Jul 25 19:52:26.101536 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:26.109369 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-cb5a0654-6399-4cbd-a93e-ec0560321b07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:26.147349 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-cb5a0654-6399-4cbd-a93e-ec0560321b07 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042489 Jul 25 19:52:26.148971 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Jul 25 19:52:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:28.509939 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-43e727d9-4ffd-4d00-b631-e627265188c4 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:28.510968 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-43e727d9-4ffd-4d00-b631-e627265188c4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 25 19:52:28.511362 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:28.992801 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-6a1c8a76-3e3a-44b9-a198-66ad0d5b8a49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:28.998628 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:29.014896 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-6a1c8a76-3e3a-44b9-a198-66ad0d5b8a49 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.497143 Jul 25 19:52:29.015447 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:29.032807 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-d79d514c-7452-4681-a0a3-66aa39f5dd36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:29.070711 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-d79d514c-7452-4681-a0a3-66aa39f5dd36 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045104 Jul 25 19:52:29.071584 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Jul 25 19:52:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:52:31.605553 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-6a1c8a76-3e3a-44b9-a198-66ad0d5b8a49 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:31.606618 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-6a1c8a76-3e3a-44b9-a198-66ad0d5b8a49 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 25 19:52:31.607306 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:32.209575 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "id": "5"}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:32.237084 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.623389 Jul 25 19:52:32.246162 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Jul 25 19:52:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:52:32.256210 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-aa3d7563-2e58-49a5-ad8a-e85ffc03e1f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:52:32.296367 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-aa3d7563-2e58-49a5-ad8a-e85ffc03e1f7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049367 Jul 25 19:52:32.297686 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Jul 25 19:52:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:52:57.338846 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:57.339874 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 25 19:52:57.340333 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:52:57.355050 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:57.813075 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-62b38d15-f245-4af9-9471-9143329a1d08 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:57.840628 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-62b38d15-f245-4af9-9471-9143329a1d08 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.493455 Jul 25 19:52:57.841391 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Jul 25 19:52:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:52:59.004890 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.006557 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-5f737678-e435-4330-a9d3-5d98223a7d38 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Jul 25 19:52:59.007314 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:52:59.631616 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-67b95abd-34b1-4acf-b918-0ecb99ef3ee9 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.637647 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.wsgi [None req-67b95abd-34b1-4acf-b918-0ecb99ef3ee9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-67b95abd-34b1-4acf-b918-0ecb99ef3ee9 admin admin] Request method failure captured: Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Accept: application/json Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Accept-Encoding: gzip, deflate Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Connection: keep-alive Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Content-Length: 0 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Host: 10.222.0.48 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Openstack-Api-Version: compute 2.90 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: Openstack-System-Scope: None Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: User-Agent: python-novaclient Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Auth-Token: gAAAAABi3vSadSyhrXJHJkMiOblvTqRlIpabdVPSJ4T85YoxjID-WXmPAata52vdzmre-qB4NOTa1RPUOycuhZuXVvV41MJDkYVw4MKkau8a5rTpAapqmJDzLNQg3rVktTEyHteM6F7h0X8C5vfrQBtF7zjIqoOB0LI8VSgTPDX4WlvWL3HtaBw Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Id: None Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Name: None Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Identity-Status: Confirmed Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Is-Admin-Project: True Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Id: default Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Name: Default Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Name: admin Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Role: admin,reader,member Jul 25 19:52:59.640955 n-d-845775-3 devstack@n-api.service[104149]: X-Roles: admin,reader,member Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant: admin Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Name: admin Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-User: admin Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Id: default Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Name: Default Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: X-User-Name: admin Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: method: > Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: exception: Flavor 42 could not be found. Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: action_args: {'id': '42'} Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:52:59.642651 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:52:59.643876 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.645451 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-67b95abd-34b1-4acf-b918-0ecb99ef3ee9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:52:59.646898 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-67b95abd-34b1-4acf-b918-0ecb99ef3ee9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.448784 Jul 25 19:52:59.646898 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:52:59.654636 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-077eff7c-837a-4a9e-9427-f881505a5861 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.658799 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:52:59.678210 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-077eff7c-837a-4a9e-9427-f881505a5861 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027054 Jul 25 19:52:59.678781 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:52:59.707209 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-84f90dad-78e6-4e37-95c7-42b1a94cabd7 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.731632 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-84f90dad-78e6-4e37-95c7-42b1a94cabd7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027997 Jul 25 19:52:59.732231 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:52:59.742126 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-23fa4e42-f997-4fb8-8523-9163708949b7 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:52:59.748819 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.wsgi [None req-23fa4e42-f997-4fb8-8523-9163708949b7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-23fa4e42-f997-4fb8-8523-9163708949b7 admin admin] Request method failure captured: Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Accept: application/json Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Accept-Encoding: gzip, deflate Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Connection: keep-alive Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Content-Length: 0 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Host: 10.222.0.48 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Openstack-Api-Version: compute 2.90 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: Openstack-System-Scope: None Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: User-Agent: python-novaclient Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Auth-Token: gAAAAABi3vSadSyhrXJHJkMiOblvTqRlIpabdVPSJ4T85YoxjID-WXmPAata52vdzmre-qB4NOTa1RPUOycuhZuXVvV41MJDkYVw4MKkau8a5rTpAapqmJDzLNQg3rVktTEyHteM6F7h0X8C5vfrQBtF7zjIqoOB0LI8VSgTPDX4WlvWL3HtaBw Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Id: None Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Name: None Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Identity-Status: Confirmed Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Is-Admin-Project: True Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Id: default Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Name: Default Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Name: admin Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Role: admin,reader,member Jul 25 19:52:59.752084 n-d-845775-3 devstack@n-api.service[104150]: X-Roles: admin,reader,member Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant: admin Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Name: admin Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-User: admin Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Id: default Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Name: Default Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: X-User-Name: admin Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: method: > Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: exception: Flavor 42 could not be found. Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: action_args: {'id': '42'} Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:52:59.754392 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:52:59.755981 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:52:59.758777 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-23fa4e42-f997-4fb8-8523-9163708949b7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:52:59.760723 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-23fa4e42-f997-4fb8-8523-9163708949b7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015215 Jul 25 19:52:59.760723 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Jul 25 19:52:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:53:00.766751 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-84f90dad-78e6-4e37-95c7-42b1a94cabd7 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:00.767941 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-84f90dad-78e6-4e37-95c7-42b1a94cabd7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jul 25 19:53:00.768371 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:01.327548 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-991ed788-19c9-4e4c-9519-971a4fbd3ca4 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:01.333187 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.wsgi [None req-991ed788-19c9-4e4c-9519-971a4fbd3ca4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-991ed788-19c9-4e4c-9519-971a4fbd3ca4 admin admin] Request method failure captured: Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Accept: application/json Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Accept-Encoding: gzip, deflate Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Connection: keep-alive Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Content-Length: 0 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Host: 10.222.0.48 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Openstack-Api-Version: compute 2.90 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: Openstack-System-Scope: None Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: User-Agent: python-novaclient Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Auth-Token: gAAAAABi3vScxrgSsuLrmnWJhK3gCmias_uPu0n78yGqdTmap1BM2rdU4qLZd70mPwirBlG3Y4lCjBZUWnyzZxJ_SlDjWwbdXbP1vb80KKakIY5ZhsfsWW7fd2abqfnZmxPC9SE_E2BLgZ36bcsBp7LA2YDn4FgBKvScNN4g1NouNjlA3eDUtLY Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Id: None Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Name: None Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Identity-Status: Confirmed Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Is-Admin-Project: True Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Id: default Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Name: Default Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Name: admin Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Role: admin,reader,member Jul 25 19:53:01.335697 n-d-845775-3 devstack@n-api.service[104150]: X-Roles: admin,reader,member Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant: admin Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Name: admin Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-User: admin Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Id: default Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Name: Default Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: X-User-Name: admin Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: method: > Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: exception: Flavor 84 could not be found. Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: action_args: {'id': '84'} Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:53:01.337102 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:01.337919 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 19:53:01.339255 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.340655 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-991ed788-19c9-4e4c-9519-971a4fbd3ca4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:53:01.341827 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-991ed788-19c9-4e4c-9519-971a4fbd3ca4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.434053 Jul 25 19:53:01.342575 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Jul 25 19:53:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 19:53:01.352494 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-eae77396-3d43-4b64-86a7-f7b0b76d6f6f admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:01.368938 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-eae77396-3d43-4b64-86a7-f7b0b76d6f6f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020306 Jul 25 19:53:01.369516 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:53:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:53:01.380240 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-0d7f821f-4bca-456d-902e-afd302deeb1d admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:01.400702 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-0d7f821f-4bca-456d-902e-afd302deeb1d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024012 Jul 25 19:53:01.401266 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:53:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:53:01.411174 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f02fb4f3-d444-4321-b400-010d5df4cb6d admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:01.416790 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.wsgi [None req-f02fb4f3-d444-4321-b400-010d5df4cb6d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f02fb4f3-d444-4321-b400-010d5df4cb6d admin admin] Request method failure captured: Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Accept: application/json Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Accept-Encoding: gzip, deflate Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Connection: keep-alive Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Content-Length: 0 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Host: 10.222.0.48 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Openstack-Api-Version: compute 2.90 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: Openstack-System-Scope: None Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: User-Agent: python-novaclient Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Auth-Token: gAAAAABi3vScxrgSsuLrmnWJhK3gCmias_uPu0n78yGqdTmap1BM2rdU4qLZd70mPwirBlG3Y4lCjBZUWnyzZxJ_SlDjWwbdXbP1vb80KKakIY5ZhsfsWW7fd2abqfnZmxPC9SE_E2BLgZ36bcsBp7LA2YDn4FgBKvScNN4g1NouNjlA3eDUtLY Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Id: None Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Name: None Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Identity-Status: Confirmed Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Is-Admin-Project: True Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Id: default Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Name: Default Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Name: admin Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Role: admin,reader,member Jul 25 19:53:01.418335 n-d-845775-3 devstack@n-api.service[104149]: X-Roles: admin,reader,member Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant: admin Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Name: admin Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-User: admin Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Id: default Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Name: Default Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: X-User-Name: admin Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: method: > Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: exception: Flavor 84 could not be found. Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: action_args: {'id': '84'} Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:53:01.419887 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:01.420859 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:01.422514 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f02fb4f3-d444-4321-b400-010d5df4cb6d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:53:01.423921 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-f02fb4f3-d444-4321-b400-010d5df4cb6d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012289 Jul 25 19:53:01.423921 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Jul 25 19:53:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:53:02.471270 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-0d7f821f-4bca-456d-902e-afd302deeb1d admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:02.472349 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-0d7f821f-4bca-456d-902e-afd302deeb1d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Jul 25 19:53:02.472854 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:03.076267 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f2962bd1-d485-4254-a185-d9851bf48d62 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:03.082678 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.wsgi [None req-f2962bd1-d485-4254-a185-d9851bf48d62 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f2962bd1-d485-4254-a185-d9851bf48d62 admin admin] Request method failure captured: Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Accept: application/json Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Accept-Encoding: gzip, deflate Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Connection: keep-alive Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Content-Length: 0 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Host: 10.222.0.48 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Openstack-Api-Version: compute 2.90 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: Openstack-System-Scope: None Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: User-Agent: python-novaclient Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Auth-Token: gAAAAABi3vSeLpMml0YIANMbyYp1Ha51LNfjIICozl0XOABfN8jnaoOHVvv8ly82QDUG-ifofHT8sSwzHZt7gPXAL2eHRGNldTzVqYTkht3ioh0aEeVX0-IYC1cjaLX66_GsD9moz10QyxvTbHvmU3ZXuh8NGvytrVlqPvImzVKletm0RKOEkq0 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Id: None Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Domain-Name: None Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Identity-Status: Confirmed Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Is-Admin-Project: True Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Id: default Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Domain-Name: Default Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Project-Name: admin Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Role: admin,reader,member Jul 25 19:53:03.084260 n-d-845775-3 devstack@n-api.service[104149]: X-Roles: admin,reader,member Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant: admin Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-Tenant-Name: admin Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-User: admin Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Id: default Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-User-Domain-Name: Default Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: X-User-Name: admin Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: method: > Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: exception: Flavor 451 could not be found. Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: action_args: {'id': '451'} Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:53:03.087326 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:03.088860 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.090787 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-f2962bd1-d485-4254-a185-d9851bf48d62 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:53:03.093436 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-f2962bd1-d485-4254-a185-d9851bf48d62 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.475320 Jul 25 19:53:03.093436 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 19:53:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:53:03.097232 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-fa27a64e-a208-4a36-8d3c-1452aa2e3f5d admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:03.113566 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-fa27a64e-a208-4a36-8d3c-1452aa2e3f5d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020586 Jul 25 19:53:03.114305 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:53:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:53:03.127700 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:03.143630 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019475 Jul 25 19:53:03.144302 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Jul 25 19:53:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:53:03.155160 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5899bad8-85cf-4f42-b211-1a9c86925c09 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:03.161141 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.wsgi [None req-5899bad8-85cf-4f42-b211-1a9c86925c09 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5899bad8-85cf-4f42-b211-1a9c86925c09 admin admin] Request method failure captured: Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Accept: application/json Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Accept-Encoding: gzip, deflate Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Connection: keep-alive Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Content-Length: 0 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Host: 10.222.0.48 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Openstack-Api-Version: compute 2.90 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: Openstack-System-Scope: None Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: User-Agent: python-novaclient Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Auth-Token: gAAAAABi3vSeLpMml0YIANMbyYp1Ha51LNfjIICozl0XOABfN8jnaoOHVvv8ly82QDUG-ifofHT8sSwzHZt7gPXAL2eHRGNldTzVqYTkht3ioh0aEeVX0-IYC1cjaLX66_GsD9moz10QyxvTbHvmU3ZXuh8NGvytrVlqPvImzVKletm0RKOEkq0 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Id: None Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Domain-Name: None Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Identity-Status: Confirmed Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Is-Admin-Project: True Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Id: default Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Domain-Name: Default Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Project-Name: admin Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Role: admin,reader,member Jul 25 19:53:03.162832 n-d-845775-3 devstack@n-api.service[104150]: X-Roles: admin,reader,member Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f3cde255d88f4aa39d95d3b3da246434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f3cde255d88f4aa39d95d3b3da246434"}]}] Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant: admin Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Id: f3cde255d88f4aa39d95d3b3da246434 Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-Tenant-Name: admin Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-User: admin Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Id: default Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-User-Domain-Name: Default Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-User-Id: 60a5519be8014c1bafeb7a084432059e Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: X-User-Name: admin Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: method: > Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: exception: Flavor 451 could not be found. Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: action_args: {'id': '451'} Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 19:53:03.165386 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:03.167545 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: ERROR nova.api.openstack.wsgi Jul 25 19:53:03.169627 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-5899bad8-85cf-4f42-b211-1a9c86925c09 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 19:53:03.171445 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-5899bad8-85cf-4f42-b211-1a9c86925c09 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013054 Jul 25 19:53:03.171445 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 19:53:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 19:53:04.206587 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:04.207696 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 25 19:53:04.208382 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:04.812590 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-6a2b19de-c2cf-4a89-8a5c-3f811ee00736 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:53:04.834402 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-6a2b19de-c2cf-4a89-8a5c-3f811ee00736 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.479192 Jul 25 19:53:04.834957 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Jul 25 19:53:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:53:05.880845 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:05.882423 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002298 Jul 25 19:53:05.882807 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:06.507557 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-2649cdb1-03eb-4aa8-bfea-a3b68bef205f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:53:06.535833 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-2649cdb1-03eb-4aa8-bfea-a3b68bef205f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.513732 Jul 25 19:53:06.536412 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Jul 25 19:53:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 19:53:07.547748 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:07.548797 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 25 19:53:07.549196 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:08.213270 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-28c8f8e5-01ad-4d36-b0d0-f63c1fc9ce54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:53:08.233131 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-28c8f8e5-01ad-4d36-b0d0-f63c1fc9ce54 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.545452 Jul 25 19:53:08.233676 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Jul 25 19:53:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:53:09.312427 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:09.314106 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Jul 25 19:53:09.314555 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:53:09.920019 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-89419146-4548-4d14-907b-79114213a0eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 19:53:09.949251 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-89419146-4548-4d14-907b-79114213a0eb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.480269 Jul 25 19:53:09.949809 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Jul 25 19:53:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 19:53:10.997091 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:10.998204 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jul 25 19:53:10.998603 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:53:11.608938 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-da16d95e-29ca-4767-be1e-7ad5badb0ca5 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:53:11.630028 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-da16d95e-29ca-4767-be1e-7ad5badb0ca5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.484758 Jul 25 19:53:11.630589 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Jul 25 19:53:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:54:06.711735 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:06.713180 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-524707a5-2a1f-4a98-8f4b-b21a06f4c7f4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Jul 25 19:54:06.713692 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Mon Jul 25 19:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 19:54:06.725854 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:07.173352 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-570fd23c-3242-47e8-ad4c-04d9f63c12ef admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.195208 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-570fd23c-3242-47e8-ad4c-04d9f63c12ef admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.474873 Jul 25 19:54:07.195750 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Jul 25 19:54:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 19:54:07.216478 n-d-845775-3 devstack@n-api.service[104149]: DEBUG dbcounter [-] [104149] Writing DB stats nova_api:SELECT=14 {{(pid=104149) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:54:07.227726 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-ec222d04-c598-411c-8b14-04aadf2665ec admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.238465 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-ec222d04-c598-411c-8b14-04aadf2665ec admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023525 Jul 25 19:54:07.239020 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Jul 25 19:54:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:07.251873 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-d0dc0311-9b95-4d82-8a8b-712c6c6fdb09 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.260021 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-d0dc0311-9b95-4d82-8a8b-712c6c6fdb09 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011621 Jul 25 19:54:07.260521 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Jul 25 19:54:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 19:54:07.272835 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.280665 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011692 Jul 25 19:54:07.281209 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Jul 25 19:54:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:54:07.293482 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-f089dfbd-4655-41f9-b31c-2fca2673ee5b admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:54:07.301421 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-f089dfbd-4655-41f9-b31c-2fca2673ee5b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011558 Jul 25 19:54:07.302573 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Jul 25 19:54:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 19:59:56.074057 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:56.075136 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 25 19:59:56.075532 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:59:56.217476 n-d-845775-3 devstack@n-api.service[104150]: DEBUG dbcounter [-] [104150] Writing DB stats nova_api:SELECT=6 {{(pid=104150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:59:56.404152 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:56.407618 n-d-845775-3 devstack@n-api.service[104150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:59:56.407618 n-d-845775-3 devstack@n-api.service[104150]: warnings.warn(msg) Jul 25 19:59:56.408987 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:56.409441 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:56.410242 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:56.410676 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:56.452738 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-569c057b-768b-4fa0-93f6-640fd878a666 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.236650 Jul 25 19:59:56.453339 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 19:59:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 19:59:57.321115 n-d-845775-3 devstack@n-api.service[104149]: DEBUG nova.api.openstack.wsgi [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] Calling method '>' {{(pid=104149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:57.323323 n-d-845775-3 devstack@n-api.service[104149]: INFO nova.api.openstack.requestlog [None req-254c8643-29a1-4c68-856e-5f948d35320c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Jul 25 19:59:57.325103 n-d-845775-3 devstack@n-api.service[104149]: [pid: 104149|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Jul 25 19:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 19:59:57.528802 n-d-845775-3 devstack@n-api.service[104150]: DEBUG nova.api.openstack.wsgi [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] Calling method '>' {{(pid=104150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 19:59:57.531525 n-d-845775-3 devstack@n-api.service[104150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:59:57.531525 n-d-845775-3 devstack@n-api.service[104150]: warnings.warn(msg) Jul 25 19:59:57.532775 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:57.533823 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:57.535897 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 19:59:57.536715 n-d-845775-3 devstack@n-api.service[104150]: DEBUG oslo_concurrency.lockutils [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 19:59:57.569083 n-d-845775-3 devstack@n-api.service[104150]: INFO nova.api.openstack.requestlog [None req-b518e5de-2061-4523-ac30-e23ffe91c99b admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.098357 Jul 25 19:59:57.569966 n-d-845775-3 devstack@n-api.service[104150]: [pid: 104150|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 19:59:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:00:44.319291 n-d-845775-3 devstack@n-api.service[104137]: Mon Jul 25 20:00:44 2022 - graceful shutdown triggered... Jul 25 20:00:44.318819 n-d-845775-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 20:00:44.320780 n-d-845775-3 devstack@n-api.service[104149]: Gracefully killing worker 1 (pid: 104149)... Jul 25 20:00:44.321207 n-d-845775-3 devstack@n-api.service[104150]: Gracefully killing worker 2 (pid: 104150)... Jul 25 20:00:45.320013 n-d-845775-3 devstack@n-api.service[104137]: worker 1 buried after 1 seconds Jul 25 20:00:45.320013 n-d-845775-3 devstack@n-api.service[104137]: worker 2 buried after 1 seconds Jul 25 20:00:45.320013 n-d-845775-3 devstack@n-api.service[104137]: goodbye to uWSGI. Jul 25 20:00:45.322400 n-d-845775-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 25 20:00:45.323525 n-d-845775-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 20:00:45.327187 n-d-845775-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 20:00:45.356347 n-d-845775-3 devstack@n-api.service[119711]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 20:00:45.376797 n-d-845775-3 devstack@n-api.service[119711]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 20:00:45 2022] *** Jul 25 20:00:45.377053 n-d-845775-3 devstack@n-api.service[119711]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 20:00:45.377236 n-d-845775-3 devstack@n-api.service[119711]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 20:00:45.377359 n-d-845775-3 devstack@n-api.service[119711]: nodename: n-d-845775-3 Jul 25 20:00:45.377473 n-d-845775-3 devstack@n-api.service[119711]: machine: x86_64 Jul 25 20:00:45.377605 n-d-845775-3 devstack@n-api.service[119711]: clock source: unix Jul 25 20:00:45.377884 n-d-845775-3 devstack@n-api.service[119711]: pcre jit disabled Jul 25 20:00:45.378015 n-d-845775-3 devstack@n-api.service[119711]: detected number of CPU cores: 4 Jul 25 20:00:45.378134 n-d-845775-3 devstack@n-api.service[119711]: current working directory: / Jul 25 20:00:45.378247 n-d-845775-3 devstack@n-api.service[119711]: detected binary path: /usr/bin/uwsgi-core Jul 25 20:00:45.378365 n-d-845775-3 devstack@n-api.service[119711]: your processes number limit is 47680 Jul 25 20:00:45.378477 n-d-845775-3 devstack@n-api.service[119711]: your memory page size is 4096 bytes Jul 25 20:00:45.378600 n-d-845775-3 devstack@n-api.service[119711]: detected max file descriptor number: 2048 Jul 25 20:00:45.378764 n-d-845775-3 devstack@n-api.service[119711]: lock engine: pthread robust mutexes Jul 25 20:00:45.379053 n-d-845775-3 devstack@n-api.service[119711]: thunder lock: enabled Jul 25 20:00:45.379393 n-d-845775-3 devstack@n-api.service[119711]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 20:00:45.379761 n-d-845775-3 devstack@n-api.service[119711]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 20:00:45.428086 n-d-845775-3 devstack@n-api.service[119711]: Python main interpreter initialized at 0x561af88859c0 Jul 25 20:00:45.428429 n-d-845775-3 devstack@n-api.service[119711]: python threads support enabled Jul 25 20:00:45.428429 n-d-845775-3 devstack@n-api.service[119711]: your server socket listen backlog is limited to 100 connections Jul 25 20:00:45.428429 n-d-845775-3 devstack@n-api.service[119711]: your mercy for graceful operations on workers is 90 seconds Jul 25 20:00:45.428927 n-d-845775-3 devstack@n-api.service[119711]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 20:00:45.429121 n-d-845775-3 devstack@n-api.service[119711]: *** Operational MODE: preforking *** Jul 25 20:00:45.429473 n-d-845775-3 devstack@n-api.service[119711]: *** uWSGI is running in multiple interpreter mode *** Jul 25 20:00:45.429473 n-d-845775-3 devstack@n-api.service[119711]: spawned uWSGI master process (pid: 119711) Jul 25 20:00:45.429740 n-d-845775-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 25 20:00:45.433232 n-d-845775-3 devstack@n-api.service[119711]: spawned uWSGI worker 1 (pid: 119723, cores: 1) Jul 25 20:00:45.433935 n-d-845775-3 devstack@n-api.service[119711]: spawned uWSGI worker 2 (pid: 119724, cores: 1) Jul 25 20:00:45.434352 n-d-845775-3 devstack@n-api.service[119711]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 20:00:46.238050 n-d-845775-3 devstack@n-api.service[119724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 20:00:46.320571 n-d-845775-3 devstack@n-api.service[119723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 20:00:47.466842 n-d-845775-3 devstack@n-api.service[119724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:00:47.466842 n-d-845775-3 devstack@n-api.service[119724]: from cryptography.utils import int_from_bytes Jul 25 20:00:47.467660 n-d-845775-3 devstack@n-api.service[119724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:00:47.467660 n-d-845775-3 devstack@n-api.service[119724]: from cryptography.utils import int_from_bytes Jul 25 20:00:47.538938 n-d-845775-3 devstack@n-api.service[119723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:00:47.538938 n-d-845775-3 devstack@n-api.service[119723]: from cryptography.utils import int_from_bytes Jul 25 20:00:47.539736 n-d-845775-3 devstack@n-api.service[119723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 20:00:47.539736 n-d-845775-3 devstack@n-api.service[119723]: from cryptography.utils import int_from_bytes Jul 25 20:00:49.932875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 20:00:49.933580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 20:00:49.933580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 20:00:49.934157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 20:00:49.934157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 20:00:49.934586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.934878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.935207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.935534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.935871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.936223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.936560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.936890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.937224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.937568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.937885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.938223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845775-3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.938547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.939260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.939587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.939921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.940800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.941138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.941456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.941974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.943266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.943266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.943266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.943617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.943940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.944273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.944606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.944925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.945262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.945596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.945993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845775-3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.946321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.946651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.947012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.947422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.947808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.948285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.948567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.948797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.949031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.949307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.949645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.949978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.950329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.950621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.950968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.951290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.951621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.951934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.952365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.952629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.952876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.953141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.953692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.953875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.954044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.954282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.954609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.954933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.955248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.955569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.955938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.956787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.957106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.957436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.957812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.958074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.958353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.958675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.959006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.959322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.959647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.960082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.960342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.960657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.961007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.961438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.961666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.961937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.962283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.962658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.962890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.963210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.963537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.964121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.964284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.964506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.964755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.965043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.965362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.965675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.965989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.966307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.966618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.966931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.967394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.967622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.967983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.968287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.968556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.968873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.969186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.969500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.969830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.970161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.970476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.970792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.971106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.971606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.971789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.972099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.972420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.972806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.973058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.973371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.973697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.974177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.974350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.974631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.974945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.975260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.975585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.975901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.976242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.976563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.976874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.977180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.977491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.977799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.978106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.978409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.978735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.979066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.979384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.979699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.980010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.980360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:49.980706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.981047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.981398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.981769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.982052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.982898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.982898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.983829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.983829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.983829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.984618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.984618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.984912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.985058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.985347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.985685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.986010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.986796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.986796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.987148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.987310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.987610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.987921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.988266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.988623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.988974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.989299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.989640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.989979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.990299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.990708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.990967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.991235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.991586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.992223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.992223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.992910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.992910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.993213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.993483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.993863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.994099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.994428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.994943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.995186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.995396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.995674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.995989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.996333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.996658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.996970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.997281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.997596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.997909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.998237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.998596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.998876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.999217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.999537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:49.999850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.000821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.000821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.000821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.001307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.001467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.001711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.004161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.004161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.004161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.004161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.004161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.005231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.005231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.005231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.005231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.006022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.006022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.006022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.006601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.006821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.007019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.007928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.007928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.007928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.008638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.008638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.009013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.009207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.009473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.009761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.010077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.010400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.010870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.011239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.011560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.011872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.012219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.012554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.012911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.013448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.013760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.014273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.014453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.014720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.015066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.015415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.015738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.016097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.016408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.016726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.017055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.017368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.018152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.018953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.019240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.019607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.020152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.020516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.020847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.021172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.021501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.021816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.022141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.022538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.022884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.023179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.023550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.024913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.024913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.024913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.024913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.025526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.025526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.025828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.025979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.026278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.026768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.027362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.027983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.028529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.028529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.029987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.029987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.029987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.029987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.030808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.030808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.030808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.031404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.031404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.031809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.031999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.032537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.032796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.033007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.033183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.033495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.033821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.034167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.034478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.034983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.035169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.035421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.035736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.036101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.037948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.038267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.038722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.038925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.039245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.039558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.039910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.040241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.040561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.040913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.041210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.041545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.041858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.042179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.042734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.042929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.043111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.043434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.043789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.044097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.044416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.044737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.045145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.045362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.045681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.046005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.046604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.046948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.047371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.047631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.047915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.048269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.049046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.049046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.049581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.049581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.050109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.050374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.050628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.050867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.051119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.051499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.051768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.052008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.052319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.052590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.053098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.053355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.053614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.053896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.054289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.054539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.054786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.055054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.055579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.055579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.056126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.056382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.056641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.056903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.057193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.057611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.057904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.058163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.058456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.058867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.059432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.059432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.059913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.060265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.060265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.060762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.061016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.061271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.061667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.061944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.062208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.062460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.062711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.062999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.063496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.063745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.064001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.064323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.064693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.064950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.065752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.066254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.066254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.067931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.067931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.067931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.068713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.068713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.069402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.069402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.070197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.070197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.070197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.070911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.070911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.071391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.071391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.072055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.072055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.072570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.072570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.073047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.073335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.073859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.073859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.074352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.074352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.075000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.075000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.075481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.075724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.075990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.076578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.076578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.077064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.077064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.077548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.077825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.078183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.078430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.078701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.078951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.079384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.079640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.080183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.080183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.080672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.080953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.081825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.082427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.082752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.083077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.083411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.083960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.084283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.084541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.084783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.085166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.085425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.085682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.085971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.086292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.086817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.087063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.087303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.087621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.087882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.088432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.088432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.088929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.089169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.089450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.089831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.090075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.090614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.090614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.091095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.091352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.091622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.091905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.092222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.092582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.092916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.093174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.093482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.093779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.094271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.094518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.094794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.095197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.095463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.095723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.096024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.096396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.097061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.097061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.097536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.097778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.098019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.098281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.098693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.099058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.099595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.100144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.100421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.101034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.101034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.101512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.101768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.102020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.102263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.102558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.102935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.103192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.103499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.103820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.104141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.104683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.104946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.105205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.105603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.105850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.108159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.110024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.111908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.113919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.114225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.114403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.114768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.115023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.115347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.115685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.116027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.116361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.116702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.117036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.117415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.117686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.118018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.118329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.118638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.118954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.119262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.119574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.119885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.120439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.120814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.120981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.121581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.121761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.122084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.122420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.122740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.123136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.123429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.123758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.124232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.124682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.125268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.125268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.126066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.126066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.129546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.131309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.131309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.131309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.131309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.131309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.132540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.132540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.132933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.133115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.133449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.133775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.134098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.134419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.134739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.135113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.135413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.135699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.136109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.136410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.136753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.137085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.137412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.137750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.138445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.138703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.139118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.139472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.139756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.140052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 20:00:50.140591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.140780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 20:00:50.141306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.141306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.141306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.141901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 20:00:50.142199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.142199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.142698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 20:00:50.142863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.143048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 20:00:50.143212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.143212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.144158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.144264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.144353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.144447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.144534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.144630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.144630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.144798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.144917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.145135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.145302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.145607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.145728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.146189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.146320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.146512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.146693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.146852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.147044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.147181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.147312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.147514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.147628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.147843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.147949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845775-3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.148198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.148328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.148538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.148652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.148863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.148975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.149178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.149302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.149515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.149666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.149813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.149982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.150127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.150348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.150524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.150955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.151237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.151506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.151793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.152125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.152334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.152547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.152704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.152999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.153154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.153360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.153630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.153736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.153991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.154083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.154514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.154642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.154785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.154948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.155054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.155214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.155307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.155540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.155644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.155884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.156016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845775-3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.156238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.156435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.156563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.156693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.156878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.157019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.157194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.157450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.157535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.157771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.157862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.158241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.158346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.158423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.158505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.158722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.158815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.159175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.159281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.159391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.159484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.159744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.159890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.160065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.160161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.160349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.160444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.160657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.160750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.160966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.161062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.161276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.161379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.161600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.161699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.161917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.162014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.162241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.162400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.162519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.162617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.162902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.163022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.163158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.163263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.163471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.163582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.163788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.163891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.164202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.164380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.164499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.164615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.164808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.164935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.165134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.165247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.165453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.165557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.165827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.165998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.166138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.166284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.166448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.166614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.166841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.166985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.167101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.167215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.167365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.167676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.167998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.168405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.168530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.168866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.169181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.169273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.169507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.169608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.169919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.170029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.170175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.170297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.170485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.170641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.170833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.170961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.172071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.172197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.172299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.172561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.172664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.172760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.172839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.172921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.173005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.173087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.173163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.173251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.173335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.173418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.173493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.173607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.173730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.173927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.174023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.174178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.174263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.174486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.174623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.174828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.175011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.175152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.175248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.175463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.175572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.175776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.175880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.176117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.176231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.176554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.176909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.177242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.177381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.177568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.177698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.177904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.178011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.178241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.178343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.178567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.178684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.178877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.178973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.179191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.179284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.179501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.179604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.179814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.179927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.180149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.180249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.180478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.180586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.180786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.180881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.181098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.181225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.181407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.181549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.181722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.181878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.182031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.182208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.182341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.182807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.182961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.183062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.183166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.183261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.183356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.183522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.183646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.183852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.183960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.184200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.184310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.184539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.184643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.184888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.184992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.185209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.185314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.185563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.185659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.185880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.185975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.186195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.186291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.186502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.186604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.186812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.186908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.187118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.187212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.187425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.187519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.187731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.187827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.188143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.188256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.188355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.188453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.188655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.188762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.188957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.189056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.189278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.189389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.189588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.189681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.189900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.190003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.190733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.190845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.191041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.191132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.191351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.191452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 20:00:50.191664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.191771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.191977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.192743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.193923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.194866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.195837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.196806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.197981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.198087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.198381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.198499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.198661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.198821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.199931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.200303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.200641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.200735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.200956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.201943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.202899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.203955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.204920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.205906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.206646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.206743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.206977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.207923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.208989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.209951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.210147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.210304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.210529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.210677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.210785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 20:00:50.210882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.211092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.211402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.211716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.212072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.212364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.212672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.212997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.213392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.213613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.213993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.214313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.214623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.214969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.215255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.215561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.215880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.216217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.216533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.216849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.217162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.217490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.217806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.218119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.218457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.218792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.219101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.219426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.219754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.220106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.220416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.220729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.221035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.221343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.221677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.221988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.222293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.222599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.222909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.223214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.223523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.223848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.224180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.224487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.224794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.225099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.225447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.225755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.226098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.226435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.226755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.227077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.227392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.227709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.228020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.228355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.228668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.228979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.229341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.229754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.230082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.230484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.230820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.231138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.231461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.231769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.232112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.232461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.232796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.233118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.233443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.233757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.234072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.234384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.234714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.235028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.235340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.235660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.235972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.236319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.236632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.236957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.237435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.237765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.238073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.238390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.238725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.239062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.239378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.239694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.240019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.240354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.240666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.240977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.241284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.241591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.241902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.242219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.242531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.242845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.243153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.243467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.243781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.244110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.244420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.244733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.245056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.245367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.245690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.246012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.246318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.246622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.246948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.247258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.247564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.247868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.248199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.248553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.248866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.249174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.249502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.249818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.250127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.250447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.250776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.251072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.251397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.251718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.252056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.252367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.253258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.253526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.253838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.254165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.254477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.254792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.255105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.255412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.255724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.256066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.256654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.256995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.257315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.257639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.257965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.258286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.258621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.258954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.259298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.259614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.259931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.260277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.260586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.260899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.261210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.261521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.261830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.262143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.262448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.262755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.263363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.263628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.263946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.264294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.264611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.264919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.265244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.265556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.265862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.266169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.266475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.266820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.267128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.267468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.267798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.268285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.269230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.269540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.269866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.270177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.270478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.270785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.271099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.271406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.271711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.272022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.272356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.272669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.272983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.273289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.273609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.273913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.274229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.274538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.274631 n-d-845775-3 devstack@n-api.service[119724]: INFO dbcounter [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Registered counter for database nova_api Jul 25 20:00:50.274842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.275145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.275456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.275765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.276090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.276403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.276708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.277025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.277331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.277637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.277941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.278285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.278588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.278891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.279215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.279526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.279830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.280157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.280470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.280774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.281079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.281390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.281713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.282031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.282337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.282648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.282951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.283256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.283585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.283870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.284226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.284538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.284841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.285144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.285448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.285770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.286079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.286384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.286690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.286994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.287338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.287644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.288004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.288351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.288651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.288971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.289283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.290388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.290388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.290388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.290676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.290900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.291239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.291548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.291920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.292250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.292566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.292879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.293203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.293530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.317907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.322725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.323845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.323845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.323845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.323845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_db.sqlalchemy.engines [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.324512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.326179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.327333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writer thread running {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.336838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.337645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.338490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.339214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.340234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.341398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.342311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.343250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.344973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.345963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.346727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.347555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.348472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.349310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.350936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.351338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.351883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.352503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.356722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.357012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.357147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.357473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.357793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.358430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.358758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.359165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.359500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.359895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.360304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.360688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.361030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.361376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.361690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.362009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.362860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.363168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.363498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.363818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.364154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.364482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.364794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.365352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.365707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.366030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.366362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.366693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.367011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.367323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.367652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.367964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.368303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.368629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.368947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.369261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.369566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.369876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.370282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.370590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.370906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.371419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.371841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.372182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.372500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.372814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.373134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.373446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.373761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.374071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.374377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.374510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.context [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119724) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 20:00:50.374700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.375011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.375325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.375633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.375948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.376282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.376594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.376961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.377293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.377605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.378482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.378817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.379129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.379257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.379455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.379774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.380109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.380473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.380739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.380848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.381342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.381561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.381688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.381990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.382348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.382676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.383125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.383344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.383585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.383838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.383949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.384237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.384563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.384877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.385194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.385506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.385868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.386393 n-d-845775-3 devstack@n-api.service[119724]: INFO dbcounter [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Registered counter for database nova_cell0 Jul 25 20:00:50.386545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.386545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.386862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.387179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.387494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.387808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.388480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.388805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.389342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.389648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.389872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.390069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.390232 n-d-845775-3 devstack@n-api.service[119724]: INFO dbcounter [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Registered counter for database nova_cell1 Jul 25 20:00:50.390526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.391092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.391559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.391885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.392401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.392663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.393047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.393419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.393716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.394095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.394471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.394766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.395024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.395348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.395672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.395998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.396338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.396663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.397021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.397324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.397639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_db.sqlalchemy.engines [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.397851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.397991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.398259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.398567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.398916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_db.sqlalchemy.engines [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.400816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.400934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.401579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.401808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.402223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.402736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.403224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.403590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.404095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.404531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writer thread running {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.404657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.404924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.405406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.405855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.406282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.406602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.406916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.407237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.407550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.407864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.408198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.408542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.408882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.409241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.409770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.410100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.410312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.410489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.410814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.411138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.411463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.411776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.412134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.412452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.412770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.413084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.413477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.413709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.414019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.414354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.414682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.414996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.415318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.415634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.415956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.416299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.416615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.416949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.417265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.417574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.417885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.418200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.418509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.418831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.419149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.419460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.419772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.420113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.420442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.420767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.421092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.421401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.421727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.422080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.422393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.422740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.423069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.423385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.423698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.424004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 20:00:50.424356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 20:00:50.551463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writer thread running {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.562185 n-d-845775-3 devstack@n-api.service[119724]: INFO dbcounter [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Registered counter for database nova_cell0 Jul 25 20:00:50.569546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_db.sqlalchemy.engines [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.574114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writer thread running {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.578704 n-d-845775-3 devstack@n-api.service[119723]: INFO dbcounter [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Registered counter for database nova_api Jul 25 20:00:50.600316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_db.sqlalchemy.engines [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.607650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writer thread running {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.666924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.context [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119723) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 20:00:50.671311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.672932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.673742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:00:50.675806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:00:50.677878 n-d-845775-3 devstack@n-api.service[119723]: INFO dbcounter [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Registered counter for database nova_cell0 Jul 25 20:00:50.682090 n-d-845775-3 devstack@n-api.service[119723]: INFO dbcounter [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Registered counter for database nova_cell1 Jul 25 20:00:50.689667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_db.sqlalchemy.engines [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.693030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_db.sqlalchemy.engines [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.695932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writer thread running {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.703930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writer thread running {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.846229 n-d-845775-3 devstack@n-api.service[119723]: INFO dbcounter [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Registered counter for database nova_cell0 Jul 25 20:00:50.854264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_db.sqlalchemy.engines [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 20:00:50.859497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writer thread running {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 20:00:50.901573 n-d-845775-3 devstack@n-api.service[119724]: WARNING keystonemiddleware.auth_token [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 20:00:50.908884 n-d-845775-3 devstack@n-api.service[119724]: WARNING keystonemiddleware.auth_token [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 20:00:51.195472 n-d-845775-3 devstack@n-api.service[119723]: WARNING keystonemiddleware.auth_token [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 20:00:51.203146 n-d-845775-3 devstack@n-api.service[119723]: WARNING keystonemiddleware.auth_token [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 20:00:51.261906 n-d-845775-3 devstack@n-api.service[119724]: WARNING keystonemiddleware.auth_token [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 20:00:51.269535 n-d-845775-3 devstack@n-api.service[119724]: WARNING keystonemiddleware.auth_token [None req-586bd9c9-fdd3-49de-b501-ea47ff59b4ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 20:00:51.275147 n-d-845775-3 devstack@n-api.service[119724]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561af88859c0 pid: 119724 (default app) Jul 25 20:00:51.590652 n-d-845775-3 devstack@n-api.service[119723]: WARNING keystonemiddleware.auth_token [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 20:00:51.597963 n-d-845775-3 devstack@n-api.service[119723]: WARNING keystonemiddleware.auth_token [None req-8bffc7a6-2ffc-40c2-a110-49f0818662ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 20:00:51.604322 n-d-845775-3 devstack@n-api.service[119723]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561af88859c0 pid: 119723 (default app) Jul 25 20:01:39.555961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.557078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.558092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.559040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.836717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.838134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.839090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:39.841210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:40.725167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:40.727245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:40.728000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:40.728966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:40.729405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:40.775169 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9faea7c-cdca-42b8-85fc-23904d004ff4 tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.224436 Jul 25 20:01:40.784527 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Jul 25 20:01:39 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:01:40.791027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:40.792866 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:40.792866 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:40.794373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:40.795211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:40.796501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:40.797087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:40.825724 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c64bf68f-3ce5-47b5-a9d5-20f789592c3d tempest-AZAdminV2TestJSON-1609417441 tempest-AZAdminV2TestJSON-1609417441-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.039467 Jul 25 20:01:40.832640 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:01:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:41.118107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Calling method '.version_select at 0x7f196c28f940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:41.123329 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.123329 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:41.132573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119723) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 20:01:41.133419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.133872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.166774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.167212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.181335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.181910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.189291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5af98f73-63ba-4345-b653-f7e3ad8f9f0d tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 1.364070 Jul 25 20:01:41.190542 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1208 bytes} [Mon Jul 25 20:01:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:01:41.488517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '.version_select at 0x7f196c1a49d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:41.489637 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.489637 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:41.496635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119724) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 25 20:01:41.497458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.498033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.527904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.528396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.542065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.542509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.550023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-faf8d3f6-921f-4c72-a653-df8dc23e16c7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.715813 Jul 25 20:01:41.551221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:01:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:41.672670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fff90c14-f495-4851-94f8-aa0ce8de9c28 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1786832683", "id": 1414234439, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:41.693288 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.693288 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:41.735590 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fff90c14-f495-4851-94f8-aa0ce8de9c28 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.543727 Jul 25 20:01:41.736150 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2/5] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:41.741514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17125407-4432-4339-bfc8-06e3837e4a49 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1692469975"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:41.744405 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.744405 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:41.745385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-17125407-4432-4339-bfc8-06e3837e4a49 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Generated uuid 29947006-3113-4467-b897-5b6607d96928 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:01:41.758088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:41.771175 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.771175 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:41.772611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.773323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.774571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:41.775352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:41.806041 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6388c210-123e-4265-830c-a9610e920722 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.253601 Jul 25 20:01:41.807266 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:01:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:41.825973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17125407-4432-4339-bfc8-06e3837e4a49 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.087937 Jul 25 20:01:41.828945 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3/7] 10.222.0.48 () {62 vars in 1205 bytes} [Mon Jul 25 20:01:41 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:41.830704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17125407-4432-4339-bfc8-06e3837e4a49 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:41.833265 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17125407-4432-4339-bfc8-06e3837e4a49 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001972 Jul 25 20:01:41.834018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 4/8] 10.222.0.48 () {56 vars in 886 bytes} [Mon Jul 25 20:01:41 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 20:01:41.839890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e845ddf7-f218-422e-8ef3-e9dcc007e93b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:41.840967 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.840967 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:41.879331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e845ddf7-f218-422e-8ef3-e9dcc007e93b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1414234439" status: 202 len: 0 microversion: 2.1 time: 0.042916 Jul 25 20:01:41.879983 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:41 2022] DELETE /compute/v2.1/flavors/1414234439 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:41.885555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f02c1b0-87e1-493d-bda7-cd49236decfa tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-629176221"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:41.978565 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:41.978565 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:41.988488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c8911dcd-fbf5-4ddf-b170-7f215b52823d tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-69072872", "id": 1425663987, "os-flavor-access:is_public": "True"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.009946 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.009946 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:42.045696 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c8911dcd-fbf5-4ddf-b170-7f215b52823d tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.236470 Jul 25 20:01:42.056675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f02c1b0-87e1-493d-bda7-cd49236decfa tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.174992 Jul 25 20:01:42.056792 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 5/10] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:01:41 2022] POST /compute/v2.1/flavors => generated 447 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:42.060338 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 6/11] 10.222.0.48 () {62 vars in 1210 bytes} [Mon Jul 25 20:01:41 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:42.067343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de48284f-d1b7-4abe-8f54-9195fd9d4c75 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.101664 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de48284f-d1b7-4abe-8f54-9195fd9d4c75 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.043515 Jul 25 20:01:42.102961 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:42.110802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1f0693d-5f89-4c99-ad8c-5d70e2045d4f tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.112258 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.112258 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:42.133819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1f0693d-5f89-4c99-ad8c-5d70e2045d4f tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.029136 Jul 25 20:01:42.134957 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 7/13] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:42.140947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b291a216-ed8a-4a66-b21e-e73f6e2e67fd tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-503175367", "id": 1535203726, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.144790 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.144790 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:42.163294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b291a216-ed8a-4a66-b21e-e73f6e2e67fd tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.027097 Jul 25 20:01:42.164237 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 8/14] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:42 2022] POST /compute/v2.1/flavors => generated 416 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:42.169285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69672417-2829-4f7a-a533-2bb5910a220c tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.172337 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.172337 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:42.214377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69672417-2829-4f7a-a533-2bb5910a220c tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:42.214852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69672417-2829-4f7a-a533-2bb5910a220c tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:42.257256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d5f11bf-6d5a-4b90-97c8-cea5b3028364 tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.285797 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d5f11bf-6d5a-4b90-97c8-cea5b3028364 tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] 10.222.0.48 "GET /compute/v2.1/flavors/1425663987" status: 200 len: 447 microversion: 2.55 time: 0.215852 Jul 25 20:01:42.295243 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 7/15] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/1425663987 => generated 447 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:42.300505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84752d34-a237-4811-bee6-23c1f119a415 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.336974 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84752d34-a237-4811-bee6-23c1f119a415 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.040209 Jul 25 20:01:42.338371 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:42.343508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d6e2a59-77a8-4fc6-b9c1-15ccb144d027 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] Action: 'update', calling method: .version_select at 0x7f196c6489d0>, body: {"flavor": {"description": "new"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.358591 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.358591 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:42.419302 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d6e2a59-77a8-4fc6-b9c1-15ccb144d027 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1425663987" status: 200 len: 448 microversion: 2.55 time: 0.079645 Jul 25 20:01:42.419939 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 9/17] 10.222.0.48 () {62 vars in 1219 bytes} [Mon Jul 25 20:01:42 2022] PUT /compute/v2.1/flavors/1425663987 => generated 448 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:42.429724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1be8d35d-1cb7-4c60-a52f-c4009bfa0201 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.430692 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.430692 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:42.474866 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1be8d35d-1cb7-4c60-a52f-c4009bfa0201 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1535203726" status: 202 len: 0 microversion: 2.1 time: 0.053682 Jul 25 20:01:42.475864 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:42 2022] DELETE /compute/v2.1/flavors/1535203726 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:42.480818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a54613e2-03d6-4a2c-a105-621d2abf7cef tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.533277 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a54613e2-03d6-4a2c-a105-621d2abf7cef tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5723 microversion: 2.55 time: 0.056056 Jul 25 20:01:42.534945 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 11/19] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5723 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:01:42.539649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b36d6ff-a480-4bae-a9c1-d461eb5043d7 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.564080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b36d6ff-a480-4bae-a9c1-d461eb5043d7 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5407 microversion: 2.1 time: 0.027771 Jul 25 20:01:42.565924 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 12/20] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5407 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:42.570659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-778c1ca1-6d3a-4565-94ff-3d8ccdeaa3d1 tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.595906 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-778c1ca1-6d3a-4565-94ff-3d8ccdeaa3d1 tempest-FlavorsV255TestJSON-1581829459 tempest-FlavorsV255TestJSON-1581829459-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.55 time: 0.028669 Jul 25 20:01:42.596901 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 13/21] 10.222.0.48 () {60 vars in 1166 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:01:42.601433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cc92d1e-8fd0-4329-85ab-534f7126e59f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1284648222", "id": 1974118038, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.604480 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:42.604480 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:42.624615 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2cc92d1e-8fd0-4329-85ab-534f7126e59f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026442 Jul 25 20:01:42.625881 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 14/22] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:42 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:42.631297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a05264b6-978f-4863-8484-e959cace04d3 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.653378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a05264b6-978f-4863-8484-e959cace04d3 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1425663987" status: 202 len: 0 microversion: 2.55 time: 0.026028 Jul 25 20:01:42.654845 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 15/23] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Jul 25 20:01:42 2022] DELETE /compute/v2.1/flavors/1425663987 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:01:42.660669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5035c3f-b25b-42ea-8727-10f21a6b2249 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.681224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5035c3f-b25b-42ea-8727-10f21a6b2249 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1974118038" status: 202 len: 0 microversion: 2.1 time: 0.024656 Jul 25 20:01:42.682391 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 16/24] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:42 2022] DELETE /compute/v2.1/flavors/1974118038 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:42.688967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98bf3364-d3ec-47cd-b578-899e4fd6b220 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.714092 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98bf3364-d3ec-47cd-b578-899e4fd6b220 tempest-FlavorsV255TestJSON-878696609 tempest-FlavorsV255TestJSON-878696609-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.030136 Jul 25 20:01:42.714943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 17/25] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:01:42.720938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86408fd2-8413-4cf8-862e-57bf5a15fdf1 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.751155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-86408fd2-8413-4cf8-862e-57bf5a15fdf1 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034595 Jul 25 20:01:42.752425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 18/26] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:42.773652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5043123e-524e-44bd-8634-8f1d5aacdd8b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-992237860", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.804909 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5043123e-524e-44bd-8634-8f1d5aacdd8b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.033541 Jul 25 20:01:42.816210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 19/27] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:42 2022] POST /compute/v2.1/flavors => generated 506 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:42.822912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87a03031-cee1-4e13-be5e-6ab3f738bdf2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.849407 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87a03031-cee1-4e13-be5e-6ab3f738bdf2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/156443ac-76a3-41b8-8a73-5a886cc9d346" status: 202 len: 0 microversion: 2.1 time: 0.030150 Jul 25 20:01:42.853689 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 20/28] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:42 2022] DELETE /compute/v2.1/flavors/156443ac-76a3-41b8-8a73-5a886cc9d346 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:42.871222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d053b61d-8f05-4d7b-8869-08457a559981 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:42.911237 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d053b61d-8f05-4d7b-8869-08457a559981 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055664 Jul 25 20:01:42.911869 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 21/29] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:42.937442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08fd96f4-c232-4513-a14c-8206b6c3e461 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-319678307", "id": "1dc309ca-1d35-4b98-adef-0e17028b63a0", "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:42.989086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08fd96f4-c232-4513-a14c-8206b6c3e461 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.055937 Jul 25 20:01:42.990595 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 22/30] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:42 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:43.010687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0c03eb1-5381-4c01-ab07-854c03ea689e tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.055564 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0c03eb1-5381-4c01-ab07-854c03ea689e tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1dc309ca-1d35-4b98-adef-0e17028b63a0" status: 202 len: 0 microversion: 2.1 time: 0.054365 Jul 25 20:01:43.058722 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 23/31] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:01:42 2022] DELETE /compute/v2.1/flavors/1dc309ca-1d35-4b98-adef-0e17028b63a0 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:43.067978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93255109-7be2-407c-a64a-5d16333087d4 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.103197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:DELETE=18,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:43.117868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93255109-7be2-407c-a64a-5d16333087d4 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057434 Jul 25 20:01:43.136728 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 24/32] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:43.151036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-245e4dc5-1eb4-4024-ad77-591a8335adfd tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1201570783", "id": 853656364, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:43.185551 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-245e4dc5-1eb4-4024-ad77-591a8335adfd tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.041966 Jul 25 20:01:43.189190 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 25/33] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:43 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:43.205872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c304b0c8-9f55-4efe-87c7-fec71e6ebf98 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.222967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c304b0c8-9f55-4efe-87c7-fec71e6ebf98 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/853656364" status: 200 len: 411 microversion: 2.1 time: 0.023931 Jul 25 20:01:43.224590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 26/34] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:01:43 2022] GET /compute/v2.1/flavors/853656364 => generated 411 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:43.518905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69672417-2829-4f7a-a533-2bb5910a220c tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.353331 Jul 25 20:01:43.527079 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 9/35] 10.222.0.48 () {62 vars in 1232 bytes} [Mon Jul 25 20:01:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:43.539930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ceb1b481-d9d6-4c75-a7b9-5f8fa4519e44 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:43.545073 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:43.545073 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:43.568978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb1b481-d9d6-4c75-a7b9-5f8fa4519e44 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:43.575209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb1b481-d9d6-4c75-a7b9-5f8fa4519e44 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:43.637773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-830b8a4f-0cf1-4af9-9a54-219fa237ff50 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.694610 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-830b8a4f-0cf1-4af9-9a54-219fa237ff50 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.454361 Jul 25 20:01:43.695451 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 27/36] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:43 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:43.726382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c30eb43-b22d-4dc5-960a-7eca16cce19b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.772953 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c30eb43-b22d-4dc5-960a-7eca16cce19b tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/853656364" status: 202 len: 0 microversion: 2.1 time: 0.058737 Jul 25 20:01:43.776696 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 28/37] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:01:43 2022] DELETE /compute/v2.1/flavors/853656364 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:43.781543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc413d87-8443-4013-b24a-145fc92fe524 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.839906 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc413d87-8443-4013-b24a-145fc92fe524 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061783 Jul 25 20:01:43.840574 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 29/38] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:43.865200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5b8ebee-237c-4f45-aed3-d7452af2267f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2022081812", "id": 899651038, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:43.899313 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ceb1b481-d9d6-4c75-a7b9-5f8fa4519e44 tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.370512 Jul 25 20:01:43.907178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 10/39] 10.222.0.48 () {62 vars in 1232 bytes} [Mon Jul 25 20:01:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:43.918713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2035997-599e-4874-9dd0-32df430c390e tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:43.927435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5b8ebee-237c-4f45-aed3-d7452af2267f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.071136 Jul 25 20:01:43.928467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 30/40] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:43 2022] POST /compute/v2.1/flavors => generated 427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:43.935233 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:43.935233 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:43.941046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f7afeae-2d34-4335-ac30-ad831a959121 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "899651038"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:43.967458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7f7afeae-2d34-4335-ac30-ad831a959121 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] HTTP exception thrown: Flavor 899651038 could not be found. Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f7afeae-2d34-4335-ac30-ad831a959121 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Request method failure captured: Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 106 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaifllokZyFrQ35ruNPE8flq8Dzw8ZGZA-MaErEzxr41DDWGseDk0A_V5jclPQYWp3PRauakJhA4loKUtZjk2HdTpyddbc80B63zDWJMTksJOine5kVcFR7Q0oQwxU0AI9wQdC1EwcL39F3T3FbtI8JoVr2ufrahhQ9mCitBTReWrg Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7daad522941a4fe283793453a73b4112 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsAdminTestJSON-411257550 Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:01:43.980720 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7daad522941a4fe283793453a73b4112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7daad522941a4fe283793453a73b4112"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7daad522941a4fe283793453a73b4112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7daad522941a4fe283793453a73b4112"}]}] Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsAdminTestJSON-411257550 Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7daad522941a4fe283793453a73b4112 Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-411257550 Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsAdminTestJSON-411257550-project Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: d831460995bf49c7a0333187bd475350 Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsAdminTestJSON-411257550-project Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "test", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "899651038"}} Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:01:43.982111 n-d-845775-3 devstack@n-api.service[119723]: exception: Flavor 899651038 could not be found. Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '899651038'}}} Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 899651038 could not be found. Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:43.982793 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 899651038 could not be found. Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:43.983805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:43.984897 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:43.984897 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:43.984897 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:43.984897 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 899651038 could not be found. Jul 25 20:01:43.984897 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:43.988904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f7afeae-2d34-4335-ac30-ad831a959121 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Returning 400 to user: Flavor 899651038 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:43.990647 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f7afeae-2d34-4335-ac30-ad831a959121 tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.054343 Jul 25 20:01:43.993342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 31/41] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:43 2022] POST /compute/v2.1/servers => generated 80 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 20:01:43.999674 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2035997-599e-4874-9dd0-32df430c390e tempest-AggregatesAdminTestV241-990842040 tempest-AggregatesAdminTestV241-990842040-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.084833 Jul 25 20:01:44.004592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 11/42] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 20:01:43 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:44.006186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a91d363-c8f5-4dab-be34-26bce075fd6c tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.027031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f220108-222a-4941-a2fc-b624752bac54 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1787825789", "name": "tempest-test_aggregate-1948589980"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:44.056697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a91d363-c8f5-4dab-be34-26bce075fd6c tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/899651038" status: 202 len: 0 microversion: 2.1 time: 0.055194 Jul 25 20:01:44.057457 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 32/43] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:01:43 2022] DELETE /compute/v2.1/flavors/899651038 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:44.066430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-847aca66-46a0-4036-a62d-8107dd28a23f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.074398 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:44.074398 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:44.080782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-1f220108-222a-4941-a2fc-b624752bac54 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid 8504478a-1760-42f4-b806-fa9a37b8b63c for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:01:44.111897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-847aca66-46a0-4036-a62d-8107dd28a23f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050107 Jul 25 20:01:44.118347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 33/44] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:01:44.154882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed639237-869b-4aac-a489-d92426db8074 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-937526455", "id": 1552908770, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:44.166833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f220108-222a-4941-a2fc-b624752bac54 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.142931 Jul 25 20:01:44.168946 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 12/45] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:44.187647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ba4943d-1432-4f08-a871-ac3ad9c4782c tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.188736 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:44.188736 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:44.202079 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed639237-869b-4aac-a489-d92426db8074 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.051584 Jul 25 20:01:44.210407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 34/46] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:44.224190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-483871c3-277d-4dc2-80c2-1d4f4144ec71 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2109047977", "id": 641318302, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:44.232531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ba4943d-1432-4f08-a871-ac3ad9c4782c tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.051497 Jul 25 20:01:44.235713 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 13/47] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.248801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00980405-a031-43a5-87bc-ac7a43c606be tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:44.255136 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:44.255136 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:44.257613 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-483871c3-277d-4dc2-80c2-1d4f4144ec71 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043922 Jul 25 20:01:44.261074 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 35/48] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/flavors => generated 411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.280543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87915e5b-aaec-47b5-9958-b90735d548e1 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.288231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00980405-a031-43a5-87bc-ac7a43c606be tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:44.288687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00980405-a031-43a5-87bc-ac7a43c606be tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:44.327951 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87915e5b-aaec-47b5-9958-b90735d548e1 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.056894 Jul 25 20:01:44.328833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 36/49] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.353198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4b2398a-3ee6-4aca-ab91-6dc1c4a737b2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.366058 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4b2398a-3ee6-4aca-ab91-6dc1c4a737b2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.027623 Jul 25 20:01:44.374772 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 37/50] 10.222.0.48 () {58 vars in 1177 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.380237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcef56c0-755f-47c0-b448-fec0fbbf8ff9 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.393479 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bcef56c0-755f-47c0-b448-fec0fbbf8ff9 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.016821 Jul 25 20:01:44.401953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 38/51] 10.222.0.48 () {58 vars in 1171 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.409298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ff8c6d9-3f77-4192-b3c1-05e9795337f2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.423203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ff8c6d9-3f77-4192-b3c1-05e9795337f2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.019855 Jul 25 20:01:44.432153 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 39/52] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.436928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfe54a48-c69b-4848-83aa-3dc035556322 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.464986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfe54a48-c69b-4848-83aa-3dc035556322 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.031661 Jul 25 20:01:44.475694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 40/53] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.487536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4771ed02-bbea-4701-825e-bc6e1c43a3d2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.532668 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4771ed02-bbea-4701-825e-bc6e1c43a3d2 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.048187 Jul 25 20:01:44.546917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 41/54] 10.222.0.48 () {58 vars in 1175 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.589561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b166f584-cb14-4a58-bd2f-c1cb325ebd82 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.614121 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00980405-a031-43a5-87bc-ac7a43c606be tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.369986 Jul 25 20:01:44.632424 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 14/55] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:44.665348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b166f584-cb14-4a58-bd2f-c1cb325ebd82 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.111064 Jul 25 20:01:44.665348 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 42/56] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.687500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b581f79-a2ec-4bdb-92cf-0a2a75586f7a tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.733976 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b581f79-a2ec-4bdb-92cf-0a2a75586f7a tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.049996 Jul 25 20:01:44.734584 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 15/57] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.753569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6cd3f769-9813-4056-b1df-5d7cdf429cc8 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.787543 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6cd3f769-9813-4056-b1df-5d7cdf429cc8 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/641318302" status: 202 len: 0 microversion: 2.1 time: 0.037875 Jul 25 20:01:44.788308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 43/58] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:01:44 2022] DELETE /compute/v2.1/flavors/641318302 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:44.797344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-452f8f2e-7bce-41bb-afb8-79d8aff2995f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.837764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-452f8f2e-7bce-41bb-afb8-79d8aff2995f tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044891 Jul 25 20:01:44.841107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 16/59] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.863529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53c59515-3e79-4e44-b67b-29e962a47400 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.900550 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53c59515-3e79-4e44-b67b-29e962a47400 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1552908770" status: 202 len: 0 microversion: 2.1 time: 0.042101 Jul 25 20:01:44.904084 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 44/60] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:44 2022] DELETE /compute/v2.1/flavors/1552908770 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:01:44.912778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d41aac87-d582-4783-87bb-39a7df290fbb tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:44.942003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d41aac87-d582-4783-87bb-39a7df290fbb tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032672 Jul 25 20:01:44.942741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 45/61] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:44.961629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1540182c-5053-4549-8ae4-05adebc52f4d tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-113292727", "id": 2004958459, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:44.988522 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1540182c-5053-4549-8ae4-05adebc52f4d tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030452 Jul 25 20:01:44.997954 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 46/62] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:45.004469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64b5f49a-2450-4f08-8918-43296581285e tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.029200 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64b5f49a-2450-4f08-8918-43296581285e tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030063 Jul 25 20:01:45.042336 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 47/63] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:45.050273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1238cbb0-bc08-4496-a822-0adf1e2ebdaf tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.082212 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1238cbb0-bc08-4496-a822-0adf1e2ebdaf tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036785 Jul 25 20:01:45.083141 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 48/64] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:45.103326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b513a79e-2811-4632-8e87-3b27c22b8818 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.131454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b513a79e-2811-4632-8e87-3b27c22b8818 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2004958459" status: 202 len: 0 microversion: 2.1 time: 0.032684 Jul 25 20:01:45.132412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 49/65] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:45 2022] DELETE /compute/v2.1/flavors/2004958459 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:01:45.142241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ceb2ad9a-86fa-4c97-8473-b546cb047b05 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.169893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ceb2ad9a-86fa-4c97-8473-b546cb047b05 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032051 Jul 25 20:01:45.187995 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 50/66] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:45.200017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a25cdd2-28d3-452b-ab2a-4c73f6e8e154 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1397591871", "id": 676056718, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:45.229643 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a25cdd2-28d3-452b-ab2a-4c73f6e8e154 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035586 Jul 25 20:01:45.237600 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 51/67] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:45 2022] POST /compute/v2.1/flavors => generated 411 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:45.244939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f19d4182-9396-4280-a045-983e14773ffc tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.297801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f19d4182-9396-4280-a045-983e14773ffc tempest-FlavorsAdminTestJSON-411257550 tempest-FlavorsAdminTestJSON-411257550-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.058983 Jul 25 20:01:45.315666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 52/68] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:45 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:45.322469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a2e59247-f786-4efb-8f24-23aa71508657 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.343489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:45.364625 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a2e59247-f786-4efb-8f24-23aa71508657 tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/676056718" status: 202 len: 0 microversion: 2.1 time: 0.044936 Jul 25 20:01:45.365943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 53/69] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:01:45 2022] DELETE /compute/v2.1/flavors/676056718 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:45.380855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6dc232af-453b-413f-ba86-764926d216ab tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:45.423311 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6dc232af-453b-413f-ba86-764926d216ab tempest-FlavorsAdminTestJSON-782348814 tempest-FlavorsAdminTestJSON-782348814-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052956 Jul 25 20:01:45.425749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 54/70] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:45.513302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-844059128", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "availability_zone": "tempest-test_az-1787825789"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:45.565036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:45.565519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:45.568099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:45.569117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:47.426105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:01:47.985263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:01:47.985866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:01:47.986935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:01:47.987589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:01:47.988286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:01:48.018018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:48.022577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:48.023632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:48.024264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:48.105315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Getting quotas for project f73f6e3e8e7b4a00b681dee79f6622ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:01:48.124837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Getting quotas for user 0bd6e4cba0a6468ab69836bb0db43fea and project f73f6e3e8e7b4a00b681dee79f6622ea. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:01:48.173107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:01:48.185776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:01:48.314445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0ab89df8-4783-4bff-a280-4b5de159a522 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.433249 Jul 25 20:01:48.315658 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 17/71] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:01:48.327104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffc64a4b-2a97-489b-ba4e-fc86e2e996c2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:48.328447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ffc64a4b-2a97-489b-ba4e-fc86e2e996c2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:50.434679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffc64a4b-2a97-489b-ba4e-fc86e2e996c2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:50.461275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffc64a4b-2a97-489b-ba4e-fc86e2e996c2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1242 microversion: 2.1 time: 2.138486 Jul 25 20:01:50.464076 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 55/72] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:48 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1242 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:51.339403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-320d3fd8-f544-4985-baab-40e7a1755f57 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1126944221", "id": 654502242, "os-flavor-access:is_public": "False"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:51.344472 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:51.344472 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:51.387386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-320d3fd8-f544-4985-baab-40e7a1755f57 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.537435 Jul 25 20:01:51.387990 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 18/73] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:51.400781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef5269a4-f843-49f4-8e96-11afc3dfa8f0 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b55a3974548544bfbd3ac61d07b847cf"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:51.404135 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:51.404135 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:51.423317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:51.483779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:51.484666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:51.494485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:51.514443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:51.514897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:51.515681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:51.516160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:51.713504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:51.765384 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-add35953-e141-478e-81e2-ebaee6bd0e53 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1296 microversion: 2.1 time: 0.286760 Jul 25 20:01:51.773950 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 19/74] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:51 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1296 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:52.379482 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef5269a4-f843-49f4-8e96-11afc3dfa8f0 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/654502242/action" status: 200 len: 96 microversion: 2.1 time: 0.982365 Jul 25 20:01:52.382160 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 56/75] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Jul 25 20:01:51 2022] POST /compute/v2.1/flavors/654502242/action => generated 96 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:01:52.796729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e989d26e-51e7-41ce-8708-bd2d07c70b66 tempest-FlavorsAccessTestJSON-439105643 tempest-FlavorsAccessTestJSON-439105643-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:52.878908 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e989d26e-51e7-41ce-8708-bd2d07c70b66 tempest-FlavorsAccessTestJSON-439105643 tempest-FlavorsAccessTestJSON-439105643-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.487617 Jul 25 20:01:52.882504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 20/76] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:52 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:52.898500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:52.899372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:52.911708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:52.912208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:52.915933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:52.916451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:53.006902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Calling method '.version_select at 0x7f196a820550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:53.013771 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:53.013771 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:53.018871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:53.019664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:53.021663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:53.022396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:53.108423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25c296b0-18d4-43c0-9d82-6ec81be19d98 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.575632 Jul 25 20:01:53.116638 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 57/77] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:01:52 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:01:53.131907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3233642d-799d-45e3-87ee-dca3b553dfe2 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b55a3974548544bfbd3ac61d07b847cf"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:53.143273 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:53.143273 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:53.763584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:53.776984 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ee163fe-3a49-4c51-8138-9f82cd20376c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.893146 Jul 25 20:01:53.802858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 21/78] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:52 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:54.493387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3233642d-799d-45e3-87ee-dca3b553dfe2 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/654502242/action" status: 200 len: 21 microversion: 2.1 time: 1.373744 Jul 25 20:01:54.496216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 58/79] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Jul 25 20:01:53 2022] POST /compute/v2.1/flavors/654502242/action => generated 21 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:01:54.515706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a920bac4-e910-487c-a3e1-1f5a9b33e9c1 tempest-FlavorsAccessTestJSON-439105643 tempest-FlavorsAccessTestJSON-439105643-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:54.589025 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a920bac4-e910-487c-a3e1-1f5a9b33e9c1 tempest-FlavorsAccessTestJSON-439105643 tempest-FlavorsAccessTestJSON-439105643-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082997 Jul 25 20:01:54.607453 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 59/80] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:54.621846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1ce2f85-37f9-4768-a15d-8266c32ba626 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:54.629336 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:54.629336 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:54.679432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1ce2f85-37f9-4768-a15d-8266c32ba626 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/654502242" status: 202 len: 0 microversion: 2.1 time: 0.069280 Jul 25 20:01:54.680525 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 60/81] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:01:54 2022] DELETE /compute/v2.1/flavors/654502242 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:54.699919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f3f114bb-0eba-4c91-9480-1049a1e70b74 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:54.750404 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f3f114bb-0eba-4c91-9480-1049a1e70b74 tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062582 Jul 25 20:01:54.773409 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 61/82] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:54.790317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa20ad5d-a2cc-404e-9548-8f4f9662958b tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-6802739", "id": 1203167763, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:54.798421 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:54.798421 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:54.838831 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa20ad5d-a2cc-404e-9548-8f4f9662958b tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.054858 Jul 25 20:01:54.839945 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 62/83] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:54 2022] POST /compute/v2.1/flavors => generated 428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:01:54.854590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:54.855646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:54.872895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:54.876482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:54.879710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:54.886691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:54.973784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29807eb2-0b30-493b-8cbd-2ddfc31adcae tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Calling method '.version_select at 0x7f196a77a550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:54.977274 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:54.977274 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:54.978846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29807eb2-0b30-493b-8cbd-2ddfc31adcae tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29807eb2-0b30-493b-8cbd-2ddfc31adcae tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:01:54.993557 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:01:54.994788 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:54.995537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 25 20:01:54.996995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:54.998956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29807eb2-0b30-493b-8cbd-2ddfc31adcae tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:55.004961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29807eb2-0b30-493b-8cbd-2ddfc31adcae tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.196154 Jul 25 20:01:55.006746 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 22/84] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:01:53 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:55.393452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Calling method '.version_select at 0x7f196a64b3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.399160 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.399160 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.401184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:55.401885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:55.463550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:55.465128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:55.514458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:55.514925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:55.544511 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-184e7553-a966-445b-beb7-62d4b9ddb532 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.532434 Jul 25 20:01:55.545592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 23/85] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:55.556436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9a982ea-a266-444f-b8cd-8c05bfe6a0ae tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.557430 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.557430 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.614865 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9a982ea-a266-444f-b8cd-8c05bfe6a0ae tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1203167763/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.065618 Jul 25 20:01:55.615941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 24/86] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/flavors/1203167763/os-flavor-access => generated 21 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:01:55.627616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa029176-a4bb-43b9-be3e-3c8ee8f6a368 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Calling method '.version_select at 0x7f196cb05b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.630665 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.630665 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.637618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa029176-a4bb-43b9-be3e-3c8ee8f6a368 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa029176-a4bb-43b9-be3e-3c8ee8f6a368 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/n-d-845775-3/reboot HTTP/1.1 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:01:55.640506 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'n-d-845775-3'} Jul 25 20:01:55.641658 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:55.643092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 25 20:01:55.644669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.648125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa029176-a4bb-43b9-be3e-3c8ee8f6a368 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:55.651048 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa029176-a4bb-43b9-be3e-3c8ee8f6a368 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-845775-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.033316 Jul 25 20:01:55.656459 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 25/87] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hosts/n-d-845775-3/reboot => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:55.663297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Calling method '.version_select at 0x7f196a80e8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.668589 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.668589 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.670336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:55.672692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:55.709645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:55.714647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:55.732301 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac17d1e8-057d-437a-a489-ccc48812d344 tempest-HypervisorAdminV228Test-591233411 tempest-HypervisorAdminV228Test-591233411-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.074012 Jul 25 20:01:55.737188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 26/88] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:01:55.747254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-022d880c-cac8-4802-a9f7-841ffef2ce7d tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.751607 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.751607 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.788682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:55.811071 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-022d880c-cac8-4802-a9f7-841ffef2ce7d tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1203167763" status: 202 len: 0 microversion: 2.1 time: 0.072115 Jul 25 20:01:55.812347 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 27/89] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:01:55 2022] DELETE /compute/v2.1/flavors/1203167763 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:01:55.829409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4ba0548-d474-4057-a486-cb0dc25d55a3 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Calling method '.version_select at 0x7f196a66fca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.831613 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.831613 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.841584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d1132a9-6fe7-4aa8-abd8-d8b02ca00c36 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 1.000257 Jul 25 20:01:55.856815 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 63/90] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:54 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:55.866706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e8eb056-e620-4bfa-abfe-d7ec7895ec8c tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.873001 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c4ba0548-d474-4057-a486-cb0dc25d55a3 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4ba0548-d474-4057-a486-cb0dc25d55a3 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:55.886842 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'nonexistent_hostname'} Jul 25 20:01:55.888117 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:01:55.889178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 20:01:55.890204 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.891238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.894954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4ba0548-d474-4057-a486-cb0dc25d55a3 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:55.896106 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4ba0548-d474-4057-a486-cb0dc25d55a3 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.081816 Jul 25 20:01:55.901673 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 28/91] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:01:55.911773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f396d694-62f3-4882-b67d-440671b262a5 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Calling method '.version_select at 0x7f196a66f8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.917424 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.917424 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:55.919166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f396d694-62f3-4882-b67d-440671b262a5 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f396d694-62f3-4882-b67d-440671b262a5 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/n-d-845775-3 HTTP/1.1 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:01:55.921309 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'n-d-845775-3'} Jul 25 20:01:55.922493 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:55.923185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 25 20:01:55.924803 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.929280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f396d694-62f3-4882-b67d-440671b262a5 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:55.931441 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f396d694-62f3-4882-b67d-440671b262a5 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-845775-3" status: 403 len: 109 microversion: 2.1 time: 0.028388 Jul 25 20:01:55.935199 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e8eb056-e620-4bfa-abfe-d7ec7895ec8c tempest-FlavorsAccessTestJSON-1304344208 tempest-FlavorsAccessTestJSON-1304344208-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091881 Jul 25 20:01:55.941204 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 29/92] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hosts/n-d-845775-3 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:55.952868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3dfa4480-74dd-4118-ba72-8545ede72291 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Calling method '.version_select at 0x7f196a6dc4c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.955651 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 64/93] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:55.964245 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3dfa4480-74dd-4118-ba72-8545ede72291 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3dfa4480-74dd-4118-ba72-8545ede72291 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:55.972664 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'nonexistent_hostname'} Jul 25 20:01:55.975060 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.975760 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:55.976769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:55.981045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3dfa4480-74dd-4118-ba72-8545ede72291 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:55.984339 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3dfa4480-74dd-4118-ba72-8545ede72291 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041560 Jul 25 20:01:55.992136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 30/94] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:01:55.995102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd0032f5-d514-45ee-aa34-e9e4126b4e28 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Calling method '.version_select at 0x7f196a686dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:55.995897 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:55.995897 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:55.997319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd0032f5-d514-45ee-aa34-e9e4126b4e28 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd0032f5-d514-45ee-aa34-e9e4126b4e28 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hosts/n-d-845775-3/shutdown HTTP/1.1 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:01:56.002529 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'n-d-845775-3'} Jul 25 20:01:56.003696 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.004710 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 25 20:01:56.005670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.006535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd0032f5-d514-45ee-aa34-e9e4126b4e28 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.015434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd0032f5-d514-45ee-aa34-e9e4126b4e28 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-845775-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012928 Jul 25 20:01:56.021254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 65/95] 10.222.0.48 () {58 vars in 1194 bytes} [Mon Jul 25 20:01:55 2022] GET /compute/v2.1/os-hosts/n-d-845775-3/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:56.027404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bcb84855-f97c-49a1-a2f4-dd378d50a7ba tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Calling method '.version_select at 0x7f196a69d5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:56.028582 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:56.028582 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:56.046122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-bcb84855-f97c-49a1-a2f4-dd378d50a7ba tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bcb84855-f97c-49a1-a2f4-dd378d50a7ba tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:56.048318 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'nonexistent_hostname'} Jul 25 20:01:56.049505 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:01:56.050191 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 20:01:56.051165 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.052214 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.057985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bcb84855-f97c-49a1-a2f4-dd378d50a7ba tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.059278 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bcb84855-f97c-49a1-a2f4-dd378d50a7ba tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.036623 Jul 25 20:01:56.070700 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 31/96] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:01:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:01:56.075399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f465d147-6ed2-4053-8727-06fc4a62434d tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Calling method '.version_select at 0x7f196a68dc10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:56.076239 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:56.076239 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:56.077336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f465d147-6ed2-4053-8727-06fc4a62434d tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f465d147-6ed2-4053-8727-06fc4a62434d tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hosts/n-d-845775-3/startup HTTP/1.1 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:01:56.085890 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'n-d-845775-3'} Jul 25 20:01:56.087009 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.087690 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 25 20:01:56.088693 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.089589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f465d147-6ed2-4053-8727-06fc4a62434d tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.089589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f465d147-6ed2-4053-8727-06fc4a62434d tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-845775-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.016303 Jul 25 20:01:56.089589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 66/97] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Jul 25 20:01:56 2022] GET /compute/v2.1/os-hosts/n-d-845775-3/startup => generated 110 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:01:56.096847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f85c7cc-6ecf-4039-9e92-88564e1c4839 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Calling method '.version_select at 0x7f196a77aca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:56.098123 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:56.098123 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:01:56.109241 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5f85c7cc-6ecf-4039-9e92-88564e1c4839 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f85c7cc-6ecf-4039-9e92-88564e1c4839 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:56.113268 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'nonexistent_hostname'} Jul 25 20:01:56.114473 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:01:56.115228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 25 20:01:56.118049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.119095 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.122637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f85c7cc-6ecf-4039-9e92-88564e1c4839 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.123816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f85c7cc-6ecf-4039-9e92-88564e1c4839 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.030674 Jul 25 20:01:56.126152 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 32/98] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Jul 25 20:01:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:01:56.137348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54f2c821-d9dd-4aef-96cb-e635a7b61d06 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Action: 'update', calling method: .version_select at 0x7f196c1f74c0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54f2c821-d9dd-4aef-96cb-e635a7b61d06 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/os-hosts/n-d-845775-3 HTTP/1.1 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 51 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:01:56.144456 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: {"status": "enable", "maintenance_mode": "invalid"} Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:01:56.145810 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'n-d-845775-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance: Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.146587 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.147963 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.152485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.152485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:01:56.152485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:01:56.152485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.152485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.154695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54f2c821-d9dd-4aef-96cb-e635a7b61d06 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.155931 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54f2c821-d9dd-4aef-96cb-e635a7b61d06 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-845775-3" status: 400 len: 199 microversion: 2.1 time: 0.023816 Jul 25 20:01:56.157078 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 67/99] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:56 2022] PUT /compute/v2.1/os-hosts/n-d-845775-3 => generated 199 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:01:56.169795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c587d79-c1c9-4236-ae33-39d747f2185a tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Action: 'update', calling method: .version_select at 0x7f196a69d3a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c587d79-c1c9-4236-ae33-39d747f2185a tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/os-hosts/n-d-845775-3 HTTP/1.1 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 51 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:56.178382 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: {"status": "invalid", "maintenance_mode": "enable"} Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:56.179885 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'n-d-845775-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance: Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.182587 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.183860 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.185038 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.185038 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:01:56.185038 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:01:56.185038 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 25 20:01:56.185038 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.187543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c587d79-c1c9-4236-ae33-39d747f2185a tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.188701 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c587d79-c1c9-4236-ae33-39d747f2185a tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-845775-3" status: 400 len: 189 microversion: 2.1 time: 0.026065 Jul 25 20:01:56.190023 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 33/100] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:56 2022] PUT /compute/v2.1/os-hosts/n-d-845775-3 => generated 189 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:01:56.199418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ac9fb2f-54b3-4190-8946-0159cf729f79 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Action: 'update', calling method: .version_select at 0x7f196a68d670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:56.202358 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:01:56.202358 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:01:56.203753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8ac9fb2f-54b3-4190-8946-0159cf729f79 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '882071f42c344465860546b708c60e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2213367bd54ecfb5f40693332b0446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ac9fb2f-54b3-4190-8946-0159cf729f79 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Request method failure captured: Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/os-hosts/n-d-845775-3 HTTP/1.1 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 50 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vatDtFKUxw9suxKE7XluILwC3MoH6dglzMhr5AML9lAamm3p13Flhxv5itmy70WZzZP20a2dWo5y089dkTbNDeOJwxUyVSsC0XVo6_b8DqpCbupNQmX4Js4w1EN6jC9c3Ob3oPAJWsrZEwvSKbRHxBfR_yxlcvKRP32_bHFJPn1jSk Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:01:56.209268 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac2213367bd54ecfb5f40693332b0446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac2213367bd54ecfb5f40693332b0446"}]}] Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ac2213367bd54ecfb5f40693332b0446 Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-334461312 Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 882071f42c344465860546b708c60e2e Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-334461312-project Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 20:01:56.210540 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'n-d-845775-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.211265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 25 20:01:56.212974 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.215987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ac9fb2f-54b3-4190-8946-0159cf729f79 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.215987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ac9fb2f-54b3-4190-8946-0159cf729f79 tempest-HostsAdminNegativeTestJSON-334461312 tempest-HostsAdminNegativeTestJSON-334461312-project] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-845775-3" status: 403 len: 111 microversion: 2.1 time: 0.015208 Jul 25 20:01:56.215987 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 68/101] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:56 2022] PUT /compute/v2.1/os-hosts/n-d-845775-3 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:01:56.228647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a68ed68-4678-4cee-9ed6-846cb18b362e tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Action: 'update', calling method: .version_select at 0x7f196a69d280>, body: {"status": null, "maintenance_mode": null} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a68ed68-4678-4cee-9ed6-846cb18b362e tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/os-hosts/n-d-845775-3 HTTP/1.1 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 42 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:01:56.244999 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: {"status": null, "maintenance_mode": null} Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 20:01:56.246556 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'n-d-845775-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'disable', Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'Enable', Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'Disable', Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance: Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi None Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.247677 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.249624 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a68ed68-4678-4cee-9ed6-846cb18b362e tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.250824 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7a68ed68-4678-4cee-9ed6-846cb18b362e tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-845775-3" status: 400 len: 127 microversion: 2.1 time: 0.029617 Jul 25 20:01:56.252269 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 34/102] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:01:56 2022] PUT /compute/v2.1/os-hosts/n-d-845775-3 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:01:56.260576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Action: 'update', calling method: .version_select at 0x7f196a623310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:56.265781 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.hosts [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Enabling host nonexistent_hostname. Jul 25 20:01:56.286318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Request method failure captured: Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 50 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vawc5-DHNH9t5fb4369VYACoF4fSBu2oREvyK8nZuUaVi39olIpF1c16-M9kS2_D9oV0Ec299_I40kCOVhSyN3vHrZzusWrwcb0kc4aywH-3gofY9ZX1Y_NL6RAroTU55xdGqA9SyqiIjuLsALmsnn6ArqI9k5gnUVhWS4yHlTk-ws Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:01:56.298245 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa14e2a28a004fdb84ba85ad9fd0ca51"}]}] Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: fa14e2a28a004fdb84ba85ad9fd0ca51 Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-227496620 Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 10f5e77cf23c4d8d8b8a9e660c0316af Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HostsAdminNegativeTestJSON-227496620-project-admin Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: {"status": "enable", "maintenance_mode": "enable"} Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.299488 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:01:56.300377 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:01:56.301289 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 25 20:01:56.304134 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:01:56.314710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:01:56.315829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e5c9b10-7541-40df-b9fd-b4d3cf636013 tempest-HostsAdminNegativeTestJSON-227496620 tempest-HostsAdminNegativeTestJSON-227496620-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.060211 Jul 25 20:01:56.316671 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 69/103] 10.222.0.48 () {60 vars in 1211 bytes} [Mon Jul 25 20:01:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:01:56.881019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:56.882121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:56.901216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:56.905672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:56.909627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:56.911613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:57.331506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:57.344471 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-375b30fa-b314-4ae2-bea7-681357792d90 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.477223 Jul 25 20:01:57.345389 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 35/104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:56 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:58.372958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:01:58.379989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:01:58.402188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:58.412571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:58.415141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:01:58.420608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:01:58.948235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:58.950569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:01:59.688567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-968791059", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:01:59.722343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:01:59.754884 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb2ce76a-d01c-4974-a3c8-f96e6d989d0a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 1.383423 Jul 25 20:01:59.757456 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 70/105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:01:58 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:01:59.817276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:02:00.083629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a578c6a8-f5be-42e2-82e0-8d4cf5c645f2 req-843e0934-1ef2-49cb-9132-3280adaac21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4796f258-b5a8-4d85-a51d-3466062cccce", "tag": "c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:00.145132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a578c6a8-f5be-42e2-82e0-8d4cf5c645f2 req-843e0934-1ef2-49cb-9132-3280adaac21b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:00.147733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a578c6a8-f5be-42e2-82e0-8d4cf5c645f2 req-843e0934-1ef2-49cb-9132-3280adaac21b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:00.259203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a578c6a8-f5be-42e2-82e0-8d4cf5c645f2 req-843e0934-1ef2-49cb-9132-3280adaac21b service nova] Creating event network-changed:c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c for instance 4796f258-b5a8-4d85-a51d-3466062cccce on n-h1-845775-3 Jul 25 20:02:00.264261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a578c6a8-f5be-42e2-82e0-8d4cf5c645f2 req-843e0934-1ef2-49cb-9132-3280adaac21b service nova] Acquired lock "compute-rpcapi-router" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:02:00.269490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:00.270594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:00.274949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:00.275636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:00.312200 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.rpcapi [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 20:02:00.316279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] Releasing lock "compute-rpcapi-router" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:02:00.383717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7dd2213f-a114-473d-9f78-e88970244e8e None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.620222 Jul 25 20:02:00.384656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 71/106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:00.750621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:01.154304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ce61424-875e-4ce8-9296-717ca69e8a22 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-418754067", "id": 1540896786, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:01.161222 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:01.161222 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:01.188334 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ce61424-875e-4ce8-9296-717ca69e8a22 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.438379 Jul 25 20:02:01.190143 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 72/107] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:00 2022] POST /compute/v2.1/flavors => generated 438 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:01.206818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:01.209575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:01.231945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:01.234339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:01.239432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:01.240129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:02.189517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:02:02.190791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:02:02.191540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:02:02.192224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:02:02.192781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:02:02.244306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:02.248632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:02.253038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:02.257488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:02.339531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Getting quotas for project 5d57cfb0349141529b75dc0699f15dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:02:02.353290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Getting quotas for user c82ae8310ea8405b84503785081fc815 and project 5d57cfb0349141529b75dc0699f15dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:02:02.388244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:02:02.391337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:02:02.554849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2ef74db-e7a5-4a90-909e-640d71f737da tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.618227 Jul 25 20:02:02.570891 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 36/108] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:02:02.590202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-afdc7ed1-d36b-41d8-8774-5cf5af6e4ba7 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:02.603255 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:02.603255 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:03.087709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:03.113313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cad03b32-a61e-4d99-a4fb-45e9dd50e2f2 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 1.921594 Jul 25 20:02:03.119456 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 73/109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:01 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:03.136972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-222b9bf7-7608-4013-a775-294656a5bce6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:03.150907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-222b9bf7-7608-4013-a775-294656a5bce6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:03.291951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-222b9bf7-7608-4013-a775-294656a5bce6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:03.305350 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-222b9bf7-7608-4013-a775-294656a5bce6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1219 microversion: 2.1 time: 0.184453 Jul 25 20:02:03.306149 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 74/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:03 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:03.773662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-afdc7ed1-d36b-41d8-8774-5cf5af6e4ba7 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1540896786/action" status: 200 len: 97 microversion: 2.1 time: 1.198072 Jul 25 20:02:03.782583 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 37/111] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Jul 25 20:02:02 2022] POST /compute/v2.1/flavors/1540896786/action => generated 97 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:03.787800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2248bcb6-a071-49a8-8ab5-95e21e431a8d tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:03.794632 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:03.794632 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:04.157094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:04.160726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:04.195804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:04.197323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:04.204484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:04.205493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:04.504406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2248bcb6-a071-49a8-8ab5-95e21e431a8d tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2248bcb6-a071-49a8-8ab5-95e21e431a8d tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Request method failure captured: Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/flavors/1540896786/action HTTP/1.1 Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 67 Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3va3OhHxDDUR7zO3_lvqF0tlIueuBYnwo6lSkHvFLKLHlHtZv7I3CpZ3lXp5DH4uaZuBkbHyrFBjToHCgDhV9BtrUnHkQG6hXpcEU-a6KyxW9IEwhuK86QtH5Wan3RZ9O5-ZxjTSyDrW58kMRz7zjMHousEjbtCw2WE_tC8GLHmWY0I Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:04.569402 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}] Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 942c5ce9bade4a27bfb12f560fc4324e Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} Jul 25 20:02:04.570810 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: exception: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1540896786', 'body': {'addTenantAccess': {'tenant': '84d25be033964481b1f15008c7cdba0c'}}} Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:02:04.571629 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-84d25be033964481b1f15008c7cdba0c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 20:02:04.572806 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 20:02:04.573955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:02:04.575090 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-84d25be033964481b1f15008c7cdba0c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 20, 2, 4, 487789), 'updated_at': None, 'flavor_id': 29, 'project_id': '84d25be033964481b1f15008c7cdba0c'}] Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:04.576107 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:04.577161 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:04.578660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:04.580586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. Jul 25 20:02:04.580586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:04.581842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2248bcb6-a071-49a8-8ab5-95e21e431a8d tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 84d25be033964481b1f15008c7cdba0c combination. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:04.587136 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2248bcb6-a071-49a8-8ab5-95e21e431a8d tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1540896786/action" status: 409 len: 152 microversion: 2.1 time: 0.799548 Jul 25 20:02:04.588699 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 75/112] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Jul 25 20:02:03 2022] POST /compute/v2.1/flavors/1540896786/action => generated 152 bytes in 806 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:04.602508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e8488b9a-e98d-4c0d-add1-8349351f96cc tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:04.606296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e8488b9a-e98d-4c0d-add1-8349351f96cc tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:04.743319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e8488b9a-e98d-4c0d-add1-8349351f96cc tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:04.757851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:04.775163 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e8488b9a-e98d-4c0d-add1-8349351f96cc tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1219 microversion: 2.1 time: 0.183082 Jul 25 20:02:04.786889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cefa65cb-e84c-4591-921a-4ab4745ffebf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.650681 Jul 25 20:02:04.791739 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 38/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:04 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:04.791908 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 76/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:04 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:04.805518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-259d6cd1-9d3f-4273-b56e-80d9f0e2ee52 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:04.816520 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:04.816520 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:05.465244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-259d6cd1-9d3f-4273-b56e-80d9f0e2ee52 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1540896786/action" status: 200 len: 21 microversion: 2.1 time: 0.671435 Jul 25 20:02:05.468709 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 77/115] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Jul 25 20:02:04 2022] POST /compute/v2.1/flavors/1540896786/action => generated 21 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:05.489654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5889648f-b0cc-4b2a-ba71-cc68130fb242 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.492841 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:05.492841 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:05.565732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5889648f-b0cc-4b2a-ba71-cc68130fb242 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1540896786" status: 202 len: 0 microversion: 2.1 time: 0.090371 Jul 25 20:02:05.566998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 39/116] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:02:05 2022] DELETE /compute/v2.1/flavors/1540896786 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:05.576896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a71bb13-7d55-4c23-83ff-47ecd3d63c7f tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.625802 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a71bb13-7d55-4c23-83ff-47ecd3d63c7f tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052891 Jul 25 20:02:05.628625 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 78/117] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:05.655385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1320286-8647-4adf-bbe4-45f9c3155ef8 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-564553092", "id": 998527139, "os-flavor-access:is_public": "True"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:05.667912 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:05.667912 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:05.729942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1320286-8647-4adf-bbe4-45f9c3155ef8 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.079678 Jul 25 20:02:05.738211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 40/118] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:05 2022] POST /compute/v2.1/flavors => generated 434 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:05.753389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3252428d-501f-4bea-a0bb-a398cb9ceb3e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.754345 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:05.754345 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:05.780928 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3252428d-501f-4bea-a0bb-a398cb9ceb3e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3252428d-501f-4bea-a0bb-a398cb9ceb3e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Request method failure captured: Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/flavors/998527139/os-flavor-access HTTP/1.1 Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3va3OhHxDDUR7zO3_lvqF0tlIueuBYnwo6lSkHvFLKLHlHtZv7I3CpZ3lXp5DH4uaZuBkbHyrFBjToHCgDhV9BtrUnHkQG6hXpcEU-a6KyxW9IEwhuK86QtH5Wan3RZ9O5-ZxjTSyDrW58kMRz7zjMHousEjbtCw2WE_tC8GLHmWY0I Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:05.782313 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}] Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 942c5ce9bade4a27bfb12f560fc4324e Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: exception: Access list not available for public flavors. Jul 25 20:02:05.783637 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'flavor_id': '998527139'} Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 25 20:02:05.784441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:05.790890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3252428d-501f-4bea-a0bb-a398cb9ceb3e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:05.795769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3252428d-501f-4bea-a0bb-a398cb9ceb3e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/998527139/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.051843 Jul 25 20:02:05.804430 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 79/119] 10.222.0.48 () {58 vars in 1206 bytes} [Mon Jul 25 20:02:05 2022] GET /compute/v2.1/flavors/998527139/os-flavor-access => generated 91 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:05.807300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.808841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:05.816016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c36d761c-09b5-4ef4-ad87-086741447cc6 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.816963 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:05.816963 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:05.819946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:05.823598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:05.829088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:05.833548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:05.912222 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c36d761c-09b5-4ef4-ad87-086741447cc6 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/998527139" status: 202 len: 0 microversion: 2.1 time: 0.105793 Jul 25 20:02:05.917837 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 80/120] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:02:05 2022] DELETE /compute/v2.1/flavors/998527139 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:05.920008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:05.921392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:05.936112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:05.941164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:05.942540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:05.943363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:06.046463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:06.061531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-065dd4b3-15a2-46b9-99b4-83571a26d03b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1271 microversion: 2.1 time: 0.265333 Jul 25 20:02:06.062710 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 41/121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:05 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:06.073253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4318b8c9-de13-4c0c-90f4-b4cfb0fdaff0 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:06.140745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4318b8c9-de13-4c0c-90f4-b4cfb0fdaff0 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075317 Jul 25 20:02:06.153222 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 42/122] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:06.169088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f5a6bc7-74c5-4ac5-8478-b16e3736f506 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-816775808", "id": 1067813519, "os-flavor-access:is_public": "False"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:06.182255 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:06.182255 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:06.211303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f5a6bc7-74c5-4ac5-8478-b16e3736f506 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.049293 Jul 25 20:02:06.221777 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 43/123] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:06.324008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:06.337339 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bcdcd7f1-4a99-4a74-90ed-5fe2caea401c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.421750 Jul 25 20:02:06.349360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 81/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:05 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:07.094048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:07.096245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:07.103495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:07.108984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:07.110171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:07.115983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:07.264339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85dae1ca-2147-42d6-90d5-b619605a8b47 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:07.267389 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:07.267389 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:07.270533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-85dae1ca-2147-42d6-90d5-b619605a8b47 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '3da794ec76ee4be48bb8b4672e1d5388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d25be033964481b1f15008c7cdba0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85dae1ca-2147-42d6-90d5-b619605a8b47 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Request method failure captured: Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/flavors/1067813519/action HTTP/1.1 Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 67 Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaypKP10HKn24kpDHQvT2X4eAcZAKzw9FOobk8adCwMZgVWnbrN5S5jfgeTzTkolzV3kL-D4OWsqu-3Tj3xb4GfJOzzfwKAscdNwdlGg7hBHb7zwlFuURZAv0zrkKlIyQ8l4U04gGkb8lNJZAyaoaL4ZAWO3wHEYkQ5M3QuHubf76E Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 84d25be033964481b1f15008c7cdba0c Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:07.278559 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84d25be033964481b1f15008c7cdba0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84d25be033964481b1f15008c7cdba0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84d25be033964481b1f15008c7cdba0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84d25be033964481b1f15008c7cdba0c"}]}] Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 84d25be033964481b1f15008c7cdba0c Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsAccessNegativeTestJSON-1315743543-project Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 3da794ec76ee4be48bb8b4672e1d5388 Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543-project Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} Jul 25 20:02:07.280228 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1067813519', 'body': {'addTenantAccess': {'tenant': '84d25be033964481b1f15008c7cdba0c'}}} Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:07.281219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 25 20:02:07.282444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:07.284977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85dae1ca-2147-42d6-90d5-b619605a8b47 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:07.285353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:07.285584 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-85dae1ca-2147-42d6-90d5-b619605a8b47 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] 10.222.0.48 "POST /compute/v2.1/flavors/1067813519/action" status: 403 len: 130 microversion: 2.1 time: 1.061974 Jul 25 20:02:07.286241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 44/125] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Jul 25 20:02:06 2022] POST /compute/v2.1/flavors/1067813519/action => generated 130 bytes in 1064 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:07.295773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6027259-7249-4ee4-9ca6-c1cf3c30912e tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1277 microversion: 2.1 time: 0.205589 Jul 25 20:02:07.296848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e7a7dce-c3c2-44bc-916b-d5461d6e402c tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:07.297626 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:07.297626 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:07.299436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 82/126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:07 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:07.340908 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e7a7dce-c3c2-44bc-916b-d5461d6e402c tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1067813519" status: 202 len: 0 microversion: 2.1 time: 0.050135 Jul 25 20:02:07.341926 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 45/127] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:02:07 2022] DELETE /compute/v2.1/flavors/1067813519 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:07.350524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-031ac765-7e48-4078-9242-47babe8511fe tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:07.360597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:07.361498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:07.372341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:07.372799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:07.373603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:07.374041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:07.394649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-031ac765-7e48-4078-9242-47babe8511fe tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048467 Jul 25 20:02:07.414319 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 83/128] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:07.429897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a934cd46-d905-4b6c-80c1-71149b82d16e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1049883531", "id": 379409416, "os-flavor-access:is_public": "False"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:07.438181 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:07.438181 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:07.477721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a934cd46-d905-4b6c-80c1-71149b82d16e tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052135 Jul 25 20:02:07.480719 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 84/129] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:07 2022] POST /compute/v2.1/flavors => generated 436 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:07.505496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9fe1dd01-9b2a-452b-844b-6e993a92f5f4 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:07.509268 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:07.509268 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:07.701697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:07.719731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58268d01-abb4-4fc4-90b6-1baa780c2480 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.363183 Jul 25 20:02:07.720862 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 46/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:07 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:08.319295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:08.320083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:08.335136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:08.336930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:08.339431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:08.347763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:08.527975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9fe1dd01-9b2a-452b-844b-6e993a92f5f4 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/379409416/action" status: 200 len: 96 microversion: 2.1 time: 1.038861 Jul 25 20:02:08.540199 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 85/131] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Jul 25 20:02:07 2022] POST /compute/v2.1/flavors/379409416/action => generated 96 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:08.554364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8eb1a1c-4398-487f-b8a1-c69088b045e8 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:08.566366 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:08.566366 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:08.573440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8eb1a1c-4398-487f-b8a1-c69088b045e8 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '3da794ec76ee4be48bb8b4672e1d5388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d25be033964481b1f15008c7cdba0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:08.574484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8eb1a1c-4398-487f-b8a1-c69088b045e8 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Request method failure captured: Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/flavors/379409416/action HTTP/1.1 Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 70 Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaypKP10HKn24kpDHQvT2X4eAcZAKzw9FOobk8adCwMZgVWnbrN5S5jfgeTzTkolzV3kL-D4OWsqu-3Tj3xb4GfJOzzfwKAscdNwdlGg7hBHb7zwlFuURZAv0zrkKlIyQ8l4U04gGkb8lNJZAyaoaL4ZAWO3wHEYkQ5M3QuHubf76E Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 84d25be033964481b1f15008c7cdba0c Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:02:08.578687 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84d25be033964481b1f15008c7cdba0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84d25be033964481b1f15008c7cdba0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84d25be033964481b1f15008c7cdba0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84d25be033964481b1f15008c7cdba0c"}]}] Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 84d25be033964481b1f15008c7cdba0c Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543 Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsAccessNegativeTestJSON-1315743543-project Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 3da794ec76ee4be48bb8b4672e1d5388 Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1315743543-project Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: {"removeTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} Jul 25 20:02:08.581912 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '379409416', 'body': {'removeTenantAccess': {'tenant': '84d25be033964481b1f15008c7cdba0c'}}} Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can( Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:08.583605 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 25 20:02:08.586243 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:08.592652 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d12302f5-5476-463e-9790-1d80d50522b1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1277 microversion: 2.1 time: 0.271027 Jul 25 20:02:08.593142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8eb1a1c-4398-487f-b8a1-c69088b045e8 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:08.593142 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8eb1a1c-4398-487f-b8a1-c69088b045e8 tempest-FlavorsAccessNegativeTestJSON-1315743543 tempest-FlavorsAccessNegativeTestJSON-1315743543-project] 10.222.0.48 "POST /compute/v2.1/flavors/379409416/action" status: 403 len: 133 microversion: 2.1 time: 0.050005 Jul 25 20:02:08.598518 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 86/133] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Jul 25 20:02:08 2022] POST /compute/v2.1/flavors/379409416/action => generated 133 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:08.602612 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 47/133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:08 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:08.612293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78897582-1c2c-4d08-b11a-7c5e3c330225 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "84d25be033964481b1f15008c7cdba0c"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:08.743490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:08.747140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:08.770914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:08.775273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:08.779972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:08.781798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:09.193743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:09.203718 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26e5a8ee-cf58-4119-b9ce-f623aa508a11 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.465274 Jul 25 20:02:09.216073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 48/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:08 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:09.610651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:09.615386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:09.624623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:09.646256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:09.655796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:09.658281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:09.670023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:09.738005 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78897582-1c2c-4d08-b11a-7c5e3c330225 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/379409416/action" status: 200 len: 21 microversion: 2.1 time: 1.132272 Jul 25 20:02:09.752972 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 87/135] 10.222.0.48 () {60 vars in 1197 bytes} [Mon Jul 25 20:02:08 2022] POST /compute/v2.1/flavors/379409416/action => generated 21 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:09.772361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=89 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:09.779681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b8d0668f-7c86-4bc0-bfd1-9e20216e9325 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:09.789063 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:09.789063 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:09.889346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:09.913093 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b8d0668f-7c86-4bc0-bfd1-9e20216e9325 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/379409416" status: 202 len: 0 microversion: 2.1 time: 0.156324 Jul 25 20:02:09.919226 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 88/136] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:02:09 2022] DELETE /compute/v2.1/flavors/379409416 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:09.920725 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ade7792-7caa-4d42-a8cc-16ea4ff9a926 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1277 microversion: 2.1 time: 0.310359 Jul 25 20:02:09.931327 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 49/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:09 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:09.936996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ca1e3d5-eab0-42dd-a0d5-9e0ef750e5fc tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:10.011448 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ca1e3d5-eab0-42dd-a0d5-9e0ef750e5fc tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081964 Jul 25 20:02:10.013616 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 89/138] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:10.063456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00248cca-37e8-4078-af29-704840e989e9 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-233768093", "id": 2070085904, "os-flavor-access:is_public": "False"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:10.100756 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:10.100756 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:10.176112 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00248cca-37e8-4078-af29-704840e989e9 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.106671 Jul 25 20:02:10.177935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 50/139] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:10.206578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fcbb0806-b1ac-4855-a34c-11d2e69b72af tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "90509e9a573746e3968719def71d44cf"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:10.233995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:10.235151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:10.245290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:10.246175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:10.247260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:10.247931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:10.302654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:10.754592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:10.787842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c94b663b-409f-4081-bdcf-de80e45e67c3 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.556199 Jul 25 20:02:10.791869 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 51/140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:10 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:10.959293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:10.960893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:11.004545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:11.006417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:11.017705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:11.023929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:11.506687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:11.543515 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6e3ebaa-7223-4cf9-a6e3-d060db04f7d1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.592386 Jul 25 20:02:11.557736 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 52/141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:10 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:11.828911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:11.832390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:11.894095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:11.910383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:11.916072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:11.920470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:12.067550 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fcbb0806-b1ac-4855-a34c-11d2e69b72af tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] HTTP exception thrown: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fcbb0806-b1ac-4855-a34c-11d2e69b72af tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Request method failure captured: Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/flavors/2070085904/action HTTP/1.1 Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 70 Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3va3OhHxDDUR7zO3_lvqF0tlIueuBYnwo6lSkHvFLKLHlHtZv7I3CpZ3lXp5DH4uaZuBkbHyrFBjToHCgDhV9BtrUnHkQG6hXpcEU-a6KyxW9IEwhuK86QtH5Wan3RZ9O5-ZxjTSyDrW58kMRz7zjMHousEjbtCw2WE_tC8GLHmWY0I Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:12.089674 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a1fc7ef243b485d9fa3e4b3697a925e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a1fc7ef243b485d9fa3e4b3697a925e"}]}] Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2a1fc7ef243b485d9fa3e4b3697a925e Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265 Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 942c5ce9bade4a27bfb12f560fc4324e Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: {"removeTenantAccess": {"tenant": "90509e9a573746e3968719def71d44cf"}} Jul 25 20:02:12.091410 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: exception: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2070085904', 'body': {'removeTenantAccess': {'tenant': '90509e9a573746e3968719def71d44cf'}}} Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 25 20:02:12.092311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:12.093509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. Jul 25 20:02:12.094740 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:12.098279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fcbb0806-b1ac-4855-a34c-11d2e69b72af tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Returning 404 to user: Flavor access not found for 33 / 90509e9a573746e3968719def71d44cf combination. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:12.106676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fcbb0806-b1ac-4855-a34c-11d2e69b72af tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/2070085904/action" status: 404 len: 124 microversion: 2.1 time: 1.911135 Jul 25 20:02:12.112849 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 90/142] 10.222.0.48 () {60 vars in 1200 bytes} [Mon Jul 25 20:02:10 2022] POST /compute/v2.1/flavors/2070085904/action => generated 124 bytes in 1922 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:12.163457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a98beaf-f8fe-41c0-86cd-c21fe273dd43 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:12.251110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a98beaf-f8fe-41c0-86cd-c21fe273dd43 tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2070085904" status: 202 len: 0 microversion: 2.1 time: 0.135861 Jul 25 20:02:12.272817 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 91/143] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:02:12 2022] DELETE /compute/v2.1/flavors/2070085904 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:12.310252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:12.315406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed66733c-042c-4a19-aeae-ded35b9d0cfa tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:12.376966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:12.435839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed66733c-042c-4a19-aeae-ded35b9d0cfa tempest-FlavorsAccessNegativeTestJSON-2087343265 tempest-FlavorsAccessNegativeTestJSON-2087343265-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.155113 Jul 25 20:02:12.457021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:12.465069 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 92/144] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:12.482245 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2a41af90-3de4-45eb-851e-ca7f4c632672 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.661300 Jul 25 20:02:12.499508 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 53/145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:11 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:12.569909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:12.570539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:12.590386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:12.591095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:12.609293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:12.613521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:13.250570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:13.281519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a51b3bcd-2f3b-4c8f-967c-28e43698f16c tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.715584 Jul 25 20:02:13.295326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 93/146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:12 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:13.532672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:13.533412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:13.537202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:13.553856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:13.554265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:13.562200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:13.563533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:13.891372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:13.905793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac6e0f7f-36b9-48ee-a5e3-cd7e6160267a tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.381565 Jul 25 20:02:13.906317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 54/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:13 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:14.327614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:14.336026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:14.371162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:14.386638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:14.395998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:14.397453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:14.625863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Calling method '.version_select at 0x7f196a6415e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:14.635782 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:14.635782 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:14.641575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:14.656201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:14.771596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:14.779808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:14.823179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:14.884447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:14.885147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:14.922641 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e28bd420-ff8d-4611-9303-2fa311928e29 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.052156 Jul 25 20:02:14.933115 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 94/148] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:15.299273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:15.329094 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4ce5fae-e9b0-4d18-8f70-7db721813db7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 1.008867 Jul 25 20:02:15.341467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 55/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:14 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:15.365310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Calling method '.version_select at 0x7f196a54be50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:15.367375 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:15.367375 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:15.373072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.374312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.463857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.468694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.510688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Calling method '.version_select at 0x7f196a641dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:15.517411 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:15.517411 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:15.523248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.524537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.557064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.557825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.646683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.647965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.663970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.665262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.683863 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19b97a7d-d99b-4e10-936f-20c77e9756c3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-845775-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.339795 Jul 25 20:02:15.686249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.686898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.696805 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 56/150] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Jul 25 20:02:15 2022] GET /compute/v2.1/os-hypervisors/n-h1-845775-3/servers => generated 196 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:15.707415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:15.709983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:15.722436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.723339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.724932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.725840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.757429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:15.758153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:15.772251 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8bfe6ef-4952-4b56-a7e5-cc02adf63d7f tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1758 microversion: 2.53 time: 0.835775 Jul 25 20:02:15.773367 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 95/151] 10.222.0.48 () {60 vars in 1243 bytes} [Mon Jul 25 20:02:14 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1758 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:02:16.018975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-feb4af8b-3193-4051-8ccd-dcd9e4d387cf tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] Calling method '.version_select at 0x7f196a5061f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:16.020606 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:16.020606 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:16.066378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-feb4af8b-3193-4051-8ccd-dcd9e4d387cf tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.291486 Jul 25 20:02:16.084803 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 96/152] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:02:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:16.133016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Calling method '.version_select at 0x7f196a2b29d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:16.134370 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:16.134370 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:16.149552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.154623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.246741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.248399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.298232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.299167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.336812 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed0e4c0c-03c2-41fa-b380-1fd930d08cd3 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.250206 Jul 25 20:02:16.344491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 97/153] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:16.362045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Calling method '.version_select at 0x7f196a2b2ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:16.364514 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:16.364514 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:16.365756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.366216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.400834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.401338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.453312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.457192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.511387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.517019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.623986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.641390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:16.684636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69a4e506-fb40-42fe-b024-0c58152e9df6 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.335249 Jul 25 20:02:16.691217 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 98/154] 10.222.0.48 () {60 vars in 1222 bytes} [Mon Jul 25 20:02:16 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:16.723626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25781ce4-9267-41ad-9e8a-42fcc38fc38c tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] Action: 'update', calling method: .version_select at 0x7f196a4f7550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:16.743985 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:16.743985 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:16.936623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:16.962015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6362c778-865b-4388-9915-cd72b8103b44 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 1.261117 Jul 25 20:02:16.965157 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 57/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:15 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:16.986344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Calling method '.version_select at 0x7f196a4d0550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:16.992920 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:16.992920 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:16.996988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:16.997386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.065421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:17.066121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.091897 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d658c165-8cf0-410b-bd9a-8d4d5b1f7b89 tempest-HypervisorAdminUnderV252Test-1430914066 tempest-HypervisorAdminUnderV252Test-1430914066-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-845775-3/search" status: 200 len: 104 microversion: 2.1 time: 0.124668 Jul 25 20:02:17.098559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 58/156] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Jul 25 20:02:16 2022] GET /compute/v2.1/os-hypervisors/n-h1-845775-3/search => generated 104 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:17.146708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:17.147338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:17.183130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:17.183777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.184631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:17.185076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.590611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=8,nova_api:UPDATE=9,nova_api:INSERT=9 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:17.823456 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25781ce4-9267-41ad-9e8a-42fcc38fc38c tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.126677 Jul 25 20:02:17.824178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 99/157] 10.222.0.48 () {60 vars in 1206 bytes} [Mon Jul 25 20:02:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:17.828543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Calling method '.version_select at 0x7f196a2e05e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:17.831093 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:17.831093 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:17.845612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:17.846545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.905118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:17.910833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:17.973301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62ff346d-8996-494c-a960-a030ec63ee89 tempest-HypervisorAdminV253TestBase-1407111252 tempest-HypervisorAdminV253TestBase-1407111252-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/a0221bfe-d88c-45f1-bc6d-b34da4c7e458" status: 200 len: 792 microversion: 2.53 time: 0.148119 Jul 25 20:02:17.984634 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 100/158] 10.222.0.48 () {60 vars in 1298 bytes} [Mon Jul 25 20:02:17 2022] GET /compute/v2.1/os-hypervisors/a0221bfe-d88c-45f1-bc6d-b34da4c7e458 => generated 792 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:18.028794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:18.040773 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0935e0a-701c-4c25-93b1-cc3372e38791 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.911718 Jul 25 20:02:18.041652 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 59/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:17 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:18.911648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b602c35e-126e-461b-9e6b-add4af74fc8f req-f7cdd75a-a04a-43a0-a72e-530d448298d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4796f258-b5a8-4d85-a51d-3466062cccce", "name": "network-vif-plugged", "status": "completed", "tag": "c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:18.913474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0d17eb72-9145-4a93-b4ff-e5da4f61d7d4 req-9310ff3b-eb89-436a-b4a9-19c7f90bb72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dd400a-e875-406a-8b5b-d4ae8ae991f8", "tag": "1305f8d5-e25e-43cd-9793-0a0322f26540"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:18.945078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b602c35e-126e-461b-9e6b-add4af74fc8f req-f7cdd75a-a04a-43a0-a72e-530d448298d0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:18.949584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b602c35e-126e-461b-9e6b-add4af74fc8f req-f7cdd75a-a04a-43a0-a72e-530d448298d0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:18.962530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0d17eb72-9145-4a93-b4ff-e5da4f61d7d4 req-9310ff3b-eb89-436a-b4a9-19c7f90bb72e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:18.971210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0d17eb72-9145-4a93-b4ff-e5da4f61d7d4 req-9310ff3b-eb89-436a-b4a9-19c7f90bb72e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.005118 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b602c35e-126e-461b-9e6b-add4af74fc8f req-f7cdd75a-a04a-43a0-a72e-530d448298d0 service nova] Creating event network-vif-plugged:c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c for instance 4796f258-b5a8-4d85-a51d-3466062cccce on n-h1-845775-3 Jul 25 20:02:19.026479 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b602c35e-126e-461b-9e6b-add4af74fc8f req-f7cdd75a-a04a-43a0-a72e-530d448298d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049087 Jul 25 20:02:19.035243 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 101/160] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:19.052830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0d17eb72-9145-4a93-b4ff-e5da4f61d7d4 req-9310ff3b-eb89-436a-b4a9-19c7f90bb72e service nova] Creating event network-changed:1305f8d5-e25e-43cd-9793-0a0322f26540 for instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 on n-h2-845775-3 Jul 25 20:02:19.053905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c49c2449-d884-4440-afc8-1759774ef97d tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] Calling method '.version_select at 0x7f196a296550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:19.055073 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:19.055073 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:19.055947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0d17eb72-9145-4a93-b4ff-e5da4f61d7d4 req-9310ff3b-eb89-436a-b4a9-19c7f90bb72e service nova] Acquired lock "compute-rpcapi-router" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:02:19.058371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328e301d-2533-490c-9757-def28d6deaae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.062847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328e301d-2533-490c-9757-def28d6deaae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.065186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328e301d-2533-490c-9757-def28d6deaae None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.065637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328e301d-2533-490c-9757-def28d6deaae None None] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.109143 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c49c2449-d884-4440-afc8-1759774ef97d tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.072457 Jul 25 20:02:19.124057 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.rpcapi [None req-328e301d-2533-490c-9757-def28d6deaae None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 20:02:19.125003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328e301d-2533-490c-9757-def28d6deaae None None] Releasing lock "compute-rpcapi-router" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:02:19.125743 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 102/161] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:02:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:19.141441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:19.142229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:19.161990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.162448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.166903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.168150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.186215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-328e301d-2533-490c-9757-def28d6deaae None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.140999 Jul 25 20:02:19.188168 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 60/162] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:19.210342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:19.212162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:19.248497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.249871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.256748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:19.258538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:19.745463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:19.758691 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-112c173a-a52a-462d-a36b-c16d80423b04 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.630926 Jul 25 20:02:19.777133 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 103/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:19 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:19.791467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0eb095f-366e-4684-9f02-cae2c265aae2 tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] Action: 'update', calling method: .version_select at 0x7f196a28bdc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:19.806906 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:19.806906 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:20.033293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0eb095f-366e-4684-9f02-cae2c265aae2 tempest-QuotaClassesAdminTestJSON-1114226733 tempest-QuotaClassesAdminTestJSON-1114226733-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.254299 Jul 25 20:02:20.034217 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 104/164] 10.222.0.48 () {60 vars in 1206 bytes} [Mon Jul 25 20:02:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:20.353691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:20.365858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99360556-c692-4d49-80c5-a7d65d2c9d66 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 1.174389 Jul 25 20:02:20.380302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 61/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:19 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:20.807608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:20.808624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:20.833533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:20.834983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:20.836931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:20.837539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:21.284462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:21.294643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:21.310698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f36dd13f-d4c5-4e32-b101-ba3b0ca8f34c tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.521104 Jul 25 20:02:21.312337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 105/166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:20 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:21.395185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:21.395758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:21.409514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:21.410314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:21.411470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:21.412510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:22.057903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:22.067344 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07bd970f-f431-42a6-8c24-de899856ad76 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.676280 Jul 25 20:02:22.081825 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 62/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:21 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:22.355351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:22.356677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:22.366483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:22.367203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:22.368800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:22.369478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:22.999852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:23.026804 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a653fb64-1732-4f3f-8c98-7305d4b0682d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1338 microversion: 2.1 time: 0.688274 Jul 25 20:02:23.029581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 106/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:22 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1338 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:23.093708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:23.096140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:23.103856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:23.106147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:23.108247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:23.109000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:23.448702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:23.464674 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7d35e92-4301-41cc-82d2-35b527d65289 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.376220 Jul 25 20:02:23.481725 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 63/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:23 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:24.051164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:24.052454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:24.059259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.060122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.061077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.061663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.503157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:24.503938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:24.506642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:24.516136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.518511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.520601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.522934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.524463 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afa0e356-4517-4aea-a176-eae6de336d21 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1488 microversion: 2.1 time: 0.476562 Jul 25 20:02:24.549630 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 107/170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:24 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1488 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:24.557189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:24.557820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:24.575926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.576429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.577226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:24.577661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:24.921681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:24.933122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d9c8f59-00a3-47cd-b281-59730ede4a83 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.435310 Jul 25 20:02:24.939474 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 64/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:24 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:25.277419 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef971487-d3d4-4488-87dd-b8fcb82196cb tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1639 microversion: 2.1 time: 0.721616 Jul 25 20:02:25.280506 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 108/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:24 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1639 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:25.323344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:25.324214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:25.335229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.336626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.338371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.339339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.391909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:02:25.571634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:25.652480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-346b85cd-6c90-4fb8-9488-7f685d9f188d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 204 len: 0 microversion: 2.1 time: 0.337116 Jul 25 20:02:25.659376 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 65/173] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:02:25 2022] DELETE /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:02:25.668091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:25.669490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:25.686633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.688589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.692351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.693762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.961738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:25.963170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:25.977835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.979278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.980307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:25.982588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:25.995956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:26.020547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b80dcb4f-c4ba-44ed-af8d-eed8b1b3aedf tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1494 microversion: 2.1 time: 0.358935 Jul 25 20:02:26.056876 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 109/174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:25 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1494 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:26.464655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:26.476356 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f456909e-c8c7-48ba-b7a8-8ffda34b8c31 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.518402 Jul 25 20:02:26.477597 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 66/175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:25 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:26.839056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-637b9be7-09ef-486a-a674-5c566ea3a4ab tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:26.845532 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:26.845532 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:26.851961 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-637b9be7-09ef-486a-a674-5c566ea3a4ab tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-637b9be7-09ef-486a-a674-5c566ea3a4ab tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin] Request method failure captured: Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbSjk4s9ZYRJwg3VLwZjBubvKjbh1koUaPe37mjdFebkq-9bAVSWWaCw6f9il_MavtmVcMtlPFOMWOXVnderS9s-5KK6QyFMI-wmSThi663PIiTJeUp69iq4XpeGPYSm2_7DI6a9-j_xVWmc8o3W857PO87LFLJNt5fv7-848cnq8c Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6b8fa67d02ab434f82513373e2df54bb Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:26.857895 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b8fa67d02ab434f82513373e2df54bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b8fa67d02ab434f82513373e2df54bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b8fa67d02ab434f82513373e2df54bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b8fa67d02ab434f82513373e2df54bb"}]}] Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6b8fa67d02ab434f82513373e2df54bb Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 48698a494f3649148d9a9d861c54c45a Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid timestamp for date invalid_time Jul 25 20:02:26.859424 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'invalid_time'} Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:26.860232 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 25 20:02:26.861990 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:26.864602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-637b9be7-09ef-486a-a674-5c566ea3a4ab tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:26.865957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-637b9be7-09ef-486a-a674-5c566ea3a4ab tempest-InstanceUsageAuditLogNegativeTestJSON-523242046 tempest-InstanceUsageAuditLogNegativeTestJSON-523242046-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.561060 Jul 25 20:02:26.866984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 110/176] 10.222.0.48 () {58 vars in 1224 bytes} [Mon Jul 25 20:02:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 563 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:02:27.061049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:27.062104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:27.083843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:27.086470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:27.089715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:27.090910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:27.543879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:27.560732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95583d50-302c-4f26-91da-0cf67c7cf3ff tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1494 microversion: 2.1 time: 0.503539 Jul 25 20:02:27.566220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 111/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:27 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1494 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:27.574284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:27.583241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:27.601864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:27.611402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:27.612508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:27.613096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:27.780281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06c51a73-a56b-4719-a96e-77c6a24af6e7 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:27.781557 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:27.781557 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:27.783447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06c51a73-a56b-4719-a96e-77c6a24af6e7 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '4216aa382e534397a839aed25541572f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c834906ae2474f0e84bd6237b66df9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06c51a73-a56b-4719-a96e-77c6a24af6e7 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Request method failure captured: Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbQMy86Cs_BvVDE-y081If6YBt3HNy-vFnF1fKyal2c9z1P0iSKPpuJKvVXTvsIpR5FVz1JTWDJTaJpLztakfctDc7Mn0uANUXI69Rop95hJ2RwbtLer5IBa885REaIJfRZkYR44p3iJto8RitN7f2yXnmAZRcTcSwxMmf7Z7ymMT4 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c834906ae2474f0e84bd6237b66df9bc Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:27.785382 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c834906ae2474f0e84bd6237b66df9bc"}]}] Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c834906ae2474f0e84bd6237b66df9bc Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 4216aa382e534397a839aed25541572f Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:27.787626 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:27.789269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.791935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06c51a73-a56b-4719-a96e-77c6a24af6e7 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:27.794842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-06c51a73-a56b-4719-a96e-77c6a24af6e7 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.912714 Jul 25 20:02:27.802002 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 67/178] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:02:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 929 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:27.821811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb341f83-45eb-48c6-8b4d-cf3194c84514 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:27.822659 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:27.822659 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:27.824362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eb341f83-45eb-48c6-8b4d-cf3194c84514 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '4216aa382e534397a839aed25541572f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c834906ae2474f0e84bd6237b66df9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb341f83-45eb-48c6-8b4d-cf3194c84514 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Request method failure captured: Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2020:02:27 HTTP/1.1 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbQMy86Cs_BvVDE-y081If6YBt3HNy-vFnF1fKyal2c9z1P0iSKPpuJKvVXTvsIpR5FVz1JTWDJTaJpLztakfctDc7Mn0uANUXI69Rop95hJ2RwbtLer5IBa885REaIJfRZkYR44p3iJto8RitN7f2yXnmAZRcTcSwxMmf7Z7ymMT4 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c834906ae2474f0e84bd6237b66df9bc Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:27.826030 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c834906ae2474f0e84bd6237b66df9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c834906ae2474f0e84bd6237b66df9bc"}]}] Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c834906ae2474f0e84bd6237b66df9bc Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 4216aa382e534397a839aed25541572f Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:27.827268 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2022-07-25 20:02:27'} Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:27.827899 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 25 20:02:27.829965 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:27.834252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb341f83-45eb-48c6-8b4d-cf3194c84514 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:27.835225 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb341f83-45eb-48c6-8b4d-cf3194c84514 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151 tempest-InstanceUsageAuditLogNegativeTestJSON-568273151-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 20:02:27" status: 403 len: 128 microversion: 2.1 time: 0.032161 Jul 25 20:02:27.835796 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 68/179] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:02:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2020%3A02%3A27 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:28.593217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:28.593826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:28.603725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:28.604278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:28.605021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:28.616346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:28.620198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:28.638075 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95dec0c9-11a9-4098-b65f-619babebf0f4 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 1.069806 Jul 25 20:02:28.639161 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 112/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:27 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:29.070065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd6e4cba0a6468ab69836bb0db43fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f73f6e3e8e7b4a00b681dee79f6622ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:29.085423 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89978583-8c95-4092-ab8b-79741e01b4e5 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 200 len: 1494 microversion: 2.1 time: 0.498143 Jul 25 20:02:29.100073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 69/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:28 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 1494 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:29.365216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d84e794c-366e-4d7a-8fa7-3cec19e35a4a tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1017053308", "ram": 512, "vcpus": 1, "disk": 10, "id": 1739026296, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:29.370824 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:29.370824 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:29.415709 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d84e794c-366e-4d7a-8fa7-3cec19e35a4a tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.565545 Jul 25 20:02:29.418381 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 113/182] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:28 2022] POST /compute/v2.1/flavors => generated 416 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:29.441855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ace8205-2dc8-4864-99cb-44d1a52980c6 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:29.448014 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:29.448014 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:29.460937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:29.553732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ace8205-2dc8-4864-99cb-44d1a52980c6 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123112 Jul 25 20:02:29.557290 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 70/183] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:29 2022] POST /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:29.637941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-002c988d-225c-4a6c-b5b2-1b30b9eb4bdb req-45437671-c0cd-4cbb-89e6-8112c8794e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4796f258-b5a8-4d85-a51d-3466062cccce", "name": "network-vif-deleted", "tag": "c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:29.681447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-002c988d-225c-4a6c-b5b2-1b30b9eb4bdb req-45437671-c0cd-4cbb-89e6-8112c8794e38 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:29.683008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-002c988d-225c-4a6c-b5b2-1b30b9eb4bdb req-45437671-c0cd-4cbb-89e6-8112c8794e38 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:29.741519 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-002c988d-225c-4a6c-b5b2-1b30b9eb4bdb req-45437671-c0cd-4cbb-89e6-8112c8794e38 service nova] Creating event network-vif-deleted:c753dee2-6e1e-4b70-af8e-bb4a2ff91c5c for instance 4796f258-b5a8-4d85-a51d-3466062cccce on n-h1-845775-3 Jul 25 20:02:29.759725 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-002c988d-225c-4a6c-b5b2-1b30b9eb4bdb req-45437671-c0cd-4cbb-89e6-8112c8794e38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127869 Jul 25 20:02:29.763231 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 71/184] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:29.783897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:29.784666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:29.815853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:29.816376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:29.817260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:29.817707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:30.032138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:30.253884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e76f95b5-3a28-4d5a-861e-af6494aa28f3 tempest-FlavorsExtraSpecsTestJSON-800570118 tempest-FlavorsExtraSpecsTestJSON-800570118-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:30.282258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e76f95b5-3a28-4d5a-861e-af6494aa28f3 tempest-FlavorsExtraSpecsTestJSON-800570118 tempest-FlavorsExtraSpecsTestJSON-800570118-project] 10.222.0.48 "GET /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.715698 Jul 25 20:02:30.283361 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 114/185] 10.222.0.48 () {58 vars in 1203 bytes} [Mon Jul 25 20:02:29 2022] GET /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:30.652951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9909860-6cf4-49b3-a4cd-a82f7d263dcd tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] Action: 'create', calling method: .version_select at 0x7f196a20af70>, body: {"security_group": {"name": "tempest-securitygroup-1891980567", "description": "tempest-description-660526670"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:30.838320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:30.849597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-373442c5-c041-4ebf-b057-1782b781d8f8 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 1.085105 Jul 25 20:02:30.850457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 72/186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:29 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:30.878538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:30.889172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:30.915885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:30.918227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:30.920600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:30.923373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:30.965639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] HTTP exception thrown: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Request method failure captured: Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce HTTP/1.1 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiKfZSFqJF63bViY88G3A1AVGqhmFzd7zV0jgxpiY9_-w97NWrHesrNP98sVDa38FKSYXBWmfFKvG_fxPUp3Tn3fhRCIr6_zpyedr1ba4PgrmMY7J6SBMaRDDben-pi7CcpnKO0K4Sm1TeluFSw6MgRYqetcObYXl2YN_9HQJ-HL0 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:30.976237 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}] Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 0bd6e4cba0a6468ab69836bb0db43fea Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:30.977715 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4796f258-b5a8-4d85-a51d-3466062cccce'} Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:30.978955 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:30.980814 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:30.982722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Returning 404 to user: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:30.983764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-728a9098-aedf-466c-b51e-b012f470d66d tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 404 len: 111 microversion: 2.1 time: 0.132237 Jul 25 20:02:30.984562 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 73/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:30 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:30.994064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4eca2dd1-da5f-45a4-88f7-997c6263bb83 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.010349 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.010349 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.064783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4eca2dd1-da5f-45a4-88f7-997c6263bb83 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.078582 Jul 25 20:02:31.066646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 74/188] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:30 2022] POST /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:31.080203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69d96cdd-13f3-42d2-9d32-8540ce6f2e7b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.087285 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.087285 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.121262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69d96cdd-13f3-42d2-9d32-8540ce6f2e7b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:31.122073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69d96cdd-13f3-42d2-9d32-8540ce6f2e7b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:31.417469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9909860-6cf4-49b3-a4cd-a82f7d263dcd tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.132410 Jul 25 20:02:31.419749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 115/189] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:02:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:31.437275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-842368db-0b8a-4397-9258-79103101d7ae tempest-FlavorsExtraSpecsTestJSON-800570118 tempest-FlavorsExtraSpecsTestJSON-800570118-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:31.491112 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-842368db-0b8a-4397-9258-79103101d7ae tempest-FlavorsExtraSpecsTestJSON-800570118 tempest-FlavorsExtraSpecsTestJSON-800570118-project] 10.222.0.48 "GET /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.069417 Jul 25 20:02:31.500270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 116/190] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:02:31 2022] GET /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:31.510370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b33c2f2a-7055-481d-bbe9-ebda0fedcd31 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] Action: 'create', calling method: .version_select at 0x7f196a20a550>, body: {"security_group": {"name": "tempest-securitygroup-808044599", "description": "tempest-description-296710527"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.567828 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69d96cdd-13f3-42d2-9d32-8540ce6f2e7b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.496900 Jul 25 20:02:31.569615 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 75/191] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:31.587996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-406f1e0f-a479-4ce3-b8fc-9aa096218cb5 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.597179 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.597179 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.680131 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-406f1e0f-a479-4ce3-b8fc-9aa096218cb5 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106612 Jul 25 20:02:31.693606 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 76/192] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:31 2022] POST /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:31.711636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59afe333-1347-4550-a5d0-4ceb7a5d8547 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:31.716554 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.716554 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.769669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59afe333-1347-4550-a5d0-4ceb7a5d8547 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.073448 Jul 25 20:02:31.772983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 77/193] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:31.792458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99a43802-5c74-4f68-b232-e3d86151a8b4 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:31.825785 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99a43802-5c74-4f68-b232-e3d86151a8b4 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045843 Jul 25 20:02:31.826884 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 78/194] 10.222.0.48 () {58 vars in 1203 bytes} [Mon Jul 25 20:02:31 2022] GET /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:31.851330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd974e4c-63c3-49f7-8169-8b39eb2a4266 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-910760296"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.856331 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.856331 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.858654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-bd974e4c-63c3-49f7-8169-8b39eb2a4266 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid f70477c6-6011-4173-9c54-89cf396ec904 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:31.891153 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd974e4c-63c3-49f7-8169-8b39eb2a4266 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062126 Jul 25 20:02:31.893767 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 79/195] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:31.902073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37c14ded-bd72-441a-83bd-986212d0dc2f tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:31.906629 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:31.906629 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:31.939241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:SAVEPOINT=7,nova_api:INSERT=3,nova_api:RELEASE=7,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:31.994626 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37c14ded-bd72-441a-83bd-986212d0dc2f tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.097095 Jul 25 20:02:31.996068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 80/196] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Jul 25 20:02:31 2022] PUT /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes => generated 22 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:32.006739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:32.012832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:32.035030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:32.036012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.038412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:32.039517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.260517 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b33c2f2a-7055-481d-bbe9-ebda0fedcd31 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.757497 Jul 25 20:02:32.261413 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 117/197] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:02:31 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:32.266545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f7e67e1-a0f4-467b-ba24-3af163fcde42 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:32.271624 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:32.271624 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:32.301996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7e67e1-a0f4-467b-ba24-3af163fcde42 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:32.305118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7e67e1-a0f4-467b-ba24-3af163fcde42 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.488863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:32.500465 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91d88419-c6a0-4632-aa4f-cedf94d5f4c5 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.503039 Jul 25 20:02:32.518318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 81/198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:31 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:32.523881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-88fab170-253a-46c5-9f9c-4d8656452c13 req-0670c7b3-baae-4039-8311-5727d1ce8069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd400a-e875-406a-8b5b-d4ae8ae991f8", "name": "network-vif-plugged", "status": "completed", "tag": "1305f8d5-e25e-43cd-9793-0a0322f26540"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:32.538519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-88fab170-253a-46c5-9f9c-4d8656452c13 req-0670c7b3-baae-4039-8311-5727d1ce8069 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:32.539220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-88fab170-253a-46c5-9f9c-4d8656452c13 req-0670c7b3-baae-4039-8311-5727d1ce8069 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:32.564623 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-88fab170-253a-46c5-9f9c-4d8656452c13 req-0670c7b3-baae-4039-8311-5727d1ce8069 service nova] Creating event network-vif-plugged:1305f8d5-e25e-43cd-9793-0a0322f26540 for instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 on n-h2-845775-3 Jul 25 20:02:32.572750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-88fab170-253a-46c5-9f9c-4d8656452c13 req-0670c7b3-baae-4039-8311-5727d1ce8069 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052471 Jul 25 20:02:32.574417 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 82/199] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:32.582521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00d9a40f-9d44-49d6-92f7-5784c832b324 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:32.604659 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00d9a40f-9d44-49d6-92f7-5784c832b324 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028494 Jul 25 20:02:32.614912 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 83/200] 10.222.0.48 () {58 vars in 1203 bytes} [Mon Jul 25 20:02:32 2022] GET /compute/v2.1/flavors/1739026296/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:33.214253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd2873f1-7fe4-475f-a936-269f8714b603 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] Action: 'create', calling method: .version_select at 0x7f196a4d0d30>, body: {"security_group": {"name": "tempest-securitygroup-1031811035", "description": "tempest-description-737128784"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:33.685963 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f7e67e1-a0f4-467b-ba24-3af163fcde42 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 1.423159 Jul 25 20:02:33.686969 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 118/201] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:33.701680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ac4ed83-fa36-49ba-976e-41bfb60533aa tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:33.702662 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:33.702662 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:33.754218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ac4ed83-fa36-49ba-976e-41bfb60533aa tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.065556 Jul 25 20:02:33.755503 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 119/202] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:02:33 2022] DELETE /compute/v2.1/flavors/1739026296/os-extra_specs/hw:numa_nodes => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:33.763501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:33.765692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:33.779151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:33.780366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:33.783220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:33.784331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:34.346493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:34.382321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b38c7a44-f055-4617-93b4-ecd80de935e0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.624547 Jul 25 20:02:34.387781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 120/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:33 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:34.402371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b904019-b22e-4b4d-914b-6265b390a783 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:34.403465 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:34.403465 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:34.427892 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b904019-b22e-4b4d-914b-6265b390a783 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.035061 Jul 25 20:02:34.430994 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 121/204] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:02:34 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:34.443189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47cc022e-d6c3-412f-9b2e-117c8450087c tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:34.444463 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:34.444463 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:34.505972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-47cc022e-d6c3-412f-9b2e-117c8450087c tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1739026296/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.073267 Jul 25 20:02:34.509327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 122/205] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:02:34 2022] DELETE /compute/v2.1/flavors/1739026296/os-extra_specs/hw:cpu_policy => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:34.524380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5314dc0b-f567-4182-b980-bebf5e5e572b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:34.532699 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:34.532699 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:34.547237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:UPDATE=15,nova_api:SELECT=76,nova_api:INSERT=5,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:34.573237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5314dc0b-f567-4182-b980-bebf5e5e572b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:34.573710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5314dc0b-f567-4182-b980-bebf5e5e572b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:34.921601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5314dc0b-f567-4182-b980-bebf5e5e572b tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.406508 Jul 25 20:02:34.928011 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 123/206] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:34 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:34.952242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b49fcb4-beed-43e1-bbc8-c118a0b622bd tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:34.985448 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b49fcb4-beed-43e1-bbc8-c118a0b622bd tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1739026296/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055689 Jul 25 20:02:34.989412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 124/207] 10.222.0.48 () {58 vars in 1203 bytes} [Mon Jul 25 20:02:34 2022] GET /compute/v2.1/flavors/1739026296/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:35.008107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1676e6d1-c1db-4724-a6c7-0ac82ddd9dd7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:35.009538 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:35.009538 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:35.057213 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1676e6d1-c1db-4724-a6c7-0ac82ddd9dd7 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062319 Jul 25 20:02:35.058796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 125/208] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:34 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:35.064508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b125a20b-bd91-4d7b-952d-04694446c30f tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:35.065568 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:35.065568 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:35.097987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b125a20b-bd91-4d7b-952d-04694446c30f tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1739026296" status: 202 len: 0 microversion: 2.1 time: 0.037407 Jul 25 20:02:35.100012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 126/209] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:02:35 2022] DELETE /compute/v2.1/flavors/1739026296 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:35.115556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18b1133d-9429-4bfa-bfa1-46212e498291 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-735023279"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:35.123462 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:35.123462 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:35.127232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-18b1133d-9429-4bfa-bfa1-46212e498291 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid 48be5c96-c17c-4e0b-8bfa-5d3edb7800fe for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:35.156527 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd2873f1-7fe4-475f-a936-269f8714b603 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.538657 Jul 25 20:02:35.159891 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 84/210] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:02:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:35.173455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7a2c2f0-b55f-4a0d-ba8b-4365d9ea9727 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:35.186850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18b1133d-9429-4bfa-bfa1-46212e498291 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083927 Jul 25 20:02:35.190464 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 127/211] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:35.205556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71f50312-f654-4771-8c76-b691d787c28d tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] Action: 'create', calling method: .version_select at 0x7f196a2965e0>, body: {"security_group": {"name": "tempest-securitygroup-759659643", "description": "tempest-description-1415868461"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:35.230185 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7a2c2f0-b55f-4a0d-ba8b-4365d9ea9727 tempest-FlavorsExtraSpecsTestJSON-683195573 tempest-FlavorsExtraSpecsTestJSON-683195573-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067417 Jul 25 20:02:35.230889 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 85/212] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:35.238733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-720a1f9f-b2b5-4989-9e69-8f1134a5f3fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:35.242101 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:35.242101 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:35.257248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-720a1f9f-b2b5-4989-9e69-8f1134a5f3fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:35.257895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-720a1f9f-b2b5-4989-9e69-8f1134a5f3fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:35.584723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-720a1f9f-b2b5-4989-9e69-8f1134a5f3fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.351932 Jul 25 20:02:35.585563 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 86/213] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:35 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:35.597766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:35.597766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:35.623277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:35.624147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:35.625652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:35.634463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:36.193922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:36.216062 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-741beddd-cf41-43df-bdc8-c89784522918 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1319 microversion: 2.1 time: 0.628927 Jul 25 20:02:36.217553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 87/214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:35 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1319 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:36.228125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d3858af-8647-478b-bed6-ee58e315cfee tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:36.238984 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:36.238984 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:36.267745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d3858af-8647-478b-bed6-ee58e315cfee tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.048773 Jul 25 20:02:36.268614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 88/215] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:02:36 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:36.310467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3ef2bbb-596e-498e-95c8-9c8afce16be1 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:36.321708 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:36.321708 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:36.383854 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71f50312-f654-4771-8c76-b691d787c28d tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.190681 Jul 25 20:02:36.393943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 128/216] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:02:35 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:36.406846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3ef2bbb-596e-498e-95c8-9c8afce16be1 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:36.411283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3ef2bbb-596e-498e-95c8-9c8afce16be1 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:36.427875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-de08d9ad-7d3a-46ff-8334-8b0b0f5587c9 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] Calling method '.version_select at 0x7f196a1f9ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:36.810493 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3ef2bbb-596e-498e-95c8-9c8afce16be1 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.527525 Jul 25 20:02:36.824274 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 89/217] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:36.832456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66f7b773-c2c0-4593-b263-33c723487189 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:36.834060 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:36.834060 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:36.890959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66f7b773-c2c0-4593-b263-33c723487189 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.063898 Jul 25 20:02:36.893749 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 90/218] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:36 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:36.916662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6f0dd0b-787a-467d-845e-38fc0b37de4e tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1162661864"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:36.929078 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:36.929078 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:36.931302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-d6f0dd0b-787a-467d-845e-38fc0b37de4e tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid 4f5a48b3-ad63-4f8c-bfd8-f9a0226e8124 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:36.998193 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6f0dd0b-787a-467d-845e-38fc0b37de4e tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092417 Jul 25 20:02:37.001114 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 91/219] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:02:37.030026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8587ff6-888b-4467-bfab-4b60ecf31577 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:37.036548 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:37.036548 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:37.059083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8587ff6-888b-4467-bfab-4b60ecf31577 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:37.060838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8587ff6-888b-4467-bfab-4b60ecf31577 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:37.471588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8587ff6-888b-4467-bfab-4b60ecf31577 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.455368 Jul 25 20:02:37.473785 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 92/220] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:37 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:37.499589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:37.503913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:37.517156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:37.520382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:37.522305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:37.523355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:38.124268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:38.141157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-832fa7ed-b813-4ae1-8276-806ae3f99521 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1469 microversion: 2.1 time: 0.665831 Jul 25 20:02:38.141804 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 93/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:37 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:38.167931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0093877-a0dc-44c0-ae4b-7908afb51c22 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:38.176762 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:38.176762 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:38.189188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0093877-a0dc-44c0-ae4b-7908afb51c22 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:38.189919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0093877-a0dc-44c0-ae4b-7908afb51c22 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:38.463998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0093877-a0dc-44c0-ae4b-7908afb51c22 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.320153 Jul 25 20:02:38.467803 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 94/222] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:38 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:39.251916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:39.253018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:39.264012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:39.265185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:39.267035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:39.267501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:39.419885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:02:39.607833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d061a229-570c-4477-b2e9-fb755896e946 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 204 len: 0 microversion: 2.1 time: 1.138129 Jul 25 20:02:39.609063 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 95/223] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:02:38 2022] DELETE /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 0 bytes in 1141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:02:40.012386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1151545030", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:40.183579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:02:40.915160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:02:40.916132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:02:40.916274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:02:40.916775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:02:40.917380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:02:40.947978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.948693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.953271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:40.953849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:40.990401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Getting quotas for project 5cc2511a5f074cc2a2202824e562a706. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:02:41.001595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Getting quotas for user 379a83cc54324c8abbf35a120ffde95c and project 5cc2511a5f074cc2a2202824e562a706. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:02:41.027823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-de08d9ad-7d3a-46ff-8334-8b0b0f5587c9 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7002 microversion: 2.1 time: 4.625405 Jul 25 20:02:41.029241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 129/224] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Jul 25 20:02:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7002 bytes in 4628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:41.039279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4527bc79-1509-4b83-a2d6-6d261dd4b9ed tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:41.040921 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:41.040921 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:41.063926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:02:41.068682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:02:41.101059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4527bc79-1509-4b83-a2d6-6d261dd4b9ed tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.070288 Jul 25 20:02:41.102383 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 130/225] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:41 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:41.112308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:41.114140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:41.137226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:41.139108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:41.152230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:41.153206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:41.169581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff7530f7-2166-4e37-b8df-d2cb48f02ae2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557732 Jul 25 20:02:41.171297 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 96/226] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:02:41.622839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:41.654454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9483dcb-2233-47a3-8a60-ae7daf806677 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1475 microversion: 2.1 time: 0.543596 Jul 25 20:02:41.654454 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 131/227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:41 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1475 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:41.679879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-935159f6-d9c9-499d-af85-9d75b97e60f4 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] Calling method '.version_select at 0x7f196a28b4c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.082248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3cbc65f0-340d-481d-8387-919d72237e00 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] Calling method '.version_select at 0x7f196a49d1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.083871 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.083871 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:42.131649 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3cbc65f0-340d-481d-8387-919d72237e00 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.952130 Jul 25 20:02:42.133757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 97/228] 10.222.0.48 () {60 vars in 1226 bytes} [Mon Jul 25 20:02:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:42.159319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4782912-3420-4bcc-bf2b-9c10e1550e32 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1767071060"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:42.163014 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.163014 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:42.181561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-f4782912-3420-4bcc-bf2b-9c10e1550e32 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid ead681e2-3c1a-4dab-ba01-04f568d37a6c for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:42.241080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4782912-3420-4bcc-bf2b-9c10e1550e32 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.105122 Jul 25 20:02:42.242464 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 98/229] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:42.252491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-21c5e5f2-6742-4496-b86c-8fca059edb7e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2056093016"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:42.262461 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.262461 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:42.270789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-21c5e5f2-6742-4496-b86c-8fca059edb7e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid 409a7710-c846-4b9b-9ec8-29e4c7418555 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:42.326490 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-21c5e5f2-6742-4496-b86c-8fca059edb7e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080500 Jul 25 20:02:42.342967 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 99/230] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:42.358681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-75373f37-a29f-4d7b-927c-51e0d0faa521 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.363813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-75373f37-a29f-4d7b-927c-51e0d0faa521 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:42.590316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-75373f37-a29f-4d7b-927c-51e0d0faa521 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:42.623781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-75373f37-a29f-4d7b-927c-51e0d0faa521 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1222 microversion: 2.1 time: 0.278585 Jul 25 20:02:42.640698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-935159f6-d9c9-499d-af85-9d75b97e60f4 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.988616 Jul 25 20:02:42.641993 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 100/231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:42 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1222 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:42.643115 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 132/232] 10.222.0.48 () {58 vars in 1191 bytes} [Mon Jul 25 20:02:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:42.648834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c0e25ee-d039-4ea5-95f4-b9ba634858fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:42.650866 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.650866 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:42.659791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3328e017-a490-4156-8b3d-36c24a3bb3f1 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] Action: 'update', calling method: .version_select at 0x7f196a463040>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:42.664854 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.664854 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:42.705184 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c0e25ee-d039-4ea5-95f4-b9ba634858fe tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.059827 Jul 25 20:02:42.708657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 133/233] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:42 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:42.730928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SAVEPOINT=1,nova_api:UPDATE=3,nova_api:RELEASE=1,nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:42.740447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d67652c6-1345-4772-bf0c-9e5d1da41952 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:42.746222 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:42.746222 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:42.763940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d67652c6-1345-4772-bf0c-9e5d1da41952 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:42.765679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d67652c6-1345-4772-bf0c-9e5d1da41952 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:42.991115 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d67652c6-1345-4772-bf0c-9e5d1da41952 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.280204 Jul 25 20:02:42.992017 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 134/234] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:42 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:43.015021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f974a028-4ebe-42fc-9b42-7e49ee45003e tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] Calling method '.version_select at 0x7f196a28bdc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:43.101361 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3328e017-a490-4156-8b3d-36c24a3bb3f1 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.453159 Jul 25 20:02:43.104514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 101/235] 10.222.0.48 () {62 vars in 1247 bytes} [Mon Jul 25 20:02:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:43.114010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:43.114637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:43.145615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:43.146060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:43.147465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:43.148786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:43.640928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:43.660631 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6054d29d-6821-44ca-b830-7d3e076e98ec tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 200 len: 1433 microversion: 2.1 time: 0.554165 Jul 25 20:02:43.661899 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 102/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:43 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 1433 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:43.667873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18115c18-7559-4ad6-b34e-2c22956a7773 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:43.669155 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:43.669155 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:43.682915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-18115c18-7559-4ad6-b34e-2c22956a7773 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18115c18-7559-4ad6-b34e-2c22956a7773 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Request method failure captured: Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak52QfVZCpHbMCAsreCGtAjb9O0R0nQgbHmztEadF-GMpxJwKIZrykJbI40GcTgMo9ETwNvw9jj_4tIcRlZB5zBWenMD8UpSfLfr3RXLYQ2lpWsgy6ryK0aFMajLctOZeTa22Fw5NJpat6L2CmCtj3vZ6JSWdVdDy5umH4QJ_ly1c Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:43.691926 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}] Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8cf710b0f9d34757a1ad6c32aace03bb Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: exception: Aggregate 6 could not be found. Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6'} Jul 25 20:02:43.693486 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.694344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 25 20:02:43.695642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.699759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18115c18-7559-4ad6-b34e-2c22956a7773 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:43.708940 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18115c18-7559-4ad6-b34e-2c22956a7773 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.045405 Jul 25 20:02:43.715541 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 103/237] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:02:43 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:43.729252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:43.732726 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:43.732726 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:43.768019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:43.776846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:43.823930 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-845775-3. Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 39 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:43.867138 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: {"add_host": {"host": "n-h1-845775-3"}} Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:43.869961 n-d-845775-3 devstack@n-api.service[119724]: exception: Aggregate 7 already has host n-h1-845775-3. Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-845775-3'}}} Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:02:43.871452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-845775-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 20:02:43.873764 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 20:02:43.881727 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:02:43.887724 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-845775-3-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 20, 2, 43, 807404), 'updated_at': None, 'host': 'n-h1-845775-3', 'aggregate_id': 7}] Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.896820 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-845775-3. Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.900990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-845775-3. Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:43.906265 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:43.911235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-845775-3. Jul 25 20:02:43.911235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:43.911235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-845775-3. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:43.911235 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-457df58d-b017-4d48-b2e8-355b8475c5e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.190356 Jul 25 20:02:43.917367 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 104/238] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:43 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 25 20:02:43.930028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-872cd86b-11f0-4bfe-aa94-a8cb7814826c tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] Calling method '.version_select at 0x7f196a0dd3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:43.933131 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:43.933131 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:43.968456 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-872cd86b-11f0-4bfe-aa94-a8cb7814826c tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.049658 Jul 25 20:02:43.969047 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 105/239] 10.222.0.48 () {60 vars in 1226 bytes} [Mon Jul 25 20:02:43 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:43.990939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a780f484-de11-4689-bb2c-1fa77e7579a0 req-247050fe-273f-4b57-9bb9-e41454fe55c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dd400a-e875-406a-8b5b-d4ae8ae991f8", "name": "network-vif-deleted", "tag": "1305f8d5-e25e-43cd-9793-0a0322f26540"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:44.029155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a780f484-de11-4689-bb2c-1fa77e7579a0 req-247050fe-273f-4b57-9bb9-e41454fe55c1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.029898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a780f484-de11-4689-bb2c-1fa77e7579a0 req-247050fe-273f-4b57-9bb9-e41454fe55c1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.061846 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a780f484-de11-4689-bb2c-1fa77e7579a0 req-247050fe-273f-4b57-9bb9-e41454fe55c1 service nova] Creating event network-vif-deleted:1305f8d5-e25e-43cd-9793-0a0322f26540 for instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 on n-h2-845775-3 Jul 25 20:02:44.073447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a780f484-de11-4689-bb2c-1fa77e7579a0 req-247050fe-273f-4b57-9bb9-e41454fe55c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089608 Jul 25 20:02:44.075063 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 106/240] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:44.083363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:44.084550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:44.101515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.102188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.103508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.103972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.254402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f974a028-4ebe-42fc-9b42-7e49ee45003e tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/22bcd630-ec38-43b8-a99a-6b11d91c4fdd" status: 202 len: 0 microversion: 2.1 time: 1.260983 Jul 25 20:02:44.255297 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 135/241] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:02:42 2022] DELETE /compute/v2.1/os-security-groups/22bcd630-ec38-43b8-a99a-6b11d91c4fdd => generated 0 bytes in 1262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:44.265112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e69a4b77-3454-4c55-83f0-28cb5b8a002d tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:44.266514 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:44.266514 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:44.340178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e69a4b77-3454-4c55-83f0-28cb5b8a002d tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e69a4b77-3454-4c55-83f0-28cb5b8a002d tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Request method failure captured: Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vak52QfVZCpHbMCAsreCGtAjb9O0R0nQgbHmztEadF-GMpxJwKIZrykJbI40GcTgMo9ETwNvw9jj_4tIcRlZB5zBWenMD8UpSfLfr3RXLYQ2lpWsgy6ryK0aFMajLctOZeTa22Fw5NJpat6L2CmCtj3vZ6JSWdVdDy5umH4QJ_ly1c Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:44.348689 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}] Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8cf710b0f9d34757a1ad6c32aace03bb Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: exception: Aggregate 6 could not be found. Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '6'} Jul 25 20:02:44.350020 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:44.350752 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:44.351828 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e69a4b77-3454-4c55-83f0-28cb5b8a002d tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:44.354705 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e69a4b77-3454-4c55-83f0-28cb5b8a002d tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.093565 Jul 25 20:02:44.356850 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 136/242] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:44.372890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d67ded5-498e-4bca-a1bd-159b66cb1044 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:44.396077 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:44.396077 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:44.447018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d67ded5-498e-4bca-a1bd-159b66cb1044 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:44.449882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d67ded5-498e-4bca-a1bd-159b66cb1044 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:44.481786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:44.503496 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72b83917-ea3b-49bc-8490-b1ce181b128d tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1292 microversion: 2.1 time: 0.427027 Jul 25 20:02:44.516573 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 107/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:44 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:44.550150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-603336a8-1dee-4baa-a99f-5cdc7607fb67 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] Action: 'update', calling method: .version_select at 0x7f196a340790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:44.555533 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:44.555533 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:44.702192 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-603336a8-1dee-4baa-a99f-5cdc7607fb67 tempest-QuotaClassesAdmin257Test-1068530094 tempest-QuotaClassesAdmin257Test-1068530094-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.180301 Jul 25 20:02:44.703097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 108/244] 10.222.0.48 () {62 vars in 1247 bytes} [Mon Jul 25 20:02:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:02:44.806822 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d67ded5-498e-4bca-a1bd-159b66cb1044 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.448226 Jul 25 20:02:44.815634 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 137/245] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:44 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:44.827318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57a1b306-a1bd-4000-a440-77ff58220e84 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] Calling method '.version_select at 0x7f196a1c6d30>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:45.029097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ebf3dbc0-3277-4548-b047-b815838f2fff tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1355584783", "ram": 512, "vcpus": 1, "disk": 10, "id": 1612773280, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:45.034782 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:45.034782 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:45.069906 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ebf3dbc0-3277-4548-b047-b815838f2fff tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.363858 Jul 25 20:02:45.070981 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 109/246] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:44 2022] POST /compute/v2.1/flavors => generated 416 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:45.095806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36f2d134-52e6-4415-8fa2-2b04494b9c38 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-621700048", "name": "tempest-test_aggregate-830278875"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:45.100349 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:45.100349 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:45.102051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-36f2d134-52e6-4415-8fa2-2b04494b9c38 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid 692c5f3d-d34a-4c38-8392-4162d2bc4fc1 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:45.210556 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36f2d134-52e6-4415-8fa2-2b04494b9c38 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.131009 Jul 25 20:02:45.215317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 110/247] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Jul 25 20:02:45 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:45.243458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:45.244445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:45.269820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:45.276334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:45.277659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:45.278259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:45.282903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:45.347972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 HTTP/1.1 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:45.354619 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:02:45.356694 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '08dd400a-e875-406a-8b5b-d4ae8ae991f8'} Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:45.358183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:02:45.360199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:45.361967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:45.361967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e8b8cd1-7f1f-4a27-a30f-7c17a8e6bebf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 404 len: 111 microversion: 2.1 time: 0.130144 Jul 25 20:02:45.363866 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 111/248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:45 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:45.381243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1fd64e4e-601d-40b9-b30c-69320fb193b8 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:45.383129 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:45.383129 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:45.460418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1fd64e4e-601d-40b9-b30c-69320fb193b8 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.094817 Jul 25 20:02:45.466748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 112/249] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:46.145125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ed488b3-f1ec-4ad5-b501-f4967289dfda tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:46.231335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57a1b306-a1bd-4000-a440-77ff58220e84 tempest-SecurityGroupsTestAdminJSON-729735850 tempest-SecurityGroupsTestAdminJSON-729735850-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/458163dd-cd81-47fe-b80f-233c1c933171" status: 202 len: 0 microversion: 2.1 time: 1.415437 Jul 25 20:02:46.233068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 138/250] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:02:44 2022] DELETE /compute/v2.1/os-security-groups/458163dd-cd81-47fe-b80f-233c1c933171 => generated 0 bytes in 1421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:46.233818 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6ed488b3-f1ec-4ad5-b501-f4967289dfda tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] HTTP exception thrown: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:46.241250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-faae4e63-fbde-4247-8649-a253ab09b125 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:46.242051 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:46.242051 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ed488b3-f1ec-4ad5-b501-f4967289dfda tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Request method failure captured: Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbh-DSd2Mi7TLxmacWu3Lt5JA75zN9jekVu1BlgJDD5YVP7m1GtGNibESMdkfIQzDGX95vgAxN2hly9gTHfwx5AdYII7Qw5RtVkSAl_jNSVWYjYueWUCH_BJOAv3XKfhrg137_I1HOCVdgLKJxD_uV4zbgyZ2tkvgVdQ9O52kYR6Og Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:46.260454 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd31444dcd354e59907f93099030094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd31444dcd354e59907f93099030094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}] Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 27859066b605482abc72bad753520413 Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:46.262453 n-d-845775-3 devstack@n-api.service[119724]: exception: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'flavor_id': '1612773280', 'id': 'hw:cpu_thread_policy'} Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:46.263167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ed488b3-f1ec-4ad5-b501-f4967289dfda tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Returning 404 to user: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:46.265936 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ed488b3-f1ec-4ad5-b501-f4967289dfda tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] 10.222.0.48 "GET /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.790151 Jul 25 20:02:46.266887 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 113/251] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:02:45 2022] GET /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 799 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:46.288380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f0ac7f2-f34b-41f0-bfe1-33e90c4591e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1544703784"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:46.303196 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:46.303196 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:46.305205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-5f0ac7f2-f34b-41f0-bfe1-33e90c4591e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid ae819b29-e262-457a-bf12-443f74cae056 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:46.359552 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f0ac7f2-f34b-41f0-bfe1-33e90c4591e7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091297 Jul 25 20:02:46.366987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-faae4e63-fbde-4247-8649-a253ab09b125 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.131779 Jul 25 20:02:46.369908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 114/252] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:46.371134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 139/253] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:46.380473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:46.381359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:46.400155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:46.407532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:46.410904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:46.413070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:46.417753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-916933413", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:46.606874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:02:46.646315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:46.669836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c6c9bff-40f5-4752-b137-b4e62df5daad tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1280 microversion: 2.1 time: 0.298701 Jul 25 20:02:46.670579 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 115/254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:46 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:46.701743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7c3e579-d406-4ae5-b3fa-119ec79129a1 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] Calling method '.version_select at 0x7f196a07be50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:48.201452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:02:48.202701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:02:48.203358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:02:48.204566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:02:48.205165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:02:48.221334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:48.221780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:48.222775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:48.223439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:48.256391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Getting quotas for project 5d57cfb0349141529b75dc0699f15dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:02:48.266250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Getting quotas for user c82ae8310ea8405b84503785081fc815 and project 5d57cfb0349141529b75dc0699f15dbd. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:02:48.298902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:02:48.303331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:02:48.376207 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29da48a6-429f-4eee-862e-353ef8283d54 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002019 Jul 25 20:02:48.377343 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 140/255] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:02:48.383780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f59f1535-1c9a-4f98-b8b0-9bd67bb72f5d tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:48.388290 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:48.388290 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:48.390409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f59f1535-1c9a-4f98-b8b0-9bd67bb72f5d tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '27859066b605482abc72bad753520413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd31444dcd354e59907f93099030094b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f59f1535-1c9a-4f98-b8b0-9bd67bb72f5d tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Request method failure captured: Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/flavors/1612773280/os-extra_specs HTTP/1.1 Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 66 Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbh-DSd2Mi7TLxmacWu3Lt5JA75zN9jekVu1BlgJDD5YVP7m1GtGNibESMdkfIQzDGX95vgAxN2hly9gTHfwx5AdYII7Qw5RtVkSAl_jNSVWYjYueWUCH_BJOAv3XKfhrg137_I1HOCVdgLKJxD_uV4zbgyZ2tkvgVdQ9O52kYR6Og Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:02:48.394370 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd31444dcd354e59907f93099030094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd31444dcd354e59907f93099030094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}] Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 27859066b605482abc72bad753520413 Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 25 20:02:48.397164 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'flavor_id': '1612773280', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:48.398569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 25 20:02:48.399764 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.402523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f59f1535-1c9a-4f98-b8b0-9bd67bb72f5d tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:48.403725 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f59f1535-1c9a-4f98-b8b0-9bd67bb72f5d tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] 10.222.0.48 "POST /compute/v2.1/flavors/1612773280/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.025190 Jul 25 20:02:48.404604 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 141/256] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:48 2022] POST /compute/v2.1/flavors/1612773280/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:48.467852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7c3e579-d406-4ae5-b3fa-119ec79129a1 tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/dd34284d-fb81-4a4f-a407-03cd5d9e2021" status: 202 len: 0 microversion: 2.1 time: 1.795490 Jul 25 20:02:48.469350 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 116/257] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:02:46 2022] DELETE /compute/v2.1/os-security-groups/dd34284d-fb81-4a4f-a407-03cd5d9e2021 => generated 0 bytes in 1798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:48.477975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9f43a10-277d-4899-8591-adce699750d2 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:48.482093 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:48.482093 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:48.499242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-b9f43a10-277d-4899-8591-adce699750d2 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9f43a10-277d-4899-8591-adce699750d2 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Request method failure captured: Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak52QfVZCpHbMCAsreCGtAjb9O0R0nQgbHmztEadF-GMpxJwKIZrykJbI40GcTgMo9ETwNvw9jj_4tIcRlZB5zBWenMD8UpSfLfr3RXLYQ2lpWsgy6ryK0aFMajLctOZeTa22Fw5NJpat6L2CmCtj3vZ6JSWdVdDy5umH4QJ_ly1c Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:48.508139 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}] Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8cf710b0f9d34757a1ad6c32aace03bb Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: exception: Aggregate 8 could not be found. Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '8'} Jul 25 20:02:48.510296 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.511510 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.513427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9f43a10-277d-4899-8591-adce699750d2 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:48.517218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9f43a10-277d-4899-8591-adce699750d2 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.039718 Jul 25 20:02:48.517218 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 117/258] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:02:48 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:48.529090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:48.532699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:48.550870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:48.553085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:48.557150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:48.559734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:48.908729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e68fd046-11b8-4cb7-b500-3a29ac68ac44 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:48.911787 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:48.911787 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:48.912842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e68fd046-11b8-4cb7-b500-3a29ac68ac44 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e68fd046-11b8-4cb7-b500-3a29ac68ac44 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 39 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:02:48.915595 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: {"add_host": {"host": "n-h1-845775-3"}} Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:48.917178 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-845775-3'}}} Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:48.918095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 25 20:02:48.919375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:48.921630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e68fd046-11b8-4cb7-b500-3a29ac68ac44 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:48.922804 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e68fd046-11b8-4cb7-b500-3a29ac68ac44 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.516854 Jul 25 20:02:48.923960 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 142/259] 10.222.0.48 () {60 vars in 1191 bytes} [Mon Jul 25 20:02:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 519 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:48.929140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba4a9363-2403-4f57-a2cc-8946dfe21d9f tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:48.929957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba4a9363-2403-4f57-a2cc-8946dfe21d9f tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:49.120373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba4a9363-2403-4f57-a2cc-8946dfe21d9f tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:49.129776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba4a9363-2403-4f57-a2cc-8946dfe21d9f tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1219 microversion: 2.1 time: 0.204381 Jul 25 20:02:49.130844 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 143/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:48 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:49.149183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6679209-cd2b-4fb1-9b4d-7f0042626b03 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.154690 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.154690 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:49.191609 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6679209-cd2b-4fb1-9b4d-7f0042626b03 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1612773280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059560 Jul 25 20:02:49.192486 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 144/261] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/flavors/1612773280/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:49.204977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-999d46d4-c1e9-49df-8b7c-c7944937449d tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] Calling method '.version_select at 0x7f196a11c3a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.450078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:49.461233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e4f6b0e-e8dc-4826-896d-e4b142be7df0 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.941400 Jul 25 20:02:49.462900 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 118/262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:48 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:49.471609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a0fd1be-6e09-4716-9122-c155aa028947 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.473947 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.473947 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.490027 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6a0fd1be-6e09-4716-9122-c155aa028947 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a0fd1be-6e09-4716-9122-c155aa028947 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Request method failure captured: Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak52QfVZCpHbMCAsreCGtAjb9O0R0nQgbHmztEadF-GMpxJwKIZrykJbI40GcTgMo9ETwNvw9jj_4tIcRlZB5zBWenMD8UpSfLfr3RXLYQ2lpWsgy6ryK0aFMajLctOZeTa22Fw5NJpat6L2CmCtj3vZ6JSWdVdDy5umH4QJ_ly1c Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:49.492226 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0540aadcd6b040c2a951a26bafc68249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0540aadcd6b040c2a951a26bafc68249"}]}] Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0540aadcd6b040c2a951a26bafc68249 Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-500413155 Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8cf710b0f9d34757a1ad6c32aace03bb Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-500413155-project-admin Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: exception: Aggregate 8 could not be found. Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '8'} Jul 25 20:02:49.493561 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:49.494472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.495763 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.497163 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.497163 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:49.497163 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:49.497163 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jul 25 20:02:49.497163 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.499010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a0fd1be-6e09-4716-9122-c155aa028947 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:49.500912 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a0fd1be-6e09-4716-9122-c155aa028947 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.035940 Jul 25 20:02:49.501676 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 119/263] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:49.508769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a4def1c-275a-4995-abb7-2c2ffe1c76d6 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.555729 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a4def1c-275a-4995-abb7-2c2ffe1c76d6 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.051481 Jul 25 20:02:49.557193 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 120/264] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:49.569753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ab0db25-0d3c-4fc5-ad0e-f46eab917f25 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.571829 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.571829 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.574218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9ab0db25-0d3c-4fc5-ad0e-f46eab917f25 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '27859066b605482abc72bad753520413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd31444dcd354e59907f93099030094b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ab0db25-0d3c-4fc5-ad0e-f46eab917f25 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Request method failure captured: Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbh-DSd2Mi7TLxmacWu3Lt5JA75zN9jekVu1BlgJDD5YVP7m1GtGNibESMdkfIQzDGX95vgAxN2hly9gTHfwx5AdYII7Qw5RtVkSAl_jNSVWYjYueWUCH_BJOAv3XKfhrg137_I1HOCVdgLKJxD_uV4zbgyZ2tkvgVdQ9O52kYR6Og Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:49.577332 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd31444dcd354e59907f93099030094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd31444dcd354e59907f93099030094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}] Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 27859066b605482abc72bad753520413 Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:49.580338 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'flavor_id': '1612773280', 'id': 'hw:numa_nodes'} Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:49.581669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.584316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ab0db25-0d3c-4fc5-ad0e-f46eab917f25 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:49.586413 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ab0db25-0d3c-4fc5-ad0e-f46eab917f25 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] 10.222.0.48 "DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021201 Jul 25 20:02:49.589994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 121/265] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:49.599281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c074d23-88ab-4412-894e-a6f77fe8add0 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-964187437"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.603559 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.603559 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.605256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-5c074d23-88ab-4412-894e-a6f77fe8add0 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid 15fc2975-b446-4528-8687-801c10337e88 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:49.643691 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c074d23-88ab-4412-894e-a6f77fe8add0 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051828 Jul 25 20:02:49.644874 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 122/266] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.650693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-958b54f0-3439-465a-bf6a-516716c89c0e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1687312233"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.654369 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.654369 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.655591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-958b54f0-3439-465a-bf6a-516716c89c0e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid ef678764-02e5-4b4d-87ab-e50adc971df5 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:49.669856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:UPDATE=13,nova_api:SELECT=74,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:49.702146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-958b54f0-3439-465a-bf6a-516716c89c0e tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054842 Jul 25 20:02:49.702683 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 123/267] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.709167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-804f2c2c-fedc-4940-91c3-851ef90eec79 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.711962 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.711962 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.744054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-804f2c2c-fedc-4940-91c3-851ef90eec79 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1612773280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037813 Jul 25 20:02:49.744054 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 124/268] 10.222.0.48 () {60 vars in 1224 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/flavors/1612773280/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:02:49.749649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92d7efa4-935c-4067-bf03-3617e40a5156 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.750712 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.750712 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.761095 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92d7efa4-935c-4067-bf03-3617e40a5156 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.016388 Jul 25 20:02:49.762491 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 125/269] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:49 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.769629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1760272436"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.773237 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.773237 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.785638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.786393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.803421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:49.804886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:49.818407 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1760272436 could not be found. Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 58 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:49.821284 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: {"add_host": {"host": "tempest-nonexist_host-1760272436"}} Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:49.822951 n-d-845775-3 devstack@n-api.service[119724]: exception: Compute host tempest-nonexist_host-1760272436 could not be found. Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1760272436'}}} Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1760272436' is not mapped to any cell Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.825580 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 25 20:02:49.829514 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1760272436 could not be found. Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1760272436 could not be found. Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.831469 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1760272436 could not be found. Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1760272436 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b0cb9c0-5edd-4c08-8db3-c1d97f4324c7 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.070079 Jul 25 20:02:49.836888 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 126/270] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:49.843111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9562e80-164d-4779-a36d-6b7e3b59e5bd tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.846577 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.846577 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.847972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9562e80-164d-4779-a36d-6b7e3b59e5bd tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '27859066b605482abc72bad753520413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd31444dcd354e59907f93099030094b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9562e80-164d-4779-a36d-6b7e3b59e5bd tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Request method failure captured: Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 22 Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbh-DSd2Mi7TLxmacWu3Lt5JA75zN9jekVu1BlgJDD5YVP7m1GtGNibESMdkfIQzDGX95vgAxN2hly9gTHfwx5AdYII7Qw5RtVkSAl_jNSVWYjYueWUCH_BJOAv3XKfhrg137_I1HOCVdgLKJxD_uV4zbgyZ2tkvgVdQ9O52kYR6Og Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:49.849668 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd31444dcd354e59907f93099030094b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd31444dcd354e59907f93099030094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd31444dcd354e59907f93099030094b"}]}] Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fd31444dcd354e59907f93099030094b Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 27859066b605482abc72bad753520413 Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: {"hw:numa_nodes": "1"} Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:49.850985 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'flavor_id': '1612773280', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:49.851718 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 25 20:02:49.853041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:49.855169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9562e80-164d-4779-a36d-6b7e3b59e5bd tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:49.856656 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9562e80-164d-4779-a36d-6b7e3b59e5bd tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306 tempest-FlavorsExtraSpecsNegativeTestJSON-1754832306-project] 10.222.0.48 "PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020777 Jul 25 20:02:49.857654 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 127/271] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Jul 25 20:02:49 2022] PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:49.864572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74fcc69e-b02e-4f72-8b83-de4bceec8dd6 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:49.868945 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.868945 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.914217 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74fcc69e-b02e-4f72-8b83-de4bceec8dd6 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.054950 Jul 25 20:02:49.922193 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 128/272] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:49 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:49.927645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e567170-d826-4bfe-a5d8-0f71b60125e5 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:49.928743 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:49.928743 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:49.984588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e567170-d826-4bfe-a5d8-0f71b60125e5 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.059178 Jul 25 20:02:49.989528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 129/273] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:50.005161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67ec5357-59d5-4f48-8a68-9ad5c53067fe tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.006330 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.006330 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.023769 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-67ec5357-59d5-4f48-8a68-9ad5c53067fe tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] HTTP exception thrown: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67ec5357-59d5-4f48-8a68-9ad5c53067fe tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Request method failure captured: Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbjcr3qVPjcenfgnQf50JbdfXY78HFpgRwz92iR-H35PDHZcrIyzLJt9mDAIWwibH1Sp4TqP_KVrPGsOQRGckWEynr3ckxPfTriiIYTfv7kw4cJ4S4O90sbR2rTGViNt8blI-uj7gEr8CVK99vmMDaVWgXUzIUdbOoLt5eqkzfomS8 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:50.027966 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}] Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f519391237404a9fb6e5e4131f4a968d Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:50.029342 n-d-845775-3 devstack@n-api.service[119724]: exception: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'flavor_id': '1612773280', 'id': 'hw:cpu_thread_policy'} Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.030028 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. Jul 25 20:02:50.031261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.035871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67ec5357-59d5-4f48-8a68-9ad5c53067fe tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Returning 404 to user: Flavor 1612773280 has no extra specs with key hw:cpu_thread_policy. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.037516 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67ec5357-59d5-4f48-8a68-9ad5c53067fe tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.045083 Jul 25 20:02:50.039472 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 130/274] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/flavors/1612773280/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:50.053565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3c980b3-7f86-4c06-98bf-ee02937482ff tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.055552 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.055552 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.075361 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3c980b3-7f86-4c06-98bf-ee02937482ff tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.033533 Jul 25 20:02:50.083024 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 131/275] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:50 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:50.098925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-613efc09-f9d4-4fad-b3eb-229266d5ef48 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-613efc09-f9d4-4fad-b3eb-229266d5ef48 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 283 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:50.108998 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:50.110559 n-d-845775-3 devstack@n-api.service[119724]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:02:50.111501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:02:50.112296 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:02:50.113452 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:02:50.114271 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:02:50.114271 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.117266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-613efc09-f9d4-4fad-b3eb-229266d5ef48 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.120629 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-613efc09-f9d4-4fad-b3eb-229266d5ef48 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.034160 Jul 25 20:02:50.124104 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 132/276] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Jul 25 20:02:50 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:02:50.135277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3aa1e62-cdab-422c-99f5-64cb6167bd55 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.145922 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.145922 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.151947 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c3aa1e62-cdab-422c-99f5-64cb6167bd55 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3aa1e62-cdab-422c-99f5-64cb6167bd55 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Request method failure captured: Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 27 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbjcr3qVPjcenfgnQf50JbdfXY78HFpgRwz92iR-H35PDHZcrIyzLJt9mDAIWwibH1Sp4TqP_KVrPGsOQRGckWEynr3ckxPfTriiIYTfv7kw4cJ4S4O90sbR2rTGViNt8blI-uj7gEr8CVK99vmMDaVWgXUzIUdbOoLt5eqkzfomS8 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:50.154175 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}] Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f519391237404a9fb6e5e4131f4a968d Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: {"hw:cpu_policy": "shared"} Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:50.155750 n-d-845775-3 devstack@n-api.service[119724]: exception: Request body and URI mismatch Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'flavor_id': '1612773280', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.157035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.158318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:50.158318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:50.158318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 25 20:02:50.158318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.165426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3aa1e62-cdab-422c-99f5-64cb6167bd55 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.168957 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c3aa1e62-cdab-422c-99f5-64cb6167bd55 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.040977 Jul 25 20:02:50.169704 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 133/277] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Jul 25 20:02:50 2022] PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:02:50.183207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ddaa84f4-06e0-43dd-84ef-44a89b3f642a tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.184064 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.184064 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.214321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ddaa84f4-06e0-43dd-84ef-44a89b3f642a tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.036078 Jul 25 20:02:50.219478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 134/278] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:50 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:50.230829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-384876bb-966d-4732-9d1a-977c1e01e67b tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-384876bb-966d-4732-9d1a-977c1e01e67b tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 27 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:50.240606 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: {"aggregate": {"name": ""}} Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:50.242249 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi '' Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.243086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:02:50.246138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.248547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-384876bb-966d-4732-9d1a-977c1e01e67b tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.248547 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-384876bb-966d-4732-9d1a-977c1e01e67b tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.021136 Jul 25 20:02:50.249062 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 135/279] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:50 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:02:50.256162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.257196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:50.269826 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-999d46d4-c1e9-49df-8b7c-c7944937449d tempest-SecurityGroupsTestAdminJSON-501222458 tempest-SecurityGroupsTestAdminJSON-501222458-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ea2ea033-e612-416b-8fb6-104c87f0da64" status: 202 len: 0 microversion: 2.1 time: 1.075229 Jul 25 20:02:50.270766 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 145/280] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:02:49 2022] DELETE /compute/v2.1/os-security-groups/ea2ea033-e612-416b-8fb6-104c87f0da64 => generated 0 bytes in 1077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:50.271870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:50.272362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:50.275025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:50.275836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:50.290179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d4dbe31-e76c-474a-877d-33fce1952ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d4dbe31-e76c-474a-877d-33fce1952ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Request method failure captured: Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 49 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbjcr3qVPjcenfgnQf50JbdfXY78HFpgRwz92iR-H35PDHZcrIyzLJt9mDAIWwibH1Sp4TqP_KVrPGsOQRGckWEynr3ckxPfTriiIYTfv7kw4cJ4S4O90sbR2rTGViNt8blI-uj7gEr8CVK99vmMDaVWgXUzIUdbOoLt5eqkzfomS8 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:50.304882 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04159d2ea8c142a9ada88931699b31b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04159d2ea8c142a9ada88931699b31b9"}]}] Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 04159d2ea8c142a9ada88931699b31b9 Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f519391237404a9fb6e5e4131f4a968d Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 25 20:02:50.307323 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'flavor_id': '1612773280', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance: Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 25 20:02:50.308836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.311448 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.314607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d4dbe31-e76c-474a-877d-33fce1952ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.317255 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d4dbe31-e76c-474a-877d-33fce1952ec6 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.042530 Jul 25 20:02:50.319287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 146/281] 10.222.0.48 () {60 vars in 1265 bytes} [Mon Jul 25 20:02:50 2022] PUT /compute/v2.1/flavors/1612773280/os-extra_specs/hw:numa_nodes => generated 117 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:02:50.348492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32a38ede-4235-4fef-a5d1-61d37dbd09ee tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-610994926", "availability_zone": "tempest-test_az-782845412"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.489217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:50.499202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e99a482b-214b-4860-91a9-69da17c341d7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1277 microversion: 2.1 time: 0.248823 Jul 25 20:02:50.505746 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 136/282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:50 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:50.520583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c019b395-152f-4e60-b9df-cf8a45dd7539 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-641905711"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.529496 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.529496 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.534404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c019b395-152f-4e60-b9df-cf8a45dd7539 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c019b395-152f-4e60-b9df-cf8a45dd7539 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 59 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:50.539794 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: {"aggregate": {"name": "tempest-test_aggregate-641905711"}} Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:50.541365 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-641905711'}}} Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:50.542287 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:50.545937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 25 20:02:50.550578 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:50.553495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c019b395-152f-4e60-b9df-cf8a45dd7539 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:50.556352 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c019b395-152f-4e60-b9df-cf8a45dd7539 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.047978 Jul 25 20:02:50.558336 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 137/283] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:50 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:50.589842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9674860-51b0-474d-86c2-70f39271cb31 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.592880 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.592880 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:50.644632 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9674860-51b0-474d-86c2-70f39271cb31 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1612773280" status: 202 len: 0 microversion: 2.1 time: 0.077214 Jul 25 20:02:50.651727 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 138/284] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:02:50 2022] DELETE /compute/v2.1/flavors/1612773280 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:02:50.664324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.667880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:50.676645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:50.677431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:50.678485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:50.679199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:50.726861 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.726861 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:50.734321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-32a38ede-4235-4fef-a5d1-61d37dbd09ee tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid c548c8d9-172d-4bf6-a334-7897a8a5d640 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:50.774955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32a38ede-4235-4fef-a5d1-61d37dbd09ee tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.443662 Jul 25 20:02:50.776615 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 147/285] 10.222.0.48 () {60 vars in 1165 bytes} [Mon Jul 25 20:02:50 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:50.785732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8829764e-0081-4b5f-8936-eb5ec3448211 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885848399"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.790307 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.790307 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:50.792007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-8829764e-0081-4b5f-8936-eb5ec3448211 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid eef04644-b058-4486-ba98-d5c235a01d8f for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:50.812874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=13,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:50.842458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8829764e-0081-4b5f-8936-eb5ec3448211 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063960 Jul 25 20:02:50.843324 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 148/286] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:50.861701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55432812-9c9c-48cb-9b51-8771b0f30eff tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:50.903806 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55432812-9c9c-48cb-9b51-8771b0f30eff tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200 tempest-FlavorsExtraSpecsNegativeTestJSON-2116394200-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059022 Jul 25 20:02:50.905055 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 149/287] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:02:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:50.911183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-411b4357-057f-427f-bdd9-2634d20f0b66 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-610994926_new", "availability_zone": "tempest-test_az-782845412_new"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:50.914448 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:50.914448 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:50.986410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-411b4357-057f-427f-bdd9-2634d20f0b66 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:50.987458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-411b4357-057f-427f-bdd9-2634d20f0b66 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:51.071335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-411b4357-057f-427f-bdd9-2634d20f0b66 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 334 microversion: 2.1 time: 0.161744 Jul 25 20:02:51.074569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 150/288] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:02:50 2022] PUT /compute/v2.1/os-aggregates/12 => generated 334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:51.091225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885848399"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:51.099959 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.099959 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.106001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid cfef1b9c-28d9-4872-a6c1-3e47fbd3c505 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:51.134568 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-885848399 already exists. Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 59 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:51.137252 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: {"aggregate": {"name": "tempest-test_aggregate-885848399"}} Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:51.138588 n-d-845775-3 devstack@n-api.service[119723]: exception: Aggregate tempest-test_aggregate-885848399 already exists. Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-885848399'}}} Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 25 20:02:51.140133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-885848399 already exists. Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:51.141236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-885848399 already exists. Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-885848399 already exists. Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-885848399 already exists. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:51.143190 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfe81d51-21d7-4095-a3b1-7a0bded55310 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.060617 Jul 25 20:02:51.144299 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 151/289] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:51 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:51.162935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c4a44d8-0034-47d7-a72f-989f0d69b143 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.164354 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.164354 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.207000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c4a44d8-0034-47d7-a72f-989f0d69b143 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.058148 Jul 25 20:02:51.208212 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 152/290] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:02:51 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:51.213597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-16c0c379-1203-466e-8ecb-1a77253329ea tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.215594 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.215594 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.257563 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-16c0c379-1203-466e-8ecb-1a77253329ea tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.047874 Jul 25 20:02:51.259170 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 153/291] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:51 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:51.274478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01f90610-0fa3-4dbc-b842-e0c2990e6d8c tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.278553 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.278553 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.351658 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01f90610-0fa3-4dbc-b842-e0c2990e6d8c tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.090914 Jul 25 20:02:51.352893 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 154/292] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:51 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:51.362638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01ff64a3-8436-422c-b29d-f30ccd624dcc tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1108876024"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:51.366927 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.366927 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.368461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-01ff64a3-8436-422c-b29d-f30ccd624dcc tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid 899fd2ed-b3ae-4fd4-a5f6-2f9c33d3136b for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:51.427029 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01ff64a3-8436-422c-b29d-f30ccd624dcc tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072806 Jul 25 20:02:51.431500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 155/293] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:51.437641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3aa0512-0f1b-4600-bdf5-57423ea87343 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1925101427"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:51.455944 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.455944 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.458718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-d3aa0512-0f1b-4600-bdf5-57423ea87343 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Generated uuid ed57589c-1c99-4bb2-9a99-921cbd397106 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:51.497452 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3aa0512-0f1b-4600-bdf5-57423ea87343 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064388 Jul 25 20:02:51.498309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 156/294] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:51.505873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc7aad93-6429-4481-9a6f-74701cab4485 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.507103 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.507103 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.509200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc7aad93-6429-4481-9a6f-74701cab4485 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc7aad93-6429-4481-9a6f-74701cab4485 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:02:51.512775 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 20:02:51.514064 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '14'} Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:51.515022 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 25 20:02:51.516114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:51.527632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc7aad93-6429-4481-9a6f-74701cab4485 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:51.535533 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc7aad93-6429-4481-9a6f-74701cab4485 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.034044 Jul 25 20:02:51.538191 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 157/295] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:51 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:51.555536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b99fc60-6fbf-4766-ab8e-51ae162b164e tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.557685 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:51.557685 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:51.584053 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b99fc60-6fbf-4766-ab8e-51ae162b164e tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.044139 Jul 25 20:02:51.588705 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 158/296] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:02:51 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:51.605537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:51.606407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:51.623492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:51.624571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:51.627916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:51.628949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.155231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:52.173771 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f1e2c40c-1342-401d-acf1-bc104676ce18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 1.519312 Jul 25 20:02:52.174714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 139/297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:50 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:52.193894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92777f93-9cbd-45e2-b2ea-36f7238a22dc tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.194977 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.194977 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.224137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92777f93-9cbd-45e2-b2ea-36f7238a22dc tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048000 Jul 25 20:02:52.225070 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 140/298] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:52 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:52.231667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-697a7669-70c3-4bf7-9e16-81e47582da04 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.233930 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.233930 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.273259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-697a7669-70c3-4bf7-9e16-81e47582da04 tempest-AggregatesAdminTestJSON-500413155 tempest-AggregatesAdminTestJSON-500413155-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.046892 Jul 25 20:02:52.281533 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 141/299] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:52.287739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfc8bf3-013e-4414-9dd8-bb341d790cb3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.289075 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.289075 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.307472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6bfc8bf3-013e-4414-9dd8-bb341d790cb3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfc8bf3-013e-4414-9dd8-bb341d790cb3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:52.309986 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: exception: Aggregate -1 could not be found. Jul 25 20:02:52.311308 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '-1'} Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:52.311992 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.313113 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 20:02:52.314713 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.317056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfc8bf3-013e-4414-9dd8-bb341d790cb3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.318228 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6bfc8bf3-013e-4414-9dd8-bb341d790cb3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034309 Jul 25 20:02:52.319033 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 142/300] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:52 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:52.327498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.345169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:52.353743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.354305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.355173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.356293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.377741 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] HTTP exception thrown: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Request method failure captured: Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce HTTP/1.1 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiKfZSFqJF63bViY88G3A1AVGqhmFzd7zV0jgxpiY9_-w97NWrHesrNP98sVDa38FKSYXBWmfFKvG_fxPUp3Tn3fhRCIr6_zpyedr1ba4PgrmMY7J6SBMaRDDben-pi7CcpnKO0K4Sm1TeluFSw6MgRYqetcObYXl2YN_9HQJ-HL0 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:52.379791 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}] Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 0bd6e4cba0a6468ab69836bb0db43fea Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.381086 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4796f258-b5a8-4d85-a51d-3466062cccce'} Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.381864 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.383812 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.385364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Returning 404 to user: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.386878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-894f9917-c490-4171-9b88-70ad8acb63b0 tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 404 len: 111 microversion: 2.1 time: 0.066012 Jul 25 20:02:52.393167 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 143/301] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:02:52 2022] DELETE /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:52.399815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-08ab0e13-e17b-4e96-a8f8-1b5243d1ff11 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-685197975"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:52.404129 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.404129 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.405741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.aggregate [None req-08ab0e13-e17b-4e96-a8f8-1b5243d1ff11 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid 44aff167-79e4-456d-b1c8-aeaaaca039c6 for aggregate {{(pid=119724) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:52.455042 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-08ab0e13-e17b-4e96-a8f8-1b5243d1ff11 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060015 Jul 25 20:02:52.473162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 144/302] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:52.486248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.488494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] [instance: 4796f258-b5a8-4d85-a51d-3466062cccce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:52.508165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.509106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.511239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.512989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.547651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] HTTP exception thrown: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Request method failure captured: Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce HTTP/1.1 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiKfZSFqJF63bViY88G3A1AVGqhmFzd7zV0jgxpiY9_-w97NWrHesrNP98sVDa38FKSYXBWmfFKvG_fxPUp3Tn3fhRCIr6_zpyedr1ba4PgrmMY7J6SBMaRDDben-pi7CcpnKO0K4Sm1TeluFSw6MgRYqetcObYXl2YN_9HQJ-HL0 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:52.551632 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f73f6e3e8e7b4a00b681dee79f6622ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f73f6e3e8e7b4a00b681dee79f6622ea"}]}] Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f73f6e3e8e7b4a00b681dee79f6622ea Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2075406588 Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 0bd6e4cba0a6468ab69836bb0db43fea Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminTestJSON-2075406588-project Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.553187 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4796f258-b5a8-4d85-a51d-3466062cccce'} Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.554014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. Jul 25 20:02:52.555329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.556525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] Returning 404 to user: Instance 4796f258-b5a8-4d85-a51d-3466062cccce could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.556525 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fae9162e-13d4-4149-8704-ccd12798857b tempest-AggregatesAdminTestJSON-2075406588 tempest-AggregatesAdminTestJSON-2075406588-project] 10.222.0.48 "GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce" status: 404 len: 111 microversion: 2.1 time: 0.079247 Jul 25 20:02:52.560793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 145/303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:52 2022] GET /compute/v2.1/servers/4796f258-b5a8-4d85-a51d-3466062cccce => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:52.571152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-596d4f44-396b-4769-8f1b-4c9e8bbf24f6 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.573172 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.573172 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.575546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-596d4f44-396b-4769-8f1b-4c9e8bbf24f6 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-596d4f44-396b-4769-8f1b-4c9e8bbf24f6 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:52.580320 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 20:02:52.581872 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '16'} Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:52.582642 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.583903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-596d4f44-396b-4769-8f1b-4c9e8bbf24f6 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.585069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-596d4f44-396b-4769-8f1b-4c9e8bbf24f6 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.020265 Jul 25 20:02:52.591399 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 146/304] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:52 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:52.602442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7af45825-26bb-46ee-b4ea-ddbb0e128baf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.604383 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.604383 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.631738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:52.635705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=73 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:52.661952 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-045a93df-7bae-429b-9376-72c92322e5a6 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 1.071507 Jul 25 20:02:52.662566 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 159/305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:51 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:52.680347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7af45825-26bb-46ee-b4ea-ddbb0e128baf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.086618 Jul 25 20:02:52.689403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 147/306] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:52 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:52.693537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8acc434f-eed8-48a9-b7a7-a5a7b4d997bf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.694362 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.694362 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:52.705085 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8acc434f-eed8-48a9-b7a7-a5a7b4d997bf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8acc434f-eed8-48a9-b7a7-a5a7b4d997bf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:02:52.709014 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: exception: Aggregate -1 could not be found. Jul 25 20:02:52.710591 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '-1'} Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.711426 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 25 20:02:52.712789 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.718108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8acc434f-eed8-48a9-b7a7-a5a7b4d997bf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.722304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8acc434f-eed8-48a9-b7a7-a5a7b4d997bf tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029830 Jul 25 20:02:52.723198 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 160/307] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:02:52 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:52.735643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8695306a-e2a3-46a7-8502-9a1d6a5d539b tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:52.738204 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.738204 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.738553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8695306a-e2a3-46a7-8502-9a1d6a5d539b tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8695306a-e2a3-46a7-8502-9a1d6a5d539b tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:02:52.740314 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 20:02:52.741600 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:52.742998 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:52.744213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8695306a-e2a3-46a7-8502-9a1d6a5d539b tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:52.746826 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8695306a-e2a3-46a7-8502-9a1d6a5d539b tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016639 Jul 25 20:02:52.748555 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 148/308] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:02:52 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:52.767617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8bfa887b-132c-49c4-8b28-836ea54a7204 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-320261125"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:52.777290 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.777290 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:52.783771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-8bfa887b-132c-49c4-8b28-836ea54a7204 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid dbfad831-edd9-44e1-a8fd-c6e880807aa7 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:52.845067 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8bfa887b-132c-49c4-8b28-836ea54a7204 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087150 Jul 25 20:02:52.846535 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 161/309] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:52.860664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d78fff85-826f-4106-8bf9-ce0a37247ce3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:52.863970 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:52.863970 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:52.882682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d78fff85-826f-4106-8bf9-ce0a37247ce3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.890211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d78fff85-826f-4106-8bf9-ce0a37247ce3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.931077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ebe1a698-c5b4-43bc-9435-368c2cf94884 req-15537b82-ed15-4558-af8d-929aaa93ee6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2badd5-5157-4e96-bfad-9428be5d69d3", "tag": "399f917c-b8f5-400f-9dcc-2677c45df15d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:52.958353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ebe1a698-c5b4-43bc-9435-368c2cf94884 req-15537b82-ed15-4558-af8d-929aaa93ee6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:52.960519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ebe1a698-c5b4-43bc-9435-368c2cf94884 req-15537b82-ed15-4558-af8d-929aaa93ee6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:52.992806 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ebe1a698-c5b4-43bc-9435-368c2cf94884 req-15537b82-ed15-4558-af8d-929aaa93ee6d service nova] Creating event network-changed:399f917c-b8f5-400f-9dcc-2677c45df15d for instance aa2badd5-5157-4e96-bfad-9428be5d69d3 on n-h1-845775-3 Jul 25 20:02:53.006309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ebe1a698-c5b4-43bc-9435-368c2cf94884 req-15537b82-ed15-4558-af8d-929aaa93ee6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080795 Jul 25 20:02:53.007742 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 162/310] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:53.187446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d78fff85-826f-4106-8bf9-ce0a37247ce3 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.328878 Jul 25 20:02:53.187446 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 149/311] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:52 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:53.200649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c70509b5-f350-4017-b9a0-370851d38417 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:53.203774 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:53.203774 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:53.205509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:53.206617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:53.209956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c70509b5-f350-4017-b9a0-370851d38417 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b75edec11239439e92194373986babfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68056d5a9454c29a2abdfee67eeae9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c70509b5-f350-4017-b9a0-370851d38417 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Request method failure captured: Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 42 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaiwe40-THYcnCem14S30z4DNMQobaHN-6LT-COWGNtmAvqVdoDwd8ftw60b-ibMgLETFwTva8P5AvWTyS63rBh1Bu5by00bo9GWnpBqbNUtnICGZne6osMpFhl8FxDoVV3IRP7iuf_bFUkQEtt4SRKyhZBUb7uPilCrAl3tyPc3I0 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:02:53.212253 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68056d5a9454c29a2abdfee67eeae9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68056d5a9454c29a2abdfee67eeae9d"}]}] Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: c68056d5a9454c29a2abdfee67eeae9d Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-920480806 Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b75edec11239439e92194373986babfe Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-920480806-project Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: {"remove_host": {"host": "n-h1-845775-3"}} Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:02:53.214382 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-845775-3'}}} Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:53.216857 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 25 20:02:53.220008 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:02:53.229064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:53.229064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:53.229064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:53.232607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:53.236905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c70509b5-f350-4017-b9a0-370851d38417 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:53.238559 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c70509b5-f350-4017-b9a0-370851d38417 tempest-AggregatesAdminNegativeTestJSON-920480806 tempest-AggregatesAdminNegativeTestJSON-920480806-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.044072 Jul 25 20:02:53.243587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 163/312] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:02:53.267149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f48db9e-8663-4c86-bb37-2fe9cc634e89 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:53.321921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f48db9e-8663-4c86-bb37-2fe9cc634e89 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:53.322823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f48db9e-8663-4c86-bb37-2fe9cc634e89 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:53.584369 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f48db9e-8663-4c86-bb37-2fe9cc634e89 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.334839 Jul 25 20:02:53.587330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 164/313] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:53.605506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9ffa50b-28b9-4fe9-80cb-a425bf05ab7a tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:53.607620 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:53.607620 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:53.670258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9ffa50b-28b9-4fe9-80cb-a425bf05ab7a tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.075531 Jul 25 20:02:53.677473 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 165/314] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:53 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 25 20:02:53.693081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05c84b9d-6eec-4232-b0a9-b0d5c927f668 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-857353249"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:53.700643 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:53.700643 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:02:53.702711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-05c84b9d-6eec-4232-b0a9-b0d5c927f668 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Generated uuid e902a41a-0f94-4589-96aa-4ea999a4add3 for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:02:53.755651 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05c84b9d-6eec-4232-b0a9-b0d5c927f668 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072404 Jul 25 20:02:53.759350 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 166/315] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:02:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:53.769342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:53.771741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:53.780897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:53.781632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:53.782840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:53.783515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:54.426401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:54.454064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-012af301-8ef4-4619-a3c0-9e2389c49389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 1.254427 Jul 25 20:02:54.478311 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 150/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:53 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:54.492019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:54.502653 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:54.502653 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:54.526217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:54.527153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:54.541872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:54.542619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:54.561014 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.compute.aggregates [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 20:02:54.561713 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Request method failure captured: Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 42 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vak0yd3SMqy95pZaAlXQMuZKpAMzztBO_4APGg9H2CCArqoCyQNbau3Vc2muvBOULXjKQeH49BjtC84WbuMwBBoZbhOp_qYcWomklbQ1lFNK0YRhSYu4AM1wH30HYat3fFdjvYWBkBSRTe8y16TvHPEtqtdy9znPPcb9vKWu2GcMnE Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:02:54.564089 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2b2181fe9054987bf138151fec0a623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2b2181fe9054987bf138151fec0a623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2b2181fe9054987bf138151fec0a623"}]}] Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: c2b2181fe9054987bf138151fec0a623 Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-713900627 Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 285d2119498246bd828973c1b28e938d Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: {"remove_host": {"host": "nonexist_host"}} Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:02:54.565671 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 25 20:02:54.566554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 25 20:02:54.567752 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.569107 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 25 20:02:54.570272 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:02:54.570616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:02:54.571536 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c44215d4-9d1f-495d-8b3c-57df19db19e2 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.091843 Jul 25 20:02:54.572310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 151/317] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:02:54 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:02:54.600525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-680c8396-cc69-48c2-8199-ad25262288dc req-4af98c4c-03d4-4b34-ab0e-5044ce28927b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b828fd-ee8e-405e-9178-ff082d687a15", "tag": "641c9aec-801d-4d6e-8a49-ed5b05d3b3b2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:54.617937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-680c8396-cc69-48c2-8199-ad25262288dc req-4af98c4c-03d4-4b34-ab0e-5044ce28927b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:54.618404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-680c8396-cc69-48c2-8199-ad25262288dc req-4af98c4c-03d4-4b34-ab0e-5044ce28927b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:54.643668 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-680c8396-cc69-48c2-8199-ad25262288dc req-4af98c4c-03d4-4b34-ab0e-5044ce28927b service nova] Creating event network-changed:641c9aec-801d-4d6e-8a49-ed5b05d3b3b2 for instance a4b828fd-ee8e-405e-9178-ff082d687a15 on n-h2-845775-3 Jul 25 20:02:54.663569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-680c8396-cc69-48c2-8199-ad25262288dc req-4af98c4c-03d4-4b34-ab0e-5044ce28927b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082276 Jul 25 20:02:54.665220 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 152/318] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:02:54.672371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6ae6ae7-9b99-4496-8ce4-89fc1d77e1c5 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:54.674427 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:02:54.674427 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:02:54.700505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=22,nova_cell0:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:54.746525 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6ae6ae7-9b99-4496-8ce4-89fc1d77e1c5 tempest-AggregatesAdminNegativeTestJSON-713900627 tempest-AggregatesAdminNegativeTestJSON-713900627-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.078702 Jul 25 20:02:54.757613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 153/319] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:02:54 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:02:55.197370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:55.220057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8038b94d-b061-4aa1-ba5a-5568ac0eab1b tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 1.456131 Jul 25 20:02:55.223221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 167/320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:53 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:55.481275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:55.482023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:55.500349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:55.501353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:55.502347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:55.502791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:56.136825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:56.150488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6277aab6-177e-4000-bf09-e7960936afe9 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.673416 Jul 25 20:02:56.151470 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 154/321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:55 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:56.248829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:56.251044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:56.273615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:56.276476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:56.277464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:56.277926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:57.146393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:57.162439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-efbc739d-403a-4407-8dfe-26040fb1d079 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.921484 Jul 25 20:02:57.167446 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 168/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:56 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:57.199391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:57.201170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:57.211505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:57.213226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:57.214470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:57.215429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:57.679929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:57.695114 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f91a0e49-8896-49af-b01a-b2fea80daf72 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.516190 Jul 25 20:02:57.695749 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 155/323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:57 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:58.196629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:58.197530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:58.217083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.217720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.220217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.220817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.268006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:58.529025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:58.541989 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e804a96c-c6a9-42b9-8e30-038ce7313533 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.350490 Jul 25 20:02:58.544265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 169/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:58 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:58.717172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:58.718494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:58.727848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.728350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:58.732214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:58.737527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:59.104851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:59.120889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2aad4c81-67b8-4d5f-8daf-e2015eedbf36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.406128 Jul 25 20:02:59.122302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 156/325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:58 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:02:59.299195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:02:59.579473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:02:59.580555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:02:59.589149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:59.590925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:59.590925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:02:59.591890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:02:59.783895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1456992017", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "82f9b8d8-b338-4889-8e9c-d78340530deb"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:02:59.820950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:02:59.833464 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8e4db97-c562-49d4-8bc0-1b08a332343a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.267162 Jul 25 20:02:59.837241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 157/326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:02:59 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:02:59.867893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] validate_networks() for [('82f9b8d8-b338-4889-8e9c-d78340530deb', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:03:00.148219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:00.149691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:00.169113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.170981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.178452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.179353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.560200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:00.572013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30e574f5-35f7-4d42-8938-cb7fec317d18 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.432194 Jul 25 20:03:00.573408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 158/327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:00 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:00.606196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f9160ba5-882e-4fdb-a7c2-0d7b43b04d43 req-d87b95ab-a27e-4c53-886d-9b397d7da0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2badd5-5157-4e96-bfad-9428be5d69d3", "name": "network-vif-plugged", "status": "completed", "tag": "399f917c-b8f5-400f-9dcc-2677c45df15d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:00.615626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=3,nova_api:DELETE=15 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:00.622473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f9160ba5-882e-4fdb-a7c2-0d7b43b04d43 req-d87b95ab-a27e-4c53-886d-9b397d7da0d0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.622843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f9160ba5-882e-4fdb-a7c2-0d7b43b04d43 req-d87b95ab-a27e-4c53-886d-9b397d7da0d0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.641902 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f9160ba5-882e-4fdb-a7c2-0d7b43b04d43 req-d87b95ab-a27e-4c53-886d-9b397d7da0d0 service nova] Creating event network-vif-plugged:399f917c-b8f5-400f-9dcc-2677c45df15d for instance aa2badd5-5157-4e96-bfad-9428be5d69d3 on n-h1-845775-3 Jul 25 20:03:00.647681 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f9160ba5-882e-4fdb-a7c2-0d7b43b04d43 req-d87b95ab-a27e-4c53-886d-9b397d7da0d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047689 Jul 25 20:03:00.648913 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 159/328] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:00.882643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:00.884497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:00.898636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.900459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:00.901693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:00.902248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.179168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:01.194383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7fdb592-0064-40f2-8733-d46de09cca92 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.333648 Jul 25 20:03:01.195757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:00 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:01.601819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:01.603113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:01.612222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.613511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.615221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:01.616245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:01.977522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:01.998849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e22e86a-d343-40f1-8dc8-1c2ccb93ff49 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1322 microversion: 2.1 time: 0.403931 Jul 25 20:03:02.002099 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 161/330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:01 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:02.231740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:02.232432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:02.244242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.244731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.247627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.248230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.353501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:02.354323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:02.355179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:02.356052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:02.357264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:02.403060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.405215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.407642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.409195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.504726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:02.522072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for user 98399c84012545a88dc69f2cbc91cf69 and project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:02.558747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:02.564374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:02.568765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:02.574339 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5509655a-41ae-4869-83d9-87aa84952adf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.346812 Jul 25 20:03:02.575607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 162/331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:02 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:02.690355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e713cd4-aead-431b-a440-04dddb367e8d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.395879 Jul 25 20:03:02.698822 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 170/332] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:03:02.705707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:02.706649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:02.706761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9e58edd9-2f64-4331-826e-755032d24ed5 req-6b600cab-86df-4f44-9765-359743cfd981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b828fd-ee8e-405e-9178-ff082d687a15", "name": "network-vif-plugged", "status": "completed", "tag": "641c9aec-801d-4d6e-8a49-ed5b05d3b3b2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:02.744270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9e58edd9-2f64-4331-826e-755032d24ed5 req-6b600cab-86df-4f44-9765-359743cfd981 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:02.762545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9e58edd9-2f64-4331-826e-755032d24ed5 req-6b600cab-86df-4f44-9765-359743cfd981 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:02.804886 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9e58edd9-2f64-4331-826e-755032d24ed5 req-6b600cab-86df-4f44-9765-359743cfd981 service nova] Creating event network-vif-plugged:641c9aec-801d-4d6e-8a49-ed5b05d3b3b2 for instance a4b828fd-ee8e-405e-9178-ff082d687a15 on n-h2-845775-3 Jul 25 20:03:02.831901 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9e58edd9-2f64-4331-826e-755032d24ed5 req-6b600cab-86df-4f44-9765-359743cfd981 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135518 Jul 25 20:03:02.836699 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 163/333] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:02.839481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:02.854549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:02.857344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:02.860580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-054bd1e5-da83-4e9f-81d2-053979da9825 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1262 microversion: 2.25 time: 0.158143 Jul 25 20:03:02.861412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 171/334] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:02 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:03.025381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:03.026462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:03.041181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:03.041847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:03.042687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:03.043132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:03.091958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:03.601912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:03.606335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:03.638606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:03.639514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:03.645546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:03.648994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:03.749051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:03.779041 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8fec55c-115e-425c-9e2c-b61a2b3ac92b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1472 microversion: 2.1 time: 0.759261 Jul 25 20:03:03.791027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 164/335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:03 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1472 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:04.023972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:04.064661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da992f9f-023d-4fcc-98fa-d8b4030fa342 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1319 microversion: 2.1 time: 0.470311 Jul 25 20:03:04.071162 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 172/336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:03 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:04.100750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:04.101935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:04.112918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:04.120493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.121275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:04.122647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.123388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:04.262155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:04.277864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:04.281591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:04.283719 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-829c0494-ed8e-4cef-a482-94529bd49aa2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1266 microversion: 2.25 time: 0.210913 Jul 25 20:03:04.285247 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 173/337] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:04 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:04.541751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:04.793433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:04.795182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] [instance: 3c2652dd-7e50-4c60-9756-514763cd4439] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:04.807686 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] HTTP exception thrown: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Request method failure captured: Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/3c2652dd-7e50-4c60-9756-514763cd4439/action HTTP/1.1 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbdoY8REMKm1kDQwcxObn0nL4dpXBcVrv9j-poDXt2pJrRCDKw_u6uQLlDbHfGy6Q9L0fuwQWUQr2kMC4L5gHAF_2drTqz6O1TnwPARDs2sqTU77My7pxc7xeRa5BU0yR-1w8KIWx1rpHBir7BV8HuZ_M89VUMefzcrs84FqvNQFC4 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:03:04.812758 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}] Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 96daefc72a34414a846a6aafc91188d7 Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: {"migrate": {}} Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:04.816141 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3c2652dd-7e50-4c60-9756-514763cd4439', 'body': {'migrate': {}}} Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:04.818093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. Jul 25 20:03:04.821226 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:04.826487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Returning 404 to user: Instance 3c2652dd-7e50-4c60-9756-514763cd4439 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:04.829932 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e71beb2-2355-419d-ad63-49c45fb96d2b tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3c2652dd-7e50-4c60-9756-514763cd4439/action" status: 404 len: 111 microversion: 2.1 time: 1.013810 Jul 25 20:03:04.831893 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 165/338] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:03 2022] POST /compute/v2.1/servers/3c2652dd-7e50-4c60-9756-514763cd4439/action => generated 111 bytes in 1017 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:03:04.987454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:04.991963 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:04.991963 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:04.994369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.995409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:04.997194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:04.998594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.064248 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-759d34e7-5aba-4b2d-8947-4e7b8ed08828 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.777292 Jul 25 20:03:05.065629 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 174/339] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:03:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:05.231327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d452528-bb6c-4c73-837c-3d9ef27e9dd1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Action: 'create', calling method: .version_select at 0x7f196a4f7550>, body: {"keypair": {"name": "tempest-keypair-1025890935", "type": "ssh", "user_id": "ac6e5dbc45bd4cbbb6f048c2358c0e17", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCIieG9CvA/Pm84khnhaO0VCrnmY8Ss7KWyd6DEYR/TVWaOKlX1Ywemb2BzqwzvUNOn3kykLXQKF94rYM65LQPs+jZoJa/JYSHLGkB70a9C5zAOUUpIk4VBMa8XP8ulKA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:05.263812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b38b8e4-bbf4-433c-a08d-3d931eec90dc tempest-AZAdminNegativeTestJSON-1489732997 tempest-AZAdminNegativeTestJSON-1489732997-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:05.267187 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:05.267187 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:05.269212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b38b8e4-bbf4-433c-a08d-3d931eec90dc tempest-AZAdminNegativeTestJSON-1489732997 tempest-AZAdminNegativeTestJSON-1489732997-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '76812874fefe4821a804c26293eeaa1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f366a034b93748f3aae1d07ebb98c0c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b38b8e4-bbf4-433c-a08d-3d931eec90dc tempest-AZAdminNegativeTestJSON-1489732997 tempest-AZAdminNegativeTestJSON-1489732997-project] Request method failure captured: Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vb0uLP21PG12RcVvazisCOTHgyIaNDkcn0EzJD_Zp9Ynp2Nz-QtbRPu7807V_dIc9X9Tb3G1TlopHpb5omiTy63ZOtuguq4RjPBHJzEI6L3xYCczMXVAtryDvgTXn1rOVxgYvX7cT4MhZjSGFNKv2VGn9UiKPcDx0J0b9l1oC2STag Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f366a034b93748f3aae1d07ebb98c0c7 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1489732997 Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:05.278943 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f366a034b93748f3aae1d07ebb98c0c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f366a034b93748f3aae1d07ebb98c0c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f366a034b93748f3aae1d07ebb98c0c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f366a034b93748f3aae1d07ebb98c0c7"}]}] Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AZAdminNegativeTestJSON-1489732997 Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f366a034b93748f3aae1d07ebb98c0c7 Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1489732997 Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AZAdminNegativeTestJSON-1489732997-project Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 76812874fefe4821a804c26293eeaa1f Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AZAdminNegativeTestJSON-1489732997-project Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 20:03:05.281429 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:05.283528 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:05.287128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b38b8e4-bbf4-433c-a08d-3d931eec90dc tempest-AZAdminNegativeTestJSON-1489732997 tempest-AZAdminNegativeTestJSON-1489732997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:05.291754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b38b8e4-bbf4-433c-a08d-3d931eec90dc tempest-AZAdminNegativeTestJSON-1489732997 tempest-AZAdminNegativeTestJSON-1489732997-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.447340 Jul 25 20:03:05.291754 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 166/340] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:03:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 455 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:05.299389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6d452528-bb6c-4c73-837c-3d9ef27e9dd1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:05.320386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6d452528-bb6c-4c73-837c-3d9ef27e9dd1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for user 04e52c69122844e69664662b5c63956f and project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:05.386165 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d452528-bb6c-4c73-837c-3d9ef27e9dd1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.318061 Jul 25 20:03:05.386654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 175/341] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:03:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 320 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:03:05.395504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:05.419685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1195404274", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:05.435267 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:05.435267 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:05.442713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.446679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.449999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.458439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.494754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15807c0d-0375-4283-b5c3-6217a6354e6b tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-845775-3" status: 200 len: 578 microversion: 2.1 time: 0.106003 Jul 25 20:03:05.496981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 176/342] 10.222.0.48 () {58 vars in 1172 bytes} [Mon Jul 25 20:03:05 2022] GET /compute/v2.1/os-services?host=n-d-845775-3 => generated 578 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:05.523260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:05.524756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:05.539877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.540868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.542321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:05.543180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:05.615486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:03:06.013484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:06.029122 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-000a626d-6421-424b-95df-45839ee5d7b2 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1469 microversion: 2.1 time: 0.529463 Jul 25 20:03:06.049017 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 177/343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:05 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:06.069781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1956665883", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:06.184802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:03:06.216270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:06.218127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:06.220230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:06.220904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:06.221632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:06.238909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.239726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.240797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.241597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.270315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Getting quotas for project 30b360d8347d487db79dc2eafc2cf9b8. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:06.281776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Getting quotas for user ed77cff514cc478d8b2a72d89a742d35 and project 30b360d8347d487db79dc2eafc2cf9b8. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:06.306722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:06.312642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:06.403712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1cbba662-92d1-44ff-8473-a9e458f133e6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110412 Jul 25 20:03:06.408835 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 167/344] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:03:06.428631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:06.431703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:06.452423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.453929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.455944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.456876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.602497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:06.629585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:06.632692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:06.638946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e04b1349-7006-47eb-bd61-31c455648353 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1320 microversion: 2.25 time: 0.227292 Jul 25 20:03:06.641245 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 168/345] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:06 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:06.662771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6507c118-3761-4217-88fc-b97ef29e0ec6 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Action: 'create', calling method: .version_select at 0x7f196a095280>, body: {"keypair": {"name": "tempest-keypair-107701765", "type": "ssh", "user_id": "ac6e5dbc45bd4cbbb6f048c2358c0e17", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6nV/p/CkTszhrJive6pXwa+ZkGHeGqvZqq4qbei3LKkP6oFIyorzMdlr9o5XwLBmRd7c7SShMYqOYnA85NVDsxtKViqwRa8xX1HWGsy8xtoQlm77lWtGSZUzFPLLsHpw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:06.756226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:06.757474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:06.758481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:06.759238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:06.759900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:06.761295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6507c118-3761-4217-88fc-b97ef29e0ec6 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:06.777681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6507c118-3761-4217-88fc-b97ef29e0ec6 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for user 04e52c69122844e69664662b5c63956f and project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:06.785245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.786723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.794199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.795288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.856014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6507c118-3761-4217-88fc-b97ef29e0ec6 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.210556 Jul 25 20:03:06.866707 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 169/346] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:03:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:03:06.877228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:06.881729 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:06.881729 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:06.884419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.886015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.886563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:06.887286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:06.893682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Getting quotas for project 5cc2511a5f074cc2a2202824e562a706. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:06.917586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Getting quotas for user 379a83cc54324c8abbf35a120ffde95c and project 5cc2511a5f074cc2a2202824e562a706. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:06.955128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f791b9d-a78e-46a0-b5d7-5d3beb7a140d tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092620 Jul 25 20:03:06.962848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:06.966282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:06.974831 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 170/347] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:03:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:06.987384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:06.991775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:07.001162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.002950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.004618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.005251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.143801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-564594cc-d802-43b3-b7ac-8a5e3778eeb7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089611 Jul 25 20:03:07.159428 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 178/348] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:03:07.185410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf87ca8f-8a62-4f8b-8406-9a770980ffbc tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:07.191293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bf87ca8f-8a62-4f8b-8406-9a770980ffbc tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:07.207653 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd2b92b6-f68a-47c6-8324-e21b7d77a2c7 tempest-DeleteServersAdminTestJSON-1983756842 tempest-DeleteServersAdminTestJSON-1983756842-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15/action" status: 202 len: 0 microversion: 2.1 time: 0.229688 Jul 25 20:03:07.213107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 171/349] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:06 2022] POST /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:07.218111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37fbbce6-ac2b-4c01-95e7-f2dbe014ec3c tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Calling method '.version_select at 0x7f196a54be50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:07.253145 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37fbbce6-ac2b-4c01-95e7-f2dbe014ec3c tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1025890935?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17" status: 200 len: 512 microversion: 2.10 time: 0.043065 Jul 25 20:03:07.254345 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 172/350] 10.222.0.48 () {60 vars in 1340 bytes} [Mon Jul 25 20:03:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1025890935?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17 => generated 512 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:07.264242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:07.268963 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:07.268963 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:07.271480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.273050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.274325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.275475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.321187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bf87ca8f-8a62-4f8b-8406-9a770980ffbc tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:07.331204 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28020287-8ea5-4698-b519-bd24845a3ab3 tempest-ServicesAdminTestJSON-1054748299 tempest-ServicesAdminTestJSON-1054748299-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.074409 Jul 25 20:03:07.348921 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf87ca8f-8a62-4f8b-8406-9a770980ffbc tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1223 microversion: 2.1 time: 0.185347 Jul 25 20:03:07.350426 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 179/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:07 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1223 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:07.370983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffec2e84-ed74-4673-9555-4413cff3a94a tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:07.375585 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 173/352] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:03:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:07.376997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ffec2e84-ed74-4673-9555-4413cff3a94a tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:07.396214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:07.399105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:07.425781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.427121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.431762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.432660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.564338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:07.566620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:07.567865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lazy-loading 'fault' on Instance uuid a4b828fd-ee8e-405e-9178-ff082d687a15 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:07.768645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffec2e84-ed74-4673-9555-4413cff3a94a tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:07.797167 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffec2e84-ed74-4673-9555-4413cff3a94a tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1222 microversion: 2.1 time: 0.445087 Jul 25 20:03:07.827387 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 180/353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:07 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1222 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:07.840781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d15c726e-678c-4635-afba-ebaebf8d4af1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Action: 'create', calling method: .version_select at 0x7f196a0e4e50>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-655932065", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHTPtpiZRMKyN0If/hleCf9JrRk9PYAEl3b46uCd8KOCFFdhRqi95Yeit6NMdaztJ5ky7ygTETwUxDPDEZ92L3h/3O0GCw2JBxc1B3BNmBBSjNtGFjXFH2YjGxtLtvLHg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:07.889726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d15c726e-678c-4635-afba-ebaebf8d4af1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:07.956444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d15c726e-678c-4635-afba-ebaebf8d4af1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Getting quotas for user 04e52c69122844e69664662b5c63956f and project 7f9319bedbc04b1ea8f036d22acc908c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:08.100701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d15c726e-678c-4635-afba-ebaebf8d4af1 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.269869 Jul 25 20:03:08.102342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 181/354] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:03:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 274 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:03:08.115680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.117769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:08.151260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.159784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.163775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.166028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.205745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:08.216362 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0962518c-d661-4072-a26b-48607087700a tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1452 microversion: 2.1 time: 0.838950 Jul 25 20:03:08.216952 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 174/355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:07 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1452 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:08.261494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff649308-6842-4bbf-90aa-58a0c8141b3e tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Calling method '.version_select at 0x7f196a340af0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.267262 n-d-845775-3 devstack@n-api.service[119724]: WARNING oslo_db.sqlalchemy.utils [None req-ff649308-6842-4bbf-90aa-58a0c8141b3e tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:03:08.306146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff649308-6842-4bbf-90aa-58a0c8141b3e tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17" status: 200 len: 725 microversion: 2.10 time: 0.086161 Jul 25 20:03:08.313198 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 175/356] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Jul 25 20:03:08 2022] GET /compute/v2.1/os-keypairs?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17 => generated 725 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:08.321936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.325991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:08.354630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.355083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.356485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.356485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.496122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:03:08.634314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:08.660639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:08.666858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:08.670224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-009b5fb7-6565-47a6-b79e-72fcb21b4566 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.565385 Jul 25 20:03:08.678116 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c7a908f-5df4-424b-a739-181317347dc1 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 204 len: 0 microversion: 2.1 time: 0.365012 Jul 25 20:03:08.680423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 176/357] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:08 2022] DELETE /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:08.691413 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 182/358] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:08 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:08.696600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec9a6a72-d092-4462-8227-6015bed86d12 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Calling method '.version_select at 0x7f196a340ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.723988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.729798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:08.739501 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec9a6a72-d092-4462-8227-6015bed86d12 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-655932065" status: 204 len: 0 microversion: 2.10 time: 0.056158 Jul 25 20:03:08.740635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 177/359] 10.222.0.48 () {60 vars in 1322 bytes} [Mon Jul 25 20:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-655932065 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:03:08.751531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:08.753479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:08.758977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.759229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.764175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.767073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.778840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.779869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.785539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.786312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.934685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:08.935965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:08.937040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lazy-loading 'fault' on Instance uuid a4b828fd-ee8e-405e-9178-ff082d687a15 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:09.032826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:09.053793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-736d92bc-54ad-4bab-927d-9b637bb6d34d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1275 microversion: 2.1 time: 0.357828 Jul 25 20:03:09.055484 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 183/360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:08 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:09.066014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1db228c6-afeb-4fdb-84b1-4a0e320fc087 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Calling method '.version_select at 0x7f196a0d2ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:09.103786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1db228c6-afeb-4fdb-84b1-4a0e320fc087 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107701765?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17" status: 204 len: 0 microversion: 2.10 time: 0.046112 Jul 25 20:03:09.105720 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 184/361] 10.222.0.48 () {60 vars in 1340 bytes} [Mon Jul 25 20:03:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107701765?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:03:09.113446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:09.115203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:09.127091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:09.129176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:09.133322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:09.134361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:09.474381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:09.498627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58ed85bb-7569-4477-b202-02435d5b2a93 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1218 microversion: 2.1 time: 0.391316 Jul 25 20:03:09.532759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 185/362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:09 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1218 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:09.562469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-033d98ea-9963-4eae-ae88-4db3529264d5 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] Calling method '.version_select at 0x7f196a4f7550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:09.606228 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-033d98ea-9963-4eae-ae88-4db3529264d5 tempest-KeyPairsV210TestJSON-405511796 tempest-KeyPairsV210TestJSON-405511796-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025890935?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17" status: 204 len: 0 microversion: 2.10 time: 0.049117 Jul 25 20:03:09.607560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 186/363] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:03:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025890935?user_id=ac6e5dbc45bd4cbbb6f048c2358c0e17 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:03:09.721366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:09.722741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:09.737636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:09.738505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:09.739537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:09.741135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.088171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.131587 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42dc2887-0fac-4561-83f9-b32bc3eee30d tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1458 microversion: 2.1 time: 1.375792 Jul 25 20:03:10.145586 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 178/364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:08 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1458 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:10.170900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:10.172022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:10.206885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.210150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.211594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.212386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.533276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.555738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.560361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.562659 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-66716be7-e7c5-4247-aa8f-af9528922398 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.846624 Jul 25 20:03:10.569556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.581417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 187/365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:09 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:10.600125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86974510-10e8-4a37-90af-fc44243e7325 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1281 microversion: 2.1 time: 0.451461 Jul 25 20:03:10.601650 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 179/366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:10 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1281 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:10.622181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:10.629496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:10.658600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.659505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.660964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:10.661856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:10.854247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:10.870773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cd8e94cb-e5dd-4b28-a2c1-7181ca2ab633 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1280 microversion: 2.1 time: 0.271472 Jul 25 20:03:10.873657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 188/367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:10 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1280 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:11.188592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:11.198146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:11.254348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.265618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.272226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.273912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.377416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.383779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.384849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lazy-loading 'fault' on Instance uuid a4b828fd-ee8e-405e-9178-ff082d687a15 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:11.609147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:11.610554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:11.619086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.619537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.622473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.624322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.799573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:11.834881 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac4b7766-e0d8-4808-9a24-3a3f27a62de9 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1458 microversion: 2.1 time: 0.665414 Jul 25 20:03:11.837630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 180/368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:11 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1458 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:11.876964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:11.881310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:11.916217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.918227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:11.923643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:11.925544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.229574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:12.243320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:12.245109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:12.246308 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5309fe5c-ee5f-41e7-a8c3-f87442791ff9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.641288 Jul 25 20:03:12.246887 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 189/369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:11 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:03:12.253884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:12.271422 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7cfdb28b-3ad0-49b3-a95f-4d2f14b846b6 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1281 microversion: 2.1 time: 0.428651 Jul 25 20:03:12.280235 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 181/370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:11 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1281 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:12.281873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:12.282506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:12.290505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e1b49ca7-ce00-4154-8a4d-36dd9061327d req-7ec8ae7d-7f95-4631-84fc-703ea22f3658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:12.305028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.305704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.307050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.307848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.339888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e1b49ca7-ce00-4154-8a4d-36dd9061327d req-7ec8ae7d-7f95-4631-84fc-703ea22f3658 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.341764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e1b49ca7-ce00-4154-8a4d-36dd9061327d req-7ec8ae7d-7f95-4631-84fc-703ea22f3658 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.381923 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e1b49ca7-ce00-4154-8a4d-36dd9061327d req-7ec8ae7d-7f95-4631-84fc-703ea22f3658 service nova] Creating event network-changed:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h2-845775-3 Jul 25 20:03:12.398569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e1b49ca7-ce00-4154-8a4d-36dd9061327d req-7ec8ae7d-7f95-4631-84fc-703ea22f3658 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108215 Jul 25 20:03:12.402370 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 182/371] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:12.592687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:12.613266 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a30e4c99-a794-42a8-a91a-214a05335616 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1280 microversion: 2.1 time: 0.354643 Jul 25 20:03:12.614916 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 190/372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:12 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:12.870926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:12.872155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:12.884414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.886094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.888192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.889200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.945310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:12.945956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:12.946746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lazy-loading 'fault' on Instance uuid a4b828fd-ee8e-405e-9178-ff082d687a15 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:13.277818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:13.278655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:13.288590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.292211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.297900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.303331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.845003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:13.867071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:13.882427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:13.886551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:13.890437 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-585a7da9-aee3-448b-9496-a7d4192379cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.617302 Jul 25 20:03:13.907591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0b842fa-08f4-4dff-b9d8-5b06030859f0 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1458 microversion: 2.1 time: 1.045619 Jul 25 20:03:13.908168 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 191/373] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:13 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:13.919680 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 183/374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:12 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1458 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:13.929944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:13.931185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:13.935767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:13.936681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:13.950956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.954162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.956951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.957182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.957956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.960521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.963248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:13.966629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:13.972928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:14.385030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:14.415340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3acfd594-3e97-4fa3-aa2e-367d5bd842db tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1280 microversion: 2.1 time: 0.490764 Jul 25 20:03:14.418376 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 184/375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:13 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:14.476875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f33d6463-7e39-471b-b843-17219f768435 req-508208dd-6183-4610-a407-7b5d83aa904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b828fd-ee8e-405e-9178-ff082d687a15", "name": "network-vif-deleted", "tag": "641c9aec-801d-4d6e-8a49-ed5b05d3b3b2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:14.545973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f33d6463-7e39-471b-b843-17219f768435 req-508208dd-6183-4610-a407-7b5d83aa904c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:14.548340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f33d6463-7e39-471b-b843-17219f768435 req-508208dd-6183-4610-a407-7b5d83aa904c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:14.588424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:14.645943 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f33d6463-7e39-471b-b843-17219f768435 req-508208dd-6183-4610-a407-7b5d83aa904c service nova] Creating event network-vif-deleted:641c9aec-801d-4d6e-8a49-ed5b05d3b3b2 for instance a4b828fd-ee8e-405e-9178-ff082d687a15 on n-h2-845775-3 Jul 25 20:03:14.668152 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f33d6463-7e39-471b-b843-17219f768435 req-508208dd-6183-4610-a407-7b5d83aa904c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203011 Jul 25 20:03:14.674487 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 185/376] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:03:14.921316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:14.928930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:14.965042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:14.966312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:14.969981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:14.973454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:15.287494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:15.318413 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a7af6d1-9b3c-4f42-8d69-78752cec0685 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 1.408758 Jul 25 20:03:15.323114 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 192/377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:13 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:15.346151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:15.348501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:15.369895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:15.370615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:15.374383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:15.376220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:15.481320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:15.482048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:15.485715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lazy-loading 'fault' on Instance uuid a4b828fd-ee8e-405e-9178-ff082d687a15 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:15.627234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82ae8310ea8405b84503785081fc815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d57cfb0349141529b75dc0699f15dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:15.642097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6bde886-fe14-4a3b-b4ad-eb245a604585 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 200 len: 1309 microversion: 2.1 time: 0.315859 Jul 25 20:03:15.643009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 193/378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:15 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:15.753180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:15.764584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:15.774789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:15.776523 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dbe2f5e0-3543-4f4e-82aa-be7b527f95cf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.863254 Jul 25 20:03:15.778170 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 186/379] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:14 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:15.786479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:15.791278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:15.808968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:15.809507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:15.810191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:15.812379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.156589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04880f7b-d92f-446a-8f38-00e17dea9146 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-532061785", "id": 275716946, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:16.169263 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:16.169263 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:16.222347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04880f7b-d92f-446a-8f38-00e17dea9146 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.573846 Jul 25 20:03:16.237466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 194/380] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:03:15 2022] POST /compute/v2.1/flavors => generated 467 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:16.246081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-857aa7ac-db54-463d-bbc4-d7560eb2d897 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:16.256526 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:16.256526 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:16.485309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:16.506577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-759e66ec-d170-4c91-b555-ee9264af9da7 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.727017 Jul 25 20:03:16.524732 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 187/381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:15 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:16.530040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.531525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:16.534220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:16.544688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.545621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.546661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.547358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.651917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:16.679856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-857aa7ac-db54-463d-bbc4-d7560eb2d897 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/275716946/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.440526 Jul 25 20:03:16.680685 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 195/382] 10.222.0.48 () {62 vars in 1262 bytes} [Mon Jul 25 20:03:16 2022] POST /compute/v2.1/flavors/275716946/os-extra_specs => generated 62 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:16.697330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.698226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:16.708340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.709096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.710203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.710887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.726818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 HTTP/1.1 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:16.729454 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.730694 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a4b828fd-ee8e-405e-9178-ff082d687a15'} Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:16.731386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.732550 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.736151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:16.737501 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55f7a25d-eafc-47e5-b5cf-3797c0576b67 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 404 len: 111 microversion: 2.1 time: 0.047404 Jul 25 20:03:16.744292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 196/383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:16 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:16.749572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-16b2e552-fe88-4a70-8b93-9884815d6ec2 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.751234 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:16.751234 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:16.778782 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-16b2e552-fe88-4a70-8b93-9884815d6ec2 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/275716946" status: 202 len: 0 microversion: 2.86 time: 0.032329 Jul 25 20:03:16.783076 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 197/384] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Jul 25 20:03:16 2022] DELETE /compute/v2.1/flavors/275716946 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:16.793324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:16.796837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.798748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:16.810283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.810892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.811796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.812361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.836214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:16.842365 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 HTTP/1.1 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:16.846084 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.847756 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a4b828fd-ee8e-405e-9178-ff082d687a15'} Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:16.848641 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:16.850001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:16.852493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:16.852493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f16ffac5-737e-4d0d-9144-3e04e4909e08 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 404 len: 111 microversion: 2.1 time: 0.068703 Jul 25 20:03:16.852930 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 198/385] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:16 2022] DELETE /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:16.861009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8af6bbb2-4db9-4dc2-a236-a0735afdf2e0 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.891314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8af6bbb2-4db9-4dc2-a236-a0735afdf2e0 tempest-FlavorMetadataValidation-699291859 tempest-FlavorMetadataValidation-699291859-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.037155 Jul 25 20:03:16.892852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 199/386] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:03:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:16.908474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:16.909103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:16.919430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.919791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:16.920564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:16.921008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.021751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:17.037021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a19bc4ed-830f-4dfb-b11b-bf38c5972d02 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 0.510727 Jul 25 20:03:17.038191 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 188/387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:16 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:17.046268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:17.048805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: a4b828fd-ee8e-405e-9178-ff082d687a15] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:17.061791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.062536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.063701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.064379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.083158 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 HTTP/1.1 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:17.084872 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:17.086484 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a4b828fd-ee8e-405e-9178-ff082d687a15'} Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:17.087288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. Jul 25 20:03:17.088842 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.092643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance a4b828fd-ee8e-405e-9178-ff082d687a15 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:17.093709 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9084b41-b13f-442f-9913-f14d02053694 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15" status: 404 len: 111 microversion: 2.1 time: 0.054027 Jul 25 20:03:17.095554 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 189/388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:17 2022] GET /compute/v2.1/servers/a4b828fd-ee8e-405e-9178-ff082d687a15 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:17.114341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:17.114777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:17.124388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.127430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.130519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.130950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.157118 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 HTTP/1.1 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:17.159005 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.161603 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '08dd400a-e875-406a-8b5b-d4ae8ae991f8'} Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:17.162402 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.163554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.167478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:17.169945 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-169d7097-ef70-4247-9bf7-1f61255f09bf tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "DELETE /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 404 len: 111 microversion: 2.1 time: 0.068613 Jul 25 20:03:17.171099 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 190/389] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:17 2022] DELETE /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:17.185928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:17.186818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] [instance: 08dd400a-e875-406a-8b5b-d4ae8ae991f8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:17.196433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.198672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.200972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.201849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.258250 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] HTTP exception thrown: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Request method failure captured: Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 HTTP/1.1 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vaxgusGUa1YWLBi_FZ76pdHtfH7dnnmILF2aYnA9CBso276euV6hgU6veSvgYo_N2I5DgOEGrrpZwlbFLlruhmUH3ovY3il6-CvkRyApbnoGxIkdcXmbvNXi9Bkze3V3xcXa_51kdK0vcC4YOpKM69bFMJ2XbKDqdrr6n_rYOiQoM8 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:17.268116 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d57cfb0349141529b75dc0699f15dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d57cfb0349141529b75dc0699f15dbd"}]}] Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 5d57cfb0349141529b75dc0699f15dbd Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1466634647 Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c82ae8310ea8405b84503785081fc815 Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersAdminTestJSON-1466634647-project Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.269420 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '08dd400a-e875-406a-8b5b-d4ae8ae991f8'} Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:17.270102 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. Jul 25 20:03:17.271611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:17.274699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] Returning 404 to user: Instance 08dd400a-e875-406a-8b5b-d4ae8ae991f8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:17.277459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-915fdd68-22dd-4b6c-bbac-548922bad9f7 tempest-DeleteServersAdminTestJSON-1466634647 tempest-DeleteServersAdminTestJSON-1466634647-project] 10.222.0.48 "GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8" status: 404 len: 111 microversion: 2.1 time: 0.097890 Jul 25 20:03:17.281158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 191/390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:17 2022] GET /compute/v2.1/servers/08dd400a-e875-406a-8b5b-d4ae8ae991f8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:17.308955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cd23318d-e81e-4edd-bb7c-120108446273 req-fe7c33c6-00e3-4e10-9d12-da702f6cbd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696be067-7add-4b8e-ae29-32c441e7aca5", "tag": "21161b9d-0b68-476a-a2ba-dd1c414ee3de"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:17.359564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:17.366904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cd23318d-e81e-4edd-bb7c-120108446273 req-fe7c33c6-00e3-4e10-9d12-da702f6cbd22 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.369872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cd23318d-e81e-4edd-bb7c-120108446273 req-fe7c33c6-00e3-4e10-9d12-da702f6cbd22 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.435765 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cd23318d-e81e-4edd-bb7c-120108446273 req-fe7c33c6-00e3-4e10-9d12-da702f6cbd22 service nova] Creating event network-changed:21161b9d-0b68-476a-a2ba-dd1c414ee3de for instance 696be067-7add-4b8e-ae29-32c441e7aca5 on n-h1-845775-3 Jul 25 20:03:17.466211 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cd23318d-e81e-4edd-bb7c-120108446273 req-fe7c33c6-00e3-4e10-9d12-da702f6cbd22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177734 Jul 25 20:03:17.466844 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 192/391] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:17.483205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:17.512948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:17.514701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:17.522469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6649c661-2499-4124-bb56-acf7458365aa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.628668 Jul 25 20:03:17.526949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 200/392] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:16 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:17.537484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:17.538291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:17.558603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.559070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:17.559865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:17.560386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:18.061653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:18.062311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:18.064386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=26 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:18.078940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:18.079694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:18.084861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:18.085919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:18.824604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:18.855122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ab2e9f2-c83d-4214-87d3-f00849d06d39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 1.315132 Jul 25 20:03:18.857450 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 193/393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:17 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:18.884100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:18.887263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:18.916780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:18.917660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:18.918867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:18.920173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:19.091323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:19.110125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5781295f-0245-4321-9054-87c262ade5a2 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 1.052519 Jul 25 20:03:19.115199 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 201/394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:18 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:19.145383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-986fcf5f-1be0-4476-b8d1-d3da97e83dde req-870cd182-8168-45ff-89b4-c7b46585cccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fc0eeb-467e-41f4-8ff8-af4bcf390b99", "tag": "8d1d4982-0dc1-4dd0-832c-11c294cc092c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:19.174104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-986fcf5f-1be0-4476-b8d1-d3da97e83dde req-870cd182-8168-45ff-89b4-c7b46585cccc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:19.174722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-986fcf5f-1be0-4476-b8d1-d3da97e83dde req-870cd182-8168-45ff-89b4-c7b46585cccc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:19.221569 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-986fcf5f-1be0-4476-b8d1-d3da97e83dde req-870cd182-8168-45ff-89b4-c7b46585cccc service nova] Creating event network-changed:8d1d4982-0dc1-4dd0-832c-11c294cc092c for instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 on n-h1-845775-3 Jul 25 20:03:19.246557 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-986fcf5f-1be0-4476-b8d1-d3da97e83dde req-870cd182-8168-45ff-89b4-c7b46585cccc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128255 Jul 25 20:03:19.253721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 202/395] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:19.635181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:19.667504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:19.669942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:19.671531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42bcaf9b-9719-436d-a3fb-74036cc56b89 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.812665 Jul 25 20:03:19.689590 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 194/396] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:18 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:19.891627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:19.892997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:19.910051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:19.920540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:19.921797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:19.923270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:20.153140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:20.158592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:20.184439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:20.193089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:20.195867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:20.196874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:20.641048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:20.662894 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-903ba92b-f56c-44a9-a4fd-17a935f988e2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.776193 Jul 25 20:03:20.665488 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 203/397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:19 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:20.728395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:20.729521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:20.765596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:20.766451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:20.767865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:20.768661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:20.773943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:20.807692 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37d06782-4915-4193-b6cf-fa78cbb1aae8 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 0.661335 Jul 25 20:03:20.812874 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 195/398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:20 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:21.219639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2dd58196-8138-413a-85e1-3bc69ab64f46 req-94375b6e-5f99-442a-ab75-60c1c87fda9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "name": "network-vif-plugged", "status": "completed", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:21.258800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2dd58196-8138-413a-85e1-3bc69ab64f46 req-94375b6e-5f99-442a-ab75-60c1c87fda9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:21.259583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2dd58196-8138-413a-85e1-3bc69ab64f46 req-94375b6e-5f99-442a-ab75-60c1c87fda9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:21.315019 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2dd58196-8138-413a-85e1-3bc69ab64f46 req-94375b6e-5f99-442a-ab75-60c1c87fda9b service nova] Creating event network-vif-plugged:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h2-845775-3 Jul 25 20:03:21.334905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2dd58196-8138-413a-85e1-3bc69ab64f46 req-94375b6e-5f99-442a-ab75-60c1c87fda9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122800 Jul 25 20:03:21.337556 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 196/399] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:03:21.485160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:21.519829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:21.532543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:21.538385 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b31feb8-518f-4263-bd38-c6915e528182 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.817622 Jul 25 20:03:21.542434 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 204/400] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:20 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:21.712192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:21.713851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:21.735411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:21.736551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:21.739035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:21.739836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:21.850568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:21.851729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:21.859497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:21.860825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:21.862420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:21.863000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:22.637506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:22.646623 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1cfe2796-dfc8-4157-949e-afb74f71b5fa tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.946056 Jul 25 20:03:22.648723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 197/401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:21 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:22.658496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:22.673190 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-726575ae-8ea7-4cc8-9806-ce5dce8626cd tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 0.829780 Jul 25 20:03:22.687525 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 205/402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:21 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:22.700299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:22.706500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:22.719929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:22.720587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:22.722010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:22.722745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:22.847888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e3d695f-ad67-4422-9dca-360187a53ab0 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f196a095280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:22.971267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8e3d695f-ad67-4422-9dca-360187a53ab0 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194" status: 200 len: 371 microversion: 2.1 time: 0.320917 Jul 25 20:03:22.980396 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 198/403] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:03:22 2022] GET /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194 => generated 371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:22.993890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Action: 'update', calling method: .version_select at 0x7f196a6a5790>, body: {"quota_set": {"ram": "5120"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:23.173618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.174538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:23.175646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.176397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:23.231666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:23.244426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:23.253774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:23.258422 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c55729f-4431-4d9e-a522-a714b8b836d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1362 microversion: 2.25 time: 0.565165 Jul 25 20:03:23.262399 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 206/404] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:22 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1362 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:23.297083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf6c49c4-1a06-4c89-a6ee-de70bfc66aa9 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194" status: 200 len: 328 microversion: 2.1 time: 0.308433 Jul 25 20:03:23.299111 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 199/405] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:03:22 2022] PUT /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194 => generated 328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:23.317075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-956ea95d-e64b-46e7-a872-9ddb2f170e22 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:23.345673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-956ea95d-e64b-46e7-a872-9ddb2f170e22 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194" status: 202 len: 0 microversion: 2.1 time: 0.037924 Jul 25 20:03:23.346965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 207/406] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:03:23 2022] DELETE /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:23.356862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6e4dd4a-0972-4ecd-b383-c1211957e73e tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f196a07b820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:23.544313 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6e4dd4a-0972-4ecd-b383-c1211957e73e tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194" status: 200 len: 371 microversion: 2.1 time: 0.192611 Jul 25 20:03:23.546514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 200/407] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:03:23 2022] GET /compute/v2.1/os-quota-sets/e357f7ed97124a2b9443e6dabf7a2194 => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:23.672156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:23.672995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:23.687204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.692386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:23.701314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:23.703065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:23.711480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.713821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:23.741418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.743210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:23.749110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:23.775906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:24.599127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:24.618159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6050377-d7da-4247-9bb7-63fddb19da82 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.951477 Jul 25 20:03:24.622058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 208/408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:23 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:24.635239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1527945f-898d-423a-95d9-f9d124c33dd0 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f196a20a3a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:24.710343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:24.719596 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6e7830ce-0eac-446f-a43b-569620071d1d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 1.024490 Jul 25 20:03:24.740418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 201/409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:23 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:24.752951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:24.753572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:24.763851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:24.764360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:24.765652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:24.766287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:25.044088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:25.066973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:25.071748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:25.075335 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-381d449c-322a-4509-bbfc-cf826400caa6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1559 microversion: 2.25 time: 0.333057 Jul 25 20:03:25.088071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 202/410] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:24 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1559 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:25.300474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1527945f-898d-423a-95d9-f9d124c33dd0 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.676817 Jul 25 20:03:25.303550 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 209/411] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:03:24 2022] GET /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f/defaults => generated 371 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:25.316972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8e10fa1e-1512-466e-a612-0439545d36d3 req-02cfdacb-4899-44e8-92a4-f291bd9e4b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696be067-7add-4b8e-ae29-32c441e7aca5", "name": "network-vif-plugged", "status": "completed", "tag": "21161b9d-0b68-476a-a2ba-dd1c414ee3de"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:25.335580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8e10fa1e-1512-466e-a612-0439545d36d3 req-02cfdacb-4899-44e8-92a4-f291bd9e4b07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:25.345110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8e10fa1e-1512-466e-a612-0439545d36d3 req-02cfdacb-4899-44e8-92a4-f291bd9e4b07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:25.366992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8e10fa1e-1512-466e-a612-0439545d36d3 req-02cfdacb-4899-44e8-92a4-f291bd9e4b07 service nova] Creating event network-vif-plugged:21161b9d-0b68-476a-a2ba-dd1c414ee3de for instance 696be067-7add-4b8e-ae29-32c441e7aca5 on n-h1-845775-3 Jul 25 20:03:25.379847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8e10fa1e-1512-466e-a612-0439545d36d3 req-02cfdacb-4899-44e8-92a4-f291bd9e4b07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074743 Jul 25 20:03:25.393253 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 210/412] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:25.640951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:25.642682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:25.659407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:25.663574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:25.666383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:25.667552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:25.726016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:25.726016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:25.735490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:25.736025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:25.741422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:25.741884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.025120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:26.041741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1d72592-5cc9-4660-ac4e-bd5e0c237fa5 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.398086 Jul 25 20:03:26.043337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 211/413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:25 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:26.061741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:26.063306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:26.078189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.083479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.089279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:26.090352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.090820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.163873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d4d97d15-2d67-47c7-9165-99a538ae7d51 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 2052 microversion: 2.25 time: 1.062026 Jul 25 20:03:26.166016 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 203/414] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:25 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 2052 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:26.194626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:26.195978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:26.230305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.231972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.234025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.237456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.493019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:26.518213 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8a0bf11-273a-43e2-8d29-0e31f8d8f50d tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1323 microversion: 2.1 time: 0.469041 Jul 25 20:03:26.525099 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:26 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:26.577526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:26.606031 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b3f301b-1a10-4aa9-9c6c-f7b5e44d0cad tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 2052 microversion: 2.25 time: 0.418859 Jul 25 20:03:26.618230 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 204/416] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:26 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 2052 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:26.631338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:26.634593 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:26.634593 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:26.636345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.642210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.643832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.644407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.708752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb84ba6a-8172-492a-8dcb-0ddef86f7549 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.081969 Jul 25 20:03:26.711316 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 213/417] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Jul 25 20:03:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:26.723277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845775-3", "block_migration": "auto"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:26.726024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:26.737603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.739523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:26.740397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:26.740922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:27.066292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:27.067839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:27.093455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:27.094208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:27.095234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:27.095784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:27.418192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:27.428986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b82fc8f-6196-41ac-b449-adc4e5cf6b98 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.369155 Jul 25 20:03:27.430333 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 214/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:27 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:27.447479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Action: 'update', calling method: .version_select at 0x7f196a296040>, body: {"quota_set": {"ram": "5120"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:28.043276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'flavor' on Instance uuid d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:28.129190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Going to try to live migrate instance to n-h1-845775-3 {{(pid=119724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:03:28.258272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:28.404714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:28.405894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:28.409116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:28.410343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:28.589204 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b81d062-7f17-42bf-b022-afdb0ef2d4bc tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f" status: 200 len: 328 microversion: 2.1 time: 1.157270 Jul 25 20:03:28.599382 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 215/419] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:03:27 2022] PUT /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f => generated 328 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:28.615510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-413777f6-29f9-4ba3-8fc0-9d01a344915f req-8bcb0de7-5522-48ae-9331-e94ea7e5f4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fc0eeb-467e-41f4-8ff8-af4bcf390b99", "name": "network-vif-plugged", "status": "completed", "tag": "8d1d4982-0dc1-4dd0-832c-11c294cc092c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:28.631604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-413777f6-29f9-4ba3-8fc0-9d01a344915f req-8bcb0de7-5522-48ae-9331-e94ea7e5f4b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:28.632662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-413777f6-29f9-4ba3-8fc0-9d01a344915f req-8bcb0de7-5522-48ae-9331-e94ea7e5f4b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:28.648539 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-413777f6-29f9-4ba3-8fc0-9d01a344915f req-8bcb0de7-5522-48ae-9331-e94ea7e5f4b0 service nova] Creating event network-vif-plugged:8d1d4982-0dc1-4dd0-832c-11c294cc092c for instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 on n-h1-845775-3 Jul 25 20:03:28.656241 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-413777f6-29f9-4ba3-8fc0-9d01a344915f req-8bcb0de7-5522-48ae-9331-e94ea7e5f4b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052102 Jul 25 20:03:28.658089 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 216/420] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:28.667723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:28.668745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:28.679573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:28.700294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:28.702057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:28.706866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:29.746877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:29.767151 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba3bdffa-889b-4e5f-a89a-dc445f38b590 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1473 microversion: 2.1 time: 1.105281 Jul 25 20:03:29.767809 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 217/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:28 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1473 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:29.805113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:29.807093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:29.831196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:29.832012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:29.836080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:29.838531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:30.210025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:30.239244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6435c84c-12d7-4a63-87f7-de69e35ededb tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1322 microversion: 2.1 time: 0.452027 Jul 25 20:03:30.252970 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 218/422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:29 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:30.616529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df89014d-78c4-411e-9031-da3e5bf4c17e tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1692508519", "id": 586332778, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:30.659206 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:30.659206 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:30.716671 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df89014d-78c4-411e-9031-da3e5bf4c17e tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.449846 Jul 25 20:03:30.726569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 219/423] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:03:30 2022] POST /compute/v2.1/flavors => generated 465 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:30.731789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f196c7b35e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:31.048362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:31.050864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:31.052632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:31.053601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:31.093375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:31.138255 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74b7d4f7-dd01-4668-a731-c43946eda06c tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f/detail" status: 200 len: 916 microversion: 2.1 time: 0.410118 Jul 25 20:03:31.142695 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 220/424] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:03:30 2022] GET /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f/detail => generated 916 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:31.494076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e1c6c7d-ef28-4855-a17a-2d898f074146 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Calling method '.version_select at 0x7f196a054e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:31.495293 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:31.495293 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:31.496937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e1c6c7d-ef28-4855-a17a-2d898f074146 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ac95b26e03bf43d0875429be4fe36e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0704c2ba13f54bdb8aea4ae47fc73d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e1c6c7d-ef28-4855-a17a-2d898f074146 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Request method failure captured: Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOTaUqMRD-fOQqoQV-J2BsKr_ZMUCKX3c7TyklZEjlv-eAStuhHMUoDHeJi3qS3sMQJzMt7AnaUMIuvp0RhgyE_K9x0DLSJElX2gXE8JbNzmAON_SMYeXhHYoCRqj8kJsWA3KrivrMXZpyJbmI4YZ-SK4TlT13vGN_d47VWpXxmko Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:31.501891 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}] Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ac95b26e03bf43d0875429be4fe36e83 Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:03:31.503343 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:31.504221 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 25 20:03:31.505424 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.508982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e1c6c7d-ef28-4855-a17a-2d898f074146 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:31.510667 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e1c6c7d-ef28-4855-a17a-2d898f074146 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.358901 Jul 25 20:03:31.522156 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 221/425] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:03:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:31.529131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:31.530770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:31.560495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:31.560975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:31.568381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:31.569133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:31.745921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Request method failure captured: Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5/diagnostics HTTP/1.1 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vb0qiHbvOcMyKJWaxXE-R5hUGknvxV9ILZoVfKHt1wM2Cq05sTh4oZFvl9z5htFg5859Pmspjvo07Gay-5Cj638HVdhcLIZBisKYIan8jmQ0rNoF2KkOKWAqZn2iJTcsvQ7vCTkGRjU-hDepRL7lM6wloKPEpMSoW1tm-2zQcnIpjk Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 30b360d8347d487db79dc2eafc2cf9b8 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:31.752512 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/30b360d8347d487db79dc2eafc2cf9b8"}]}] Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 30b360d8347d487db79dc2eafc2cf9b8 Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerDiagnosticsNegativeTest-165277876-project Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ed77cff514cc478d8b2a72d89a742d35 Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-165277876-project Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:03:31.754409 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '696be067-7add-4b8e-ae29-32c441e7aca5'} Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:31.755680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 25 20:03:31.756931 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:31.758486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:31.762071 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b8492f8f-4321-4b59-9ba8-9c74e5bd8404 tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.238331 Jul 25 20:03:31.774156 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 222/426] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:03:31 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5/diagnostics => generated 117 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:32.120356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1a557183-bd1b-4f75-9f6d-cf4fbd119fe1 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:32.143103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1a557183-bd1b-4f75-9f6d-cf4fbd119fe1 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] 10.222.0.48 "GET /compute/v2.1/flavors/586332778" status: 200 len: 465 microversion: 2.61 time: 0.359316 Jul 25 20:03:32.143697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 223/427] 10.222.0.48 () {60 vars in 1196 bytes} [Mon Jul 25 20:03:31 2022] GET /compute/v2.1/flavors/586332778 => generated 465 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:32.156070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:32.161432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:32.179544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:32.180667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:32.183275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:32.184744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:32.701420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:32.719282 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11abc34e-f415-4193-9083-0216e482aed2 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1471 microversion: 2.1 time: 0.572911 Jul 25 20:03:32.719981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 224/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:32 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:32.730842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b6557c-01ba-43be-8853-6c53d9476d2e tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Calling method '.version_select at 0x7f196a054ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:32.732391 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:32.732391 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:32.734444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9b6557c-01ba-43be-8853-6c53d9476d2e tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ac95b26e03bf43d0875429be4fe36e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0704c2ba13f54bdb8aea4ae47fc73d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b6557c-01ba-43be-8853-6c53d9476d2e tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Request method failure captured: Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOTaUqMRD-fOQqoQV-J2BsKr_ZMUCKX3c7TyklZEjlv-eAStuhHMUoDHeJi3qS3sMQJzMt7AnaUMIuvp0RhgyE_K9x0DLSJElX2gXE8JbNzmAON_SMYeXhHYoCRqj8kJsWA3KrivrMXZpyJbmI4YZ-SK4TlT13vGN_d47VWpXxmko Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:32.738380 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}] Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ac95b26e03bf43d0875429be4fe36e83 Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:03:32.741111 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:32.742862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 25 20:03:32.745250 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:32.759431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b6557c-01ba-43be-8853-6c53d9476d2e tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:32.766332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9b6557c-01ba-43be-8853-6c53d9476d2e tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.038435 Jul 25 20:03:32.769234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 225/429] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:03:32 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:32.790597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Action: 'update', calling method: .version_select at 0x7f1969fca790>, body: {"quota_set": {"ram": "2048"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:32.950770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:32.952337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:32.953499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:32.954284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.020494 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24a263f6-5af5-45ee-9e23-4273a4c1b616 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb/action" status: 202 len: 0 microversion: 2.25 time: 6.300961 Jul 25 20:03:33.024494 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 205/430] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:03:26 2022] POST /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb/action => generated 0 bytes in 6306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:33.035804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.036509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.048395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.048848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.049410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.050083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.052481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.056559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.061817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.068343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.134717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:03:33.138264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:INSERT=3,nova_api:RELEASE=1,nova_api:SELECT=91,nova_api:DELETE=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.191969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.210982 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9dddca1-620a-4980-8910-d379cb70e730 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f?user_id=6366f965245044daa475e53eddff4568" status: 200 len: 328 microversion: 2.1 time: 0.439484 Jul 25 20:03:33.213408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 226/431] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:03:32 2022] PUT /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f?user_id=6366f965245044daa475e53eddff4568 => generated 328 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:33.226027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff4efd6d-c7d0-4f4f-bd19-c1341c987d4b tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:33.240825 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:33.240825 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:33.279951 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff4efd6d-c7d0-4f4f-bd19-c1341c987d4b tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/586332778" status: 200 len: 466 microversion: 2.61 time: 0.064687 Jul 25 20:03:33.281326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 227/432] 10.222.0.48 () {62 vars in 1216 bytes} [Mon Jul 25 20:03:33 2022] PUT /compute/v2.1/flavors/586332778 => generated 466 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:33.290190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:33.291095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.299347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.300136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.301098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.302457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.347007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16f3fdef-f838-4eda-a16f-a3186ca5448f tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "DELETE /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 204 len: 0 microversion: 2.1 time: 0.319624 Jul 25 20:03:33.348233 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 206/433] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:33 2022] DELETE /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:33.356598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a435670e-0735-40ad-9581-c87f561aa1b0 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Calling method '.version_select at 0x7f196a003e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.357904 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:33.357904 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:33.360605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a435670e-0735-40ad-9581-c87f561aa1b0 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ac95b26e03bf43d0875429be4fe36e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0704c2ba13f54bdb8aea4ae47fc73d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a435670e-0735-40ad-9581-c87f561aa1b0 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Request method failure captured: Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcOTaUqMRD-fOQqoQV-J2BsKr_ZMUCKX3c7TyklZEjlv-eAStuhHMUoDHeJi3qS3sMQJzMt7AnaUMIuvp0RhgyE_K9x0DLSJElX2gXE8JbNzmAON_SMYeXhHYoCRqj8kJsWA3KrivrMXZpyJbmI4YZ-SK4TlT13vGN_d47VWpXxmko Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:33.364093 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}] Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ac95b26e03bf43d0875429be4fe36e83 Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:03:33.365620 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:33.366554 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 25 20:03:33.367887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:33.370874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a435670e-0735-40ad-9581-c87f561aa1b0 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:33.372027 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a435670e-0735-40ad-9581-c87f561aa1b0 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022423 Jul 25 20:03:33.372824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 207/434] 10.222.0.48 () {58 vars in 1179 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:33.406865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lazy-loading 'flavor' on Instance uuid 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:33.475240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dbbd32fb-583f-4a2b-affd-3252fac7c800 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Calling method '.version_select at 0x7f1969ec8670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.524578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:33.579053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dbbd32fb-583f-4a2b-affd-3252fac7c800 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.202739 Jul 25 20:03:33.579871 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 208/435] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:03:33.585412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.588841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.600083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf5a7726-0194-4075-a476-ac800add1042 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99/action" status: 202 len: 0 microversion: 2.1 time: 0.316264 Jul 25 20:03:33.605472 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 228/436] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:33 2022] POST /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:03:33.608117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.612675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.613768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.616721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.622800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4e30a01-786b-47f1-b988-9e56d48e872d tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f1969fc9940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.752057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4e30a01-786b-47f1-b988-9e56d48e872d tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f?user_id=6366f965245044daa475e53eddff4568" status: 200 len: 370 microversion: 2.1 time: 0.144976 Jul 25 20:03:33.752985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 229/437] 10.222.0.48 () {58 vars in 1323 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/os-quota-sets/f6944737f5dd4a49bf818d6a4020e18f?user_id=6366f965245044daa475e53eddff4568 => generated 370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:33.770754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd78b3e6-d44e-46f1-8fa5-60947cb1e423 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.847137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:33.852763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd78b3e6-d44e-46f1-8fa5-60947cb1e423 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.097539 Jul 25 20:03:33.861770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 230/438] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:33.871901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:33.875602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:33.877886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:33.879726 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cdb31128-1451-413f-b0b7-4bf4c3aba65d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.298619 Jul 25 20:03:33.881437 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 209/439] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:33.881956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:33.897998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.899056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:33.909048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:33.909837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.021581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Calling method '.version_select at 0x7f1969ec8040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.023720 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:34.023720 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:34.025573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:34.026214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.050184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:34.051759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.081249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:34.082191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.095053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f916cd51-3415-4008-9216-536b0316ec43 tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.211172 Jul 25 20:03:34.103638 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 210/440] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:34.116740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caa97945-33b4-4165-8893-a36620ce14c6 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Action: 'create', calling method: .version_select at 0x7f1969ec8820>, body: {"pool": "non_exist_pool"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:34.183786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-caa97945-33b4-4165-8893-a36620ce14c6 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] HTTP exception thrown: Floating IP pool not found. Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caa97945-33b4-4165-8893-a36620ce14c6 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Request method failure captured: Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 26 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcUWV1QOHy8eR2DSmrt1Zli4ndb9eGTJbnaTFTaU0rdCATZLJrF0wRAbFjCixTj79ATtfX5tK9Z7bAPXzSMyhkA67ycMhTedvEWADGxcKxquf4BD-R9H0zNRPDJ0XGrOmfo9uDdOjqnD11LZDPhpGnnP3g0SsOzaeZ9Vc0hZcsDLgI Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 924af91d94994d268229f4f40d64e7e6 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:34.186924 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/924af91d94994d268229f4f40d64e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_924af91d94994d268229f4f40d64e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/924af91d94994d268229f4f40d64e7e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/924af91d94994d268229f4f40d64e7e6"}]}] Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 924af91d94994d268229f4f40d64e7e6 Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsNegativeTestJSON-208565482-project Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: e621eb03fcdc4107b8b4a96d8b6bda70 Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-208565482-project Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: {"pool": "non_exist_pool"} Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: exception: Floating IP pool not found. Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 25 20:03:34.190102 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:34.191990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caa97945-33b4-4165-8893-a36620ce14c6 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Returning 404 to user: Floating IP pool not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:34.197518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-caa97945-33b4-4165-8893-a36620ce14c6 tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.084316 Jul 25 20:03:34.201338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 211/441] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:03:34 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:03:34.201338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.201338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:34.219124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:34.219821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.220909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:34.221512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:34.243273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:34.281912 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9e5c939-5e92-4002-ac53-69625af55cbb tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1479 microversion: 2.1 time: 0.418346 Jul 25 20:03:34.293007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 231/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:33 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1479 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:34.310472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b593cf1c-91d5-4766-8d80-88da1d463091 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.430578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b593cf1c-91d5-4766-8d80-88da1d463091 tempest-FlavorsV261TestJSON-1158108723 tempest-FlavorsV261TestJSON-1158108723-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.119910 Jul 25 20:03:34.440905 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 232/443] 10.222.0.48 () {60 vars in 1166 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:34.472206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93ae237c-7af7-4d20-bcfa-004a931632c8 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Calling method '.version_select at 0x7f1969ef1310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.474451 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:34.474451 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:34.483697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93ae237c-7af7-4d20-bcfa-004a931632c8 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ac95b26e03bf43d0875429be4fe36e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0704c2ba13f54bdb8aea4ae47fc73d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93ae237c-7af7-4d20-bcfa-004a931632c8 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Request method failure captured: Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOTaUqMRD-fOQqoQV-J2BsKr_ZMUCKX3c7TyklZEjlv-eAStuhHMUoDHeJi3qS3sMQJzMt7AnaUMIuvp0RhgyE_K9x0DLSJElX2gXE8JbNzmAON_SMYeXhHYoCRqj8kJsWA3KrivrMXZpyJbmI4YZ-SK4TlT13vGN_d47VWpXxmko Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:34.508556 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}] Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ac95b26e03bf43d0875429be4fe36e83 Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1'} Jul 25 20:03:34.511377 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:34.514922 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 25 20:03:34.528786 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.531595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93ae237c-7af7-4d20-bcfa-004a931632c8 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:34.531595 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93ae237c-7af7-4d20-bcfa-004a931632c8 tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.076051 Jul 25 20:03:34.531595 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 233/444] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 85 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:34.554282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Calling method '.version_select at 0x7f1969fc9040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.721122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4b347003-9274-4cc3-a2d3-79511c0d9f68 could not be found", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:03:34.721887 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] HTTP exception thrown: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Request method failure captured: Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-floating-ips/4b347003-9274-4cc3-a2d3-79511c0d9f68 HTTP/1.1 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcUWV1QOHy8eR2DSmrt1Zli4ndb9eGTJbnaTFTaU0rdCATZLJrF0wRAbFjCixTj79ATtfX5tK9Z7bAPXzSMyhkA67ycMhTedvEWADGxcKxquf4BD-R9H0zNRPDJ0XGrOmfo9uDdOjqnD11LZDPhpGnnP3g0SsOzaeZ9Vc0hZcsDLgI Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 924af91d94994d268229f4f40d64e7e6 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:34.733138 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/924af91d94994d268229f4f40d64e7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_924af91d94994d268229f4f40d64e7e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/924af91d94994d268229f4f40d64e7e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/924af91d94994d268229f4f40d64e7e6"}]}] Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 924af91d94994d268229f4f40d64e7e6 Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-208565482 Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsNegativeTestJSON-208565482-project Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: e621eb03fcdc4107b8b4a96d8b6bda70 Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-208565482-project Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: exception: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68 Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4b347003-9274-4cc3-a2d3-79511c0d9f68'} Jul 25 20:03:34.737089 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:03:34.738862 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4b347003-9274-4cc3-a2d3-79511c0d9f68 could not be found Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5dc198ef-bb3e-4558-b832-5ec06e71f448'] Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68. Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.741463 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68 Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:34.743929 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68 Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] Returning 404 to user: Floating IP not found for ID 4b347003-9274-4cc3-a2d3-79511c0d9f68 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fe2068a-31d9-4cfd-9f86-ae2921ef11ea tempest-FloatingIPsNegativeTestJSON-208565482 tempest-FloatingIPsNegativeTestJSON-208565482-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/4b347003-9274-4cc3-a2d3-79511c0d9f68" status: 404 len: 111 microversion: 2.1 time: 0.201630 Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 234/445] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:03:34 2022] DELETE /compute/v2.1/os-floating-ips/4b347003-9274-4cc3-a2d3-79511c0d9f68 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:34.750993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25d84187-8a28-4404-a0b2-55f8add9f687 tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.751870 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:34.751870 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:34.803717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25d84187-8a28-4404-a0b2-55f8add9f687 tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/586332778" status: 202 len: 0 microversion: 2.61 time: 0.065599 Jul 25 20:03:34.805223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 235/446] 10.222.0.48 () {60 vars in 1199 bytes} [Mon Jul 25 20:03:34 2022] DELETE /compute/v2.1/flavors/586332778 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:34.815157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5aedaa59-f554-4ec7-867a-b87dcc44727a tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Calling method '.version_select at 0x7f196a0548b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.818394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5aedaa59-f554-4ec7-867a-b87dcc44727a tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] HTTP exception thrown: Hypervisor with ID 'c2c3496f-0879-4143-a492-c5d15688483a' could not be found. Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5aedaa59-f554-4ec7-867a-b87dcc44727a tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Request method failure captured: Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/c2c3496f-0879-4143-a492-c5d15688483a/uptime HTTP/1.1 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcQtzxVh-0To6kvRTcfQoBebqtsIHUB7BlH1Qs-yQBaE81aMIK8Ib5rvg6ku7DTKJhhbbqlEMFkaU_tL-S_XMmHEmFDVY93IrKB3FPdgfAS8DBBe4X6QCf-tEhgtHfjmXr5Thd9DMYz68VLIMkEQYG-Auxf21wWxgK0YTicXBV9NQ0 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aeb742ed79eb434e8ffa5a3f2534398b Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:03:34.831241 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aeb742ed79eb434e8ffa5a3f2534398b"}]}] Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aeb742ed79eb434e8ffa5a3f2534398b Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 756f8b6b3a534823ac918830bafe23d1 Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: exception: Hypervisor with ID 'c2c3496f-0879-4143-a492-c5d15688483a' could not be found. Jul 25 20:03:34.833191 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c2c3496f-0879-4143-a492-c5d15688483a'} Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c2c3496f-0879-4143-a492-c5d15688483a' Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 20:03:34.834189 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c2c3496f-0879-4143-a492-c5d15688483a' could not be found. Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:34.835768 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c2c3496f-0879-4143-a492-c5d15688483a' could not be found. Jul 25 20:03:34.837380 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:34.838683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5aedaa59-f554-4ec7-867a-b87dcc44727a tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Returning 404 to user: Hypervisor with ID 'c2c3496f-0879-4143-a492-c5d15688483a' could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:34.839718 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5aedaa59-f554-4ec7-867a-b87dcc44727a tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/c2c3496f-0879-4143-a492-c5d15688483a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033341 Jul 25 20:03:34.841026 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 236/447] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/os-hypervisors/c2c3496f-0879-4143-a492-c5d15688483a/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:34.850572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44b9cc87-7b24-4b3c-8509-9307f0c1ccb3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Calling method '.version_select at 0x7f1969ef15e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:34.970510 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a2e25a2-46a0-4170-a1b5-7731361bb151 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1630 microversion: 2.1 time: 0.779144 Jul 25 20:03:34.971040 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 212/448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1630 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:34.981297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9a50a75-46ff-4dcc-a1b0-e9c6fdbfef5b tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.040304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9a50a75-46ff-4dcc-a1b0-e9c6fdbfef5b tempest-FlavorsV261TestJSON-134552868 tempest-FlavorsV261TestJSON-134552868-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.065062 Jul 25 20:03:35.041308 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 213/449] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:35.058618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Calling method '.version_select at 0x7f1969df7b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.059424 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:35.059424 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:35.082067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.082529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.153948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.154401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.242035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.242834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.277255 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a66293e7-5998-437d-bc35-0ddccb5cc60d tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.221848 Jul 25 20:03:35.290972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 214/450] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:03:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:35.318005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.321047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:35.363496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.364533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.377091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.378026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.548244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44b9cc87-7b24-4b3c-8509-9307f0c1ccb3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.704831 Jul 25 20:03:35.550163 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 237/451] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:03:34 2022] GET /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f/defaults => generated 371 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:35.565257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc9f0634-64b8-4345-bb06-72ae41b5508a tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Calling method '.version_select at 0x7f196a11c4c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.566392 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:35.566392 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:35.567731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc9f0634-64b8-4345-bb06-72ae41b5508a tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ac95b26e03bf43d0875429be4fe36e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0704c2ba13f54bdb8aea4ae47fc73d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc9f0634-64b8-4345-bb06-72ae41b5508a tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Request method failure captured: Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOTaUqMRD-fOQqoQV-J2BsKr_ZMUCKX3c7TyklZEjlv-eAStuhHMUoDHeJi3qS3sMQJzMt7AnaUMIuvp0RhgyE_K9x0DLSJElX2gXE8JbNzmAON_SMYeXhHYoCRqj8kJsWA3KrivrMXZpyJbmI4YZ-SK4TlT13vGN_d47VWpXxmko Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:35.569546 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0704c2ba13f54bdb8aea4ae47fc73d3f"}]}] Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0704c2ba13f54bdb8aea4ae47fc73d3f Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746 Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ac95b26e03bf43d0875429be4fe36e83 Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1672479746-project Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1'} Jul 25 20:03:35.570813 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:03:35.571665 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 25 20:03:35.573223 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:35.577264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc9f0634-64b8-4345-bb06-72ae41b5508a tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:35.586409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc9f0634-64b8-4345-bb06-72ae41b5508a tempest-HypervisorAdminNegativeTestJSON-1672479746 tempest-HypervisorAdminNegativeTestJSON-1672479746-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.034606 Jul 25 20:03:35.587077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 238/452] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:03:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:35.593249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:35.596881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:35.618264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.619060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:35.620702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:35.621709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.259469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:36.275483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:36.278271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:36.281036 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ec171e0-4eb6-439d-9263-82586c578400 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.986915 Jul 25 20:03:36.282906 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 215/453] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:35 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:36.314227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Action: 'update', calling method: .version_select at 0x7f1969ed1d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:36.712630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed77cff514cc478d8b2a72d89a742d35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30b360d8347d487db79dc2eafc2cf9b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:36.745669 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64db249e-cd46-4a84-9dcd-be2c574b76da tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 200 len: 1479 microversion: 2.1 time: 1.157172 Jul 25 20:03:36.751852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.773330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 239/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:35 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 1479 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:36.780149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.781719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.783677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.786771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-463a017b-b344-49b6-af0a-db663496e68b tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Calling method '.version_select at 0x7f196a054ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:36.801158 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:36.801158 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:36.802878 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-463a017b-b344-49b6-af0a-db663496e68b tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] HTTP exception thrown: Hypervisor with ID '502b4245-38b3-4652-9d29-e807c2123c2e' could not be found. Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-463a017b-b344-49b6-af0a-db663496e68b tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Request method failure captured: Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/502b4245-38b3-4652-9d29-e807c2123c2e HTTP/1.1 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcQtzxVh-0To6kvRTcfQoBebqtsIHUB7BlH1Qs-yQBaE81aMIK8Ib5rvg6ku7DTKJhhbbqlEMFkaU_tL-S_XMmHEmFDVY93IrKB3FPdgfAS8DBBe4X6QCf-tEhgtHfjmXr5Thd9DMYz68VLIMkEQYG-Auxf21wWxgK0YTicXBV9NQ0 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aeb742ed79eb434e8ffa5a3f2534398b Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:03:36.806680 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aeb742ed79eb434e8ffa5a3f2534398b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aeb742ed79eb434e8ffa5a3f2534398b"}]}] Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aeb742ed79eb434e8ffa5a3f2534398b Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681 Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 756f8b6b3a534823ac918830bafe23d1 Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: exception: Hypervisor with ID '502b4245-38b3-4652-9d29-e807c2123c2e' could not be found. Jul 25 20:03:36.808707 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '502b4245-38b3-4652-9d29-e807c2123c2e'} Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '502b4245-38b3-4652-9d29-e807c2123c2e' Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 25 20:03:36.809583 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:03:36.811485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '502b4245-38b3-4652-9d29-e807c2123c2e' could not be found. Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '502b4245-38b3-4652-9d29-e807c2123c2e' could not be found. Jul 25 20:03:36.813677 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:36.817168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-463a017b-b344-49b6-af0a-db663496e68b tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] Returning 404 to user: Hypervisor with ID '502b4245-38b3-4652-9d29-e807c2123c2e' could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:36.818959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-463a017b-b344-49b6-af0a-db663496e68b tempest-HypervisorAdminNegativeTestJSON-2057227681 tempest-HypervisorAdminNegativeTestJSON-2057227681-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/502b4245-38b3-4652-9d29-e807c2123c2e" status: 404 len: 123 microversion: 2.1 time: 0.043639 Jul 25 20:03:36.839481 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 240/455] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:03:36 2022] GET /compute/v2.1/os-hypervisors/502b4245-38b3-4652-9d29-e807c2123c2e => generated 123 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:36.862868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:36.867158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:36.891177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.894020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:36.897545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:36.900945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:37.092072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:37.415967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdf4b61a-e153-4a73-be4d-a82d8d8e3db3 tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f" status: 200 len: 329 microversion: 2.1 time: 1.117341 Jul 25 20:03:37.417600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 216/456] 10.222.0.48 () {60 vars in 1263 bytes} [Mon Jul 25 20:03:36 2022] PUT /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f => generated 329 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:37.424272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ffbafcee-7c29-4928-a18a-45485b17f745 req-f2679c13-611d-4ce9-b999-fa7ed9fa1324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696be067-7add-4b8e-ae29-32c441e7aca5", "name": "network-vif-deleted", "tag": "21161b9d-0b68-476a-a2ba-dd1c414ee3de"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:37.444262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ffbafcee-7c29-4928-a18a-45485b17f745 req-f2679c13-611d-4ce9-b999-fa7ed9fa1324 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:37.444961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ffbafcee-7c29-4928-a18a-45485b17f745 req-f2679c13-611d-4ce9-b999-fa7ed9fa1324 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:37.466992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ffbafcee-7c29-4928-a18a-45485b17f745 req-f2679c13-611d-4ce9-b999-fa7ed9fa1324 service nova] Creating event network-vif-deleted:21161b9d-0b68-476a-a2ba-dd1c414ee3de for instance 696be067-7add-4b8e-ae29-32c441e7aca5 on n-h1-845775-3 Jul 25 20:03:37.473825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ffbafcee-7c29-4928-a18a-45485b17f745 req-f2679c13-611d-4ce9-b999-fa7ed9fa1324 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054464 Jul 25 20:03:37.475195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 217/457] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:37.481299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:37.482881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:37.510312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:37.511435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:37.513295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:37.514512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:38.667700 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-863b84da-8e9a-481f-841d-54b7ea054caa tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1613 microversion: 2.1 time: 1.818237 Jul 25 20:03:38.668463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 241/458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:36 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1613 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:38.691000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:38.691496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Action: 'update', calling method: .version_select at 0x7f196a0548b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:38.708600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:38.721778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:38.731638 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98dee701-efea-4d03-af93-29b4a62c0379 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 1.254833 Jul 25 20:03:38.733071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 218/459] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:37 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:38.753309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:38.753947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] [instance: 696be067-7add-4b8e-ae29-32c441e7aca5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:38.767836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.768330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:38.769134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.769577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:38.806468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] HTTP exception thrown: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Request method failure captured: Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 HTTP/1.1 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vb0qiHbvOcMyKJWaxXE-R5hUGknvxV9ILZoVfKHt1wM2Cq05sTh4oZFvl9z5htFg5859Pmspjvo07Gay-5Cj638HVdhcLIZBisKYIan8jmQ0rNoF2KkOKWAqZn2iJTcsvQ7vCTkGRjU-hDepRL7lM6wloKPEpMSoW1tm-2zQcnIpjk Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 30b360d8347d487db79dc2eafc2cf9b8 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:03:38.808237 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/30b360d8347d487db79dc2eafc2cf9b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/30b360d8347d487db79dc2eafc2cf9b8"}]}] Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 30b360d8347d487db79dc2eafc2cf9b8 Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-165277876 Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiagnosticsNegativeTest-165277876-project Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ed77cff514cc478d8b2a72d89a742d35 Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-165277876-project Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. Jul 25 20:03:38.809551 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '696be067-7add-4b8e-ae29-32c441e7aca5'} Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:38.810279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. Jul 25 20:03:38.812325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:38.815789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] Returning 404 to user: Instance 696be067-7add-4b8e-ae29-32c441e7aca5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:38.815789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b0ccdd9-a8a6-4365-8ca2-b904fcfe9d0e tempest-ServerDiagnosticsNegativeTest-165277876 tempest-ServerDiagnosticsNegativeTest-165277876-project] 10.222.0.48 "GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5" status: 404 len: 111 microversion: 2.1 time: 0.075394 Jul 25 20:03:38.815789 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 219/460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:38 2022] GET /compute/v2.1/servers/696be067-7add-4b8e-ae29-32c441e7aca5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:38.840091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:38.843234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:38.868852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.869198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:38.870987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:38.874240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.163184 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] HTTP exception thrown: Cannot 'migrate' instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 while it is in vm_state suspended Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Request method failure captured: Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99/action HTTP/1.1 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbdoY8REMKm1kDQwcxObn0nL4dpXBcVrv9j-poDXt2pJrRCDKw_u6uQLlDbHfGy6Q9L0fuwQWUQr2kMC4L5gHAF_2drTqz6O1TnwPARDs2sqTU77My7pxc7xeRa5BU0yR-1w8KIWx1rpHBir7BV8HuZ_M89VUMefzcrs84FqvNQFC4 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:03:39.173102 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}] Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 96daefc72a34414a846a6aafc91188d7 Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: {"migrate": {}} Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:39.176652 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'migrate' instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 while it is in vm_state suspended Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '39fc0eeb-467e-41f4-8ff8-af4bcf390b99', 'body': {'migrate': {}}} Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 in vm_state suspended. Cannot resize while the instance is in this state. Jul 25 20:03:39.177620 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 while it is in vm_state suspended Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.179031 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 while it is in vm_state suspended Jul 25 20:03:39.183373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.185693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Returning 409 to user: Cannot 'migrate' instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 while it is in vm_state suspended {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:39.189767 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3445e037-0998-45ca-b623-d959032695f7 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99/action" status: 409 len: 148 microversion: 2.1 time: 0.378399 Jul 25 20:03:39.190668 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 220/461] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:38 2022] POST /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99/action => generated 148 bytes in 380 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:03:39.205807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-186eb293-d0c5-4f34-ab80-92b5f130d198 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-186eb293-d0c5-4f34-ab80-92b5f130d198 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Request method failure captured: Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action HTTP/1.1 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 39 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbdoY8REMKm1kDQwcxObn0nL4dpXBcVrv9j-poDXt2pJrRCDKw_u6uQLlDbHfGy6Q9L0fuwQWUQr2kMC4L5gHAF_2drTqz6O1TnwPARDs2sqTU77My7pxc7xeRa5BU0yR-1w8KIWx1rpHBir7BV8HuZ_M89VUMefzcrs84FqvNQFC4 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:03:39.224927 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}] Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 96daefc72a34414a846a6aafc91188d7 Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: {"os-resetState": {"state": "invalid"}} Jul 25 20:03:39.226335 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'aa2badd5-5157-4e96-bfad-9428be5d69d3', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.227071 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:03:39.228699 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 25 20:03:39.229927 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.231710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-186eb293-d0c5-4f34-ab80-92b5f130d198 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:39.233895 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-186eb293-d0c5-4f34-ab80-92b5f130d198 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action" status: 400 len: 144 microversion: 2.1 time: 0.033930 Jul 25 20:03:39.235951 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 221/462] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:39 2022] POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action => generated 144 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:03:39.255672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68384503-a24f-4a70-a609-e8dbfc2f0835 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68384503-a24f-4a70-a609-e8dbfc2f0835 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Request method failure captured: Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action HTTP/1.1 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 31 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbdoY8REMKm1kDQwcxObn0nL4dpXBcVrv9j-poDXt2pJrRCDKw_u6uQLlDbHfGy6Q9L0fuwQWUQr2kMC4L5gHAF_2drTqz6O1TnwPARDs2sqTU77My7pxc7xeRa5BU0yR-1w8KIWx1rpHBir7BV8HuZ_M89VUMefzcrs84FqvNQFC4 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:03:39.272407 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}] Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 96daefc72a34414a846a6aafc91188d7 Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: {"os-resetState": {"state": 1}} Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:39.273800 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'aa2badd5-5157-4e96-bfad-9428be5d69d3', 'body': {'os-resetState': {'state': 1}}} Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 1 Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:39.274676 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 25 20:03:39.275946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.282448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68384503-a24f-4a70-a609-e8dbfc2f0835 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:39.283839 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68384503-a24f-4a70-a609-e8dbfc2f0835 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action" status: 400 len: 120 microversion: 2.1 time: 0.032621 Jul 25 20:03:39.290478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 222/463] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:03:39 2022] POST /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:03:39.300696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:39.303396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.304169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.307368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Failed to fetch instance by id 999 {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:03:39.308477 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 25 20:03:39.310206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Request method failure captured: Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 37 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbdoY8REMKm1kDQwcxObn0nL4dpXBcVrv9j-poDXt2pJrRCDKw_u6uQLlDbHfGy6Q9L0fuwQWUQr2kMC4L5gHAF_2drTqz6O1TnwPARDs2sqTU77My7pxc7xeRa5BU0yR-1w8KIWx1rpHBir7BV8HuZ_M89VUMefzcrs84FqvNQFC4 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:03:39.318757 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/92668f0cf64348f2bccee65cb74efe21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/92668f0cf64348f2bccee65cb74efe21"}]}] Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 92668f0cf64348f2bccee65cb74efe21 Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1931461934 Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 96daefc72a34414a846a6aafc91188d7 Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1931461934-project-admin Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: {"os-resetState": {"state": "error"}} Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:03:39.320231 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 999 could not be found. Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:03:39.320990 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 20:03:39.322199 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:03:39.323008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.325106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:39.326266 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6d0b675-78eb-403e-a64c-fe74e2a6c125 tempest-ServersAdminNegativeTestJSON-1931461934 tempest-ServersAdminNegativeTestJSON-1931461934-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030187 Jul 25 20:03:39.327394 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 223/464] 10.222.0.48 () {60 vars in 1179 bytes} [Mon Jul 25 20:03:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 20:03:39.343377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:39.345284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:39.383804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.384923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.387902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.389002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.466826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:03:39.724218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5371c812-516c-474b-abbd-156f70b68b39 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 204 len: 0 microversion: 2.1 time: 0.390490 Jul 25 20:03:39.725171 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 224/465] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:39 2022] DELETE /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:03:39.742815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0df6089e-b012-4a4c-aba4-5686deae1022 req-e5e0e871-9193-425a-8cbf-9c0307ef57be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "name": "network-vif-unplugged", "status": "completed", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:39.766055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0df6089e-b012-4a4c-aba4-5686deae1022 req-e5e0e871-9193-425a-8cbf-9c0307ef57be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.769865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0df6089e-b012-4a4c-aba4-5686deae1022 req-e5e0e871-9193-425a-8cbf-9c0307ef57be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.808012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0df6089e-b012-4a4c-aba4-5686deae1022 req-e5e0e871-9193-425a-8cbf-9c0307ef57be service nova] Creating event network-vif-unplugged:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h2-845775-3 Jul 25 20:03:39.824069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0df6089e-b012-4a4c-aba4-5686deae1022 req-e5e0e871-9193-425a-8cbf-9c0307ef57be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095404 Jul 25 20:03:39.826100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 225/466] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:39.837000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:39.846217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:39.877766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.878537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:39.881318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:39.882051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:40.103647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=13,nova_api:UPDATE=13,nova_api:DELETE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:40.221375 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a29a90b2-de35-46a7-a2c1-670d887e110a tempest-QuotasAdminTestJSON-1620400775 tempest-QuotasAdminTestJSON-1620400775-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f" status: 200 len: 329 microversion: 2.1 time: 1.534839 Jul 25 20:03:40.223938 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 242/467] 10.222.0.48 () {60 vars in 1263 bytes} [Mon Jul 25 20:03:38 2022] PUT /compute/v2.1/os-quota-sets/a2d49ae497b34937a99859c32236774f => generated 329 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:40.245460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:40.256025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:40.287697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:40.289413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:40.290796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:40.291800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:40.757059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:40.779453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6a3773e-661a-4c51-b0f6-0e4fc4516e36 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1468 microversion: 2.1 time: 0.939003 Jul 25 20:03:40.784245 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 226/468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:39 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1468 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:41.130337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:41.246331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:41.257196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:41.258554 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79b473cb-2846-4e40-a689-8f28d3e1ba4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 1.033020 Jul 25 20:03:41.259417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 243/469] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:40 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:41.815826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:41.816598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:41.831866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:41.832573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:41.837504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:41.838227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:42.149747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a595f35-a501-4216-985b-7cf3924bebaf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:42.202438 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a595f35-a501-4216-985b-7cf3924bebaf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.586071 Jul 25 20:03:42.204173 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 227/470] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:03:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:42.247935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8fec20f9-1d89-4988-a896-e9efe6227676 req-10b4a27b-126f-4248-8057-ce7e561a59e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:42.305765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8fec20f9-1d89-4988-a896-e9efe6227676 req-10b4a27b-126f-4248-8057-ce7e561a59e6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:42.308222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8fec20f9-1d89-4988-a896-e9efe6227676 req-10b4a27b-126f-4248-8057-ce7e561a59e6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:42.325183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:42.351416 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e72fd572-2d6a-4e28-b93e-c5118155b4cd tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1468 microversion: 2.1 time: 0.541233 Jul 25 20:03:42.352568 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 244/471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:41 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1468 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:42.364643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8fec20f9-1d89-4988-a896-e9efe6227676 req-10b4a27b-126f-4248-8057-ce7e561a59e6 service nova] Creating event network-changed:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h2-845775-3 Jul 25 20:03:42.386698 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8fec20f9-1d89-4988-a896-e9efe6227676 req-10b4a27b-126f-4248-8057-ce7e561a59e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176808 Jul 25 20:03:42.390206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 228/472] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:42.401216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:42.407589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:42.440236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:42.441549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:42.445983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:42.448277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:43.270336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:43.308412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:43.317696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:43.341920 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e8384a8-ed7c-4aba-aec0-f2e0783e0554 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.932194 Jul 25 20:03:43.343221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 229/473] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:42 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:43.362487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9d2a512b-0f63-479b-be98-1b91a7d799ca req-ee6aae2b-8106-4b19-b3a9-a4a277e5cc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fc0eeb-467e-41f4-8ff8-af4bcf390b99", "name": "network-vif-deleted", "tag": "8d1d4982-0dc1-4dd0-832c-11c294cc092c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:43.392780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32c890e7-5641-4ab7-9d41-e8da52b57312 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1238544321", "id": 716673613, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:43.403538 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:43.403538 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:43.414583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9d2a512b-0f63-479b-be98-1b91a7d799ca req-ee6aae2b-8106-4b19-b3a9-a4a277e5cc96 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:43.426102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9d2a512b-0f63-479b-be98-1b91a7d799ca req-ee6aae2b-8106-4b19-b3a9-a4a277e5cc96 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:43.453483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32c890e7-5641-4ab7-9d41-e8da52b57312 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.097543 Jul 25 20:03:43.454138 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 245/474] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:42 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:43.480778 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9d2a512b-0f63-479b-be98-1b91a7d799ca req-ee6aae2b-8106-4b19-b3a9-a4a277e5cc96 service nova] Creating event network-vif-deleted:8d1d4982-0dc1-4dd0-832c-11c294cc092c for instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 on n-h1-845775-3 Jul 25 20:03:43.490052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:43.491728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:43.494267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9d2a512b-0f63-479b-be98-1b91a7d799ca req-ee6aae2b-8106-4b19-b3a9-a4a277e5cc96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148203 Jul 25 20:03:43.504441 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 230/475] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:43.512579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88434ff0-6aa9-465d-8da1-a86fbc502ea7 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:43.542112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:43.552995 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88434ff0-6aa9-465d-8da1-a86fbc502ea7 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.046961 Jul 25 20:03:43.553715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:43.560314 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 231/476] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Jul 25 20:03:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:03:43.561475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:43.562402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:43.577825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81b267c8-bd8c-481c-a08d-cc07eafbd908 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-575642133", "id": 487381553, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:43.596732 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:43.596732 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:43.635129 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81b267c8-bd8c-481c-a08d-cc07eafbd908 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.068570 Jul 25 20:03:43.645381 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 232/477] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:43 2022] POST /compute/v2.1/flavors => generated 421 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:43.651159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c6d18c4-0a9e-43a1-833d-47f35a302ea0 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:43.699866 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c6d18c4-0a9e-43a1-833d-47f35a302ea0 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.052886 Jul 25 20:03:43.715525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:43.716441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:43.717524 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 233/478] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Jul 25 20:03:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:03:43.718409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lazy-loading 'fault' on Instance uuid 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:43.734213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1afaf1c3-8c50-4112-ab6d-02fa57dc4bd7 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Action: 'create', calling method: .version_select at 0x7f1969ecef70>, body: {"keypair": {"name": "tempest-keypair-433884167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImy/qqN0TCpdpRzXZRq7zEf8GDZd75qxJ0GCmNr3pIxFN4W9pgGGWpfVuM3DKPCMXtaFyrSisOiJYv2DKYgkb6n5votQThrpG00wx4AkC9LYSb9tkWIDX1hE/V4sGEcWA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:43.801232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1afaf1c3-8c50-4112-ab6d-02fa57dc4bd7 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:43.838582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1afaf1c3-8c50-4112-ab6d-02fa57dc4bd7 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for user 9dbcf9f54120415792c4b620078b8a0a and project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:43.919264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1afaf1c3-8c50-4112-ab6d-02fa57dc4bd7 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200231 Jul 25 20:03:43.926574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 234/479] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:03:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:43.994984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:44.011783 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4b7034e-c83f-4ee9-bf95-a1a08559723c tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 200 len: 1312 microversion: 2.1 time: 0.550795 Jul 25 20:03:44.013389 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 246/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:43 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 1312 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:44.397580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:44.411915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:44.431746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:44.432818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:44.435459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:44.441286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:44.523119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:45.052009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:45.053384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: 39fc0eeb-467e-41f4-8ff8-af4bcf390b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:45.066171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.077407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.083400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.092863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.139012 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] HTTP exception thrown: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Request method failure captured: Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 HTTP/1.1 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbbWDy1KDFAIZRGYnF_C0sldR0iAdYy69FEK6MtOldx8NIr8AeuWZu4wSCyf3DoVIj3qW8nR1IByKQ0KqSNKNe7F5GeDEI9UsnM_-5ZdM1DGUhtpGLc3MFRP38r_A4RkrEGjljKpIB3Itc2PRt9iTiF490047faESdj_o34xmEo1Pw Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 5cc2511a5f074cc2a2202824e562a706 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:45.155313 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5cc2511a5f074cc2a2202824e562a706"}]}] Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 5cc2511a5f074cc2a2202824e562a706 Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminNegativeTestJSON-1850919781-project Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 379a83cc54324c8abbf35a120ffde95c Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850919781-project Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. Jul 25 20:03:45.157091 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '39fc0eeb-467e-41f4-8ff8-af4bcf390b99'} Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:45.157961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. Jul 25 20:03:45.159474 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:45.166200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Returning 404 to user: Instance 39fc0eeb-467e-41f4-8ff8-af4bcf390b99 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:45.167293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a29d47e5-6d81-4a80-9552-a47310ed5ab6 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99" status: 404 len: 111 microversion: 2.1 time: 0.119797 Jul 25 20:03:45.177205 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 247/481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:45 2022] GET /compute/v2.1/servers/39fc0eeb-467e-41f4-8ff8-af4bcf390b99 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:03:45.187423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:45.188727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:45.206348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.208967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.213311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.214214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.294642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:03:45.513319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:45.552935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:45.563391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:45.574195 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a8a07cc5-4b15-4d01-88ae-f4cb3be0b25e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 1.183321 Jul 25 20:03:45.589842 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 235/482] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:44 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:45.622296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-181bbaae-bd0c-46d9-9b2a-c9252745c389 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 204 len: 0 microversion: 2.1 time: 0.438860 Jul 25 20:03:45.625736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 248/483] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:03:45 2022] DELETE /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:03:45.638951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:45.640730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:45.673448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.675293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:45.677670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:45.678672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:46.383469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:46.412677 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48d52ee0-fed8-477e-b5fc-20d97dbab78f tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1478 microversion: 2.1 time: 0.780430 Jul 25 20:03:46.423302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 236/484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:45 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1478 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:46.605979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:46.607310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:46.623368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:46.626309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:46.629906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:46.632803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:47.000481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:47.009873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:47.016216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:47.021131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0aa94a76-830e-4faf-8a5a-ba9ab62c12d6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.418731 Jul 25 20:03:47.022107 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 249/485] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:46 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:47.153542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:47.447858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:47.448543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:47.469666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:47.475590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:47.483446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:47.486324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:47.559256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:48.046048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969de9940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.057324 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.057324 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:03:48.061740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.066817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.072980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.073788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.167219 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-025d594b-08c4-4e2a-94e6-6cdcd3d1eed4 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.019798 Jul 25 20:03:48.173291 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 237/486] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:03:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:03:48.194516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:48.203934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba5f06c7-8df9-4a94-872c-dff16be13712 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1478 microversion: 2.1 time: 0.763657 Jul 25 20:03:48.204410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.205339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:48.210342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 250/487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:47 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1478 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:48.223968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.230267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969ef11f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.233307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.234457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.238182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.244331 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.244331 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.249264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.254826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.258104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.258551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.297328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:48.359867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1f598fdf-9f27-4651-9e3a-a15e00305689 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.147966 Jul 25 20:03:48.362796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 251/488] 10.222.0.48 () {58 vars in 1139 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:48.374437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969d6e3a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.382697 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.382697 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.387264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.387982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.389068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.391704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.480305 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c03095b9-d7b4-40be-b613-6f86e3209669 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.110003 Jul 25 20:03:48.484306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 252/489] 10.222.0.48 () {58 vars in 1145 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:03:48.518244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f196a296670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.526085 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.526085 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.530819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.531813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.533526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.534867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.623130 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c306c922-9d00-4a2a-863f-dbd3894afbd0 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.128332 Jul 25 20:03:48.627789 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 253/490] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:48.638338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969ef11f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.642024 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.642024 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.643493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.644705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.645634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.647701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.689387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-481d5086-d3c1-4aa8-81f3-b2b4ed5e8467 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.055555 Jul 25 20:03:48.698543 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 254/491] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:03:48.704779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969fc9dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.707482 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.707482 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.718700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.719453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.720394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.720831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.772330 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09cab4cd-20b9-4d76-b813-b83ea9a25a15 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.071963 Jul 25 20:03:48.779862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 255/492] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:48.792402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969e05e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.793255 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.793255 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.800380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.800832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.818591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.819174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.855752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19619c57-702e-477b-815a-5f2d4e8ff927 tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h1-845775-3" status: 200 len: 467 microversion: 2.1 time: 0.074995 Jul 25 20:03:48.861730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 256/493] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts/n-h1-845775-3 => generated 467 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:48.893032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Calling method '.version_select at 0x7f1969ef1dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:48.897283 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:03:48.897283 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:03:48.923388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.924788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:48.991832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:48.998076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:49.066077 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4099a348-a0c0-49b4-bb97-eedd67f1828b tempest-HostsAdminTestJSON-1360557891 tempest-HostsAdminTestJSON-1360557891-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h2-845775-3" status: 200 len: 467 microversion: 2.1 time: 0.199106 Jul 25 20:03:49.082100 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 257/494] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/os-hosts/n-h2-845775-3 => generated 467 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:49.232292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:49.232878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:49.242877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:49.246461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:49.247239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:49.247692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:50.004159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:50.024552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:50.035200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:50.040563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:50.043712 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f78ac5cc-f002-4206-969d-d2ee6d3ff38b tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1436 microversion: 2.1 time: 0.808908 Jul 25 20:03:50.049023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54a9ca41-81d4-48b3-a855-de29a2d01c34 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 1.874228 Jul 25 20:03:50.049605 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 238/496] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:48 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:50.067479 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 258/496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:49 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1436 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:03:50.672621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0fe110bf-ff9b-4113-b242-542da70c70b9 req-45d790b9-3181-4450-841d-14f3403c2875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2badd5-5157-4e96-bfad-9428be5d69d3", "name": "network-vif-deleted", "tag": "399f917c-b8f5-400f-9dcc-2677c45df15d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:50.701558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0fe110bf-ff9b-4113-b242-542da70c70b9 req-45d790b9-3181-4450-841d-14f3403c2875 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:50.712472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0fe110bf-ff9b-4113-b242-542da70c70b9 req-45d790b9-3181-4450-841d-14f3403c2875 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:50.737672 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0fe110bf-ff9b-4113-b242-542da70c70b9 req-45d790b9-3181-4450-841d-14f3403c2875 service nova] Creating event network-vif-deleted:399f917c-b8f5-400f-9dcc-2677c45df15d for instance aa2badd5-5157-4e96-bfad-9428be5d69d3 on n-h1-845775-3 Jul 25 20:03:50.749546 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0fe110bf-ff9b-4113-b242-542da70c70b9 req-45d790b9-3181-4450-841d-14f3403c2875 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080035 Jul 25 20:03:50.753797 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 239/497] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:51.077337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:51.078628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:51.078919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:51.080928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:51.081167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=60 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:51.100946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:51.101446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:51.102749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:51.108212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:51.113344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:51.113823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:51.114621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:51.115060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:51.237893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:51.237893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:51.237893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lazy-loading 'fault' on Instance uuid aa2badd5-5157-4e96-bfad-9428be5d69d3 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:03:51.499342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379a83cc54324c8abbf35a120ffde95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2511a5f074cc2a2202824e562a706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:51.514493 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-abe304a8-83d3-4649-b009-c630124d9658 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 200 len: 1312 microversion: 2.1 time: 0.434696 Jul 25 20:03:51.516845 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 240/498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:51 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:51.748604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:51.757957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:51.762792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:51.773368 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4760ab33-e8e4-4ea0-8e7a-034e18ecdf47 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.700973 Jul 25 20:03:51.774745 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 259/499] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:51 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:51.902478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-306497125", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:52.001752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:52.003430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:52.008803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:52.009709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:52.010516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:52.017874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-941786917", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:52.029222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:52.030222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:52.031915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:52.032606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:52.074327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Getting quotas for project 05c06165b83d4bd9b5dce8bf51e9e427. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:52.097115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Getting quotas for user 7ee4b21e5b9e4bd08a348ee79c27d8c4 and project 05c06165b83d4bd9b5dce8bf51e9e427. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:52.101830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:03:52.116058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:52.120754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:52.197169 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26221964-a99d-4bdc-95f5-cd4c552a9f67 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.678442 Jul 25 20:03:52.201899 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 241/500] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:03:52.213914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1582785893", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "487381553", "adminPass": "***", "networks": [{"uuid": "fe55f809-80ad-4d50-a2df-d6d31755d630"}], "security_groups": [{"name": "tempest-securitygroup--773792271"}], "key_name": "tempest-keypair-433884167", "user_data": "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:52.800471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] validate_networks() for [('fe55f809-80ad-4d50-a2df-d6d31755d630', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:03:52.939069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:52.939588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:52.939970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:52.940399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:52.940804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:52.965101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:52.965548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:52.966546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:52.967146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.014867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Getting quotas for project a0e140d0de734553824e8ad5d30c057a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:53.030001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Getting quotas for user e18ee331b596463f9ff5dcb27397ed07 and project a0e140d0de734553824e8ad5d30c057a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:53.068273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:53.070908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:53.192739 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ccd338ee-8bfb-4bb4-beb5-57e8aa2f3ce9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416561 Jul 25 20:03:53.194148 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 260/501] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:03:53.199115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:53.206865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:53.223786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.224256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.225050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.225695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.563038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:53.577480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:53.580990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:53.601762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c29f68e-574e-4100-b37a-34048f33547d tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "PUT /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1354 microversion: 2.75 time: 0.403260 Jul 25 20:03:53.617600 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 261/502] 10.222.0.48 () {62 vars in 1297 bytes} [Mon Jul 25 20:03:53 2022] PUT /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1354 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:53.635142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:53.635774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] [instance: aa2badd5-5157-4e96-bfad-9428be5d69d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:53.644988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.645346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.646459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.647476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.668169 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] HTTP exception thrown: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Request method failure captured: Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 HTTP/1.1 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbbWDy1KDFAIZRGYnF_C0sldR0iAdYy69FEK6MtOldx8NIr8AeuWZu4wSCyf3DoVIj3qW8nR1IByKQ0KqSNKNe7F5GeDEI9UsnM_-5ZdM1DGUhtpGLc3MFRP38r_A4RkrEGjljKpIB3Itc2PRt9iTiF490047faESdj_o34xmEo1Pw Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 5cc2511a5f074cc2a2202824e562a706 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:03:53.671135 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5cc2511a5f074cc2a2202824e562a706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5cc2511a5f074cc2a2202824e562a706"}]}] Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 5cc2511a5f074cc2a2202824e562a706 Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1850919781 Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminNegativeTestJSON-1850919781-project Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 379a83cc54324c8abbf35a120ffde95c Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1850919781-project Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. Jul 25 20:03:53.673513 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'aa2badd5-5157-4e96-bfad-9428be5d69d3'} Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:03:53.674346 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. Jul 25 20:03:53.675528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:03:53.682841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] Returning 404 to user: Instance aa2badd5-5157-4e96-bfad-9428be5d69d3 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:03:53.684937 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80c39302-90fc-4c4d-becb-805f36ff7455 tempest-ServersAdminNegativeTestJSON-1850919781 tempest-ServersAdminNegativeTestJSON-1850919781-project] 10.222.0.48 "GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3" status: 404 len: 111 microversion: 2.1 time: 0.066235 Jul 25 20:03:53.692232 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 262/503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:53 2022] GET /compute/v2.1/servers/aa2badd5-5157-4e96-bfad-9428be5d69d3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:03:53.707716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:53.710456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:53.725814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:53.735747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.744547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:53.748354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:53.749032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:54.638739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:54.656958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:54.659712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:54.664410 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cee7b60b-94eb-40e8-b866-581c5f095089 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.970405 Jul 25 20:03:54.670626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 263/504] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:53 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:54.688547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8cf7c0b2-063f-46e9-92f1-280fd6bccac1 req-1ca90b45-6f92-4b87-9ba0-4ca0e1d608af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "name": "network-vif-unplugged", "status": "completed", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:54.722842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8cf7c0b2-063f-46e9-92f1-280fd6bccac1 req-1ca90b45-6f92-4b87-9ba0-4ca0e1d608af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:54.723465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8cf7c0b2-063f-46e9-92f1-280fd6bccac1 req-1ca90b45-6f92-4b87-9ba0-4ca0e1d608af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:54.751810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8cf7c0b2-063f-46e9-92f1-280fd6bccac1 req-1ca90b45-6f92-4b87-9ba0-4ca0e1d608af service nova] Creating event network-vif-unplugged:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h2-845775-3 Jul 25 20:03:54.759975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8cf7c0b2-063f-46e9-92f1-280fd6bccac1 req-1ca90b45-6f92-4b87-9ba0-4ca0e1d608af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086587 Jul 25 20:03:54.766230 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 264/505] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:03:54.774679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:54.776720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:54.795334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:54.800138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:54.802851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:54.803677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:54.950313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:54.951606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:54.952383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:54.953881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:54.954870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:54.984559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:55.009227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.012284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.018159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.019668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.028259 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ad88656-2f02-43d7-b5aa-92f5a8a3eef3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1209 microversion: 2.1 time: 0.259870 Jul 25 20:03:55.030744 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 265/506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:54 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:55.041580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:55.043030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:55.059459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.060187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.068982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.071736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.131478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:03:55.149542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for user 9dbcf9f54120415792c4b620078b8a0a and project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:03:55.190098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:03:55.196817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:03:55.369126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6290c87-226d-4e9e-baed-2a13400c47ba tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.163231 Jul 25 20:03:55.372673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:55.377348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 242/507] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:03:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:03:55.384490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1e51c4e-06e1-4225-9859-fc8c21fe28da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:55.385584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1e51c4e-06e1-4225-9859-fc8c21fe28da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:55.389867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:55.402377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:55.422557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:55.440250 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-207d640c-93a4-4d6d-b399-d9ca5805942e tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1416 microversion: 2.75 time: 0.405025 Jul 25 20:03:55.466682 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 266/508] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:55 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1416 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:55.723992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:55.730099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1e51c4e-06e1-4225-9859-fc8c21fe28da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:55.731942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:55.756887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.757973 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1e51c4e-06e1-4225-9859-fc8c21fe28da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1262 microversion: 2.1 time: 0.377606 Jul 25 20:03:55.760940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.763025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:55.764576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:55.779358 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 243/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:55 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1262 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:56.071446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:56.072219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:56.092343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:56.092811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:56.094156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:56.111043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:56.192684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.238998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.242490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.249038 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bafb6f1-6a96-4d2d-bb89-9ed2d8e29059 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1569 microversion: 2.25 time: 0.533150 Jul 25 20:03:56.272227 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 267/510] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:55 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1569 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:56.408117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.416510 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d86c7316-535e-4a1a-91f6-d3a1ecba0a4f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1265 microversion: 2.1 time: 0.356972 Jul 25 20:03:56.437607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 244/511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:56 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1265 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:56.481279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:56.481903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:56.493295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:56.494544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:56.497128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:56.497585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:56.787637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.795963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8fb9003-badb-4cdf-ab03-a9c2d18d8436 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:56.797266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8fb9003-badb-4cdf-ab03-a9c2d18d8436 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:56.802962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.808658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:56.819423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73c1f7b9-70a7-446a-8381-ac9f0ee83cea tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1416 microversion: 2.75 time: 0.341076 Jul 25 20:03:56.824226 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 268/512] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:56 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1416 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:57.010615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8fb9003-badb-4cdf-ab03-a9c2d18d8436 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:57.037181 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8fb9003-badb-4cdf-ab03-a9c2d18d8436 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1262 microversion: 2.1 time: 0.250395 Jul 25 20:03:57.053310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 245/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:56 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1262 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:57.286581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:57.287526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:57.303854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.306780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:57.308018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.312148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:57.480148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:57.481742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:57.501634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.506873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:57.509121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.509789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:57.896483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:57.923120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0bab25fc-4732-4dd0-b83c-597cbda884ae tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1271 microversion: 2.1 time: 0.463572 Jul 25 20:03:57.925030 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 246/514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:57 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1271 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:57.947907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:57.949332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:57.971373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.975984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:57.980027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:57.982158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:58.470054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.482235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.484322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.502735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d329c68-33b7-4eb4-8495-62c647bbe8a6 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1437 microversion: 2.75 time: 0.571966 Jul 25 20:03:58.514542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 247/515] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:57 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1437 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:58.525276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:58.529066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:58.534242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.545865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:58.547397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:58.549229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:58.551740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:58.557601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.561165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.586823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ced89bd-1bd6-4019-9e11-affb6f85bccc tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1559 microversion: 2.25 time: 1.280217 Jul 25 20:03:58.587524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 269/516] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:57 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1559 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:03:58.613792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:03:58.626020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:58.637997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:58.638436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:58.640310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:58.641020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:58.845981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:03:58.849473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:58.850268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:03:58.851352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:03:58.859613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:03:58.882244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:03:58.905976 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a926bb4-91d1-41dd-9c5a-d7f68a2883dc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1322 microversion: 2.1 time: 0.388225 Jul 25 20:03:58.906605 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 248/517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:58 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:58.928707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98898042-933c-4c49-b0f9-8215c2050a34 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '.version_select at 0x7f1969e0a940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:58.964158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98898042-933c-4c49-b0f9-8215c2050a34 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:58.964846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98898042-933c-4c49-b0f9-8215c2050a34 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.018913 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98898042-933c-4c49-b0f9-8215c2050a34 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.110985 Jul 25 20:03:59.032649 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 249/518] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Jul 25 20:03:58 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:03:59.089300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:59.111157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.111851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.112852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.115580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.127488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:03:59.375789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:59.385599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:59.388234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:59.400795 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e40b2cdb-e341-47e0-830e-71e5dd11d602 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "POST /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1/action" status: 202 len: 1494 microversion: 2.75 time: 0.812119 Jul 25 20:03:59.401765 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 270/519] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:03:58 2022] POST /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1/action => generated 1494 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 20:03:59.409806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:59.411202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:59.423710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.439211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.446441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.449029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.617937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:03:59.649998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31a73b89-f663-4b0d-87c8-67f1a44ecae0 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1271 microversion: 2.1 time: 0.246465 Jul 25 20:03:59.660053 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 271/520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:03:59 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:03:59.682070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:03:59.684789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:03:59.740916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.747113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:03:59.760381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:03:59.764587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.049318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0859e99e-f48a-4c26-b584-e275ff9ccd77 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969e0aa60>, body: {"keypair": {"name": "tempest-keypair-1010741523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwAG7LUBm2SdMt1qs1fJl07Vv/nbzLtavb0zlnSPF085cG38nt00+MeqC1g0AYYmlXJYiZoDqtBLTQx4VN9YQ/tQX4k8j/xoFgkPrf/ZkyvskLUEcnw751nQIGVg3ub1w=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:00.103936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0859e99e-f48a-4c26-b584-e275ff9ccd77 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:00.131445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0859e99e-f48a-4c26-b584-e275ff9ccd77 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:00.186352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:00.208818 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0859e99e-f48a-4c26-b584-e275ff9ccd77 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 1.172976 Jul 25 20:04:00.209460 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 250/521] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:03:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1176 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:00.215392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:00.216415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:00.225716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.226658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.228734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.229547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.382541 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2708b1e5-8f8c-4281-9722-9724d93b5cbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 2052 microversion: 2.25 time: 0.719237 Jul 25 20:04:00.388506 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 272/522] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:03:59 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 2052 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:00.415427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:00.421204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:00.439683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.440645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.444185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.445026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.696122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:00.706126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:00.712736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:00.724801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10381847-844d-4299-aff8-a4a706fe6920 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.514059 Jul 25 20:04:00.726478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 251/523] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:00 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:00.735743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-95a90176-0671-4fcf-9408-19eb796279dd tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d4de50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:00.761446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-95a90176-0671-4fcf-9408-19eb796279dd tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1010741523" status: 200 len: 512 microversion: 2.2 time: 0.030465 Jul 25 20:04:00.762315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 252/524] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Jul 25 20:04:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1010741523 => generated 512 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:00.768424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:00.777025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:00.794203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.794684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.795481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:00.795933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:00.881582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:00.891820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df07a9d2-9603-4b5d-9f7f-c355c0cf1031 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1320 microversion: 2.1 time: 0.501981 Jul 25 20:04:00.897322 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 273/525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:00 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:00.907872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2054597727", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "82f9b8d8-b338-4889-8e9c-d78340530deb"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:00.932895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:00.947655 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4094b9cf-6dfd-4424-819c-d4e037b62de9 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1271 microversion: 2.1 time: 0.183538 Jul 25 20:04:00.952316 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 253/526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:00 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:00.958705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-225d4879-4da3-489b-9fb0-5a8365ac33e7 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969ce5160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:01.027190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-225d4879-4da3-489b-9fb0-5a8365ac33e7 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010741523" status: 204 len: 0 microversion: 2.2 time: 0.070043 Jul 25 20:04:01.028787 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 254/527] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Jul 25 20:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010741523 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:01.031222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] validate_networks() for [('82f9b8d8-b338-4889-8e9c-d78340530deb', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:04:01.477493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d76bf2c7-ad94-41e7-af46-24d68b9b33c6 tempest-InstanceUsageAuditLogTestJSON-348808491 tempest-InstanceUsageAuditLogTestJSON-348808491-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:01.478409 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:01.478409 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:01.507263 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d76bf2c7-ad94-41e7-af46-24d68b9b33c6 tempest-InstanceUsageAuditLogTestJSON-348808491 tempest-InstanceUsageAuditLogTestJSON-348808491-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25 20:04:00" status: 200 len: 318 microversion: 2.1 time: 0.472070 Jul 25 20:04:01.517576 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 255/528] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:04:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-25%2020%3A04%3A00 => generated 318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:01.520065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-195bab83-0573-4356-86b6-2fd470ec2a66 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969d6be50>, body: {"keypair": {"name": "tempest-keypair-237055397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkpKMlz4XFeixbCf7Kt9Os977EQImHKrku8ubpBHhj4oUf15LlXE0uN8qjjEYE7Aw0hdz+mheXRypYmXRHcHLvE5FNYn5A31uToJ6FRHe6fdTvu/jD6Y37VdBNfmP8Eig=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:01.571051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-195bab83-0573-4356-86b6-2fd470ec2a66 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:01.579217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-195bab83-0573-4356-86b6-2fd470ec2a66 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:01.641887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-195bab83-0573-4356-86b6-2fd470ec2a66 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.125263 Jul 25 20:04:01.643666 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 256/529] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:01.753633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-92118575", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:01.823929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:04:02.382012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:04:02.382657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:04:02.383455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:04:02.384195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:04:02.384863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:04:02.399784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.400378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.402738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.403308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.439253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:02.445853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for user 98399c84012545a88dc69f2cbc91cf69 and project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:02.463249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:04:02.466329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:04:02.507976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:04:02.508603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:04:02.509527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:04:02.510262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:04:02.511236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:04:02.530587 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e5818c0-c101-486b-9998-1ee2ed1aa5fa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.631777 Jul 25 20:04:02.538702 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 274/530] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:04:02.545244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e8465dd9-c265-493b-acb0-541eee260d85 tempest-InstanceUsageAuditLogTestJSON-348808491 tempest-InstanceUsageAuditLogTestJSON-348808491-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:02.547077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.547426 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:02.547426 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:04:02.547623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.548401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.548845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.595329 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e8465dd9-c265-493b-acb0-541eee260d85 tempest-InstanceUsageAuditLogTestJSON-348808491 tempest-InstanceUsageAuditLogTestJSON-348808491-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.054650 Jul 25 20:04:02.597257 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 275/531] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:04:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:02.606746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ad49d3e-9d64-47a1-aa6b-881026242eac tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d9df70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:02.646412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Getting quotas for project d163906f445f40499dd7e9f794c92b52. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:02.649579 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0ad49d3e-9d64-47a1-aa6b-881026242eac tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237055397" status: 204 len: 0 microversion: 2.2 time: 0.048948 Jul 25 20:04:02.651009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 276/532] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Jul 25 20:04:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237055397 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:02.661381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Getting quotas for user 6e31755ee871433bbcaa657add0cb6a1 and project d163906f445f40499dd7e9f794c92b52. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:02.663346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:02.665163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:02.682984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.685222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.686814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.688266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.701867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:04:02.707686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:04:02.902758 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a91f1a2b-aea7-4b85-b18b-5493b4c4f1c8 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257077 Jul 25 20:04:02.908814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 257/533] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:04:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:04:02.917893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:02.923973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:02.947646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:02.963543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:02.985656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:02.995270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:03.000609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:03.005068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:03.017883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:03.055907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b36d199-b58b-42b5-afa5-4dadd159bfff tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.393570 Jul 25 20:04:03.062669 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 277/534] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:02 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:03.099855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:03.102393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:03.135493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:03.137637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:03.155799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:03.165455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:03.746728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:03.770347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1dfa1256-286c-4372-a08a-7a1d7bae2ddf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.852183 Jul 25 20:04:03.771224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 258/535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:02 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:03.788423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:03.789272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:03.907834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:03.916868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83403f09-09e1-46c4-a5cc-56775352d6c3 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 0.846694 Jul 25 20:04:03.920553 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 278/536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:03 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:03.933084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8c6e90f-99c9-48fb-aee6-017e8541d594 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969d9d8b0>, body: {"keypair": {"name": "tempest-keypair-722494420", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:03.988459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a8c6e90f-99c9-48fb-aee6-017e8541d594 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:04.010544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a8c6e90f-99c9-48fb-aee6-017e8541d594 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:04.070745 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8c6e90f-99c9-48fb-aee6-017e8541d594 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.148546 Jul 25 20:04:04.078685 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 279/537] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:03 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:04.091293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e0af329-8b33-4ae0-8373-3c76f222b204 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.095929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e0af329-8b33-4ae0-8373-3c76f222b204 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:04.146068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.150937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=73 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:04.201134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.203963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.212462 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1294d7c-76e4-4977-aacd-39c0c03ccb3f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1262 microversion: 2.25 time: 0.432893 Jul 25 20:04:04.213112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 259/538] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:03 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1262 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:04.230175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-719ced5d-b149-41f3-9025-886098484d4a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969ce5e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.299222 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-719ced5d-b149-41f3-9025-886098484d4a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722494420" status: 204 len: 0 microversion: 2.2 time: 0.082380 Jul 25 20:04:04.300453 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 260/539] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Jul 25 20:04:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722494420 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:04.302587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e0af329-8b33-4ae0-8373-3c76f222b204 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.317857 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e0af329-8b33-4ae0-8373-3c76f222b204 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1215 microversion: 2.1 time: 0.237428 Jul 25 20:04:04.318956 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 280/540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:04 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:04.322090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.322713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:04.354025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fefb8119-6dae-45d2-93fb-0e2ee46e39db tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969c82160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1045978351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVzabMOh76byrO240/oldD1KJIiWRJDFYmcCrTAAbv1ZcSz14mbaTyuhKotRL19LNn8JzdfJtMmg9F8CeiL0U0ROJiUOwjfT0VLjUfwGMM/YRn/0g4JNxHd3ztObyv8jQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:04.368451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.368911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.369728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.379048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.412691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fefb8119-6dae-45d2-93fb-0e2ee46e39db tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:04.423860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fefb8119-6dae-45d2-93fb-0e2ee46e39db tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:04.480566 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fefb8119-6dae-45d2-93fb-0e2ee46e39db tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.157988 Jul 25 20:04:04.483902 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 281/541] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:04.537025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f843c40e-720a-4775-9eab-a30647c8213e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969cf9430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1307900704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPEG0P4IcIFFNCEWJ2QnzA6mD1kROZdEN8CYPuBbsOECHURRuA+l4UxnpX5VSRh+jQS3XkID5vB9Hf/T9zy5dwBVCpIT3QaqN7KRbitpcKHB97q3WBuwGqAkonaLARAIw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:04.620363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f843c40e-720a-4775-9eab-a30647c8213e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:04.636224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f843c40e-720a-4775-9eab-a30647c8213e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:04.731352 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f843c40e-720a-4775-9eab-a30647c8213e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.213144 Jul 25 20:04:04.731581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.748136 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 282/542] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 231 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:04.754252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b4e2d9f6-4b49-4502-8ead-7365a0a5870a req-34b8fb64-2d7f-43bd-8f26-65c5b2aca999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604df63e-89d8-4687-9191-b8975673bf08", "tag": "6b16a330-423a-48a1-9e98-78590ac30e7e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:04.767188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.770863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b4e2d9f6-4b49-4502-8ead-7365a0a5870a req-34b8fb64-2d7f-43bd-8f26-65c5b2aca999 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.771397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b4e2d9f6-4b49-4502-8ead-7365a0a5870a req-34b8fb64-2d7f-43bd-8f26-65c5b2aca999 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.780400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:04.796911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8ac6c491-b5b7-4892-b832-2a2084c024cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.490083 Jul 25 20:04:04.797300 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b4e2d9f6-4b49-4502-8ead-7365a0a5870a req-34b8fb64-2d7f-43bd-8f26-65c5b2aca999 service nova] Creating event network-changed:6b16a330-423a-48a1-9e98-78590ac30e7e for instance 604df63e-89d8-4687-9191-b8975673bf08 on n-h1-845775-3 Jul 25 20:04:04.806040 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b4e2d9f6-4b49-4502-8ead-7365a0a5870a req-34b8fb64-2d7f-43bd-8f26-65c5b2aca999 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056237 Jul 25 20:04:04.806942 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 283/543] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:04.807396 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 261/544] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:04 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:04.815718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.826130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:04.838255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:04.840915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5f9d3d49-702d-4389-b42b-457e0ff33fbc tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969d9df70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-830176350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/THwPnw0mYrodlqc8E+amxBwbpdPYH0ey6JNGruWi8NHrfjWCiJPVZjRhbrYLtwo36OI1ERbtmk0h+b1oZJB3MNqoO8RAwjpjZ/HeavMHGtiVSPZ1m+2uDQYD/jhWsPA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:04.850410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.850859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.851643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.852229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.875941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5f9d3d49-702d-4389-b42b-457e0ff33fbc tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:04.888304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5f9d3d49-702d-4389-b42b-457e0ff33fbc tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:04.905127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:04.931441 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5f9d3d49-702d-4389-b42b-457e0ff33fbc tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.104058 Jul 25 20:04:04.938949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 284/545] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:04.948459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6986ef00-8815-4112-ab82-d774107bcbab tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d15a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.955428 n-d-845775-3 devstack@n-api.service[119723]: WARNING oslo_db.sqlalchemy.utils [None req-6986ef00-8815-4112-ab82-d774107bcbab tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:04:04.966414 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6986ef00-8815-4112-ab82-d774107bcbab tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.025955 Jul 25 20:04:04.967884 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 285/546] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Jul 25 20:04:04 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:04.985606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:04.986599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:04.995656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.996389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:04.997337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:04.997935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.544593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.552135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.561530 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98b40104-27e5-4df1-9601-faede3c51dc4 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.752242 Jul 25 20:04:05.562415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51838a8f-22c9-46f8-afb9-d79bb169a2af tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 0.592992 Jul 25 20:04:05.566596 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 286/547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:04 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:05.581576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2f5169d-6082-496a-979b-95af3801fbb3 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d15f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.583223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 262/548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:04 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:05.607306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.612407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:05.619402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2f5169d-6082-496a-979b-95af3801fbb3 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-830176350" status: 204 len: 0 microversion: 2.2 time: 0.051467 Jul 25 20:04:05.623417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 287/549] 10.222.0.48 () {60 vars in 1318 bytes} [Mon Jul 25 20:04:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-830176350 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:05.635152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.635363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.635533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.635840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:05.636352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.636793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.652218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.653615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.654742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.657134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.857975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.868713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.878963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.880862 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22f01008-2e37-4222-a842-57fc395c082e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1332 microversion: 2.25 time: 0.293335 Jul 25 20:04:05.889142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 263/550] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:05 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1332 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:05.901794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1fd3a5b1-a116-4d2e-b0a0-1cc15e820f5a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969cc2310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.927320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:05.928614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1fd3a5b1-a116-4d2e-b0a0-1cc15e820f5a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1307900704" status: 204 len: 0 microversion: 2.2 time: 0.036206 Jul 25 20:04:05.929771 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 264/551] 10.222.0.48 () {60 vars in 1321 bytes} [Mon Jul 25 20:04:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1307900704 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:05.938136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.939318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:05.942007 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9572be3-70b5-46a0-98c8-4b149d3d3c7c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1275 microversion: 2.1 time: 0.316614 Jul 25 20:04:05.949681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.951251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.952230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:05.953523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:05.956812 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 288/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:05 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:05.961888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc4d2abf-22b1-405e-8576-fe629c531ab7 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969cf9310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:05.987408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc4d2abf-22b1-405e-8576-fe629c531ab7 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1045978351" status: 204 len: 0 microversion: 2.2 time: 0.029173 Jul 25 20:04:05.996822 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 289/553] 10.222.0.48 () {60 vars in 1321 bytes} [Mon Jul 25 20:04:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1045978351 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:06.003216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aba3476c-b864-42a0-8e37-6338a6761591 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969ef1dc0>, body: {"keypair": {"name": "tempest-keypair-117508557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJROxbSihfmjhVfw/YabByzfChuyTkyTcyzwMsXA/v9N8hmXBPzpE+5M0r6aSOt4j5isyE0vreYr+uGq/OXbKErYeN9juw9bzZGNK0AWVjjj4mdeXu784F6WAr3FdnG43g=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:06.038047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-aba3476c-b864-42a0-8e37-6338a6761591 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:06.045773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-aba3476c-b864-42a0-8e37-6338a6761591 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:06.083910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:06.088857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:06.098848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:06.101866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:06.110924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99ca1a6b-009f-4de4-8ae1-26f5fbc44642 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.179381 Jul 25 20:04:06.111828 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 265/554] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:05 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:06.117898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aba3476c-b864-42a0-8e37-6338a6761591 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.115320 Jul 25 20:04:06.117898 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 290/555] 10.222.0.48 () {62 vars in 1199 bytes} [Mon Jul 25 20:04:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:04:06.131361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fdf8675c-c632-48a8-ab1d-20b4c923c781 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d155e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:06.143321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fdf8675c-c632-48a8-ab1d-20b4c923c781 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-117508557" status: 200 len: 512 microversion: 2.2 time: 0.017094 Jul 25 20:04:06.144227 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 291/556] 10.222.0.48 () {60 vars in 1255 bytes} [Mon Jul 25 20:04:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-117508557 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:06.155549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bad4c478-7f5e-4d56-9360-c984dbc03d93 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969d4d310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:06.159480 n-d-845775-3 devstack@n-api.service[119724]: WARNING oslo_db.sqlalchemy.utils [None req-bad4c478-7f5e-4d56-9360-c984dbc03d93 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:04:06.174332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bad4c478-7f5e-4d56-9360-c984dbc03d93 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.022523 Jul 25 20:04:06.179136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 266/557] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Jul 25 20:04:06 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:06.190231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73649db0-3e00-4de0-bb8f-9d01066e7dc4 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969c82160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:06.220713 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73649db0-3e00-4de0-bb8f-9d01066e7dc4 tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-117508557" status: 204 len: 0 microversion: 2.2 time: 0.035538 Jul 25 20:04:06.221402 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 292/558] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Jul 25 20:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-117508557 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:06.231758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Action: 'create', calling method: .version_select at 0x7f1969cc2ee0>, body: {"keypair": {"name": "tempest-keypair-1672177720", "type": "x509"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:06.253191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:06.260352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:06.288576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.processutils [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmta6fuei/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmta6fuei/temp.key -subj /CN=2de697c3d5484a7eb98df701ebbdcf87 -extensions v3_req_client {{(pid=119724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 20:04:06.471985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.processutils [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmta6fuei/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmta6fuei/temp.key -subj /CN=2de697c3d5484a7eb98df701ebbdcf87 -extensions v3_req_client" returned: 0 in 0.183s {{(pid=119724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 20:04:06.474154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.processutils [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmta6fuei/temp.key -password pass: {{(pid=119724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 25 20:04:06.548690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.processutils [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmta6fuei/temp.key -password pass:" returned: 0 in 0.071s {{(pid=119724) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 25 20:04:06.588305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:06.588946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:06.606728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:06.607327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:06.608181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:06.608619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:06.629291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:06.642498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Getting quotas for user 2de697c3d5484a7eb98df701ebbdcf87 and project 4ae23146381d45cbb26c6a2cea90b315. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:06.685208 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16eda761-2d83-4232-9bfb-8f39a099bf9c tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.457643 Jul 25 20:04:06.693276 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 267/559] 10.222.0.48 () {62 vars in 1198 bytes} [Mon Jul 25 20:04:06 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 467 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:04:06.700681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:06.701828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:06.709906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:06.710717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:06.712128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:06.712799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.221172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.236513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.245653 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-822ef3cd-79b2-46b9-ba61-41200e8682cd tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 0.665231 Jul 25 20:04:07.258400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d4aca6e1-ec97-4131-bc70-9758c43564b5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.562984 Jul 25 20:04:07.269129 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 293/560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:06 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:07.272427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 268/561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:06 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:07.278933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:07.279559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:07.279817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62a65871-95bb-4569-b19a-a68f5e314a5d tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969ca3700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:07.286690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.287041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.288890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.290473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.294148 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62a65871-95bb-4569-b19a-a68f5e314a5d tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1672177720" status: 200 len: 1534 microversion: 2.2 time: 0.020510 Jul 25 20:04:07.300702 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 294/562] 10.222.0.48 () {60 vars in 1258 bytes} [Mon Jul 25 20:04:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1672177720 => generated 1534 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:07.315853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-27bd635b-c871-4dbb-95b6-a5ade38216e9 req-48ae1a5e-0552-4b23-b915-e7997f2ba082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9318170e-8c6e-480a-96f5-45a0caa25c69", "tag": "9802e152-559b-4ea8-a57c-8aaeab7f8c23"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:07.332498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-27bd635b-c871-4dbb-95b6-a5ade38216e9 req-48ae1a5e-0552-4b23-b915-e7997f2ba082 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.334216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-27bd635b-c871-4dbb-95b6-a5ade38216e9 req-48ae1a5e-0552-4b23-b915-e7997f2ba082 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.362331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-27bd635b-c871-4dbb-95b6-a5ade38216e9 req-48ae1a5e-0552-4b23-b915-e7997f2ba082 service nova] Creating event network-changed:9802e152-559b-4ea8-a57c-8aaeab7f8c23 for instance 9318170e-8c6e-480a-96f5-45a0caa25c69 on n-h2-845775-3 Jul 25 20:04:07.369264 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-27bd635b-c871-4dbb-95b6-a5ade38216e9 req-48ae1a5e-0552-4b23-b915-e7997f2ba082 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066479 Jul 25 20:04:07.370463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 295/563] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:07.380298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:07.381475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:07.392678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.393357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.395333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.396600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.623419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.636929 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d84457fe-d1c2-4fce-8499-2a5ca0f1c495 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1273 microversion: 2.1 time: 0.264109 Jul 25 20:04:07.658701 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 296/564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:07 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:07.668000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:07.668790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:07.682554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.683130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.684053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:07.684613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:07.883647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.900534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.902240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:07.921023 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db537e7b-a1ec-469b-8822-0878e6f7dbf7 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.261075 Jul 25 20:04:07.921938 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 297/565] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:07 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:07.944862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7591f4f-b4b5-48b8-b611-c2a1ba1e293a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969ca3e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:07.949440 n-d-845775-3 devstack@n-api.service[119723]: WARNING oslo_db.sqlalchemy.utils [None req-c7591f4f-b4b5-48b8-b611-c2a1ba1e293a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:04:07.956548 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7591f4f-b4b5-48b8-b611-c2a1ba1e293a tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022444 Jul 25 20:04:07.957927 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 298/566] 10.222.0.48 () {60 vars in 1177 bytes} [Mon Jul 25 20:04:07 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:07.979781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88f727f8-9367-44e6-b3e1-f072ab43c61e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] Calling method '.version_select at 0x7f1969c82700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:08.027649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88f727f8-9367-44e6-b3e1-f072ab43c61e tempest-KeyPairsV22TestJSON-1453170816 tempest-KeyPairsV22TestJSON-1453170816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672177720" status: 204 len: 0 microversion: 2.2 time: 0.054382 Jul 25 20:04:08.029798 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 299/567] 10.222.0.48 () {60 vars in 1261 bytes} [Mon Jul 25 20:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672177720 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:04:08.075310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.090893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.095762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.097808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca0bc284-c594-4398-af0f-d77caf11398f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 0.824255 Jul 25 20:04:08.101005 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 269/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:07 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:08.274291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:08.276945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:08.289250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:08.291072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:08.302920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.306549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.307897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.309231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.310737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.312706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.313484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.315986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.616468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.625247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77bba60d-e293-4bf8-a8da-50f3030d7d13 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 0.355658 Jul 25 20:04:08.639438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 300/569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:08 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:08.664258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:08.664941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:08.680637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.681035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.681924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.683567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.840882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.858299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba914983-12b7-4244-9917-6a27c088e34a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1273 microversion: 2.1 time: 0.198830 Jul 25 20:04:08.860023 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 301/570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:08 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:08.888313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:08.901139 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-32b58660-01bc-4820-b04e-2d63df5b8e34 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.619156 Jul 25 20:04:08.904304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 270/571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:08 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:08.950797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:08.951857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:08.963494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.966574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:08.967598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:08.971380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:09.129200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:09.130154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:09.142389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:09.143858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:09.145110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:09.145861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:09.211046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:09.220677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:09.231422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:09.247946 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bd75e973-fe38-405f-b2e3-2f494219bfd8 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.300735 Jul 25 20:04:09.258052 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 302/572] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:08 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:09.646800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:09.648669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:09.664117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:09.664564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:09.668832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:09.670687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:10.140214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:10.151337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:10.164212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:10.166874 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1339b83a-9086-492a-a437-78e381f48729 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 1.041412 Jul 25 20:04:10.172144 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 271/573] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:09 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:10.193210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:10.194379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:10.212325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:10.217955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:10.230735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:10.231726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:10.848622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:10.864250 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a7ddd713-ad9a-4142-a13a-be43820569c6 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 1.221244 Jul 25 20:04:10.864852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 303/574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:09 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:04:10.892172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:10.893040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:10.904464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:10.906776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:10.907901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:10.910176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:10.942831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:11.279104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:11.292457 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dab06fe2-3806-4ef0-bb3c-acf2d2c43df3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 1.118179 Jul 25 20:04:11.297400 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 272/575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:10 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:11.317242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:11.317865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:11.354076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.354533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.355326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.355763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.563574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:11.571191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:11.580807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:11.586021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e30b3dd5-66f1-40d9-a317-cc1172a2cc06 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.719816 Jul 25 20:04:11.586520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:11.587492 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 304/576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:10 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:11.603792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa7ae0a3-b4fa-4d95-93f6-cc8f121656cb tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.297667 Jul 25 20:04:11.605971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f93bc8e5-7866-4940-b017-153f1091c4bf req-9b915723-c5ad-4c59-be97-5d6d7da88434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:11.606667 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 273/577] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:11 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:11.619398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:11.620540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f93bc8e5-7866-4940-b017-153f1091c4bf req-9b915723-c5ad-4c59-be97-5d6d7da88434 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.621337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f93bc8e5-7866-4940-b017-153f1091c4bf req-9b915723-c5ad-4c59-be97-5d6d7da88434 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.631705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:11.638499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f93bc8e5-7866-4940-b017-153f1091c4bf req-9b915723-c5ad-4c59-be97-5d6d7da88434 service nova] Creating event network-changed:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h2-845775-3 Jul 25 20:04:11.645793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f93bc8e5-7866-4940-b017-153f1091c4bf req-9b915723-c5ad-4c59-be97-5d6d7da88434 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056628 Jul 25 20:04:11.646948 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 305/578] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:11.664492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.671023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.674419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.678617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.897656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:11.903323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:11.929933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.931240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:11.932263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:11.932915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:12.410140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:12.415021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=13 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:12.429470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:12.431333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:12.440381 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5897af9b-ead5-49d2-b2b3-a4c61463578e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 0.830449 Jul 25 20:04:12.441315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 274/579] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:11 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:12.454245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e7726ad5-fbc5-4c8f-b692-6a7409d6dd02 req-6c1cc08f-9b69-4c40-ab30-f9994bea2a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604df63e-89d8-4687-9191-b8975673bf08", "name": "network-vif-plugged", "status": "completed", "tag": "6b16a330-423a-48a1-9e98-78590ac30e7e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:12.489225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7726ad5-fbc5-4c8f-b692-6a7409d6dd02 req-6c1cc08f-9b69-4c40-ab30-f9994bea2a09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:12.490113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7726ad5-fbc5-4c8f-b692-6a7409d6dd02 req-6c1cc08f-9b69-4c40-ab30-f9994bea2a09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:12.519378 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e7726ad5-fbc5-4c8f-b692-6a7409d6dd02 req-6c1cc08f-9b69-4c40-ab30-f9994bea2a09 service nova] Creating event network-vif-plugged:6b16a330-423a-48a1-9e98-78590ac30e7e for instance 604df63e-89d8-4687-9191-b8975673bf08 on n-h1-845775-3 Jul 25 20:04:12.555586 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e7726ad5-fbc5-4c8f-b692-6a7409d6dd02 req-6c1cc08f-9b69-4c40-ab30-f9994bea2a09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112561 Jul 25 20:04:12.556481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 275/580] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:12.603801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:12.604672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:12.620819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:12.627602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:12.628576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:12.630330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:12.631005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.296560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:13.305419 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5f0d337-37eb-4f24-a90b-2074f1db939e tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 1.417907 Jul 25 20:04:13.306026 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 306/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:11 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:04:13.332609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:13.333571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:13.354479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.362402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.367289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.367289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.592938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:13.602109 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07ce3e6a-0893-4d19-a624-71d743fad088 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 1.040518 Jul 25 20:04:13.610326 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 276/582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:12 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:13.633173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:13.634294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:13.672411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.672897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.673717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.676639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.830720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:13.844317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:13.845908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:13.861660 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61e2dbf2-93de-4c6c-8793-b3cab2cbb767 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.249758 Jul 25 20:04:13.862794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 277/583] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:13 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:13.878771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:13.879848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:13.897532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.897942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:13.899118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:13.900602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.218968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:14.231803 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d328614-1bfa-4659-b2b6-28a988c63135 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.916249 Jul 25 20:04:14.232454 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 307/584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:13 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:14.252301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-aa0482df-932a-41c6-9e4f-d2ca27678e9d req-95902d7b-732b-4237-ad41-f3eaf1f060ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:14.279375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:14.282864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-aa0482df-932a-41c6-9e4f-d2ca27678e9d req-95902d7b-732b-4237-ad41-f3eaf1f060ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.283676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-aa0482df-932a-41c6-9e4f-d2ca27678e9d req-95902d7b-732b-4237-ad41-f3eaf1f060ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.296911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:14.298479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:14.301966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-aa0482df-932a-41c6-9e4f-d2ca27678e9d req-95902d7b-732b-4237-ad41-f3eaf1f060ce service nova] Creating event network-changed:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:04:14.305979 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b24a89e-13bb-440f-a81f-97378b870bf9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 0.435735 Jul 25 20:04:14.308399 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-aa0482df-932a-41c6-9e4f-d2ca27678e9d req-95902d7b-732b-4237-ad41-f3eaf1f060ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060481 Jul 25 20:04:14.309481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 278/586] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:13 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:14.309606 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 308/586] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:14.354879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:14.355871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:14.363241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.364085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.365047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.365681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.597429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Action: 'update', calling method: .version_select at 0x7f1969d4d040>, body: {"quota_set": {"ram": "5120"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:14.716275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.717675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.721688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.722150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.801293 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b14a06d3-9f8c-41af-85fd-551348cf3058 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093" status: 200 len: 148 microversion: 2.57 time: 0.490270 Jul 25 20:04:14.807544 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 279/587] 10.222.0.48 () {62 vars in 1303 bytes} [Mon Jul 25 20:04:14 2022] PUT /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093 => generated 148 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:04:14.810201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:14.813145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:14.813772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:14.823037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.824401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.825604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.826236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.830707 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c174b1bf-c367-4d7d-a9a2-8cf218965c21 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1313 microversion: 2.1 time: 0.505330 Jul 25 20:04:14.832327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 309/588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:14 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:14.838911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Calling method '.version_select at 0x7f1969cf9310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:14.957749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.958504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.959703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:14.960424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:14.992236 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-596c345e-d9c1-43f4-9d93-7d1811e4fb69 tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093/detail" status: 200 len: 463 microversion: 2.57 time: 0.158107 Jul 25 20:04:14.993635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 310/589] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Jul 25 20:04:14 2022] GET /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093/detail => generated 463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:04:14.999677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:15.000889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:15.009207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:15.010648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:15.011851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:15.012777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:15.394849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:15.413509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:15.415295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:15.432347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-584b4c5a-d7f0-4a0b-9a55-f8fa721b0853 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.437214 Jul 25 20:04:15.438932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 311/590] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:14 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:15.447554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:15.452579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:15.485155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:15.486159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:15.487752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:15.493256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:15.972767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:15.985761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16739d3a-fd39-4093-992b-59c936c07f4c tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 1.176650 Jul 25 20:04:16.003480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 280/591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:14 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:16.009029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Action: 'update', calling method: .version_select at 0x7f1969cc2f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:16.035835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:16.054326 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd6a7360-afc3-4998-9bf1-2b558555017a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 0.613673 Jul 25 20:04:16.056138 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 312/592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:15 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:16.063894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:16.065460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:16.079872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.080934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.082110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.083491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.196924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.197677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.201354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.203698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.260947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.262516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.263966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.266095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.400287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:16.404605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f1eea4b0-6507-4eb9-97fd-db79a9c1c3ba tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093?user_id=fade99cd79c14367a60281f65f0c20b8" status: 200 len: 148 microversion: 2.57 time: 0.398184 Jul 25 20:04:16.405829 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 281/593] 10.222.0.48 () {62 vars in 1384 bytes} [Mon Jul 25 20:04:16 2022] PUT /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093?user_id=fade99cd79c14367a60281f65f0c20b8 => generated 148 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:04:16.412902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7ca3f7a8-4ae2-401b-a3da-7a94262de4e9 req-76975f4a-a0b2-4a22-92ed-1cde9ae14b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9318170e-8c6e-480a-96f5-45a0caa25c69", "name": "network-vif-plugged", "status": "completed", "tag": "9802e152-559b-4ea8-a57c-8aaeab7f8c23"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:16.428017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:16.432090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7ca3f7a8-4ae2-401b-a3da-7a94262de4e9 req-76975f4a-a0b2-4a22-92ed-1cde9ae14b9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.432759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7ca3f7a8-4ae2-401b-a3da-7a94262de4e9 req-76975f4a-a0b2-4a22-92ed-1cde9ae14b9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.456441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:16.459159 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7ca3f7a8-4ae2-401b-a3da-7a94262de4e9 req-76975f4a-a0b2-4a22-92ed-1cde9ae14b9b service nova] Creating event network-vif-plugged:9802e152-559b-4ea8-a57c-8aaeab7f8c23 for instance 9318170e-8c6e-480a-96f5-45a0caa25c69 on n-h2-845775-3 Jul 25 20:04:16.461028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:16.462224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2a3abfb-83b5-4b50-9378-b9e180d05c8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 0.404433 Jul 25 20:04:16.467759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 313/594] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:16 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:16.470022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7ca3f7a8-4ae2-401b-a3da-7a94262de4e9 req-76975f4a-a0b2-4a22-92ed-1cde9ae14b9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062217 Jul 25 20:04:16.470843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 282/595] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:16.482914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9310303b-948f-4d6b-bd93-c0cd14972c0c tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] Calling method '.version_select at 0x7f1969c71f70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:16.484131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:16.488922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:16.516537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.517287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.518937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.519541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.690648 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9310303b-948f-4d6b-bd93-c0cd14972c0c tempest-QuotasAdminTestV257-935537177 tempest-QuotasAdminTestV257-935537177-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093?user_id=fade99cd79c14367a60281f65f0c20b8" status: 200 len: 190 microversion: 2.57 time: 0.217299 Jul 25 20:04:16.691949 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 283/596] 10.222.0.48 () {60 vars in 1364 bytes} [Mon Jul 25 20:04:16 2022] GET /compute/v2.1/os-quota-sets/a1f8aacdbb534c948fe5b1cfe0fc8093?user_id=fade99cd79c14367a60281f65f0c20b8 => generated 190 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:04:16.703395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:16.704843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:16.712703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.713550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.714776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:16.715728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:16.988305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:17.039554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:17.043737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:17.057605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55a0070d-fa73-489d-9eb4-e9fd3eab7f36 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.361761 Jul 25 20:04:17.058206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 284/597] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:16 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:17.073812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:17.078758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:17.091581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:17.093809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:17.094771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:17.095370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:17.366257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:17.383457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ad1cf2b-a960-44ff-8918-566841be9028 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1463 microversion: 2.1 time: 0.914039 Jul 25 20:04:17.386478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 314/598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:16 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1463 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:17.413950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:17.413950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:17.416851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:17.417310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:17.418459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:17.424331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:17.873830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:17.895173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff6b84ec-3116-4d37-a194-bce3d67b0660 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 0.830120 Jul 25 20:04:17.898041 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 285/599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:17 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:18.315779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Calling method '.version_select at 0x7f1969d6b5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:18.361364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.368587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:18.413699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.415601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:18.450356 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ca2736b-d68f-4f21-9e8f-beaadbff3f91 tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/a0e140d0de734553824e8ad5d30c057a?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583" status: 200 len: 642 microversion: 2.1 time: 0.550750 Jul 25 20:04:18.468978 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 286/600] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Jul 25 20:04:17 2022] GET /compute/v2.1/os-simple-tenant-usage/a0e140d0de734553824e8ad5d30c057a?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583 => generated 642 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:18.477298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:18.478319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:18.487233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.488987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:18.490759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.503520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:18.809815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:18.824761 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e6714bd9-a5c8-48f1-ab78-155cfb166549 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1387 microversion: 2.1 time: 1.436527 Jul 25 20:04:18.826270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 315/601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:17 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1387 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:18.833871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:18.836655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:18.857047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.858527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:18.859690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:18.860617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.075547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.100391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.102933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.112488 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f75c5260-c069-45d0-baae-639cac55bd16 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.284393 Jul 25 20:04:19.132727 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 316/602] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:18 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:19.144113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '.version_select at 0x7f1969ca3ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:19.159225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.160277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.196549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.197471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.230990 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3fdabeb9-f991-48ed-9d96-adc27eb78d9f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/a0e140d0de734553824e8ad5d30c057a?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583" status: 200 len: 694 microversion: 2.1 time: 0.096447 Jul 25 20:04:19.232584 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 317/603] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Jul 25 20:04:19 2022] GET /compute/v2.1/os-simple-tenant-usage/a0e140d0de734553824e8ad5d30c057a?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583 => generated 694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:19.256238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:19.258784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:19.268106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:19.271869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.273049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.274121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.275009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.400951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.418843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.421069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.426537 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f56d718b-0346-4d4f-bf09-2b24782611d4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 0.955106 Jul 25 20:04:19.427213 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 287/604] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:18 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:19.454422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Calling method '.version_select at 0x7f1969d0be50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:19.478726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.480134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.523406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.523867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.650017 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9df5fc2-9f55-4b50-8cb7-79c844d25d1c tempest-TenantUsagesTestJSON-699388447 tempest-TenantUsagesTestJSON-699388447-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583&detailed=1" status: 200 len: 5618 microversion: 2.1 time: 0.207241 Jul 25 20:04:19.652444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 288/605] 10.222.0.48 () {58 vars in 1335 bytes} [Mon Jul 25 20:04:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T20%3A04%3A17.413583&end=2022-07-26T20%3A04%3A17.413583&detailed=1 => generated 5618 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:19.698039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:19.704558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:19.735897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.736838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.743005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.743903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.775023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:19.833135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:04:19.862797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:19.898584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fcd6cfd2-62a3-4a16-92cd-ec157aafa1f2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 0.661726 Jul 25 20:04:19.917833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 318/606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:19 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:19.945615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:19.947548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:19.969582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.970374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:19.972495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:19.973518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.004809 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9ffbb6b-8dac-4821-b08c-b81f22aa735f tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "DELETE /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 204 len: 0 microversion: 2.1 time: 0.316197 Jul 25 20:04:20.005424 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 289/607] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:04:19 2022] DELETE /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:04:20.022370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:20.023110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:20.040912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.042635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.044967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.046233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.544911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:20.563998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19508fc7-f00e-4192-9863-fad74e1a2743 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1586 microversion: 2.1 time: 0.643330 Jul 25 20:04:20.565505 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 319/608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:19 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1586 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:20.581944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:20.582865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:20.597971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.599949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.602171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.602617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.651879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:20.663832 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-561b44cc-1413-45c3-9455-f1e49701cec5 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1469 microversion: 2.1 time: 0.651033 Jul 25 20:04:20.678014 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 290/609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:20 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:04:20.715213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:20.720775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:20.757602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.763785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.766894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:20.767691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:20.985407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.009378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.019800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.039377 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6911cb87-3863-4fdb-af9d-395672f284bf tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.471276 Jul 25 20:04:21.054020 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 320/610] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:20 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:21.092449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:21.093850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:21.135827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:21.136659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:21.138011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:21.139037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:21.494296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3220c191-46b3-4400-a31f-0ccf70d6d427 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.437986 Jul 25 20:04:21.495297 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 321/611] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:04:21 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69/os-interface => generated 285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:21.525780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-718efa42-3193-4036-b338-d307cc632834 req-0c38fec9-c1ac-49c7-9402-0e9e8b09349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "name": "network-vif-plugged", "status": "completed", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:21.559184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-718efa42-3193-4036-b338-d307cc632834 req-0c38fec9-c1ac-49c7-9402-0e9e8b09349d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:21.568886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-718efa42-3193-4036-b338-d307cc632834 req-0c38fec9-c1ac-49c7-9402-0e9e8b09349d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:21.602115 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-718efa42-3193-4036-b338-d307cc632834 req-0c38fec9-c1ac-49c7-9402-0e9e8b09349d service nova] Creating event network-vif-plugged:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h2-845775-3 Jul 25 20:04:21.623018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-718efa42-3193-4036-b338-d307cc632834 req-0c38fec9-c1ac-49c7-9402-0e9e8b09349d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112035 Jul 25 20:04:21.625166 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 322/612] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:21.645624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:21.647572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:21.663965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:21.665111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:21.666730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:21.667742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:21.694252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.711296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.722409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:21.726075 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91446011-3d0c-4e83-9a88-68f0c6ad85d1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1362 microversion: 2.25 time: 1.046699 Jul 25 20:04:21.729295 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 291/613] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:20 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1362 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:22.409890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-793616551", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "21bb1d6f-b1ef-4bf4-9acf-77064489ef62"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:22.425702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:22.440813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-702e6f10-67ed-43ae-b346-ec45b1c2d20a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 0.811933 Jul 25 20:04:22.441692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 323/614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:21 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:22.449313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:22.450278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:22.460773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:22.461875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:22.463332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:22.464303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:22.632215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] validate_networks() for [('21bb1d6f-b1ef-4bf4-9acf-77064489ef62', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:04:24.263958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18ee331b596463f9ff5dcb27397ed07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e140d0de734553824e8ad5d30c057a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:24.270867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:24.299378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b95f2d4b-0730-45f3-a4c1-06c93ddeb340 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 200 len: 1469 microversion: 2.1 time: 1.855504 Jul 25 20:04:24.302770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 324/615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:22 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 1469 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:24.315529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:24.323550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:24.353280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:24.353947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:24.355106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:24.355710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:24.666292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:24.683067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:24.684611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:24.698645 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64271110-8430-4f64-92be-1b1b8db32707 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.394425 Jul 25 20:04:24.717293 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 325/616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:24 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:24.729721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:24.730640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:24.738631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:24.739272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:24.740311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:24.740935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:24.954846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=40 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:25.854437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:25.874819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:25.889191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:25.891678 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ceb4d75-0f95-4947-97b3-1c4fadb9b0e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1558 microversion: 2.25 time: 1.172053 Jul 25 20:04:25.893158 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 326/617] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:24 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1558 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:25.901551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:25.902948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:25.916179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:25.917660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:25.918959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:25.919956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.171742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:04:26.172635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:04:26.173982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:04:26.174806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:04:26.175633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:04:26.196429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.198502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.199922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.200973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.231294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:26.238146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for user 1d0f300b7de441108c3efcee70e8f920 and project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:26.259808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:04:26.262585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:04:26.345216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8216ef60-7d3a-42cf-814e-776610916390 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.613686 Jul 25 20:04:26.346072 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 292/618] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:04:26.351110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b1ea2442-8dd9-4399-b122-d18ea81ba9d9 req-ade75d9c-cec6-4c92-8d0b-216bfab880e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-plugged", "status": "completed", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:26.363639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b1ea2442-8dd9-4399-b122-d18ea81ba9d9 req-ade75d9c-cec6-4c92-8d0b-216bfab880e7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.364378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b1ea2442-8dd9-4399-b122-d18ea81ba9d9 req-ade75d9c-cec6-4c92-8d0b-216bfab880e7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.380223 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b1ea2442-8dd9-4399-b122-d18ea81ba9d9 req-ade75d9c-cec6-4c92-8d0b-216bfab880e7 service nova] Creating event network-vif-plugged:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:04:26.387216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b1ea2442-8dd9-4399-b122-d18ea81ba9d9 req-ade75d9c-cec6-4c92-8d0b-216bfab880e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039438 Jul 25 20:04:26.395977 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 293/619] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:26.406035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ae9404bd-ea8b-4462-92bc-5b760fce6c23 req-f81a7624-5655-4af0-aa19-7f1cc43f971b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604df63e-89d8-4687-9191-b8975673bf08", "name": "network-vif-deleted", "tag": "6b16a330-423a-48a1-9e98-78590ac30e7e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:26.416637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ae9404bd-ea8b-4462-92bc-5b760fce6c23 req-f81a7624-5655-4af0-aa19-7f1cc43f971b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.417724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ae9404bd-ea8b-4462-92bc-5b760fce6c23 req-f81a7624-5655-4af0-aa19-7f1cc43f971b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.456942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ae9404bd-ea8b-4462-92bc-5b760fce6c23 req-f81a7624-5655-4af0-aa19-7f1cc43f971b service nova] Creating event network-vif-deleted:6b16a330-423a-48a1-9e98-78590ac30e7e for instance 604df63e-89d8-4687-9191-b8975673bf08 on n-h1-845775-3 Jul 25 20:04:26.463086 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ae9404bd-ea8b-4462-92bc-5b760fce6c23 req-f81a7624-5655-4af0-aa19-7f1cc43f971b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Jul 25 20:04:26.464204 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 294/620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:26.807302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:26.838157 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93aca0d2-0819-4adf-afae-73aa4bef11b4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 0.941725 Jul 25 20:04:26.841494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 327/621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:25 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:26.863596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:26.868400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:26.894947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.896488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.898445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.899200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.932519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:26.960067 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:26.960067 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:26.967307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.968666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:26.980530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:26.992297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.076389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5594fe7-1a3a-43e1-a496-d9ac40ed202e tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.610358 Jul 25 20:04:27.079772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 295/622] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:27.105824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:27.108524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] [instance: 604df63e-89d8-4687-9191-b8975673bf08] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:27.124360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.126216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.129362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.131395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.211302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] HTTP exception thrown: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Request method failure captured: Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 HTTP/1.1 Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vclxerAkNvDfxvEPW-juxchQ2tXVEn6Pm3Mi8c-PFoYOulVevUZ2_ip9hTcxFQ4Xub985i3WRx1D9FLNgHWTNZCSBNFNkIr-HifxLRWI1MtiyrOKbZc8I9G3jT2f6t-tJp7Pltc1xLNOdOmq-noMcVv8TiLopCO3NwAtbcl0RkzQAY Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a0e140d0de734553824e8ad5d30c057a Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TenantUsagesTestJSON-1798407545 Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:04:27.218602 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a0e140d0de734553824e8ad5d30c057a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a0e140d0de734553824e8ad5d30c057a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a0e140d0de734553824e8ad5d30c057a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a0e140d0de734553824e8ad5d30c057a"}]}] Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TenantUsagesTestJSON-1798407545 Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a0e140d0de734553824e8ad5d30c057a Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1798407545 Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TenantUsagesTestJSON-1798407545-project Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: e18ee331b596463f9ff5dcb27397ed07 Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TenantUsagesTestJSON-1798407545-project Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. Jul 25 20:04:27.220318 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '604df63e-89d8-4687-9191-b8975673bf08'} Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:04:27.221267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. Jul 25 20:04:27.222746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:04:27.239900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] Returning 404 to user: Instance 604df63e-89d8-4687-9191-b8975673bf08 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:04:27.243842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-922732ec-c113-4785-be4d-10195df18e05 tempest-TenantUsagesTestJSON-1798407545 tempest-TenantUsagesTestJSON-1798407545-project] 10.222.0.48 "GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08" status: 404 len: 111 microversion: 2.1 time: 0.159598 Jul 25 20:04:27.245560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 296/623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:27 2022] GET /compute/v2.1/servers/604df63e-89d8-4687-9191-b8975673bf08 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:04:27.273457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:27.274074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:27.298998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.299462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.309880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.315040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.590892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:27.592265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:27.601389 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d75afc9-6ef2-4fe7-baba-5d6dac045fc5 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 200 len: 1586 microversion: 2.1 time: 0.755115 Jul 25 20:04:27.606248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:27.608114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:27.614626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 328/624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:26 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 1586 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:27.620238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4be8d345-0ee3-4183-8273-72e29328ac38 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.370033 Jul 25 20:04:27.620909 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 297/625] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:27 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:27.633722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:27.634435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:27.635431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:27.637103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:27.649212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.650306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.651432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.652060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.657964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.661122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.667968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.669089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.813205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:27.831755 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-516478b9-3fab-4ebb-88bc-4531cc5959ef tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1214 microversion: 2.1 time: 0.199676 Jul 25 20:04:27.832504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 298/626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:27 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1214 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:27.857429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:27.875707 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:27.875707 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:27.883948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.887443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:27.906084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:27.908335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.025551 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68d2edab-74a8-463e-a643-ab70f7d58fe9 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.191118 Jul 25 20:04:28.038212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 299/627] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:04:27 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:28.038212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.038212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:28.056581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.057853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.059315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.060575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.173377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:28.230798 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c995f1bc-974f-41ff-bdf7-849ed7adf7d7 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 2051 microversion: 2.25 time: 0.599690 Jul 25 20:04:28.232294 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 329/628] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:27 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 2051 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:28.264635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.272252 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:28.272252 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:04:28.275591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.278198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.281244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.284272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.365675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-048f1094-e11c-4740-ada7-8ebb501d874d tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.110487 Jul 25 20:04:28.380759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 330/629] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:28.393507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.394896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:28.406386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.407553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.409193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.410166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.477869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:28.490651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4613c8e8-fd67-4ddd-94cb-43a73eeed258 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1315 microversion: 2.1 time: 0.460229 Jul 25 20:04:28.493073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 300/630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:28.501324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.511519 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:28.511519 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:28.514521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.517117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.519589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.520272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.567459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33845e71-00fb-4cd8-b256-aa7a18326413 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-845775-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.072734 Jul 25 20:04:28.568772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 301/631] 10.222.0.48 () {58 vars in 1194 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/os-services?host=n-d-845775-3&binary=xxx => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:04:28.584556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5c9e6ef4-ecaf-4265-aa61-139e0f6c167a req-35bfb4bb-d5d6-45e7-9756-a5d6ffa939f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9318170e-8c6e-480a-96f5-45a0caa25c69", "tag": "9802e152-559b-4ea8-a57c-8aaeab7f8c23"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:28.615461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5c9e6ef4-ecaf-4265-aa61-139e0f6c167a req-35bfb4bb-d5d6-45e7-9756-a5d6ffa939f3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.617554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5c9e6ef4-ecaf-4265-aa61-139e0f6c167a req-35bfb4bb-d5d6-45e7-9756-a5d6ffa939f3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.649366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5c9e6ef4-ecaf-4265-aa61-139e0f6c167a req-35bfb4bb-d5d6-45e7-9756-a5d6ffa939f3 service nova] Creating event network-changed:9802e152-559b-4ea8-a57c-8aaeab7f8c23 for instance 9318170e-8c6e-480a-96f5-45a0caa25c69 on n-h2-845775-3 Jul 25 20:04:28.668633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5c9e6ef4-ecaf-4265-aa61-139e0f6c167a req-35bfb4bb-d5d6-45e7-9756-a5d6ffa939f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092911 Jul 25 20:04:28.676162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 302/632] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:28.694059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.703824 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:28.703824 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:28.705676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.707183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.710283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.710985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.726439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:28.758594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb880b5e-7c50-48f6-b795-cd38988c950e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 2051 microversion: 2.25 time: 0.376172 Jul 25 20:04:28.761146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 331/633] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 2051 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:28.792076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.794294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:28.802029 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a2b30d80-5ef8-42d9-a50d-656a80dcc586 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.122914 Jul 25 20:04:28.805858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 303/634] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:28.823018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.830767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.831474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.832461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.833073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.836287 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:28.836287 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:28.838379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.838844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.839660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.840172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.954947 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba2d18f5-c43b-4cdb-97ef-186c8b9502a8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.147930 Jul 25 20:04:28.959413 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 304/635] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:04:28.976397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:28.981615 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:28.981615 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:28.987106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.988353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:28.990717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:28.991170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.059349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9f5f6dd-e3c4-4921-8f39-f683efae3e33 tempest-ServicesAdminNegativeTestJSON-1211257121 tempest-ServicesAdminNegativeTestJSON-1211257121-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.098594 Jul 25 20:04:29.070101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 305/636] 10.222.0.48 () {58 vars in 1198 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:04:29.074874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:29.075580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:29.102418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:29.107956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.108699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.112379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.113135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:29.113313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.117301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:29.134025 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-071fa2a1-517f-469e-b1b9-af3eb0c33020 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.357847 Jul 25 20:04:29.137382 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 332/637] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:28 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:29.150132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:29.151097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:29.167555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.169684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.172979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.173874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.306914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71744168-7452-40f8-951e-9e18ee9b20d8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19/action" status: 202 len: 0 microversion: 2.25 time: 0.165297 Jul 25 20:04:29.310532 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 333/638] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:04:29 2022] POST /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:29.439248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:29.463174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5904b185-2c98-4ab7-bf8c-98f704ed2423 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1262 microversion: 2.1 time: 0.396939 Jul 25 20:04:29.481225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 306/639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:29 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1262 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:29.513304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:29.515971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:29.551130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.552378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:29.554021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:29.555827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:30.006301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0169f1e-93e9-41c9-9dd3-186b5fc82ef2 tempest-ServicesAdminNegativeTestJSON-648180838 tempest-ServicesAdminNegativeTestJSON-648180838-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:30.009299 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:30.009299 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:04:30.017942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d0169f1e-93e9-41c9-9dd3-186b5fc82ef2 tempest-ServicesAdminNegativeTestJSON-648180838 tempest-ServicesAdminNegativeTestJSON-648180838-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '20c3379d67e5448d9f7a4405bf597bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721bd7b81b7a428c83991c39ea83475c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0169f1e-93e9-41c9-9dd3-186b5fc82ef2 tempest-ServicesAdminNegativeTestJSON-648180838 tempest-ServicesAdminNegativeTestJSON-648180838-project] Request method failure captured: Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vdHBPOtIKypsoTd2I_OEcG1kfagZEHsRRhlo327bvBhqD52xTywWCKdLJpMvaz-8g-XsClTp3LSS9XV-v863iUhapHWfAwoBeBE1RQ9KfJWAbLtn-BAvaGFDrzmk439X0N-fq_DpOmvwmqVTzj_7oX1UxZ7k-OgKS-NScQ9FxPxmGg Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 721bd7b81b7a428c83991c39ea83475c Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-648180838 Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:04:30.033271 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/721bd7b81b7a428c83991c39ea83475c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_721bd7b81b7a428c83991c39ea83475c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/721bd7b81b7a428c83991c39ea83475c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/721bd7b81b7a428c83991c39ea83475c"}]}] Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-648180838 Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 721bd7b81b7a428c83991c39ea83475c Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-648180838 Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServicesAdminNegativeTestJSON-648180838-project Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 20c3379d67e5448d9f7a4405bf597bc5 Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-648180838-project Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:04:30.035722 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:04:30.037171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:04:30.039516 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:04:30.053674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0169f1e-93e9-41c9-9dd3-186b5fc82ef2 tempest-ServicesAdminNegativeTestJSON-648180838 tempest-ServicesAdminNegativeTestJSON-648180838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:04:30.053674 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d0169f1e-93e9-41c9-9dd3-186b5fc82ef2 tempest-ServicesAdminNegativeTestJSON-648180838 tempest-ServicesAdminNegativeTestJSON-648180838-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.719174 Jul 25 20:04:30.053674 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 334/640] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 727 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:04:30.064707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:30.069783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:30.113233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:30.113891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:30.117188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:30.118235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:31.165195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:31.198072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:31.241727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d3e3cbd-8c38-485e-b269-1a5328f5caf2 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1464 microversion: 2.1 time: 1.200604 Jul 25 20:04:31.244125 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 335/641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:30 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1464 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:31.262091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:31.268349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:31.289154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:31.295508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:31.302589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:31.303449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:31.303868 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-946a855a-563f-4d85-9721-d800b833fb6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 2056 microversion: 2.25 time: 1.816729 Jul 25 20:04:31.304726 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 307/642] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:29 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 2056 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:31.330581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:31.332350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:31.350988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:31.351733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:31.352797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:31.356880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:31.957007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:31.980507 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0fdec34-5b0c-4ac6-8957-5ea479dc696c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1268 microversion: 2.1 time: 0.668666 Jul 25 20:04:31.983817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 308/643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:31 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1268 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:32.003989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-227080383", "metadata": {"image_type": "test"}}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:32.018400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:32.032257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:32.044321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:32.044609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:32.045272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:32.045882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:32.046751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:32.047372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:32.052427 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fcf3678d-b96b-4f42-b969-f95942dcc077 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1446 microversion: 2.75 time: 0.805913 Jul 25 20:04:32.054931 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 336/644] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:31 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1446 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:32.111126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Getting quotas for project d163906f445f40499dd7e9f794c92b52. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:32.116595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:32.126950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Getting quotas for user 6e31755ee871433bbcaa657add0cb6a1 and project d163906f445f40499dd7e9f794c92b52. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:32.340513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:32.344422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:32.362112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:32.364358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:32.367914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:32.369072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:32.600869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:32.692737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3931622d-e5a3-4f84-a465-46920ca6a782 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "POST /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041/action" status: 202 len: 0 microversion: 2.1 time: 0.704954 Jul 25 20:04:32.725020 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 309/645] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:04:31 2022] POST /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:04:33.100999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-858bf4be-1e55-431a-ab4c-b402ee002f25 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Action: 'create', calling method: .version_select at 0x7f1969d82c10>, body: {"keypair": {"name": "tempest-keypair-1450278909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpLDDxU3FAyn1imbFScmcm+4BF/2d3PcrAHSaWyl3bMv4MPKJAci9PAX0NqApxm9X0y/4V6xL+PCmj2V9yJxMB0Hgye1O30mBoN7oxoi0hDMAQJAyqtKhSxL0rWGMM0OQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:33.166736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-858bf4be-1e55-431a-ab4c-b402ee002f25 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for project 6ee985fe5d7c4c1997bd40036e648842. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:33.196029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-858bf4be-1e55-431a-ab4c-b402ee002f25 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for user 17f773da5b234701ac246ac0f6c6cf84 and project 6ee985fe5d7c4c1997bd40036e648842. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:33.282445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-858bf4be-1e55-431a-ab4c-b402ee002f25 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554985 Jul 25 20:04:33.297262 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 310/646] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:04:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:33.313155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09a14854-35ce-4493-abc4-ed549d466450 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c0a1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:33.317530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:33.371729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba73faa4-358b-4e5c-8b55-0e4304a78813 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 2036 microversion: 2.25 time: 1.040113 Jul 25 20:04:33.376662 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 337/647] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:32 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 2036 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:04:33.392903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:33.399299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:33.432664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.433847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.438568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.439195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.490382 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09a14854-35ce-4493-abc4-ed549d466450 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.185907 Jul 25 20:04:33.495980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 311/648] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:33 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:33.508888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:33.509914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:33.519564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.520547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.521595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.522197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.767033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:33.801562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0082c030-d30d-4dc0-84d6-1cc7c672e76c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1268 microversion: 2.1 time: 0.422212 Jul 25 20:04:33.803448 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 338/649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:33 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1268 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:33.826910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845775-3", "block_migration": "auto"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:33.839680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:33.859764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.861400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.862741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:33.865703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:33.867013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:33.890780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:33.901804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:33.927929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2978ec82-c4d0-417f-87ce-d79f016003b3 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1452 microversion: 2.75 time: 0.429423 Jul 25 20:04:33.932240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 312/650] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:33 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1452 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:34.104658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'flavor' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:34.150062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Going to try to live migrate instance to n-h1-845775-3 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:04:34.243562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:34.524556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-901196b8-52e2-4860-8197-2a73ef194220 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c0a820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:34.668753 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-901196b8-52e2-4860-8197-2a73ef194220 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.152331 Jul 25 20:04:34.677078 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 313/651] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:34 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:34.849605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:34.850778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:34.867303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:34.868186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:34.869429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:34.870116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:35.691904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:35.705643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d56b4524-578d-40db-bd69-9bdc5ef78eb5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 0.858277 Jul 25 20:04:35.706308 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 314/652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:34 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:35.739678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:35.752991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:35.783696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:35.797692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:35.799541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:35.802999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:36.096357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:36.116297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:36.120849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:36.140441 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a78479c2-4962-4383-aeb9-271444643b47 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1437 microversion: 2.75 time: 0.414847 Jul 25 20:04:36.153897 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 315/653] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:35 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1437 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:36.176233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-243e8df5-0870-4cac-9ad7-da34a60c7f89 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969bb2940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:36.299257 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-243e8df5-0870-4cac-9ad7-da34a60c7f89 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.143806 Jul 25 20:04:36.302334 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 316/654] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:36 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:37.385891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:37.395064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:37.417622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:37.421664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:37.423175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:37.423794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:37.703655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:04:37.704647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:04:37.705272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:04:37.705793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:04:37.709111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:04:37.832616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:37.841787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:37.842492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:37.844428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:37.856774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:38.243959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:38.293326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3be326b6-3d4b-4d6a-9ab1-26daaf8ff76b tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1/action" status: 202 len: 1940 microversion: 2.75 time: 1.989267 Jul 25 20:04:38.294349 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 317/655] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:04:36 2022] POST /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1/action => generated 1940 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 20:04:38.299731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:38.300410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:38.305875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:38.309148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:38.310419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:38.312830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:38.313627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:38.899457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:38.914935 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6781f0cd-8282-49a9-a3e1-a544da24e857 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 0.618694 Jul 25 20:04:38.933602 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 318/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:38 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:38.945397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6a7be03-bc9a-4520-8cd2-f16f3ab445e3 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19/action" status: 202 len: 0 microversion: 2.25 time: 5.139708 Jul 25 20:04:38.947470 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 339/657] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:04:33 2022] POST /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19/action => generated 0 bytes in 5143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:04:38.960422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef6eb142-ff9f-4dce-ba7b-87b94ddf2a12 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c82af0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:38.965438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-37b55019-bd2e-4131-9358-0fa9e8595a7e req-a6dcf3e5-a6d8-4c68-b112-32262fb6e764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:39.023695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-37b55019-bd2e-4131-9358-0fa9e8595a7e req-a6dcf3e5-a6d8-4c68-b112-32262fb6e764 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:39.024742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-37b55019-bd2e-4131-9358-0fa9e8595a7e req-a6dcf3e5-a6d8-4c68-b112-32262fb6e764 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:39.048511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=25 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:39.054342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-37b55019-bd2e-4131-9358-0fa9e8595a7e req-a6dcf3e5-a6d8-4c68-b112-32262fb6e764 service nova] Creating event network-changed:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h1-845775-3 Jul 25 20:04:39.064615 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-37b55019-bd2e-4131-9358-0fa9e8595a7e req-a6dcf3e5-a6d8-4c68-b112-32262fb6e764 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128199 Jul 25 20:04:39.065941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 319/658] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:39.075565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:39.076889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:39.086841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:39.087487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:39.088521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:39.089071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:39.140955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef6eb142-ff9f-4dce-ba7b-87b94ddf2a12 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.183966 Jul 25 20:04:39.142666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 340/659] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:38 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:39.467093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:39.542821 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00489b51-ae56-46dc-b6c7-293b770297ac tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.474431 Jul 25 20:04:39.550128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 320/660] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:39 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:39.590528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:39.594315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:39.620280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:39.622068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:39.625957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:39.629522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:39.716754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f8b0e1b-7da3-4f33-a681-de08060b2400 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:39.744865 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f8b0e1b-7da3-4f33-a681-de08060b2400 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.597597 Jul 25 20:04:39.752057 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 341/661] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:39.773703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1677511268", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8fc14879-d2a7-4d59-889d-09b60e36b5e9"}], "security_groups": [{"name": "tempest-securitygroup--1773893754"}], "key_name": "tempest-keypair-1450278909", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:40.258932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] validate_networks() for [('8fc14879-d2a7-4d59-889d-09b60e36b5e9', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:04:40.377768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:40.420748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:40.432068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:40.434142 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7fb90b18-c2ba-4989-bccc-395da04f079b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 0.862006 Jul 25 20:04:40.435349 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 321/662] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:39 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:40.457142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-999c4a4b-4daa-4521-895a-0a8af3dbda0d req-c764a5ec-118a-4308-b7e6-1949b454f7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-plugged", "status": "completed", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:40.502438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-999c4a4b-4daa-4521-895a-0a8af3dbda0d req-c764a5ec-118a-4308-b7e6-1949b454f7da service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:40.503170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-999c4a4b-4daa-4521-895a-0a8af3dbda0d req-c764a5ec-118a-4308-b7e6-1949b454f7da service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:40.554828 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-999c4a4b-4daa-4521-895a-0a8af3dbda0d req-c764a5ec-118a-4308-b7e6-1949b454f7da service nova] Creating event network-vif-plugged:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:04:40.572773 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-999c4a4b-4daa-4521-895a-0a8af3dbda0d req-c764a5ec-118a-4308-b7e6-1949b454f7da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135145 Jul 25 20:04:40.574416 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 322/663] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:40.593775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e95662a-76bf-422e-a631-5188caa8d6fb tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:40.698663 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e95662a-76bf-422e-a631-5188caa8d6fb tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.121533 Jul 25 20:04:40.699267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 323/664] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:04:40 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:40.711298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:40.712356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:40.742993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:40.744141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:40.747820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:40.748604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:42.353104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:42.383370 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e8f15a3-4be8-47e9-8c08-764a19dc8fb0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 1.682682 Jul 25 20:04:42.389998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 324/665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:40 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:42.425719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a901533-12a9-4a6a-bc11-06d3c552066a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c31940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:42.642378 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a901533-12a9-4a6a-bc11-06d3c552066a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.235508 Jul 25 20:04:42.643358 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 325/666] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:42 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:42.665392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:42.670072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:42.699648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:42.700858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:42.706846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:42.708234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.098991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:43.194612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98907e14-d533-4dd4-8bf2-c8d5231362c9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.545343 Jul 25 20:04:43.196264 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 326/667] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:42 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:43.206635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-302f49e6-d6b5-4b30-a511-a878eae10b93 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:43.218252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-302f49e6-d6b5-4b30-a511-a878eae10b93 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020025 Jul 25 20:04:43.219119 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 327/668] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:43.224511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:43.225785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:43.256075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=43 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:43.261109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.261641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.262445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.262891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.328132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for project 6ee985fe5d7c4c1997bd40036e648842. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:43.359943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for user 17f773da5b234701ac246ac0f6c6cf84 and project 6ee985fe5d7c4c1997bd40036e648842. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:43.398038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:04:43.398813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:04:43.399618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:04:43.400086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:04:43.400817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:04:43.443855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.444683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.445761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.446555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.508633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for project 6ee985fe5d7c4c1997bd40036e648842. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:04:43.522223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Getting quotas for user 17f773da5b234701ac246ac0f6c6cf84 and project 6ee985fe5d7c4c1997bd40036e648842. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:04:43.579810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:04:43.599551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:04:43.611969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:43.658783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:43.661433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:43.666320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2601dfac-8881-49e9-9464-d1cd7dc21dc8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 0.444080 Jul 25 20:04:43.667620 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 328/669] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:43 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:43.685113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16cba9f8-29ee-41a6-b35d-5f0dc0c60a5a tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:43.712676 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16cba9f8-29ee-41a6-b35d-5f0dc0c60a5a tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040954 Jul 25 20:04:43.716480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 329/670] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:43.731937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:43.734452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:43.756476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.757486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.758426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:43.759138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:43.781969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e2fafa4-daad-43fb-8307-4a7acbe6c8d2 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.024967 Jul 25 20:04:43.793546 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 342/671] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:04:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 4040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:04:43.831436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c15b66e0-da9d-4971-a825-0e428db3f530 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c82940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.056590 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c15b66e0-da9d-4971-a825-0e428db3f530 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.257400 Jul 25 20:04:44.064201 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 343/672] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:43 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:44.076156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-298fdb3a-128e-4666-a156-d3bb0d69c376 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.202530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-298fdb3a-128e-4666-a156-d3bb0d69c376 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.141748 Jul 25 20:04:44.207418 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 344/673] 10.222.0.48 () {58 vars in 1165 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:44.232235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1790ce43-b568-48ee-b271-a07e2d95af30 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.234199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1790ce43-b568-48ee-b271-a07e2d95af30 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:44.474230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1790ce43-b568-48ee-b271-a07e2d95af30 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:44.496951 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1790ce43-b568-48ee-b271-a07e2d95af30 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1270 microversion: 2.1 time: 0.288199 Jul 25 20:04:44.498092 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 345/674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1270 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:44.507026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.508574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:44.526063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:44.544754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d427a7eb-6c52-4f5f-835b-dc2d62db6d05 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 0.826836 Jul 25 20:04:44.550349 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 330/675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:43 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:44.555224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c63f6fbb-5762-4541-86c8-4b02e25a76b2 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.559319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:44.561583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:44.562891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:44.568242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:44.590844 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c63f6fbb-5762-4541-86c8-4b02e25a76b2 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038998 Jul 25 20:04:44.591948 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 331/676] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:44.610162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eae54bf9-343e-4e2f-af66-c0ca501b5453 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.644100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eae54bf9-343e-4e2f-af66-c0ca501b5453 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040209 Jul 25 20:04:44.645730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 332/677] 10.222.0.48 () {58 vars in 1169 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:04:44.673944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3aed5210-9323-4bdb-ab11-81c420efb6f6 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.708965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3aed5210-9323-4bdb-ab11-81c420efb6f6 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.044536 Jul 25 20:04:44.730335 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 333/678] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:44.753240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:44.754056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:44.783526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:44.784393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:44.785634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:44.786292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.039985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:45.112374 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f56e9b4-0f2d-4fc4-a2ce-92c4d2746901 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.610325 Jul 25 20:04:45.127969 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 346/679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:45.146264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15eee3da-6583-488f-b390-89f0265ceb3e tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:45.167017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15eee3da-6583-488f-b390-89f0265ceb3e tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035768 Jul 25 20:04:45.169966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 347/680] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:45.178203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cb19520e-5a94-45f8-b8da-9ae085c5e77b req-f1a8bbf6-acc3-4a1b-a0a2-55678fd2700d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "name": "network-vif-unplugged", "status": "completed", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:45.195025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cb19520e-5a94-45f8-b8da-9ae085c5e77b req-f1a8bbf6-acc3-4a1b-a0a2-55678fd2700d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:45.195865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cb19520e-5a94-45f8-b8da-9ae085c5e77b req-f1a8bbf6-acc3-4a1b-a0a2-55678fd2700d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.243521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cb19520e-5a94-45f8-b8da-9ae085c5e77b req-f1a8bbf6-acc3-4a1b-a0a2-55678fd2700d service nova] Creating event network-vif-unplugged:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h2-845775-3 Jul 25 20:04:45.270110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cb19520e-5a94-45f8-b8da-9ae085c5e77b req-f1a8bbf6-acc3-4a1b-a0a2-55678fd2700d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095309 Jul 25 20:04:45.274103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 348/681] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:45.292686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44b4dc51-533f-461f-a5fb-ec2c96267e98 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c003a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:45.317156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:45.318789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:45.345468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:45.353020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:45.355300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a8a657a1-fbe1-48f0-bab6-dc27401f907a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 0.622626 Jul 25 20:04:45.360549 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 334/682] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:44 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:45.372771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca9c503c-115d-4446-8a8a-36a89f694922 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:45.458324 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44b4dc51-533f-461f-a5fb-ec2c96267e98 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.182698 Jul 25 20:04:45.464236 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 349/683] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:45.541390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:45.541985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:45.576459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:45.577450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.582587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:45.586778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.634659 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca9c503c-115d-4446-8a8a-36a89f694922 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 3323 microversion: 2.1 time: 0.270679 Jul 25 20:04:45.644289 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 335/684] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 3323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:45.670097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:45.672951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:45.711229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:45.714575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.718493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:45.719388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:45.907442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:45.966239 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ca5b18c-9864-44fe-b8d4-30344779717d tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1274 microversion: 2.1 time: 0.431580 Jul 25 20:04:45.967740 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 350/685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:45.989984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5620050b-7060-4c5a-80a3-d091f95e939e tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.034059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5620050b-7060-4c5a-80a3-d091f95e939e tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064484 Jul 25 20:04:46.037360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 351/686] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:46.057325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-566ec85d-c75b-4f72-8aac-df9583734ac3 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.097746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:46.122417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-566ec85d-c75b-4f72-8aac-df9583734ac3 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.070856 Jul 25 20:04:46.129026 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 352/687] 10.222.0.48 () {58 vars in 1144 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:46.158682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.160297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:46.172709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:46.187343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:46.188707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:46.190344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:46.284611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:46.298323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d4b8eca8-fd56-40d1-aac1-0408836d9a5a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 0.649432 Jul 25 20:04:46.316902 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 336/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:45 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:46.356991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b753c59a-3d29-4824-b207-0c8a7e0685d2 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.396606 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b753c59a-3d29-4824-b207-0c8a7e0685d2 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077817 Jul 25 20:04:46.417263 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 337/689] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:46.425939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.445440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:46.466554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:46.470259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:46.471947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:46.476767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:46.516221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:46.599073 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5d121d1-451f-4235-9f82-63f03a0b9c98 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.461538 Jul 25 20:04:46.601826 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 353/690] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:46.619355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69eec65d-b6c7-4b5b-9f66-49e27b05dbaf tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.692847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69eec65d-b6c7-4b5b-9f66-49e27b05dbaf tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.088935 Jul 25 20:04:46.708128 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 354/691] 10.222.0.48 () {58 vars in 1148 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:46.718665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae2cf8ee-9809-43b8-b4e6-763956712583 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c82040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.867319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae2cf8ee-9809-43b8-b4e6-763956712583 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.156213 Jul 25 20:04:46.872545 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 355/692] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:46.875606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:46.890674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-634286db-7e45-44e6-8b71-281f230971b7 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:46.900315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:46.915680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:46.921731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-435d2219-7f98-4995-bcfb-c2efe767914a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 0.500933 Jul 25 20:04:46.932715 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 338/693] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:46.970720 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-634286db-7e45-44e6-8b71-281f230971b7 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.096340 Jul 25 20:04:47.009935 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 356/694] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Jul 25 20:04:46 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:47.010298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:47.011226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:47.042643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4cef69b-54d4-45e4-9b77-d7e39f403e4d tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:47.048387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:47.049136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:47.050526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:47.051337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:47.090035 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4cef69b-54d4-45e4-9b77-d7e39f403e4d tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.078278 Jul 25 20:04:47.102655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 357/695] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:47.109226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e7796c4f-029b-4468-9aa4-07ed17a5322b req-c3479fe6-ce05-4084-b3e7-6552f07f8632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "name": "network-vif-plugged", "status": "completed", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:47.148003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e7796c4f-029b-4468-9aa4-07ed17a5322b req-c3479fe6-ce05-4084-b3e7-6552f07f8632 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:47.153305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e7796c4f-029b-4468-9aa4-07ed17a5322b req-c3479fe6-ce05-4084-b3e7-6552f07f8632 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:47.173818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e7796c4f-029b-4468-9aa4-07ed17a5322b req-c3479fe6-ce05-4084-b3e7-6552f07f8632 service nova] Creating event network-vif-plugged:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h1-845775-3 Jul 25 20:04:47.181855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e7796c4f-029b-4468-9aa4-07ed17a5322b req-c3479fe6-ce05-4084-b3e7-6552f07f8632 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077686 Jul 25 20:04:47.182450 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 358/696] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:47.210707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28be18e7-12c6-48d6-b32f-728dea0260ac tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:47.351641 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28be18e7-12c6-48d6-b32f-728dea0260ac tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1781 microversion: 2.1 time: 0.164350 Jul 25 20:04:47.352312 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 359/697] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:04:47 2022] GET /compute/v2.1/flavors?marker=452 => generated 1781 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:47.381082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:47.382193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:47.403926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:47.404624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:47.405699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:47.414212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:47.959811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:47.984978 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e48ecd1a-ee5d-4bf0-9b69-7a64f095a860 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1322 microversion: 2.1 time: 0.982312 Jul 25 20:04:47.989610 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 339/698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:47 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1322 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:48.005772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb0804b6-6d11-4a77-8caa-3f53f5853e3b tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:48.089083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb0804b6-6d11-4a77-8caa-3f53f5853e3b tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.096366 Jul 25 20:04:48.089755 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 340/699] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:04:47 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:48.152664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b46af201-3184-4f41-9b05-3aa51b91bd0c req-6a89d5dd-d46e-4a8b-9776-b8d0afcd9127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:48.210476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b46af201-3184-4f41-9b05-3aa51b91bd0c req-6a89d5dd-d46e-4a8b-9776-b8d0afcd9127 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:48.213274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b46af201-3184-4f41-9b05-3aa51b91bd0c req-6a89d5dd-d46e-4a8b-9776-b8d0afcd9127 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:48.243682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:48.267481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b46af201-3184-4f41-9b05-3aa51b91bd0c req-6a89d5dd-d46e-4a8b-9776-b8d0afcd9127 service nova] Creating event network-changed:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h2-845775-3 Jul 25 20:04:48.270964 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1244cf2-84ff-4cc6-b086-9a71872e4c0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1310 microversion: 2.1 time: 0.893465 Jul 25 20:04:48.272862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 360/700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:47 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1310 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:48.286453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:48.288087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:48.288941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b46af201-3184-4f41-9b05-3aa51b91bd0c req-6a89d5dd-d46e-4a8b-9776-b8d0afcd9127 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174724 Jul 25 20:04:48.298618 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 341/701] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:48.308376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a66534f0-7ca4-4034-9457-1f9d7960c72a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969fb69d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:48.313639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:48.315543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:48.317194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:48.318327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:48.456174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a66534f0-7ca4-4034-9457-1f9d7960c72a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.154945 Jul 25 20:04:48.467064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 342/702] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:48 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:48.483951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:48.485879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:48.512629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:48.512629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:48.513618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:48.514218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:48.675522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:48.742763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4f3ca28-81fe-4fd2-91ad-f6109c399765 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.467026 Jul 25 20:04:48.748526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 361/703] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:48 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:48.763713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39955211-3cb2-49bb-aa52-9ec7498753b3 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:48.795217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39955211-3cb2-49bb-aa52-9ec7498753b3 tempest-FlavorsV2TestJSON-1124610338 tempest-FlavorsV2TestJSON-1124610338-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040697 Jul 25 20:04:48.813000 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 362/704] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:04:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:49.045109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:49.054110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:49.087471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:49.094429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:49.095794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:49.096287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:49.730698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:49.743292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:49.772970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:49.773724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fef63844-ddf1-4bda-90fa-03b126d09686 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1328 microversion: 2.1 time: 0.742989 Jul 25 20:04:49.776244 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 363/705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:49 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1328 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:04:49.783864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:49.795209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8105f7e0-99e3-4f9b-b5ab-0fa68676de64 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 1.316806 Jul 25 20:04:49.817619 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 343/706] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:48 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:49.825454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:49.830600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:49.851635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-191e0011-d24f-4600-ab2b-1c8ac94f3824 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969bfa8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:49.856525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:49.861950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:49.865493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:49.867152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:49.979047 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-191e0011-d24f-4600-ab2b-1c8ac94f3824 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.157533 Jul 25 20:04:49.981756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 344/707] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:49 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:49.993821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:49.996876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:50.020888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:50.022437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:50.023656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:50.026487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:50.592109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:50.637333 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-608a4fb7-8169-48b0-ad55-d6ff8c0bf95d tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.653409 Jul 25 20:04:50.658128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 345/708] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:49 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:50.824500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:50.825568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:50.842810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:50.844982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:50.846633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:50.848517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:50.989483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:51.041626 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65058d2e-7f6c-4527-bfe1-a0753f8d3c39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1493 microversion: 2.1 time: 1.257759 Jul 25 20:04:51.044330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 364/709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:49 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1493 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:51.068525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:51.070968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:51.093180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:51.095228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.096915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.099359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.101517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.140417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a811a9c1-913a-4ffe-bd9f-49f73bc45d33 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1328 microversion: 2.1 time: 0.327715 Jul 25 20:04:51.155630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 346/710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:50 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1328 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:51.155630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84666268-4835-488b-8fe9-a6d8c3e7a507 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969d1d3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:51.277189 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84666268-4835-488b-8fe9-a6d8c3e7a507 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.132148 Jul 25 20:04:51.281240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 347/711] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:51 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:51.598592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:51.619852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:51.621946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:51.624513 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b54c5f65-f355-4805-8207-09850ae9c269 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 0.573218 Jul 25 20:04:51.640279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 365/712] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:51 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:51.680927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:51.682127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:51.698677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.700013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.703289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.717141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.897124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:51.900356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:51.934202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.936396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:51.939019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:51.941998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:52.096968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:52.174296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b823c068-6ddf-43e8-8f2c-7ef20a93f0da tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.497697 Jul 25 20:04:52.181544 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 366/713] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:51 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:04:52.200931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:52.202721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:52.240617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:52.241395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:52.242999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:52.247343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.343539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ad3d1c8-fc6e-4042-b59b-f1ec13fc58e0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1644 microversion: 2.1 time: 2.057479 Jul 25 20:04:53.357022 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 348/714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:51 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1644 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:53.387076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f8f45e4-1891-46f4-83bf-9f1563348bad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969bdc8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:53.475068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:53.550386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f8f45e4-1891-46f4-83bf-9f1563348bad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.191868 Jul 25 20:04:53.551501 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 349/715] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:53 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:53.569167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d5d8f24c-f45a-4c50-bf1e-4dfad51f8659 req-baa8f3a9-aa76-40aa-8869-1d7cae6971c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "name": "network-vif-unplugged", "status": "completed", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:53.589993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5d8f24c-f45a-4c50-bf1e-4dfad51f8659 req-baa8f3a9-aa76-40aa-8869-1d7cae6971c0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.591409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5d8f24c-f45a-4c50-bf1e-4dfad51f8659 req-baa8f3a9-aa76-40aa-8869-1d7cae6971c0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.622122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d5d8f24c-f45a-4c50-bf1e-4dfad51f8659 req-baa8f3a9-aa76-40aa-8869-1d7cae6971c0 service nova] Creating event network-vif-unplugged:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h2-845775-3 Jul 25 20:04:53.632647 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d5d8f24c-f45a-4c50-bf1e-4dfad51f8659 req-baa8f3a9-aa76-40aa-8869-1d7cae6971c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078168 Jul 25 20:04:53.647275 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 350/716] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:53.656592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:53.657719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:53.667074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.667534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.668362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.668816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.724401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:53.749195 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-141b82a5-08df-4baa-afcc-9fabc4e9f4d1 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.563226 Jul 25 20:04:53.750197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 367/717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:52 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:53.773619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:53.773619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:53.807531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.808391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:53.809638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:53.810283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:54.179760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:54.246445 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e84e8f0-01bf-4517-a6e3-fba50bd63b92 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.488504 Jul 25 20:04:54.247215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 368/718] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:53 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:54.259634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:54.275985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:54.297363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:54.297831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:54.298697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:54.300864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:54.495056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:55.011628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:55.080588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:55.088100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:55.089564 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b576d160-0189-4835-9b28-229654e87f37 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 1.440790 Jul 25 20:04:55.109618 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 351/719] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:53 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:55.114746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e323a68-dc84-4517-82eb-051886f76935 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b10a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:55.241711 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e323a68-dc84-4517-82eb-051886f76935 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.130512 Jul 25 20:04:55.243549 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 352/720] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:55 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:55.260219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:55.261143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:55.266019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:55.279889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.281437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.283566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.284590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.838804 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74ed9e58-8387-48bd-a9a2-490c4ff9fdcc tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1644 microversion: 2.1 time: 1.590101 Jul 25 20:04:55.846872 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 369/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:54 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1644 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:55.876919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:55.878889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:55.900151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.901035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:55.902757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:55.903839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.044716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:56.074854 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31738bfd-9df8-4c72-abfa-bbf04c7d93e6 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 0.826159 Jul 25 20:04:56.094150 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 353/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:55 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:56.107003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:56.107219 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:04:56.107219 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:04:56.126618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.128927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.130480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.132247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.222802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13d1439f-5fd4-4498-83f9-bdc1a8e47b3a tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.139165 Jul 25 20:04:56.224589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 354/723] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:04:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:04:56.245309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:56.248378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:56.288136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.288136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.307656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.312763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.517089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:56.532461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:04:56.602665 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34382fc9-3fe6-4594-bb49-1ac6c0ffd2be tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.753266 Jul 25 20:04:56.646411 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 370/724] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:55 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:56.672403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845775-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:04:56.678241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:56.694924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.698049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.699896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:56.700911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:56.871975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lazy-loading 'flavor' on Instance uuid de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:04:56.930473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Going to try to live migrate instance to n-h2-845775-3 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:04:57.270382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:57.291941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:57.299646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:57.305926 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fa5c1d0-528f-45ff-8486-4040216d8660 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1568 microversion: 2.25 time: 1.079573 Jul 25 20:04:57.308431 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 355/725] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:56 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1568 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:04:57.326553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ba0fb9a-fdd4-47e7-983a-e8d58032378a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b23160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:57.539587 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ba0fb9a-fdd4-47e7-983a-e8d58032378a tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.228776 Jul 25 20:04:57.540681 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 356/726] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:04:57 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:57.563698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:57.565047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:57.589689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:57.590999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:57.592798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:57.594141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:59.620742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:04:59.643419 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57af789c-20ff-4cfb-a876-49f05757ba07 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 2.100978 Jul 25 20:04:59.650157 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 357/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:04:57 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:04:59.668164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:04:59.670586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:04:59.692346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:59.693146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:04:59.694129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:04:59.694818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.243255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:00.367032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c87629cf-fada-4d4f-9631-ec35ff172fe0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.714795 Jul 25 20:05:00.385329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 358/728] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:04:59 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:00.418047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:00.419110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:00.445391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.445863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:00.446678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:00.447154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:01.442798 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3433413b-6cfe-4ecd-ba93-9ed468aa3a66 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5/action" status: 202 len: 0 microversion: 2.1 time: 4.794304 Jul 25 20:05:01.451883 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 371/729] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:04:56 2022] POST /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5/action => generated 0 bytes in 4804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:05:01.478047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c3424a09-579a-4a1a-8107-d849de45892b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b7ee50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:01.644275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c3424a09-579a-4a1a-8107-d849de45892b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.187108 Jul 25 20:05:01.647390 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 372/730] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:01 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:01.669464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:01.670663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:01.690711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:01.691948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:01.693686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:01.694702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:01.949737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:01.989205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:02.001360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:02.003855 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9a034bb-71fa-4577-bc0f-7ba6c62273c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1543 microversion: 2.25 time: 1.616832 Jul 25 20:05:02.005685 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 359/731] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:00 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1543 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:02.023384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ae507b31-b7ed-4315-ab0b-dedc1da1ac14 req-2ba84681-e901-4307-a4a7-6662348a845f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77244c1-4f20-4caf-803e-988184c7ee0a", "tag": "a9e8d34b-bd77-4a59-b976-b81ea2a7508b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:02.065156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ae507b31-b7ed-4315-ab0b-dedc1da1ac14 req-2ba84681-e901-4307-a4a7-6662348a845f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.066385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ae507b31-b7ed-4315-ab0b-dedc1da1ac14 req-2ba84681-e901-4307-a4a7-6662348a845f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.111861 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ae507b31-b7ed-4315-ab0b-dedc1da1ac14 req-2ba84681-e901-4307-a4a7-6662348a845f service nova] Creating event network-changed:a9e8d34b-bd77-4a59-b976-b81ea2a7508b for instance e77244c1-4f20-4caf-803e-988184c7ee0a on n-h2-845775-3 Jul 25 20:05:02.149590 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ae507b31-b7ed-4315-ab0b-dedc1da1ac14 req-2ba84681-e901-4307-a4a7-6662348a845f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139970 Jul 25 20:05:02.152814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 360/732] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:02.163271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:02.174873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:02.196885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.198536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.200833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.204073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.542646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:02.596694 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-40f15c02-8412-4c3c-8e51-f1914565f67a tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.441358 Jul 25 20:05:02.601476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 361/733] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:02 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:02.616836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:02.629938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:02.638873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.643209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.644567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.645302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.677184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:02.805257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:02.830734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6916876-d316-4b16-94eb-a62041b8055e tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.180059 Jul 25 20:05:02.848739 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 373/734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:01 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:02.863485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eed34119-acf6-472c-a616-8f00a14134d9 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '.version_select at 0x7f1969c82550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:02.869861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eed34119-acf6-472c-a616-8f00a14134d9 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:02.880234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eed34119-acf6-472c-a616-8f00a14134d9 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:02.907600 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eed34119-acf6-472c-a616-8f00a14134d9 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1766 microversion: 2.25 time: 0.057393 Jul 25 20:05:02.908547 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 374/735] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Jul 25 20:05:02 2022] GET /compute/v2.1/os-migrations => generated 1766 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:02.915540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82b097dc-bc38-4a29-918b-fcf586b138d9 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b7e700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:03.025082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82b097dc-bc38-4a29-918b-fcf586b138d9 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.114825 Jul 25 20:05:03.025947 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 375/736] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:02 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:03.045278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:03.047571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:03.055204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:03.056247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:03.057427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:03.058043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:03.818861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:03.843334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2bc5cb06-916a-4f78-bab4-fbe1d7000086 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1503 microversion: 2.1 time: 1.240048 Jul 25 20:05:03.848370 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 362/737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:02 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1503 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:03.872491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:03.874608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:03.913768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:03.924252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:03.929117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:03.931234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:04.093122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid 6bf89e00-f30f-4499-810a-a732dcff6a19 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:04.116604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bd43f816-20fc-487e-8f14-be474ea93c88 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 2036 microversion: 2.25 time: 1.074937 Jul 25 20:05:04.118855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 376/738] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:03 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 2036 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:04.129201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:04.130105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:04.157399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:04.167186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:04.169139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:04.169886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:04.703536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:04.790145 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7431c155-ec80-4f84-b605-01c1fa192cc0 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.939025 Jul 25 20:05:04.792822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 363/739] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:03 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:04.817490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b8af747-425c-4a5c-be58-509200de2387 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b10a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:04.945910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b8af747-425c-4a5c-be58-509200de2387 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.144327 Jul 25 20:05:04.954975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 364/740] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:04 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:04.961804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4191617c-ca07-499a-a16c-097f932d0f40 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: .version_select at 0x7f1969b23700>, body: {"keypair": {"name": "tempest-keypair-178710913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/lfB5zzQ2z5kXlInjmLl1ODqviFSzxBU/qyub8GjkAZ4EE3aI/2UZayxTIbjK7GazmLgHMusVXZDTrNdBcghsvM64+eHomW1xo2skPkHIxktevKi4uG+ZtsbgkRdk/WA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:05.017464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4191617c-ca07-499a-a16c-097f932d0f40 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for project a6e677726d0148b997afda26e08f4a3d. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:05:05.038464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4191617c-ca07-499a-a16c-097f932d0f40 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for user 98399c84012545a88dc69f2cbc91cf69 and project a6e677726d0148b997afda26e08f4a3d. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:05:05.129745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4191617c-ca07-499a-a16c-097f932d0f40 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.173217 Jul 25 20:05:05.138653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 365/741] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:05:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:05:05.146722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7d6a82e1-a751-4f22-a821-77afde7b533c req-581d7d71-83df-4dbf-95ef-2019bffaf578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:05.192167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7d6a82e1-a751-4f22-a821-77afde7b533c req-581d7d71-83df-4dbf-95ef-2019bffaf578 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:05.192905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7d6a82e1-a751-4f22-a821-77afde7b533c req-581d7d71-83df-4dbf-95ef-2019bffaf578 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:05.227783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7d6a82e1-a751-4f22-a821-77afde7b533c req-581d7d71-83df-4dbf-95ef-2019bffaf578 service nova] Creating event network-vif-unplugged:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h1-845775-3 Jul 25 20:05:05.256343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7d6a82e1-a751-4f22-a821-77afde7b533c req-581d7d71-83df-4dbf-95ef-2019bffaf578 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121881 Jul 25 20:05:05.270528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 366/742] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:05.280418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:05.282398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:05.303693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:05.304492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:05.305815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:05.306571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:05.383095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:05.413411 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-193a2b94-2ee1-4307-a898-8d4c7f61e158 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.288463 Jul 25 20:05:05.435770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 377/743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:04 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:05.825068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:05.825779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:05.842791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:05.843628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:05.844697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:05.845456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:06.153182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:06.342197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:06.383094 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-38445987-3b2e-4ee3-8659-545c12c23fd9 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1927 microversion: 2.75 time: 0.563610 Jul 25 20:05:06.384108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 378/744] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:05 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1927 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:05:06.421680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64e8ab88-2dc3-415e-a632-022220a309fb tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969ad1ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:06.572517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:06.585538 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64e8ab88-2dc3-415e-a632-022220a309fb tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.199162 Jul 25 20:05:06.589671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-350ccad7-0025-45fa-a438-ba9662d4ca77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1503 microversion: 2.1 time: 1.317198 Jul 25 20:05:06.594753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 367/745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:05 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1503 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:06.604511 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 379/746] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:06 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:06.604511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:06.604511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:06.655434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:06.660757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:06.668809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:06.675088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:07.486337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:07.488130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:07.522041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:07.526227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:07.534056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:07.534532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:07.736290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:07.757324 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f59c695-ada2-4f59-8cd6-a14b7995f18f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.158728 Jul 25 20:05:07.762104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 380/747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:06 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:07.777560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11263c95-6433-4c57-8937-9c2f9aa1a818 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a70d30>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:07.968616 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11263c95-6433-4c57-8937-9c2f9aa1a818 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.207979 Jul 25 20:05:07.973103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 381/748] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:07 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:07.996710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:07.997814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:08.020963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:08.022134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:08.024423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:08.028704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:08.113024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:08.236222 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2740cc24-c707-4f41-8bb6-be501c8cf7b8 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1933 microversion: 2.75 time: 0.798490 Jul 25 20:05:08.241711 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 368/749] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:07 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1933 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:08.261437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-66ddce95-48dd-4925-b380-e7a216b03487 req-b6af42b2-9fa2-4eca-91af-83772adc159b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:08.303027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-66ddce95-48dd-4925-b380-e7a216b03487 req-b6af42b2-9fa2-4eca-91af-83772adc159b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:08.305031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-66ddce95-48dd-4925-b380-e7a216b03487 req-b6af42b2-9fa2-4eca-91af-83772adc159b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:08.355276 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-66ddce95-48dd-4925-b380-e7a216b03487 req-b6af42b2-9fa2-4eca-91af-83772adc159b service nova] Creating event network-changed:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h1-845775-3 Jul 25 20:05:08.387710 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-66ddce95-48dd-4925-b380-e7a216b03487 req-b6af42b2-9fa2-4eca-91af-83772adc159b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144129 Jul 25 20:05:08.391206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 369/750] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:08.790036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:08.790917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:08.819782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:08.824230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:08.829109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:08.830070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:09.528014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:09.552914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e36126e-4445-47f4-af4d-3ff3dc198e68 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1503 microversion: 2.1 time: 1.577626 Jul 25 20:05:09.554303 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 382/751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:07 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1503 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:09.571932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ea066ec-debf-47c7-8dcc-7285f055dd69 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969c004c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:09.723086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ea066ec-debf-47c7-8dcc-7285f055dd69 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.164441 Jul 25 20:05:09.730183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 383/752] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:09 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:09.744954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:09.746045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:09.764005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:09.770568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:09.772585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:09.776253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:10.593903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:10.667705 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84addbc6-0ca6-4018-8d3c-a0dad2a5af16 tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1933 microversion: 2.75 time: 0.935396 Jul 25 20:05:10.680838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 384/753] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:09 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1933 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:10.718953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:10.720928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:10.734052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:10.737903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:10.739801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:10.741349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:10.874849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:10.906091 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4604d231-af0c-49f6-a4fc-fe4aa7504a65 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 2.122555 Jul 25 20:05:10.908643 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 370/754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:08 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:10.924291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3b2fca8-e4ba-4ea1-9b7a-46c9fd5fb001 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969d6bca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:11.104018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c3b2fca8-e4ba-4ea1-9b7a-46c9fd5fb001 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1423 microversion: 2.1 time: 0.192498 Jul 25 20:05:11.111315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 371/755] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:10 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1423 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:11.727471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:11.735109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:11.744843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:11.745887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:11.747370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:11.748425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:12.098330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] Lazy-loading 'services' on Instance uuid e52b6378-866e-4533-b6ba-41e53f93f7b1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:05:12.204376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5e54a02-6c66-4d54-b169-fb3b613509ca tempest-ServersAdmin275Test-400317877 tempest-ServersAdmin275Test-400317877-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1918 microversion: 2.75 time: 0.483042 Jul 25 20:05:12.216662 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 372/756] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:11 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1918 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:12.230173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:12.230880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:12.256082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:12.256714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:12.257807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:12.258407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:12.876693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:12.893824 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6da6427d-4444-454d-8d6d-f7137ab00da0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1503 microversion: 2.1 time: 2.201946 Jul 25 20:05:12.895753 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 385/757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:10 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1503 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:12.905034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a402026-7bcb-40ad-9953-62117259a3bf tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a8a820>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:13.021245 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a402026-7bcb-40ad-9953-62117259a3bf tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1432 microversion: 2.1 time: 0.122811 Jul 25 20:05:13.023671 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 386/758] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:12 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1432 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:13.031932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:13.034880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:13.053764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.055620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.057018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.058682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.123235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:05:13.246725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:13.269550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35be94db-367f-4bbe-92bf-93cabcf0e42f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.050995 Jul 25 20:05:13.270476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 373/759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:12 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:13.277733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e9e2e8f3-bf1a-45a9-81f4-f0e7a5084ccc req-bfca21f0-108c-4e66-a8b5-deb9fc42b412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77244c1-4f20-4caf-803e-988184c7ee0a", "name": "network-vif-plugged", "status": "completed", "tag": "a9e8d34b-bd77-4a59-b976-b81ea2a7508b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:13.315590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e9e2e8f3-bf1a-45a9-81f4-f0e7a5084ccc req-bfca21f0-108c-4e66-a8b5-deb9fc42b412 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.316547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e9e2e8f3-bf1a-45a9-81f4-f0e7a5084ccc req-bfca21f0-108c-4e66-a8b5-deb9fc42b412 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.356233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e9e2e8f3-bf1a-45a9-81f4-f0e7a5084ccc req-bfca21f0-108c-4e66-a8b5-deb9fc42b412 service nova] Creating event network-vif-plugged:a9e8d34b-bd77-4a59-b976-b81ea2a7508b for instance e77244c1-4f20-4caf-803e-988184c7ee0a on n-h2-845775-3 Jul 25 20:05:13.356634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b86cec71-8d16-4e93-b828-654854d4174c tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 204 len: 0 microversion: 2.75 time: 0.300067 Jul 25 20:05:13.357530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 387/760] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:05:13 2022] DELETE /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:05:13.369591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-169640876", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "82f9b8d8-b338-4889-8e9c-d78340530deb"}], "security_groups": [{"name": "tempest-securitygroup--1756341536"}], "key_name": "tempest-keypair-178710913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:13.372848 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e9e2e8f3-bf1a-45a9-81f4-f0e7a5084ccc req-bfca21f0-108c-4e66-a8b5-deb9fc42b412 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100084 Jul 25 20:05:13.374688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 374/761] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:13.381114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f94c3b7-0f5b-4eba-8dd7-20463be078ce tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a6b820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:13.514270 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f94c3b7-0f5b-4eba-8dd7-20463be078ce tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 200 len: 1432 microversion: 2.1 time: 0.136456 Jul 25 20:05:13.528118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 375/762] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:13 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 1432 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:13.528118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:13.528901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:13.538081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.538595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.540211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.541308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.839391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:13.859092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:13.862179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:13.872518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf25f46c-588c-4f8b-a6d4-4ac9feeea46b tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1443 microversion: 2.75 time: 0.353584 Jul 25 20:05:13.885138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 376/763] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:13 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1443 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:13.902972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7a32c54f-1bad-4776-8d75-487e5cf09beb req-d3398821-0ac2-4869-a6b2-58e80d1ed602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "name": "network-vif-unplugged", "status": "completed", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:13.917148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7a32c54f-1bad-4776-8d75-487e5cf09beb req-d3398821-0ac2-4869-a6b2-58e80d1ed602 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:13.917745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7a32c54f-1bad-4776-8d75-487e5cf09beb req-d3398821-0ac2-4869-a6b2-58e80d1ed602 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:13.961846 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7a32c54f-1bad-4776-8d75-487e5cf09beb req-d3398821-0ac2-4869-a6b2-58e80d1ed602 service nova] Creating event network-vif-unplugged:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h1-845775-3 Jul 25 20:05:13.978447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7a32c54f-1bad-4776-8d75-487e5cf09beb req-d3398821-0ac2-4869-a6b2-58e80d1ed602 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091180 Jul 25 20:05:13.979824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 377/764] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:13.987495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:13.988490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:14.001820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:14.002883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:14.004414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:14.010717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:14.181587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] validate_networks() for [('82f9b8d8-b338-4889-8e9c-d78340530deb', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:05:14.889063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:14.913366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ebc561b-3727-4786-aadc-2edbcf9a7aad tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1464 microversion: 2.1 time: 0.931492 Jul 25 20:05:14.928322 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 378/765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:13 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1464 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:14.945923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:14.948795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:14.963333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:14.964572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:14.966295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:14.968232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:15.067721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:15.590786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:15.608263 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c33f556b-a7ce-41ba-a620-da03aa531ad3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1503 microversion: 2.1 time: 0.675734 Jul 25 20:05:15.611539 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 379/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:14 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1503 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:15.617224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:15.618273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:15.633748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:15.634974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:15.637522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:15.638974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:15.948655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:05:15.949456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:05:15.949846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:05:15.950556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:05:15.952394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:05:15.983307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:15.984411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:15.986007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:15.987064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:16.060076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:05:16.074607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for user 98399c84012545a88dc69f2cbc91cf69 and project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:05:16.137988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:05:16.146772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:05:16.216223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:16.302738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83dc05a6-5e71-4ccc-8668-a39e0be91f63 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.942244 Jul 25 20:05:16.303487 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 388/767] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:05:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:05:16.319453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:16.320496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:16.339713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:16.340213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:16.341015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:16.341466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:16.724317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:16.755200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-994ada27-3c72-4ac2-9d44-0737d6f0b267 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1396 microversion: 2.1 time: 1.135101 Jul 25 20:05:16.761137 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 380/768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:15 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1396 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:16.790322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-76d97f58-133f-44ba-a531-d4ccbc6741c6 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969cc2160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:16.881625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:16.900565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:16.902632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ee4b21e5b9e4bd08a348ee79c27d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05c06165b83d4bd9b5dce8bf51e9e427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:16.925031 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-76d97f58-133f-44ba-a531-d4ccbc6741c6 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba" status: 200 len: 784 microversion: 2.1 time: 0.159160 Jul 25 20:05:16.942320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a6752dd-fef2-43ab-977e-2dc695cf0d69 tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 200 len: 1443 microversion: 2.75 time: 0.634751 Jul 25 20:05:16.943921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 389/769] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:16 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 1443 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:16.947343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 381/770] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:16 2022] GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba => generated 784 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:16.952719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:16.963682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:16.965588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:16.966191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:16.980503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:16.981720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:16.984333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:16.985392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:17.156498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:17.180233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:17.183598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:17.186586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c1e62382-aa3f-4e71-b6ea-4c10e1f31366 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1284 microversion: 2.25 time: 0.240406 Jul 25 20:05:17.194081 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 390/771] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:16 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:17.213270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-feb452b8-76f8-49f8-b679-676d86ab9e85 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:17.234810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-feb452b8-76f8-49f8-b679-676d86ab9e85 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038923 Jul 25 20:05:17.236065 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 391/772] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:05:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:17.252834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4aed2474-70b1-442d-b239-fd66b2bb9863 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a51e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:17.811523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:17.837637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3faa080c-2d84-4463-b757-d1ac8307e8ad tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1493 microversion: 2.1 time: 0.881016 Jul 25 20:05:17.838495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 382/773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:16 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1493 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:17.854809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-103e4d69-b0bf-40e7-863f-7e6ca45f5a90 req-b9b9f8a7-3b62-49eb-9232-26a212c84192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-unplugged", "status": "completed", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:17.903342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-103e4d69-b0bf-40e7-863f-7e6ca45f5a90 req-b9b9f8a7-3b62-49eb-9232-26a212c84192 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:17.905054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-103e4d69-b0bf-40e7-863f-7e6ca45f5a90 req-b9b9f8a7-3b62-49eb-9232-26a212c84192 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:17.985168 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-103e4d69-b0bf-40e7-863f-7e6ca45f5a90 req-b9b9f8a7-3b62-49eb-9232-26a212c84192 service nova] Creating event network-vif-unplugged:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:05:18.003156 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-103e4d69-b0bf-40e7-863f-7e6ca45f5a90 req-b9b9f8a7-3b62-49eb-9232-26a212c84192 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162613 Jul 25 20:05:18.004679 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 383/774] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:18.028624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:18.030834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:18.045922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:18.047003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:18.048673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:18.049661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:18.775632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:18.790201 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86ea1f16-513b-4e63-8439-d604746da562 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1577 microversion: 2.1 time: 0.783672 Jul 25 20:05:18.803440 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 384/775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:18 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1577 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:18.818564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d58b78e-8841-444b-9fa9-25553f5dbae0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '.version_select at 0x7f1969bfa3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:18.835403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d58b78e-8841-444b-9fa9-25553f5dbae0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:18.839526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d58b78e-8841-444b-9fa9-25553f5dbae0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:18.890491 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d58b78e-8841-444b-9fa9-25553f5dbae0 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.084460 Jul 25 20:05:18.893560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 385/776] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:05:18 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:18.914543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:18.917552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] [instance: e52b6378-866e-4533-b6ba-41e53f93f7b1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:18.942381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:18.943129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:18.944910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:18.952699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.015501 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] HTTP exception thrown: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Request method failure captured: Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 HTTP/1.1 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vckmLxTP3KIywikdoRfcDM3xXazUuhYPjKC0FqgJ8PuCtG4-Q9FfKhQZvRZ6ve7j2KvCQEeeUFCftID4UDRyed66PcOecbMPi1wea3Wnn1CTBPE70SrSrhn1dKkTk5KSOGxaP7aK_hc7-djfMEO0zqryCBr_YJauPyDl0B9Wf_rwgk Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.75 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 05c06165b83d4bd9b5dce8bf51e9e427 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdmin275Test-1095143284 Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:05:19.027529 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/05c06165b83d4bd9b5dce8bf51e9e427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_05c06165b83d4bd9b5dce8bf51e9e427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/05c06165b83d4bd9b5dce8bf51e9e427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/05c06165b83d4bd9b5dce8bf51e9e427"}]}] Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdmin275Test-1095143284 Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 05c06165b83d4bd9b5dce8bf51e9e427 Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdmin275Test-1095143284 Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdmin275Test-1095143284-project Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7ee4b21e5b9e4bd08a348ee79c27d8c4 Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdmin275Test-1095143284-project Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. Jul 25 20:05:19.030397 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'e52b6378-866e-4533-b6ba-41e53f93f7b1'} Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:05:19.031868 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. Jul 25 20:05:19.037543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.047723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] Returning 404 to user: Instance e52b6378-866e-4533-b6ba-41e53f93f7b1 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:05:19.047723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9aa78ec-1451-43f9-ab14-fd8a5d0ab88f tempest-ServersAdmin275Test-1095143284 tempest-ServersAdmin275Test-1095143284-project] 10.222.0.48 "GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1" status: 404 len: 111 microversion: 2.75 time: 0.147685 Jul 25 20:05:19.057791 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 386/777] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:18 2022] GET /compute/v2.1/servers/e52b6378-866e-4533-b6ba-41e53f93f7b1 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:05:19.086282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:19.102900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:19.127002 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4aed2474-70b1-442d-b239-fd66b2bb9863 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "DELETE /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 204 len: 0 microversion: 2.1 time: 1.879794 Jul 25 20:05:19.127729 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 392/778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:17 2022] DELETE /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 0 bytes in 1881 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:05:19.129727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.130372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.140345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.141280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.153813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:19.154849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:19.180803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:19.214470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.215238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.216631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.217893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.307063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:19.415013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:19.453143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:19.458561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:19.466661 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cccf4703-8c57-46f4-8e9d-a085cfe420af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1344 microversion: 2.25 time: 0.404916 Jul 25 20:05:19.507141 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 387/779] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:19 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1344 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:19.516072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:19.517263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:19.526050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.527043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.528616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.530025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.776818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-309c72ac-1c60-4b6d-8a1a-183a492227c4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.647838 Jul 25 20:05:19.778905 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 393/780] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:05:19 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a/os-interface => generated 285 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:19.794193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3671af22-1411-48aa-91a2-255d022abf28 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a7f430>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:19.844173 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3671af22-1411-48aa-91a2-255d022abf28 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] HTTP exception thrown: Image not found. Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3671af22-1411-48aa-91a2-255d022abf28 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Request method failure captured: Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf HTTP/1.1 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcwiWmcZ8HEFjHNIiaq7c9RjmrqmWvOacfbMnAPbz16Kc90U83hbAyTBT2rkt1kksy8CstIh1DhYLAYciWVd0kvcoqEP3Jc-JzHfun5Ibdl6qRYSxTvRX1Ua8UJStn6bDzZEGSX7ANWduv0tb6vPw_d6AswcbMZVmE_Q9ULCwogjlU Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:05:19.873562 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d163906f445f40499dd7e9f794c92b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}] Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6e31755ee871433bbcaa657add0cb6a1 Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9f5ff07e-b6c7-430c-98f0-4f0a79c81adf'} Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:05:19.877876 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f5ff07e-b6c7-430c-98f0-4f0a79c81adf Jul 25 20:05:19.879570 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:05:19.882546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f5ff07e-b6c7-430c-98f0-4f0a79c81adf could not be found. Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:05:19.884431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3671af22-1411-48aa-91a2-255d022abf28 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:05:19.886379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3671af22-1411-48aa-91a2-255d022abf28 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 404 len: 62 microversion: 2.1 time: 0.103198 Jul 25 20:05:19.889560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 394/781] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:19 2022] GET /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:05:19.902625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1837003762"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:19.913076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:19.930331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.931476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:19.932808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:19.933881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:20.334489 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8d5d8e0-a712-4b54-8802-f6b759cb9c1c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1644 microversion: 2.1 time: 0.825608 Jul 25 20:05:20.339334 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 388/782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:19 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1644 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:20.491276 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ae8ff8d-d07f-43d4-a657-9439786ca2e4 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "POST /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041/action" status: 202 len: 0 microversion: 2.1 time: 0.594213 Jul 25 20:05:20.494125 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 395/783] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:05:19 2022] POST /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 20:05:20.510726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b323dc2d-d7c5-4cda-8f87-49a2cdf7a6a3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969aa9310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:20.546897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:20.553776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:20.602829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:20.603870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:20.607939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:20.613472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:20.675285 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b323dc2d-d7c5-4cda-8f87-49a2cdf7a6a3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.166512 Jul 25 20:05:20.676314 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 389/784] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:20 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:20.743137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-714912713", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "21bb1d6f-b1ef-4bf4-9acf-77064489ef62"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:20.870838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] validate_networks() for [('21bb1d6f-b1ef-4bf4-9acf-77064489ef62', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:05:20.910748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:20.948025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:20.958664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:20.963396 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d0d7d5e-c74e-4c79-96ab-eead9f533018 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1342 microversion: 2.25 time: 0.446910 Jul 25 20:05:20.969573 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 396/785] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:20 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1342 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:21.576738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e2ca2c0-2991-40b3-862b-23f8a7446afc tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Action: 'create', calling method: .version_select at 0x7f1969a8a430>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:25.909799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:05:25.911488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:05:25.912718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:05:25.914539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:05:25.917848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:05:25.926078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:25.952847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:25.954140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:25.955435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:25.956120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:25.996889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:05:26.015079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:26.025551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for user 1d0f300b7de441108c3efcee70e8f920 and project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:05:26.060316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:05:26.070458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:05:26.223432 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ae57ea0-23b7-4364-ac89-d12c8298a8f6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.488530 Jul 25 20:05:26.242793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 390/786] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:05:26.269101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9762ae1b-4859-4c66-b5df-9dab4e6ca4f7 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969aa9b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:26.382100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9762ae1b-4859-4c66-b5df-9dab4e6ca4f7 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.135612 Jul 25 20:05:26.390155 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 391/787] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:26 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:26.422421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:26.423442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:26.439800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:26.440665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:26.442853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:26.443832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:27.162345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:27.485143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:27.527532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:27.541068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:27.543710 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-93b74ae8-2a90-4ce3-a4d8-ee18fe80c8f3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1410 microversion: 2.25 time: 1.133882 Jul 25 20:05:27.546526 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 392/788] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:26 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1410 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:27.562050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-479df789-6d70-46b7-a7da-8b2ad1d31d4d req-968564f4-91aa-4247-ae2d-2a1e89739a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:27.591353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-479df789-6d70-46b7-a7da-8b2ad1d31d4d req-968564f4-91aa-4247-ae2d-2a1e89739a66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:27.591815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-479df789-6d70-46b7-a7da-8b2ad1d31d4d req-968564f4-91aa-4247-ae2d-2a1e89739a66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:27.620648 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-479df789-6d70-46b7-a7da-8b2ad1d31d4d req-968564f4-91aa-4247-ae2d-2a1e89739a66 service nova] Creating event network-changed:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:05:27.631793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-479df789-6d70-46b7-a7da-8b2ad1d31d4d req-968564f4-91aa-4247-ae2d-2a1e89739a66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073761 Jul 25 20:05:27.631793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 393/789] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:27.641397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:27.646495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:27.666446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:27.667236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:27.672494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:27.673038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:27.915056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:27.930962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52e99075-0e64-4c74-8f67-109e206e27ac tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1214 microversion: 2.1 time: 0.297602 Jul 25 20:05:27.944223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 394/790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:27 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:27.949652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:27.950520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:27.967699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:27.968386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:27.969784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:27.970469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:28.047933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:05:28.308863 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-96010776-593e-40e3-9325-10a11a31ecf1 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 204 len: 0 microversion: 2.1 time: 0.373462 Jul 25 20:05:28.311351 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 395/791] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:05:27 2022] DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:05:28.327727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf6b7acf-54ff-4b5e-aa51-8f3d53ce5fe3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b23790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:28.531799 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf6b7acf-54ff-4b5e-aa51-8f3d53ce5fe3 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.218220 Jul 25 20:05:28.533921 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 396/792] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:28 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:28.593847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:28.595111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:28.617860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:28.623592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:28.626330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:28.628804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:29.056840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:29.088504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:29.093095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:29.095591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49be2cb7-e1c7-45f3-bc5d-93ebb083a215 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1410 microversion: 2.25 time: 0.509349 Jul 25 20:05:29.096675 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 397/793] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:28 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1410 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:05:29.119458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-214931819", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "716673613", "adminPass": "***", "networks": [{"uuid": "fe55f809-80ad-4d50-a2df-d6d31755d630"}], "security_groups": [{"name": "tempest-securitygroup--773792271"}], "key_name": "tempest-keypair-433884167", "user_data": "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:29.759787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] validate_networks() for [('fe55f809-80ad-4d50-a2df-d6d31755d630', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:05:30.571789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:30.931733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:34.341181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:05:34.341827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:05:34.342835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:05:34.343271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:05:34.343787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:05:34.378546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:34.386739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:34.388328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:34.389755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:34.487662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:05:34.511505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Getting quotas for user 9dbcf9f54120415792c4b620078b8a0a and project 4af4a4328b6d404f8e80abe01cd5b883. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:05:34.578349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:05:34.586176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:05:34.844697 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd2f22e7-0fe1-428f-ad11-faea289d0a38 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.734746 Jul 25 20:05:34.851664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 398/794] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:05:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 5743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:05:34.874864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:34.894466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:34.927271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:34.930915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:34.931825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:34.934627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:36.948673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e2ca2c0-2991-40b3-862b-23f8a7446afc tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 15.716100 Jul 25 20:05:36.950572 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 397/795] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:05:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 15719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:36.968216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eaa22217-8215-48ab-82d6-1e005b3fdf6b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f19699c0700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:37.193342 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eaa22217-8215-48ab-82d6-1e005b3fdf6b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.240812 Jul 25 20:05:37.211220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 398/796] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:36 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:37.234739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:37.239745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:37.274730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:37.281019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:37.284175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:37.285245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:37.471149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:37.525224 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee2ea16d-9698-4f80-a9f3-a89e6cb07580 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 2.671182 Jul 25 20:05:37.534753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 399/797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:34 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:37.563335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-18d7d91a-14cc-47c7-830b-abdfd1ccb8a0 req-929117fb-cb1a-407c-89ab-aabe23cf850c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77244c1-4f20-4caf-803e-988184c7ee0a", "tag": "a9e8d34b-bd77-4a59-b976-b81ea2a7508b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:37.620024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-18d7d91a-14cc-47c7-830b-abdfd1ccb8a0 req-929117fb-cb1a-407c-89ab-aabe23cf850c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:37.623870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-18d7d91a-14cc-47c7-830b-abdfd1ccb8a0 req-929117fb-cb1a-407c-89ab-aabe23cf850c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:37.723881 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-18d7d91a-14cc-47c7-830b-abdfd1ccb8a0 req-929117fb-cb1a-407c-89ab-aabe23cf850c service nova] Creating event network-changed:a9e8d34b-bd77-4a59-b976-b81ea2a7508b for instance e77244c1-4f20-4caf-803e-988184c7ee0a on n-h2-845775-3 Jul 25 20:05:37.744001 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-18d7d91a-14cc-47c7-830b-abdfd1ccb8a0 req-929117fb-cb1a-407c-89ab-aabe23cf850c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201838 Jul 25 20:05:37.775225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 400/798] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:37.798172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:37.801478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:37.819877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:37.822204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:37.827682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:37.829497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:37.978979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:38.014805 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4de9240-ca97-485c-ab5b-4bb13c6e930f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1577 microversion: 2.1 time: 0.799887 Jul 25 20:05:38.018711 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 399/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:37 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1577 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:38.038937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-746290d4-5024-4c26-9e18-8f1203edc9f0 req-fce30822-b371-4a68-a46a-bfb34647fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-plugged", "status": "completed", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:38.078236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-746290d4-5024-4c26-9e18-8f1203edc9f0 req-fce30822-b371-4a68-a46a-bfb34647fdf2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:38.079831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-746290d4-5024-4c26-9e18-8f1203edc9f0 req-fce30822-b371-4a68-a46a-bfb34647fdf2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:38.107585 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-746290d4-5024-4c26-9e18-8f1203edc9f0 req-fce30822-b371-4a68-a46a-bfb34647fdf2 service nova] Creating event network-vif-plugged:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:05:38.121403 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-746290d4-5024-4c26-9e18-8f1203edc9f0 req-fce30822-b371-4a68-a46a-bfb34647fdf2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099489 Jul 25 20:05:38.128289 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 400/800] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:38.164738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:38.165938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:38.193264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:38.193730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:38.194852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:38.202594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:38.407177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:38.444807 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8044c699-cbb6-4773-a18e-e683dbb07092 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1321 microversion: 2.1 time: 0.308643 Jul 25 20:05:38.453275 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 401/801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:38 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:38.471736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b62ad101-bc9b-4759-9372-0379ecaf50a0 req-0f1f0d9d-812a-40b4-96d9-70c00bd1fbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9318170e-8c6e-480a-96f5-45a0caa25c69", "name": "network-vif-deleted", "tag": "9802e152-559b-4ea8-a57c-8aaeab7f8c23"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:38.499274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b62ad101-bc9b-4759-9372-0379ecaf50a0 req-0f1f0d9d-812a-40b4-96d9-70c00bd1fbe6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:38.502408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b62ad101-bc9b-4759-9372-0379ecaf50a0 req-0f1f0d9d-812a-40b4-96d9-70c00bd1fbe6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:38.552828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b62ad101-bc9b-4759-9372-0379ecaf50a0 req-0f1f0d9d-812a-40b4-96d9-70c00bd1fbe6 service nova] Creating event network-vif-deleted:9802e152-559b-4ea8-a57c-8aaeab7f8c23 for instance 9318170e-8c6e-480a-96f5-45a0caa25c69 on n-h2-845775-3 Jul 25 20:05:38.575117 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b62ad101-bc9b-4759-9372-0379ecaf50a0 req-0f1f0d9d-812a-40b4-96d9-70c00bd1fbe6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119210 Jul 25 20:05:38.580463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 402/802] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:38.592894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e60d083-9a7e-4a62-b4f7-ceab6605e56f tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Action: 'create', calling method: .version_select at 0x7f1969d6eaf0>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:39.027301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:39.046487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:39.050457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:39.052637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5f41bef-f6c9-45f7-a386-52e5fabff934 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1410 microversion: 2.25 time: 1.274585 Jul 25 20:05:39.053875 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 401/803] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:37 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1410 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:39.063186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59a388ee-c258-459b-8b9a-389f3ccd1cfe tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b230d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:39.159912 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59a388ee-c258-459b-8b9a-389f3ccd1cfe tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.104082 Jul 25 20:05:39.160831 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 402/804] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:39 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:39.188244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:39.190114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:39.212375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:39.216073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:39.220347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:39.221264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:41.001610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:41.010437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aeab8b57-8397-4ea3-914c-38f876f5140c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 1.843375 Jul 25 20:05:41.011037 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 403/805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:39 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:41.043198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:41.043828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:41.067287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:41.067651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:41.068724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:41.069172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:41.623543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:41.635117 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89ee79cc-57b1-4d75-a604-2308f0e75351 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1386 microversion: 2.1 time: 0.603438 Jul 25 20:05:41.648667 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 404/806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:41 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1386 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:41.656302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:41.657034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:41.675774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:41.677158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:41.678638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:41.679660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:42.327847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:42.360889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:42.365774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:42.374874 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-700e208c-ae0a-4791-8139-2c9de5ed325f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1410 microversion: 2.25 time: 0.723982 Jul 25 20:05:42.384320 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 405/807] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:41 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1410 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:42.407977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-44e0a9d8-0c8d-481e-8b3e-0c8b6f01b6cf req-4ddd53cd-4a89-4146-9762-8abe860a6f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "name": "network-vif-plugged", "status": "completed", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:42.442214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-44e0a9d8-0c8d-481e-8b3e-0c8b6f01b6cf req-4ddd53cd-4a89-4146-9762-8abe860a6f4f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:42.447788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-44e0a9d8-0c8d-481e-8b3e-0c8b6f01b6cf req-4ddd53cd-4a89-4146-9762-8abe860a6f4f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:42.477712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-44e0a9d8-0c8d-481e-8b3e-0c8b6f01b6cf req-4ddd53cd-4a89-4146-9762-8abe860a6f4f service nova] Creating event network-vif-plugged:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:05:42.491882 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-44e0a9d8-0c8d-481e-8b3e-0c8b6f01b6cf req-4ddd53cd-4a89-4146-9762-8abe860a6f4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105958 Jul 25 20:05:42.499086 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 406/808] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:42.507817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0beb93a4-e228-482d-9fbf-3901ca27c223 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969aa95e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:44.439570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:44.549092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:46.926980 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e60d083-9a7e-4a62-b4f7-ceab6605e56f tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.344605 Jul 25 20:05:46.938246 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 403/809] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:05:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:46.947849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:46.948633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:46.971518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:46.971981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:46.972819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:46.980853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:48.274265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:48.289204 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1a63d422-7585-4011-ae6b-16f45371799b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 1.349405 Jul 25 20:05:48.293192 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 404/810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:46 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:48.314145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:48.316004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:48.350555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:48.360267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:48.364481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:48.365745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:48.994866 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0beb93a4-e228-482d-9fbf-3901ca27c223 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 6.494131 Jul 25 20:05:48.995444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 407/811] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:42 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 6496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:49.033145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-95642a97-f3ee-4e40-ab4a-323edff96efc req-33b8cdca-0b14-49de-9dde-35e761fbd890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:49.065996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-95642a97-f3ee-4e40-ab4a-323edff96efc req-33b8cdca-0b14-49de-9dde-35e761fbd890 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:49.066445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-95642a97-f3ee-4e40-ab4a-323edff96efc req-33b8cdca-0b14-49de-9dde-35e761fbd890 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:49.113213 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-95642a97-f3ee-4e40-ab4a-323edff96efc req-33b8cdca-0b14-49de-9dde-35e761fbd890 service nova] Creating event network-changed:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h1-845775-3 Jul 25 20:05:49.145054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-95642a97-f3ee-4e40-ab4a-323edff96efc req-33b8cdca-0b14-49de-9dde-35e761fbd890 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127191 Jul 25 20:05:49.145996 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 408/812] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:49.162022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:49.162750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:49.172401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:49.172856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:49.173648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:49.174088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:49.230908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:49.885191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:49.906048 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7c9dfa0-d2a4-4394-9c9c-4bbffec507da tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1386 microversion: 2.1 time: 1.610886 Jul 25 20:05:49.914907 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 405/813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:48 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1386 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:49.920753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-920a4065-86af-4564-950d-c49e684df265 req-c17b0b42-8e4c-40ea-966a-43b3373f5033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f721cade-dbc8-4931-bbb9-16e7350cc163", "tag": "a1e04947-c068-4ce9-a6ae-15bb8f6995a9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:49.938727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-920a4065-86af-4564-950d-c49e684df265 req-c17b0b42-8e4c-40ea-966a-43b3373f5033 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:49.939568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-920a4065-86af-4564-950d-c49e684df265 req-c17b0b42-8e4c-40ea-966a-43b3373f5033 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:49.958767 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-920a4065-86af-4564-950d-c49e684df265 req-c17b0b42-8e4c-40ea-966a-43b3373f5033 service nova] Creating event network-changed:a1e04947-c068-4ce9-a6ae-15bb8f6995a9 for instance f721cade-dbc8-4931-bbb9-16e7350cc163 on n-h1-845775-3 Jul 25 20:05:49.964876 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-920a4065-86af-4564-950d-c49e684df265 req-c17b0b42-8e4c-40ea-966a-43b3373f5033 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048240 Jul 25 20:05:49.967305 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 406/814] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:49.974190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d7378f5-8d67-4bd4-b99d-3c16f4221c59 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Action: 'create', calling method: .version_select at 0x7f1969a7f430>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:50.644755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:50.658262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:50.681294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:50.682624 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0b93c44-8b8a-49ce-89e7-64115443bcb3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1606 microversion: 2.25 time: 1.535504 Jul 25 20:05:50.683224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 409/815] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:05:49 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1606 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:05:50.703850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:50.722684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:50.765164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:50.765895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:50.767475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:50.779990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:51.294432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:51.322299 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d579e97-0880-4870-98f6-edefdff12f0f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 0.627875 Jul 25 20:05:51.336938 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 410/816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:50 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:51.359815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10fa9e16-7a06-4a54-b4b1-f745f660e9b7 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969a85c10>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:51.469534 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10fa9e16-7a06-4a54-b4b1-f745f660e9b7 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.130867 Jul 25 20:05:51.470340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 411/817] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:51 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:51.476773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:51.480015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:51.493686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:51.494754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:51.508299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:51.511607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:52.306657 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec86d7b0-8345-43e2-8d71-f88c9684e0ba tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.833855 Jul 25 20:05:52.308181 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 412/818] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:05:51 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-interface => generated 284 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:05:52.353318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:52.363211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:52.390164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:52.391249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:52.393054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:52.396567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:53.094838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:53.106331 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-480ea25a-880f-41f3-9786-3c9bf85a592a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1386 microversion: 2.1 time: 0.795986 Jul 25 20:05:53.123634 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 413/819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:52 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1386 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:53.158897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:53.159956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:53.198586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:53.204069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:53.208914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:53.210906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:54.733664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:54.744262 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-711007dc-8b3f-494f-b308-e35a06f13492 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 1.618861 Jul 25 20:05:54.758678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 414/820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:53 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:54.786283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4467ceb3-22c2-4bd2-92b3-091f335c1c37 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b23ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:54.908365 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4467ceb3-22c2-4bd2-92b3-091f335c1c37 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.147646 Jul 25 20:05:54.909642 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 415/821] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:54 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:54.945094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:54.945837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:54.964360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:54.964788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:54.965776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:54.966295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:56.447104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:56.463824 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8182fb25-cf7d-47af-bef1-4671f37e8c15 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1386 microversion: 2.1 time: 1.551661 Jul 25 20:05:56.473140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 416/822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:54 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1386 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:56.501336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-106d8e57-64d4-46e9-83a6-c11e2d1fb58f req-ecee4b3c-393a-4705-8bc0-a52b2879e0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f721cade-dbc8-4931-bbb9-16e7350cc163", "name": "network-vif-plugged", "status": "completed", "tag": "a1e04947-c068-4ce9-a6ae-15bb8f6995a9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:56.533493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:56.540970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-106d8e57-64d4-46e9-83a6-c11e2d1fb58f req-ecee4b3c-393a-4705-8bc0-a52b2879e0af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:56.541681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-106d8e57-64d4-46e9-83a6-c11e2d1fb58f req-ecee4b3c-393a-4705-8bc0-a52b2879e0af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:56.581511 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-106d8e57-64d4-46e9-83a6-c11e2d1fb58f req-ecee4b3c-393a-4705-8bc0-a52b2879e0af service nova] Creating event network-vif-plugged:a1e04947-c068-4ce9-a6ae-15bb8f6995a9 for instance f721cade-dbc8-4931-bbb9-16e7350cc163 on n-h1-845775-3 Jul 25 20:05:56.601929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-106d8e57-64d4-46e9-83a6-c11e2d1fb58f req-ecee4b3c-393a-4705-8bc0-a52b2879e0af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126196 Jul 25 20:05:56.606034 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 417/823] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:56.638889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:56.650314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:56.672594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:56.673574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:56.674618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:56.675245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:57.461372 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d7378f5-8d67-4bd4-b99d-3c16f4221c59 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.492438 Jul 25 20:05:57.470240 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 407/824] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:05:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:57.486399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d103a84f-c045-4b22-8ec5-7e33c82fe20f tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f19699ec280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:57.507002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:57.517220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3965a4ca-26e5-4184-81ed-6a8098f6904b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 0.907391 Jul 25 20:05:57.524493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 418/825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:56 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:57.529726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3490bb25-3c8f-4b17-b0f2-b1aedaa972bc req-7a9b6d9d-2f55-48d2-9fd0-45b8add502b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:57.572887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3490bb25-3c8f-4b17-b0f2-b1aedaa972bc req-7a9b6d9d-2f55-48d2-9fd0-45b8add502b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:57.573825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3490bb25-3c8f-4b17-b0f2-b1aedaa972bc req-7a9b6d9d-2f55-48d2-9fd0-45b8add502b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:57.620746 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3490bb25-3c8f-4b17-b0f2-b1aedaa972bc req-7a9b6d9d-2f55-48d2-9fd0-45b8add502b0 service nova] Creating event network-changed:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:05:57.628843 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d103a84f-c045-4b22-8ec5-7e33c82fe20f tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1429 microversion: 2.1 time: 0.157363 Jul 25 20:05:57.631226 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 408/826] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:57 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:57.640058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8d7b51a-e2b9-4283-9d6b-721a54199f31 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Action: 'create', calling method: .version_select at 0x7f19699baca0>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:05:57.658280 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3490bb25-3c8f-4b17-b0f2-b1aedaa972bc req-7a9b6d9d-2f55-48d2-9fd0-45b8add502b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131783 Jul 25 20:05:57.660814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 419/827] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:05:57.700230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:57.700230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:57.733412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:57.734098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:57.735248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:57.747266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:58.945303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:58.985410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e204cf0-5c91-4bfc-afd4-52b94b2fd06e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1386 microversion: 2.1 time: 1.321948 Jul 25 20:05:59.028476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 420/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:57 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1386 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:59.043666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:59.048065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:05:59.075791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:59.084000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:59.087295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:05:59.087786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:05:59.576716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:05:59.616267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2ee7091-fcd1-4ef3-a695-512be7e2f74a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 0.581727 Jul 25 20:05:59.648183 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 421/829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:05:59 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:05:59.688684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b7e44759-fde5-4177-a5c9-38ce47cecd58 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b230d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:05:59.936261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:05:59.958115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=30 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:02.970782 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8d7b51a-e2b9-4283-9d6b-721a54199f31 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.338300 Jul 25 20:06:02.979360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 409/830] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:05:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:02.983783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e8c3fd07-9df9-4936-8d77-f694f1650a8f req-d7b2fe8e-1919-41c9-847b-b1ac4254ada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "name": "network-vif-plugged", "status": "completed", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:03.009241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e8c3fd07-9df9-4936-8d77-f694f1650a8f req-d7b2fe8e-1919-41c9-847b-b1ac4254ada6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:03.009698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e8c3fd07-9df9-4936-8d77-f694f1650a8f req-d7b2fe8e-1919-41c9-847b-b1ac4254ada6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:03.024503 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e8c3fd07-9df9-4936-8d77-f694f1650a8f req-d7b2fe8e-1919-41c9-847b-b1ac4254ada6 service nova] Creating event network-vif-plugged:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h1-845775-3 Jul 25 20:06:03.034335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e8c3fd07-9df9-4936-8d77-f694f1650a8f req-d7b2fe8e-1919-41c9-847b-b1ac4254ada6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058064 Jul 25 20:06:03.034953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 410/831] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:03.054226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:03.055473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:03.063791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:03.064582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:03.065616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:03.066230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:03.694401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:03.714140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19334e25-6df1-464d-9c11-4cdb925d6ee3 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1584 microversion: 2.1 time: 0.659945 Jul 25 20:06:03.715092 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 411/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:03 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1584 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:03.721219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:03.722068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:03.728593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:03.729034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:03.729990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:03.731039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:04.325461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:04.354485 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0de5ffed-66bc-42a4-bd25-96777c9ef272 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1310 microversion: 2.1 time: 0.635409 Jul 25 20:06:04.356216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 412/833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:03 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1310 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:04.367860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65ea97de-bf68-4055-bd6c-45faab88d05e tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f196a0359d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:04.858901 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65ea97de-bf68-4055-bd6c-45faab88d05e tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/3344a780-be8f-427d-9c99-3a474072ae23" status: 200 len: 141 microversion: 2.1 time: 0.500785 Jul 25 20:06:04.864930 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 413/834] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:04 2022] GET /compute/v2.1/os-floating-ips/3344a780-be8f-427d-9c99-3a474072ae23 => generated 141 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:04.903177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:04.927376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:04.950425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:04.960470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:04.972111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:04.973315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:05.229536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac7655b1-0cd8-4d72-8bbb-1badfa17a991 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.347021 Jul 25 20:06:05.231242 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 414/835] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:06:04 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:05.236625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-453962fe-0cfe-459e-bf0d-7fb7f9648083 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f19699f7280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:05.845339 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b7e44759-fde5-4177-a5c9-38ce47cecd58 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1438 microversion: 2.1 time: 6.195561 Jul 25 20:06:05.846232 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 422/836] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:05:59 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1438 bytes in 6197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:05.852966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:05.869835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:05.884487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:05.885413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:05.886432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:05.888264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:06.298356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:06.319204 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc234c18-04e6-4399-9356-b455a2fd0fd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1493 microversion: 2.1 time: 0.472129 Jul 25 20:06:06.355991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 423/837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:05 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1493 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:06.363608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0de97763-528c-4273-9d61-b50d9f5c230b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f1969b23ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:06.441901 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0de97763-528c-4273-9d61-b50d9f5c230b tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 200 len: 1438 microversion: 2.1 time: 0.083641 Jul 25 20:06:06.443661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 424/838] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:06:06 2022] GET /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:06.451339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:06.454140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:06.462274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:06.463250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:06.464467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:06.465089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:06.761443 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0321749b-addd-4fdd-875a-a9e9cda08203 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1644 microversion: 2.1 time: 0.316015 Jul 25 20:06:06.764657 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 425/839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:06 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1644 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:06.771716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:06.772922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:06.797507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:06.798452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:06.800213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:06.801272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:07.164878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:07.179306 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-853d0424-263a-47f2-9b5e-a6663f61b899 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1464 microversion: 2.1 time: 0.409991 Jul 25 20:06:07.180200 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 426/840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:06 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1464 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:07.189771 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-453962fe-0cfe-459e-bf0d-7fb7f9648083 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3344a780-be8f-427d-9c99-3a474072ae23" status: 202 len: 0 microversion: 2.1 time: 1.957007 Jul 25 20:06:07.190871 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 415/841] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:06:05 2022] DELETE /compute/v2.1/os-floating-ips/3344a780-be8f-427d-9c99-3a474072ae23 => generated 0 bytes in 1959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:07.192713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:07.195946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:07.200365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e29f2bb2-b942-465b-9ed5-eaa69a5b96cd tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f1969a7f040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:07.215626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:07.217422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:07.219503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:07.220217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:07.761583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e29f2bb2-b942-465b-9ed5-eaa69a5b96cd tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.565216 Jul 25 20:06:07.762757 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 416/842] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Jul 25 20:06:07 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:06:07.773455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-465b6b5b-cdbd-4e0c-a158-aa513df42307 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f19699f71f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:07.776813 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30a2d35a-0fce-4c83-ae1d-e3d5f01d7ceb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1644 microversion: 2.1 time: 0.594150 Jul 25 20:06:07.781865 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 427/843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:07 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1644 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:07.797000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-257736ed-3ebe-4d06-bff0-afe538e9a8d6 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f1969bc79d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:08.187494 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-257736ed-3ebe-4d06-bff0-afe538e9a8d6 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.401778 Jul 25 20:06:08.188176 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 428/844] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:06:07 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:08.193421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:08.204224 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:06:08.204224 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:06:08.205753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:08.206556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:08.208566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:08.210366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:08.273437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b36a272-3b93-42e5-b220-c3d7ce9c7067 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083882 Jul 25 20:06:08.279520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 429/845] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:06:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:08.289103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0fe82a7-c099-4857-9c55-7395ac63288f tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f1969bb23a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:08.811345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-465b6b5b-cdbd-4e0c-a158-aa513df42307 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "DELETE /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6" status: 204 len: 0 microversion: 2.1 time: 1.046449 Jul 25 20:06:08.819752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 417/846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:07 2022] DELETE /compute/v2.1/images/bceafbac-0354-46a9-9f28-2028e5cb5ed6 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:06:08.825273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:08.826277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:08.834084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:08.834784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:08.836192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:08.836978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:08.959837 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08f714f5-75d7-48f3-82cb-78e4bd533bdf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763/action" status: 202 len: 0 microversion: 2.1 time: 0.138228 Jul 25 20:06:08.961427 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 418/847] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:06:08 2022] POST /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:08.968786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19a1c145-3429-4259-ace2-05f62d4d5711 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '.version_select at 0x7f196a2b2820>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:09.049104 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-19a1c145-3429-4259-ace2-05f62d4d5711 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] HTTP exception thrown: Image not found. Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19a1c145-3429-4259-ace2-05f62d4d5711 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Request method failure captured: Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf HTTP/1.1 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcwiWmcZ8HEFjHNIiaq7c9RjmrqmWvOacfbMnAPbz16Kc90U83hbAyTBT2rkt1kksy8CstIh1DhYLAYciWVd0kvcoqEP3Jc-JzHfun5Ibdl6qRYSxTvRX1Ua8UJStn6bDzZEGSX7ANWduv0tb6vPw_d6AswcbMZVmE_Q9ULCwogjlU Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:09.051044 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d163906f445f40499dd7e9f794c92b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}] Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6e31755ee871433bbcaa657add0cb6a1 Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9f5ff07e-b6c7-430c-98f0-4f0a79c81adf'} Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:09.058087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f5ff07e-b6c7-430c-98f0-4f0a79c81adf to delete Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.059642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f5ff07e-b6c7-430c-98f0-4f0a79c81adf could not be found. Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:09.061807 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19a1c145-3429-4259-ace2-05f62d4d5711 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19a1c145-3429-4259-ace2-05f62d4d5711 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "DELETE /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf" status: 404 len: 62 microversion: 2.1 time: 0.089462 Jul 25 20:06:09.063905 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 419/848] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:08 2022] DELETE /compute/v2.1/images/9f5ff07e-b6c7-430c-98f0-4f0a79c81adf => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:06:09.067606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:09.067606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:09.105457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:09.105921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:09.106758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:09.107703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.455576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:10.471836 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c2854eae-0a40-45b4-b083-1aaaa0182b6d tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1584 microversion: 2.1 time: 1.415665 Jul 25 20:06:10.472500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 420/849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:09 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1584 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:10.479580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-249b1b6d-366c-4115-aa01-1cd0593d15a5 req-0a5906cd-d601-435b-8335-f76450f434a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f721cade-dbc8-4931-bbb9-16e7350cc163", "tag": "a1e04947-c068-4ce9-a6ae-15bb8f6995a9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:10.501465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-249b1b6d-366c-4115-aa01-1cd0593d15a5 req-0a5906cd-d601-435b-8335-f76450f434a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.502063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-249b1b6d-366c-4115-aa01-1cd0593d15a5 req-0a5906cd-d601-435b-8335-f76450f434a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.519210 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-249b1b6d-366c-4115-aa01-1cd0593d15a5 req-0a5906cd-d601-435b-8335-f76450f434a2 service nova] Creating event network-changed:a1e04947-c068-4ce9-a6ae-15bb8f6995a9 for instance f721cade-dbc8-4931-bbb9-16e7350cc163 on n-h1-845775-3 Jul 25 20:06:10.525623 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-249b1b6d-366c-4115-aa01-1cd0593d15a5 req-0a5906cd-d601-435b-8335-f76450f434a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051726 Jul 25 20:06:10.532287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 421/850] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:10.532831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0fe82a7-c099-4857-9c55-7395ac63288f tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/2ef53cbc-587e-47fa-84bb-23a41c217d5d" status: 202 len: 0 microversion: 2.1 time: 2.251690 Jul 25 20:06:10.534045 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 430/851] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:06:08 2022] DELETE /compute/v2.1/os-floating-ips/2ef53cbc-587e-47fa-84bb-23a41c217d5d => generated 0 bytes in 2253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:10.539321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:10.539828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:10.545197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:10.546931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:10.552820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.553280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.556024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.556753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.557723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.558319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.562110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.563093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.628862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:06:10.811448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-518b3cc2-fcd7-479d-b3fd-ab61bbb82dc1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 204 len: 0 microversion: 2.1 time: 0.276096 Jul 25 20:06:10.811972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 431/852] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:10 2022] DELETE /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:06:10.833443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-81e52076-ef2a-40e5-b594-04ac3885324a req-b5f7dc6b-cbf1-4785-869a-56c49f294d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-unplugged", "status": "completed", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:10.862227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81e52076-ef2a-40e5-b594-04ac3885324a req-b5f7dc6b-cbf1-4785-869a-56c49f294d93 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:10.863135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81e52076-ef2a-40e5-b594-04ac3885324a req-b5f7dc6b-cbf1-4785-869a-56c49f294d93 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:10.897737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-81e52076-ef2a-40e5-b594-04ac3885324a req-b5f7dc6b-cbf1-4785-869a-56c49f294d93 service nova] Creating event network-vif-unplugged:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:06:10.906876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-81e52076-ef2a-40e5-b594-04ac3885324a req-b5f7dc6b-cbf1-4785-869a-56c49f294d93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092719 Jul 25 20:06:10.913434 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 432/853] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:10.948457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41fa9d18-1f0e-4e6e-952a-5085eff7c4cb tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1629 microversion: 2.1 time: 0.411687 Jul 25 20:06:10.973670 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 422/854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:10 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1629 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:10.990822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c24e8297-dd3b-4c06-9f82-dbaeca213cc3 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f1969b64af0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:11.396269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-572fe37a-3cca-428c-adf5-018054a7aebf tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Action: 'create', calling method: .version_select at 0x7f1969a85700>, body: {"keypair": {"name": "tempest-keypair-1119428391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCBG5nd0OPBncCIvrMSL4bRN83h/VFVQVWlYnxdx+JSh+KodPtLuk9F9lTW1+ByHVauKK5lUdiJyYXzF5sUAAziQej1g0u0eXJJnHvg926RBj7OlxkmSyp25Icavie0rQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:11.442481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-572fe37a-3cca-428c-adf5-018054a7aebf tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:11.453963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-572fe37a-3cca-428c-adf5-018054a7aebf tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for user 87596ed917d44ee68e1c99fdfb615691 and project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:11.505347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-572fe37a-3cca-428c-adf5-018054a7aebf tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.584850 Jul 25 20:06:11.511889 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 433/855] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:06:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:11.518130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:11.519441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:11.529760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:11.530588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:11.532380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:11.533259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:11.539544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:12.796612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:12.816783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd18b280-cff8-4f2c-a080-2bdab91cf085 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1470 microversion: 2.1 time: 1.302488 Jul 25 20:06:12.826908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 434/856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:11 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1470 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:12.846774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845775-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:12.851556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:12.882757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:12.885133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:12.887588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:12.891135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:13.003912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lazy-loading 'flavor' on Instance uuid d2c574d5-8512-4c01-85f3-013f9050d763 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:06:13.059136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Going to try to live migrate instance to n-h2-845775-3 {{(pid=119724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:06:14.479830 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c24e8297-dd3b-4c06-9f82-dbaeca213cc3 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/aff49f25-9aac-4f34-9b54-70d18c7579b1" status: 202 len: 0 microversion: 2.1 time: 3.504045 Jul 25 20:06:14.483461 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 423/857] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:06:10 2022] DELETE /compute/v2.1/os-floating-ips/aff49f25-9aac-4f34-9b54-70d18c7579b1 => generated 0 bytes in 3509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:14.490201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:14.490859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:14.524233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:14.536614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:14.548842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:14.554158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:14.974756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:14.988769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d4d1be68-439a-43b6-9710-7b4628156541 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1470 microversion: 2.1 time: 0.503927 Jul 25 20:06:14.989932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 424/858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:14 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:15.006223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:15.020830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:15.021922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Searching by: {'deleted': False, 'project_id': '6ee985fe5d7c4c1997bd40036e648842'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:06:15.042448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:15.045587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:15.046769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:15.047436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:15.332182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:06:15.514932 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebb819ae-3e23-458a-9dd1-d74c09ebc1be tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.523735 Jul 25 20:06:15.528300 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 425/859] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:06:14 2022] GET /compute/v2.1/servers => generated 334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:15.534935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-13d510cb-91c5-4764-95bd-565e92bfa368 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] Calling method '.version_select at 0x7f19699c0ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:16.788446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a81b85ab-d78c-424e-97f6-f57da3013f1d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763/action" status: 202 len: 0 microversion: 2.1 time: 3.959846 Jul 25 20:06:16.790409 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 435/860] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:06:12 2022] POST /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763/action => generated 0 bytes in 3963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:16.801565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:16.819824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:16.820964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Searching by: {'deleted': False, 'project_id': '6ee985fe5d7c4c1997bd40036e648842'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:06:16.842161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.842990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:16.844788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:16.845864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.000856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-13d510cb-91c5-4764-95bd-565e92bfa368 tempest-FloatingIPDetailsTestJSON-1359746801 tempest-FloatingIPDetailsTestJSON-1359746801-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/25cefbf1-ffdf-4178-9f4d-2647fea79961" status: 202 len: 0 microversion: 2.1 time: 1.470447 Jul 25 20:06:17.002041 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 426/861] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:06:15 2022] DELETE /compute/v2.1/os-floating-ips/25cefbf1-ffdf-4178-9f4d-2647fea79961 => generated 0 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:17.010744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:17.013053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:17.025207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.026024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.027194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.027858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.129145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.129912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.130610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lazy-loading 'fault' on Instance uuid 2a1270fb-8ec9-4df0-ac2d-14c08d071041 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:06:17.158444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:06:17.235003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e31755ee871433bbcaa657add0cb6a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd163906f445f40499dd7e9f794c92b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:17.246168 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5b002b9-d04e-4c20-a45c-45b22f1bb9c0 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 200 len: 1305 microversion: 2.1 time: 0.241958 Jul 25 20:06:17.265578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 427/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:17 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 1305 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:17.280991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-94397688", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b88c6120-1420-4049-8355-169945b30a10"}], "security_groups": [{"name": "tempest-securitygroup--494566883"}], "key_name": "tempest-keypair-1119428391", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:17.378330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:17.390909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.394996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.673083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] validate_networks() for [('b88c6120-1420-4049-8355-169945b30a10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:06:17.865288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0eedef44-ab58-44c4-97d0-71dd68e18a80 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.071665 Jul 25 20:06:17.867178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 436/863] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:06:16 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:17.873291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-795df677-8ef9-42c1-a73f-893346213976 req-1d36a53b-102b-40ea-9de6-313c2bec71f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a1270fb-8ec9-4df0-ac2d-14c08d071041", "name": "network-vif-deleted", "tag": "35942623-c7fa-45ea-af33-6780273b50c1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:17.900028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-795df677-8ef9-42c1-a73f-893346213976 req-1d36a53b-102b-40ea-9de6-313c2bec71f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.903070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-795df677-8ef9-42c1-a73f-893346213976 req-1d36a53b-102b-40ea-9de6-313c2bec71f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:17.930968 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-795df677-8ef9-42c1-a73f-893346213976 req-1d36a53b-102b-40ea-9de6-313c2bec71f6 service nova] Creating event network-vif-deleted:35942623-c7fa-45ea-af33-6780273b50c1 for instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 on n-h2-845775-3 Jul 25 20:06:17.948384 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-795df677-8ef9-42c1-a73f-893346213976 req-1d36a53b-102b-40ea-9de6-313c2bec71f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077482 Jul 25 20:06:17.949888 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 437/864] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:17.963867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:17.965017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:17.999451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:17.999909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.000732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.001178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.303909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:18.315007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-000ff10e-5606-412b-8e73-fe325620f613 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.363014 Jul 25 20:06:18.320878 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 438/865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:17 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:18.330396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec712fd7-6682-462a-98bf-f54f8359b182 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:18.353202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec712fd7-6682-462a-98bf-f54f8359b182 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030812 Jul 25 20:06:18.361043 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 439/866] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:06:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:18.366972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:18.368193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] [instance: 2a1270fb-8ec9-4df0-ac2d-14c08d071041] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:18.376104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.376912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.377999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.378853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.397058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] HTTP exception thrown: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Request method failure captured: Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 HTTP/1.1 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcwiWmcZ8HEFjHNIiaq7c9RjmrqmWvOacfbMnAPbz16Kc90U83hbAyTBT2rkt1kksy8CstIh1DhYLAYciWVd0kvcoqEP3Jc-JzHfun5Ibdl6qRYSxTvRX1Ua8UJStn6bDzZEGSX7ANWduv0tb6vPw_d6AswcbMZVmE_Q9ULCwogjlU Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:18.399806 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d163906f445f40499dd7e9f794c92b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d163906f445f40499dd7e9f794c92b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d163906f445f40499dd7e9f794c92b52"}]}] Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d163906f445f40499dd7e9f794c92b52 Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1366327304 Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6e31755ee871433bbcaa657add0cb6a1 Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerTestJSON-1366327304-project Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. Jul 25 20:06:18.401573 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2a1270fb-8ec9-4df0-ac2d-14c08d071041'} Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:18.402344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. Jul 25 20:06:18.403687 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:18.409407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] Returning 404 to user: Instance 2a1270fb-8ec9-4df0-ac2d-14c08d071041 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:18.410629 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cfb1ad9b-1c79-441d-afe8-47284a8c08f1 tempest-ImagesOneServerTestJSON-1366327304 tempest-ImagesOneServerTestJSON-1366327304-project] 10.222.0.48 "GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041" status: 404 len: 111 microversion: 2.1 time: 0.048229 Jul 25 20:06:18.411408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 440/867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:18 2022] GET /compute/v2.1/servers/2a1270fb-8ec9-4df0-ac2d-14c08d071041 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:18.554604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:06:18.556225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:06:18.558250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:06:18.561556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:06:18.562259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:06:18.586238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.594012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.595534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.596257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.630772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:18.645328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for user 87596ed917d44ee68e1c99fdfb615691 and project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:18.668735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:06:18.671692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:06:18.717577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:18.718427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:18.734892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.737659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.742748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:18.742748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:18.791489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:06:18.797943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df835500-cb02-4dc7-846e-2bf49553fb18 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.530852 Jul 25 20:06:18.798926 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 428/868] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:06:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:06:18.814504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0a8251a-e0e8-4216-998d-2c98b892af1e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:18.815181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0a8251a-e0e8-4216-998d-2c98b892af1e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:18.927342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0a8251a-e0e8-4216-998d-2c98b892af1e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:18.935657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0a8251a-e0e8-4216-998d-2c98b892af1e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1240 microversion: 2.1 time: 0.126336 Jul 25 20:06:18.936808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 429/869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:18 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:18.998399 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20bfa4ec-833b-436d-a77c-188f76ff2bd0 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 204 len: 0 microversion: 2.1 time: 0.284597 Jul 25 20:06:18.998991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 441/870] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:18 2022] DELETE /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:06:19.009245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:19.009877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:19.020607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.021170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:19.036063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.036063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:19.274285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:19.289784 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4514c3b-112c-4fea-93f7-14635347bd13 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1701 microversion: 2.1 time: 0.286171 Jul 25 20:06:19.301022 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 430/871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:19 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1701 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:19.343231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:19.344591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:19.366768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.369688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:19.372057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.373094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:19.590578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:19.602488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7c2c2cc-3afa-44d7-b4ed-1f3666e5aafa tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.264142 Jul 25 20:06:19.604912 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 442/872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:19 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:19.963280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:19.965844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:19.978311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.979041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:19.980231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:19.980873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:20.106074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:20.115134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2224ecd0-9a47-44d3-a2f1-9c7e5977600a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1244 microversion: 2.1 time: 0.159920 Jul 25 20:06:20.136939 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 431/873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:19 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1244 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:20.317814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:20.318612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:20.338177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:20.345238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:20.346570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:20.347263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:20.629705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:20.630669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:20.646710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:20.652195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:20.655957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:20.660843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:20.736882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:20.753779 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29b0dc5b-34fc-485d-b8b2-e6410471e469 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1701 microversion: 2.1 time: 0.439818 Jul 25 20:06:20.776439 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 443/874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:20 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1701 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:21.143257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:21.144058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:21.163264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:21.163930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:21.170156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:21.171062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:21.405811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:21.422522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77c33e13-67e7-40b4-905b-5f89ecedcbc6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1292 microversion: 2.1 time: 0.286528 Jul 25 20:06:21.424581 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 444/875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:21 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1292 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:21.477025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:21.499862 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb4c8924-387f-495e-a4db-ed84283b0df0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.869972 Jul 25 20:06:21.502234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 432/876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:20 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:21.516349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1d23e17d-f810-427c-9f8c-e37447848443 req-8009cbf0-bd0f-4300-858c-b219869d33a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "name": "network-vif-unplugged", "status": "completed", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:21.542197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1d23e17d-f810-427c-9f8c-e37447848443 req-8009cbf0-bd0f-4300-858c-b219869d33a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:21.542668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1d23e17d-f810-427c-9f8c-e37447848443 req-8009cbf0-bd0f-4300-858c-b219869d33a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:21.583657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1d23e17d-f810-427c-9f8c-e37447848443 req-8009cbf0-bd0f-4300-858c-b219869d33a6 service nova] Creating event network-vif-unplugged:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h1-845775-3 Jul 25 20:06:21.597332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1d23e17d-f810-427c-9f8c-e37447848443 req-8009cbf0-bd0f-4300-858c-b219869d33a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091134 Jul 25 20:06:21.599567 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 433/877] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:21.780413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:21.781265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:21.792466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9d85fb3-31cd-4395-9ff8-3b4ced9bf928 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] Calling method '.version_select at 0x7f196c14c820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:21.798090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:21.802110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:21.804241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:21.804990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:21.893432 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9d85fb3-31cd-4395-9ff8-3b4ced9bf928 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] 10.222.0.48 "GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba" status: 200 len: 784 microversion: 2.1 time: 0.467169 Jul 25 20:06:21.895937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 445/878] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:06:21 2022] GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba => generated 784 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:21.913836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7cfe39a-4eb6-4142-b9d4-299ae50f7e94 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] Calling method '.version_select at 0x7f1969bb24c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:22.097507 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7cfe39a-4eb6-4142-b9d4-299ae50f7e94 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] 10.222.0.48 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.186758 Jul 25 20:06:22.098261 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 446/879] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 20:06:21 2022] GET /compute/v2.1/images => generated 871 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:22.118154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9762f0c-e60f-4e54-8546-defd628f02a2 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] Calling method '.version_select at 0x7f1969ce5b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:22.226654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9762f0c-e60f-4e54-8546-defd628f02a2 tempest-ListImagesTestJSON-1934890768 tempest-ListImagesTestJSON-1934890768-project] 10.222.0.48 "GET /compute/v2.1/images/detail" status: 200 len: 1466 microversion: 2.1 time: 0.112851 Jul 25 20:06:22.227338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 447/880] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:06:22 2022] GET /compute/v2.1/images/detail => generated 1466 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:22.608847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:22.622110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25574123-b2b2-4ef7-9b29-7e66bb1a8ea4 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Action: 'create', calling method: .version_select at 0x7f1969cc2b80>, body: {"keypair": {"name": "tempest-keypair-926690495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKayuOqror093AROabCWgguidqf6EwlGb/BU4mKvnA7yCZ3DbARvZILBbKpVxBt6A6ez0PAuJ7F+wWSzVuRA57I3GrgfXI868ACHKr4Xza/xFB5D0WgGdOQweVjm2MTrA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:22.628515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d0aafaf-794d-4047-9254-a41ef719c072 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1701 microversion: 2.1 time: 0.850737 Jul 25 20:06:22.630264 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 434/881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:21 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1701 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:22.652522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:22.656759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:22.669861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-25574123-b2b2-4ef7-9b29-7e66bb1a8ea4 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Getting quotas for project 86043c5e784d48c1b34476ff21ebd69f. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:22.678166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-25574123-b2b2-4ef7-9b29-7e66bb1a8ea4 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Getting quotas for user dd5799d942424206a432a28f2b17a4fe and project 86043c5e784d48c1b34476ff21ebd69f. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:22.678735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:22.679209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:22.683163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:22.683687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:22.720252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25574123-b2b2-4ef7-9b29-7e66bb1a8ea4 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.314503 Jul 25 20:06:22.734633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 448/882] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:06:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:22.744778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:22.745682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:22.758925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:22.760472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:22.762038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:22.763549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:22.890197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:22.910687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:22.921520 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-970fd135-1d70-4182-a042-1e7475b4db29 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1298 microversion: 2.1 time: 0.287141 Jul 25 20:06:22.923429 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 435/883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:22 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:23.665324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:23.669357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:23.695645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:23.701094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:23.703507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:23.705219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:23.941191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:23.954203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6623eaa-fe57-4460-9e15-e0260934dcdb tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1633 microversion: 2.1 time: 0.298104 Jul 25 20:06:23.955171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 436/884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:23 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1633 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:23.974421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-533f2fa9-c3e4-49a7-970c-322e370057ba req-96e7a5ab-c72b-49c1-98c5-58b312a90a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:23.977979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:23.986298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-533f2fa9-c3e4-49a7-970c-322e370057ba req-96e7a5ab-c72b-49c1-98c5-58b312a90a9f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:23.987053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-533f2fa9-c3e4-49a7-970c-322e370057ba req-96e7a5ab-c72b-49c1-98c5-58b312a90a9f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:23.990165 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aed38833-ebec-4ead-ae30-1f65c3c3621d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 1.253490 Jul 25 20:06:24.010702 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 449/885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:22 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:24.010702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:24.010702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:24.029372 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-533f2fa9-c3e4-49a7-970c-322e370057ba req-96e7a5ab-c72b-49c1-98c5-58b312a90a9f service nova] Creating event network-changed:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h1-845775-3 Jul 25 20:06:24.035941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:24.048753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:24.049846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:24.050384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:24.054947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-533f2fa9-c3e4-49a7-970c-322e370057ba req-96e7a5ab-c72b-49c1-98c5-58b312a90a9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069594 Jul 25 20:06:24.055779 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 437/886] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:24.664472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:24.683005 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ff52f94-c36a-4f84-840f-815c649605fe tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.682818 Jul 25 20:06:24.685604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 450/887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:23 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:24.990012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:24.991631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:25.023912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:25.026068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:25.026797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.027567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.029548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.030308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.062366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.067365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.070638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.074394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.454228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f773da5b234701ac246ac0f6c6cf84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee985fe5d7c4c1997bd40036e648842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:25.480592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7393c931-d588-494b-a61c-fa4c2c83290f tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 200 len: 1633 microversion: 2.1 time: 0.502708 Jul 25 20:06:25.486110 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 438/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:24 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 1633 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:25.497972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4079c9b0-8810-4252-a632-e2cc390db88f req-c12de76f-4f1d-426c-ae76-edf406fa1dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77244c1-4f20-4caf-803e-988184c7ee0a", "name": "network-vif-deleted", "tag": "a9e8d34b-bd77-4a59-b976-b81ea2a7508b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:25.526884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4079c9b0-8810-4252-a632-e2cc390db88f req-c12de76f-4f1d-426c-ae76-edf406fa1dd7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.527598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4079c9b0-8810-4252-a632-e2cc390db88f req-c12de76f-4f1d-426c-ae76-edf406fa1dd7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.545709 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4079c9b0-8810-4252-a632-e2cc390db88f req-c12de76f-4f1d-426c-ae76-edf406fa1dd7 service nova] Creating event network-vif-deleted:a9e8d34b-bd77-4a59-b976-b81ea2a7508b for instance e77244c1-4f20-4caf-803e-988184c7ee0a on n-h2-845775-3 Jul 25 20:06:25.564698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4079c9b0-8810-4252-a632-e2cc390db88f req-c12de76f-4f1d-426c-ae76-edf406fa1dd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071110 Jul 25 20:06:25.565335 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 439/889] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:25.726646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:25.727815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:25.748393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.750262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:25.753554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:25.754883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:26.141057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:26.164459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6841b0f7-e2a2-4651-8414-a013e9c172b5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 1.147990 Jul 25 20:06:26.176412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 451/890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:25 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:26.527674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:26.527674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] [instance: e77244c1-4f20-4caf-803e-988184c7ee0a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:26.541173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:26.542271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:26.543798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:26.545184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:26.569171 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] HTTP exception thrown: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Request method failure captured: Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a HTTP/1.1 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vdQNDOPN2PeKDp5zWhcPesYw5m3FcNg0FPp0Os5gNTwT6BTVbM3ckvLTG0MwnJAXech_fVbIyivcyV108oxh2Osk_BD6eEXliJWAychEycvC9Q9GPq-g4a1LP4RHEO6DzmaUD936DP4_ht4rP2csOAjW4WhnH6ax0-S7LYlHk0S-Gk Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6ee985fe5d7c4c1997bd40036e648842 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestJSON-223794182 Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:26.573656 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ee985fe5d7c4c1997bd40036e648842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6ee985fe5d7c4c1997bd40036e648842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6ee985fe5d7c4c1997bd40036e648842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ee985fe5d7c4c1997bd40036e648842"}]}] Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestJSON-223794182 Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6ee985fe5d7c4c1997bd40036e648842 Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestJSON-223794182 Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestJSON-223794182-project Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 17f773da5b234701ac246ac0f6c6cf84 Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestJSON-223794182-project Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'e77244c1-4f20-4caf-803e-988184c7ee0a'} Jul 25 20:06:26.576414 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:26.578197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. Jul 25 20:06:26.580160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:26.583155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Returning 404 to user: Instance e77244c1-4f20-4caf-803e-988184c7ee0a could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:26.584911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdce05d5-c787-41c3-a5bf-b2d979577ad4 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a" status: 404 len: 111 microversion: 2.1 time: 0.064386 Jul 25 20:06:26.586532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 452/891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:26 2022] GET /compute/v2.1/servers/e77244c1-4f20-4caf-803e-988184c7ee0a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:06:26.608699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3dbb6788-88b6-47eb-b1c2-213bea3cd074 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] Calling method '.version_select at 0x7f1969cc20d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:26.672887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3dbb6788-88b6-47eb-b1c2-213bea3cd074 tempest-ServersTestJSON-223794182 tempest-ServersTestJSON-223794182-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450278909" status: 202 len: 0 microversion: 2.1 time: 0.078941 Jul 25 20:06:26.674149 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 453/892] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450278909 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:06:26.961429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:26.979978 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afcc1d22-256e-4ca2-b112-51862b43ef73 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 1.265078 Jul 25 20:06:26.988434 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 440/893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:25 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:27.132327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b3fb9045-3a47-474d-ae8a-40ecf75ffc9d req-151348b5-42fd-422b-805e-25fcff999770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6390f85-ea47-471e-b3ba-eb2f11646e27", "tag": "a15e061d-6acc-4e2b-a4aa-6196683e9412"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:27.150522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:27.151761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:27.155970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b3fb9045-3a47-474d-ae8a-40ecf75ffc9d req-151348b5-42fd-422b-805e-25fcff999770 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:27.160902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b3fb9045-3a47-474d-ae8a-40ecf75ffc9d req-151348b5-42fd-422b-805e-25fcff999770 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:27.191750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:27.192401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:27.202040 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b3fb9045-3a47-474d-ae8a-40ecf75ffc9d req-151348b5-42fd-422b-805e-25fcff999770 service nova] Creating event network-changed:a15e061d-6acc-4e2b-a4aa-6196683e9412 for instance d6390f85-ea47-471e-b3ba-eb2f11646e27 on n-h2-845775-3 Jul 25 20:06:27.209967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b3fb9045-3a47-474d-ae8a-40ecf75ffc9d req-151348b5-42fd-422b-805e-25fcff999770 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081486 Jul 25 20:06:27.213224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 454/894] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:06:27.213348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:27.218216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:27.226675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:27.237206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:27.647546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:27.658109 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be6c6e21-7dda-4541-9f27-37580b8bd5a6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.470688 Jul 25 20:06:27.658962 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 441/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:27 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:27.995430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8742372f-4701-47c7-a0b7-1d44d6f77da2 req-16f12bd2-3ce4-489b-8329-22cd7bd64148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "name": "network-vif-unplugged", "status": "completed", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:28.008841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:28.010560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:28.025153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:28.025716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:28.026587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:28.029107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:28.072810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8742372f-4701-47c7-a0b7-1d44d6f77da2 req-16f12bd2-3ce4-489b-8329-22cd7bd64148 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:28.074835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8742372f-4701-47c7-a0b7-1d44d6f77da2 req-16f12bd2-3ce4-489b-8329-22cd7bd64148 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:28.080237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:28.117789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8742372f-4701-47c7-a0b7-1d44d6f77da2 req-16f12bd2-3ce4-489b-8329-22cd7bd64148 service nova] Creating event network-vif-unplugged:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h1-845775-3 Jul 25 20:06:28.125648 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8742372f-4701-47c7-a0b7-1d44d6f77da2 req-16f12bd2-3ce4-489b-8329-22cd7bd64148 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146536 Jul 25 20:06:28.126554 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 455/896] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:06:28.434673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:28.445547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd878ba7-6252-4f34-b1fb-2a98d6ce2bcd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.439814 Jul 25 20:06:28.460590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 442/897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:28 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:28.689933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:28.691444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:28.700105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:28.701810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:28.703368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:28.704102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:28.976501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:28.989483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3c534ec-03d0-40aa-8c87-23631b082d39 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.304143 Jul 25 20:06:29.007147 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 456/898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:28 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:29.469905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:29.471445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:29.475146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:29.476621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:29.488309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:29.489235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:29.491575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:29.492768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:29.776655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:29.791258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6d1bc91-6c2e-409d-ae0c-c30bdcaca5da tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.326652 Jul 25 20:06:29.808774 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 443/899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:29 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:30.012583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:30.013701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:30.025170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:30.025638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:30.028909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:30.029468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:30.710616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:30.724241 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b663e866-7acf-44e8-82b3-fc47e59512b6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.716314 Jul 25 20:06:30.733124 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 457/900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:30 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:30.820075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:30.822482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:30.843892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:30.871752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:30.873216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:30.877732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:30.878920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:30.901187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-496321613", "imageRef": "cf582b13-a9c0-478e-b59e-162c544268be", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "be4b8adf-4881-42fd-b59d-ea4215cb27d6"}], "security_groups": [{"name": "tempest-securitygroup--1028546958"}], "key_name": "tempest-keypair-926690495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:31.351565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] validate_networks() for [('be4b8adf-4881-42fd-b59d-ea4215cb27d6', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:06:31.363797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:31.391218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3de972c0-f059-467a-88c8-88688ea68b5a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.572459 Jul 25 20:06:31.393136 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 444/901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:30 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:31.764028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:31.764770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:31.780643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:31.785102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:31.786227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:31.786888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:32.315849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:32.364962 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-933825e3-4bc2-4f7d-9a47-b7fadaff11ee tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1503 microversion: 2.1 time: 0.606653 Jul 25 20:06:32.366978 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 445/902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:31 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:32.383626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f56f72ad-aff3-4880-a0f6-0fdb22891d8c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f19699c0ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:32.442094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:06:32.442680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:06:32.445444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:06:32.446931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:06:32.447386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:06:32.471651 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f56f72ad-aff3-4880-a0f6-0fdb22891d8c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157" status: 200 len: 636 microversion: 2.1 time: 0.102886 Jul 25 20:06:32.472432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:32.473027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:32.473977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:32.474976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:32.486667 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 446/903] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:06:32 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157 => generated 636 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:32.500690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:32.500954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:32.512150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:32.513010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:32.513981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:32.514600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:32.520616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Getting quotas for project 86043c5e784d48c1b34476ff21ebd69f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:32.536547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Getting quotas for user dd5799d942424206a432a28f2b17a4fe and project 86043c5e784d48c1b34476ff21ebd69f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:32.566019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:06:32.568711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf582b13-a9c0-478e-b59e-162c544268be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:06:32.641959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bba020a9-9959-4186-8aac-810020b84c25 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.746717 Jul 25 20:06:32.643288 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 458/904] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:06:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:06:32.656304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab4594d0-c093-471b-915f-25f6b4e1fb65 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969a85a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:32.761021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ab4594d0-c093-471b-915f-25f6b4e1fb65 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:32.782328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ab4594d0-c093-471b-915f-25f6b4e1fb65 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:33.106854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:33.116156 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69443328-06f2-489d-822d-8a4c2ef76c3a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.628028 Jul 25 20:06:33.117077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 447/905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:32 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:33.129210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73c6ab5b-59e4-49a0-a339-41bc2a65846b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:33.130309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-73c6ab5b-59e4-49a0-a339-41bc2a65846b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:33.286522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73c6ab5b-59e4-49a0-a339-41bc2a65846b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:33.311825 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73c6ab5b-59e4-49a0-a339-41bc2a65846b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1244 microversion: 2.1 time: 0.186068 Jul 25 20:06:33.319274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 448/906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:33 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:33.393803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:33.401098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:33.431626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:33.432576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:33.438683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:33.440424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:33.606950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab4594d0-c093-471b-915f-25f6b4e1fb65 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 0.961028 Jul 25 20:06:33.608975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 459/907] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:32 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:33.632234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb133293-7965-4dcb-8ee0-144d3871f356 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969aa9a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:33.994860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:34.024789 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84607469-c2ef-4531-adab-f5fc383336d3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1478 microversion: 2.1 time: 0.639881 Jul 25 20:06:34.030741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 449/908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:33 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1478 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:06:34.065939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7706d298-5564-4524-91ce-d93f569d5b9b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '.version_select at 0x7f1969b644c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:34.087188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7706d298-5564-4524-91ce-d93f569d5b9b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.087927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7706d298-5564-4524-91ce-d93f569d5b9b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.128167 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7706d298-5564-4524-91ce-d93f569d5b9b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.075953 Jul 25 20:06:34.141519 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 450/909] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:06:34 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:34.152171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:34.153232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:34.164947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.165955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.167678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.168726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.275576 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb133293-7965-4dcb-8ee0-144d3871f356 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "DELETE /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.657108 Jul 25 20:06:34.276847 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 460/910] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Jul 25 20:06:33 2022] DELETE /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_version => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:06:34.306878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:34.310542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:34.363794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.364714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.366438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.367243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.719976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:34.741320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-861c259f-be1b-46cf-9b94-8e15d6e0cc76 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1629 microversion: 2.1 time: 0.461604 Jul 25 20:06:34.742293 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 461/911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:34 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1629 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:34.751468 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e14f1b3-acaf-46a6-9c63-74a4fd86ce4e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 0.607396 Jul 25 20:06:34.752437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 451/912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:34 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:34.767144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:34.768821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:34.771837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee06a033-ed49-4587-b6c6-f955e1d726ca tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969b23310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:34.777551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.778213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.779748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:34.780573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:34.826344 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee06a033-ed49-4587-b6c6-f955e1d726ca tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 37 microversion: 2.1 time: 0.071014 Jul 25 20:06:34.827677 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 462/913] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:34 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 37 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:34.839919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a037e29-9414-41ce-af9f-88617012b9d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: .version_select at 0x7f1969cc2820>, body: {"keypair": {"name": "tempest-keypair-1217502462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5r4BatBbMAFChD1qRRidsV0XVDGKoCtHb4Y7fNHIfcV3S7o2fTWMbLk7CKGBAqTRLB7QWTGK6iIol0UQ+2Zv4o0VylN1iRz0Zw/KZUKhpxBYIJ6ofq+lj+kiL6TjgH5Q=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:34.876393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=21 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:34.886995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0a037e29-9414-41ce-af9f-88617012b9d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for project b920e56f4052452a8f53673b16d2c370. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:34.900970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0a037e29-9414-41ce-af9f-88617012b9d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for user 1d0f300b7de441108c3efcee70e8f920 and project b920e56f4052452a8f53673b16d2c370. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:34.903838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:34.923732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-210f68c8-5eb5-4cfb-831d-7aa430b2e936 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1296 microversion: 2.1 time: 0.169605 Jul 25 20:06:34.926194 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 452/914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:34 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:34.933802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b5875ef-0a9e-44d8-b939-0599b004df15 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969dcd700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:34.967590 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a037e29-9414-41ce-af9f-88617012b9d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138160 Jul 25 20:06:34.968843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 463/915] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:06:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:35.047606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1b5875ef-0a9e-44d8-b939-0599b004df15 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:35.060728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1b5875ef-0a9e-44d8-b939-0599b004df15 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:35.664998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b5875ef-0a9e-44d8-b939-0599b004df15 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 0.737058 Jul 25 20:06:35.672463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 453/916] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:34 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:35.680024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b28614a7-8f7f-4c34-8539-f5b4ac354b5a tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969cc2160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:35.702009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-353a32a7-e2c1-4326-8730-ae8364cf0cd2 req-bb44164f-009b-4b9b-83b7-95e8b3f04a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6390f85-ea47-471e-b3ba-eb2f11646e27", "name": "network-vif-plugged", "status": "completed", "tag": "a15e061d-6acc-4e2b-a4aa-6196683e9412"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:35.727456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-353a32a7-e2c1-4326-8730-ae8364cf0cd2 req-bb44164f-009b-4b9b-83b7-95e8b3f04a2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:35.732624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-353a32a7-e2c1-4326-8730-ae8364cf0cd2 req-bb44164f-009b-4b9b-83b7-95e8b3f04a2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:35.756816 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-353a32a7-e2c1-4326-8730-ae8364cf0cd2 req-bb44164f-009b-4b9b-83b7-95e8b3f04a2e service nova] Creating event network-vif-plugged:a15e061d-6acc-4e2b-a4aa-6196683e9412 for instance d6390f85-ea47-471e-b3ba-eb2f11646e27 on n-h2-845775-3 Jul 25 20:06:35.771238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-353a32a7-e2c1-4326-8730-ae8364cf0cd2 req-bb44164f-009b-4b9b-83b7-95e8b3f04a2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073928 Jul 25 20:06:35.780388 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 454/917] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:35.786060 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b28614a7-8f7f-4c34-8539-f5b4ac354b5a tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.114382 Jul 25 20:06:35.786644 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 464/918] 10.222.0.48 () {58 vars in 1290 bytes} [Mon Jul 25 20:06:35 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_distro => generated 33 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:35.798500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b892c545-8e2f-446c-9df5-6a9d12c3b50c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969b235e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:35.809509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:35.810885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:35.841880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:35.849138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:35.856863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:35.860424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:35.956343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b892c545-8e2f-446c-9df5-6a9d12c3b50c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:35.970102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b892c545-8e2f-446c-9df5-6a9d12c3b50c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:36.345720 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b892c545-8e2f-446c-9df5-6a9d12c3b50c tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552049 Jul 25 20:06:36.346524 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 465/919] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:35 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:06:36.354151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:36.354905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:36.373225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:36.373701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:36.374521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:36.375011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:36.818016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:36.820817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:36.831521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d139906-f0f1-4c1a-bc74-8e0ab3fc74ce tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 1.049732 Jul 25 20:06:36.837292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 455/920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:35 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:36.840350 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-21921f55-ce34-488d-abff-040fd1750c81 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1302 microversion: 2.1 time: 0.492399 Jul 25 20:06:36.860296 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 466/921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:36 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1302 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:36.860534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-635b0267-bb74-4ac9-8119-c0d03037feee tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969ad13a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:36.952447 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-635b0267-bb74-4ac9-8119-c0d03037feee tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 0.113832 Jul 25 20:06:36.953272 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 456/922] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:36 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:36.969971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f73affc6-208b-4980-90b2-50a126724cce tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969fb6430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:37.107652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f73affc6-208b-4980-90b2-50a126724cce tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:37.136601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f73affc6-208b-4980-90b2-50a126724cce tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:37.680320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f73affc6-208b-4980-90b2-50a126724cce tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 0.714485 Jul 25 20:06:37.681723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 467/923] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:36 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:37.706008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95f5cefc-3b4c-4dd8-b89e-3f342ffaf739 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f19699c0940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:37.859111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:37.861611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:37.886068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:37.909118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-95f5cefc-3b4c-4dd8-b89e-3f342ffaf739 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:37.911412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:37.916471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:37.920168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:37.928873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-95f5cefc-3b4c-4dd8-b89e-3f342ffaf739 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:38.455892 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95f5cefc-3b4c-4dd8-b89e-3f342ffaf739 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 64 microversion: 2.1 time: 0.756814 Jul 25 20:06:38.456528 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 457/924] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:37 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 64 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:38.462152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:38.464314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:38.491397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:38.495312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:38.496834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:38.499408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:39.015143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:39.031102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b5dc32c-ff56-4003-977d-c074d0e0226d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1302 microversion: 2.1 time: 0.573169 Jul 25 20:06:39.035148 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 458/925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:38 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1302 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:39.041088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74d86f15-58ee-40c0-a9b9-46b3add2fe8b tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f19699c03a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:39.182666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74d86f15-58ee-40c0-a9b9-46b3add2fe8b tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 64 microversion: 2.1 time: 0.146051 Jul 25 20:06:39.183276 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 459/926] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:39 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 64 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:39.201699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:39.202343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:39.239095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:39.239591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:39.244793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:39.246199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:39.686893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:39.732905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41d48747-328d-42ab-b9ad-7bdb28228d86 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1365 microversion: 2.1 time: 1.880197 Jul 25 20:06:39.746027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 468/927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:37 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1365 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:39.764372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60b636e9-04c1-499c-8171-5da75dfd298f tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969df7af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:39.847346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-60b636e9-04c1-499c-8171-5da75dfd298f tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:39.880287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-60b636e9-04c1-499c-8171-5da75dfd298f tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:40.395601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:06:40.410418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:40.440217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d02d98c9-f43e-493c-a765-29f7a71c4bbc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 2343 microversion: 2.25 time: 1.249901 Jul 25 20:06:40.457463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 460/928] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:06:39 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 2343 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:06:40.465428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:40.467014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:40.489669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:40.490536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:40.491677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:40.492923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:40.858986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60b636e9-04c1-499c-8171-5da75dfd298f tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 1.111096 Jul 25 20:06:40.863126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 469/929] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:39 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:40.897268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:40.915703 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:06:40.915703 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:06:40.918376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:40.919230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:40.921451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:40.926296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:40.986986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-246c6bb1-fe71-44fb-83d2-73ec39a0b08f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.118343 Jul 25 20:06:40.987853 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 470/930] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Jul 25 20:06:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:06:40.995331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:40.996234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:41.006194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.006864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:41.008020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.008792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:41.293581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:41.306176 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ff91459-d258-4918-b806-93fdff607fc8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.852840 Jul 25 20:06:41.308089 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 461/931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:40 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:41.335652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-89fbe862-2db8-4dfa-989e-7528f8ad3c75 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update', calling method: .version_select at 0x7f1969b64430>, body: {"meta": {"os_version": "alt"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:41.479792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:41.494983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-89fbe862-2db8-4dfa-989e-7528f8ad3c75 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:41.498021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8433c714-cd45-493f-bbbd-6d5815eeffee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1555 microversion: 2.1 time: 0.506141 Jul 25 20:06:41.508586 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 471/932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:40 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1555 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:41.517557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:41.518621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:41.535327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.538988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-89fbe862-2db8-4dfa-989e-7528f8ad3c75 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:41.542066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:41.550858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.551903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:41.674141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:06:41.781054 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:06:41.781268 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 20:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_version (ip 10.222.0.48) !!! Jul 25 20:06:41.877680 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53d4c1e8-8d65-4dda-8ec8-314cc80bb72e tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 204 len: 0 microversion: 2.1 time: 0.363856 Jul 25 20:06:41.884100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 472/933] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:41 2022] DELETE /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:06:41.916888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:41.917500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:41.936254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.936708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:41.939292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:41.939729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:42.168961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b7c5656-08da-4f2d-b508-50ac1c8b3cfb tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.281613 Jul 25 20:06:42.169550 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 473/934] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:06:41 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-interface => generated 285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:42.176225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:42.177106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:42.196168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:42.198834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:42.199955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:42.202721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:42.226408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-89fbe862-2db8-4dfa-989e-7528f8ad3c75 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.916940 Jul 25 20:06:42.227569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 462/935] 10.222.0.48 () {60 vars in 1313 bytes} [Mon Jul 25 20:06:41 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata/os_version => generated 31 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:42.630747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-737868c6-1db4-4c76-bf2d-e8fd5d67e6e9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969ca3670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1136231410", "description": "tempest-description-2083748244"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:44.574098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:44.597122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-46b9eb40-8b6a-4a6f-80a1-87dc3d7b76bf tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1709 microversion: 2.1 time: 2.421440 Jul 25 20:06:44.616070 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 474/936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:42 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1709 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:44.656829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b94eb866-6896-460e-853a-1c0883f3bcfe tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969bb24c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:44.787589 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b94eb866-6896-460e-853a-1c0883f3bcfe tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 58 microversion: 2.1 time: 0.157064 Jul 25 20:06:44.789095 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 475/937] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:44 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 58 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:44.809079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:44.815232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:44.846848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:44.850872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:44.851785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:44.852271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:46.671638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:46.719469 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4464a51c-6fc9-4520-9a2c-28696060c2f7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 1.926281 Jul 25 20:06:46.723881 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 476/938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:44 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:46.746967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9a3dd35-6c02-45fa-b7fa-2e57b5fa430e tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'update_all', calling method: .version_select at 0x7f1969b23e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:47.383049 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-737868c6-1db4-4c76-bf2d-e8fd5d67e6e9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 5.154097 Jul 25 20:06:47.384921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 463/939] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:06:42 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 5156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:47.390502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:47.392293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:47.457334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:47.459493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:47.462801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:47.465243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:47.660917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b9a3dd35-6c02-45fa-b7fa-2e57b5fa430e tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:47.681622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b9a3dd35-6c02-45fa-b7fa-2e57b5fa430e tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:47.697400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbcf9f54120415792c4b620078b8a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af4a4328b6d404f8e80abe01cd5b883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:47.713359 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b8df7b9-7785-46c8-ac83-4476f998f992 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 200 len: 1642 microversion: 2.1 time: 0.326899 Jul 25 20:06:47.719706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:47.723640 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 464/940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:47 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 1642 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:47.746671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4da9f33-4e75-4e68-9f90-15cc129a45b8", "device": "/dev/xvdb"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:47.751356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:47.775765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:47.777815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:47.779194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:47.779647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:48.618052 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9a3dd35-6c02-45fa-b7fa-2e57b5fa430e tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 61 microversion: 2.1 time: 1.887878 Jul 25 20:06:48.619544 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 477/941] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:06:46 2022] PUT /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 61 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:48.626362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bfcadae7-eef7-43f6-8404-828cae3f6f77 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969a85a60>, body: {"security_group_rule": {"parent_group_id": "25efd624-5f09-4047-823c-f5929dba9974", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:48.640638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c9ada8c9-9fdd-41ba-beab-dc2a9e82fa22 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.912103 Jul 25 20:06:48.641430 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 465/942] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Jul 25 20:06:47 2022] POST /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:06:48.682619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-840935785", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "21bb1d6f-b1ef-4bf4-9acf-77064489ef62"}], "security_groups": [{"name": "tempest-securitygroup--1706865311"}], "key_name": "tempest-keypair-1217502462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:49.159345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] validate_networks() for [('21bb1d6f-b1ef-4bf4-9acf-77064489ef62', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:06:50.535408 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bfcadae7-eef7-43f6-8404-828cae3f6f77 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.914743 Jul 25 20:06:50.537857 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 478/943] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:50.544392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:50.546258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:50.569125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:50.571348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:50.573581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:50.574308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:50.942927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:51.390121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:51.411029 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f2d85b5-5f67-4d7a-adb7-44033576e6b7 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.863129 Jul 25 20:06:51.413058 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 479/944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:50 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:51.418618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e3347c85-d3b6-41bb-a51a-d80d7c9dd2c8 req-1467319a-d5f9-4a80-b340-72c1d4f88024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71d479f-ea35-4df6-9c60-8921866f46ed", "tag": "bfef752e-c174-4d45-9069-65163b583813"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:51.440988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3347c85-d3b6-41bb-a51a-d80d7c9dd2c8 req-1467319a-d5f9-4a80-b340-72c1d4f88024 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:51.441834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3347c85-d3b6-41bb-a51a-d80d7c9dd2c8 req-1467319a-d5f9-4a80-b340-72c1d4f88024 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:51.487077 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e3347c85-d3b6-41bb-a51a-d80d7c9dd2c8 req-1467319a-d5f9-4a80-b340-72c1d4f88024 service nova] Creating event network-changed:bfef752e-c174-4d45-9069-65163b583813 for instance a71d479f-ea35-4df6-9c60-8921866f46ed on n-h1-845775-3 Jul 25 20:06:51.523535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e3347c85-d3b6-41bb-a51a-d80d7c9dd2c8 req-1467319a-d5f9-4a80-b340-72c1d4f88024 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107605 Jul 25 20:06:51.526943 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 480/945] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:51.551294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a2c87c71-7b40-4c7c-9c19-6a61b5d956d1 req-30cb5a49-dde9-44ed-9b2d-7dff8247c39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f721cade-dbc8-4931-bbb9-16e7350cc163", "name": "network-vif-deleted", "tag": "a1e04947-c068-4ce9-a6ae-15bb8f6995a9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:51.569299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:51.600475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a2c87c71-7b40-4c7c-9c19-6a61b5d956d1 req-30cb5a49-dde9-44ed-9b2d-7dff8247c39e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:51.601194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a2c87c71-7b40-4c7c-9c19-6a61b5d956d1 req-30cb5a49-dde9-44ed-9b2d-7dff8247c39e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:51.638746 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a2c87c71-7b40-4c7c-9c19-6a61b5d956d1 req-30cb5a49-dde9-44ed-9b2d-7dff8247c39e service nova] Creating event network-vif-deleted:a1e04947-c068-4ce9-a6ae-15bb8f6995a9 for instance f721cade-dbc8-4931-bbb9-16e7350cc163 on n-h1-845775-3 Jul 25 20:06:51.649015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a2c87c71-7b40-4c7c-9c19-6a61b5d956d1 req-30cb5a49-dde9-44ed-9b2d-7dff8247c39e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116374 Jul 25 20:06:51.651238 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 481/946] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:51.663809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbfb5d09-2a65-470c-ae90-2f89fae66753 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Action: 'create', calling method: .version_select at 0x7f1969d4da60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:51.829488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-fbfb5d09-2a65-470c-ae90-2f89fae66753 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:51.858869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-fbfb5d09-2a65-470c-ae90-2f89fae66753 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Getting quotas for user e675957f469d43ba98e5efc792cd27bc and project 5562114c645b40edbcb506feb7f96299. Resources: dict_keys(['metadata_items']) {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:52.430893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:06:52.431209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:06:52.431871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:06:52.432474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:06:52.433692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:06:52.457777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.458555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.459887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.461465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.549210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:06:52.560758 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbfb5d09-2a65-470c-ae90-2f89fae66753 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "POST /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 85 microversion: 2.1 time: 0.906927 Jul 25 20:06:52.562467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 482/947] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Jul 25 20:06:51 2022] POST /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 85 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:52.578072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:52.580745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:52.590812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for user 1d0f300b7de441108c3efcee70e8f920 and project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:06:52.612443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.619918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.630161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.633985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.652917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:06:52.664630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:06:52.676439 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 HTTP/1.1 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:52.678945 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:52.680787 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f721cade-dbc8-4931-bbb9-16e7350cc163'} Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:52.681650 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:52.682996 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.695884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:52.697783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2a316ef7-a6e1-4edf-8539-3bb44363e968 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 404 len: 111 microversion: 2.1 time: 0.133143 Jul 25 20:06:52.707665 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 483/948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:52 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:52.723192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f8be970-97e4-4801-a86b-953f0cb3edf0 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969cc23a0>, body: {"security_group_rule": {"parent_group_id": "25efd624-5f09-4047-823c-f5929dba9974", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:52.811257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f33bb9ef-a93d-46d0-b52c-97f6207d8a88 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.165663 Jul 25 20:06:52.816354 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 466/949] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:06:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 4174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:06:52.825239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:52.833719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:52.869697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.870665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.880054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:52.880835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:52.912408 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-4f8be970-97e4-4801-a86b-953f0cb3edf0 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f8be970-97e4-4801-a86b-953f0cb3edf0 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 138 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:52.937294 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: {"security_group_rule": {"parent_group_id": "25efd624-5f09-4047-823c-f5929dba9974", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 20:06:52.938815 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: exception: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '25efd624-5f09-4047-823c-f5929dba9974', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:52.939809 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:52.941359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f8be970-97e4-4801-a86b-953f0cb3edf0 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: This rule already exists in group 25efd624-5f09-4047-823c-f5929dba9974 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:52.942746 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f8be970-97e4-4801-a86b-953f0cb3edf0 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.229614 Jul 25 20:06:52.942746 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 484/950] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:52 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:52.950747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0bbd63ae-8765-4a77-9c0a-76e0dd1403f4 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] Calling method '.version_select at 0x7f1969a96820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.031197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0bbd63ae-8765-4a77-9c0a-76e0dd1403f4 tempest-ImagesMetadataTestJSON-1754924720 tempest-ImagesMetadataTestJSON-1754924720-project] 10.222.0.48 "GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata" status: 200 len: 85 microversion: 2.1 time: 0.086821 Jul 25 20:06:53.033065 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 485/951] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:06:52 2022] GET /compute/v2.1/images/f4da540b-4088-4b0e-82aa-675e81d43157/metadata => generated 85 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:06:53.040311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.044465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:53.057043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:53.058420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:53.060153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:53.062150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:53.095395 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 HTTP/1.1 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:53.101162 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.103485 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '9318170e-8c6e-480a-96f5-45a0caa25c69'} Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:53.104700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.107369 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.115740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:53.122889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1a345e98-8388-47ab-887a-89578201efdc tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 404 len: 111 microversion: 2.1 time: 0.083071 Jul 25 20:06:53.123762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 486/952] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:53 2022] DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:53.133398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a65a9bf8-9df5-4c4a-a0c6-5a21f6bc060b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.134182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a65a9bf8-9df5-4c4a-a0c6-5a21f6bc060b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:53.368370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a65a9bf8-9df5-4c4a-a0c6-5a21f6bc060b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:53.384748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a65a9bf8-9df5-4c4a-a0c6-5a21f6bc060b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1234 microversion: 2.1 time: 0.255119 Jul 25 20:06:53.409132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 487/953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:53 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1234 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:53.426333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-220bcf74-80e0-4943-953f-39e598484a3c tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969fb6430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.453950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:53.483203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3f5079e-27bb-4b79-b599-badd9ceb0ddf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.662815 Jul 25 20:06:53.483812 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 467/954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:52 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:53.496309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.500679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:53.519546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:53.521633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:53.522667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:53.523498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:53.560144 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 HTTP/1.1 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:53.563656 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.565360 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9318170e-8c6e-480a-96f5-45a0caa25c69'} Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:53.566184 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:53.567517 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:53.569474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:53.569474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d338b5e2-a94c-496c-a1af-a28204a329bb tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 404 len: 111 microversion: 2.1 time: 0.076567 Jul 25 20:06:53.569474 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 468/955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:53 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:53.575586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c05e47e-3034-4005-b2f4-8706d912c201 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '.version_select at 0x7f19698e19d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:53.608127 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c05e47e-3034-4005-b2f4-8706d912c201 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433884167" status: 202 len: 0 microversion: 2.1 time: 0.036952 Jul 25 20:06:53.614175 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 469/956] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:06:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433884167 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:06:53.701371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-233a9f2f-7744-4d7e-bf1b-9b8b169d207a req-8da6fbb3-4b9d-4519-824a-534a38554308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6390f85-ea47-471e-b3ba-eb2f11646e27", "tag": "a15e061d-6acc-4e2b-a4aa-6196683e9412"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:53.729872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-233a9f2f-7744-4d7e-bf1b-9b8b169d207a req-8da6fbb3-4b9d-4519-824a-534a38554308 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:53.730584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-233a9f2f-7744-4d7e-bf1b-9b8b169d207a req-8da6fbb3-4b9d-4519-824a-534a38554308 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:53.761718 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-233a9f2f-7744-4d7e-bf1b-9b8b169d207a req-8da6fbb3-4b9d-4519-824a-534a38554308 service nova] Creating event network-changed:a15e061d-6acc-4e2b-a4aa-6196683e9412 for instance d6390f85-ea47-471e-b3ba-eb2f11646e27 on n-h2-845775-3 Jul 25 20:06:53.769754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-233a9f2f-7744-4d7e-bf1b-9b8b169d207a req-8da6fbb3-4b9d-4519-824a-534a38554308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071169 Jul 25 20:06:53.770455 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 470/957] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:06:53.942418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-220bcf74-80e0-4943-953f-39e598484a3c tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/efcf5ec0-77c0-405e-9cd4-daacd1627662" status: 202 len: 0 microversion: 2.1 time: 0.530264 Jul 25 20:06:53.943473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 488/958] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Jul 25 20:06:53 2022] DELETE /compute/v2.1/os-security-group-rules/efcf5ec0-77c0-405e-9cd4-daacd1627662 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:53.960712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe1570cf-6fc9-45fc-8645-99a47b036631 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f196a2b2820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1822692100", "description": "tempest-description-1382998219"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:54.415070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:54.416427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:54.439191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:54.441197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:54.449795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:54.452313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:54.819716 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe1570cf-6fc9-45fc-8645-99a47b036631 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.869713 Jul 25 20:06:54.820612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 471/959] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:06:53 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:54.823113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:54.826252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:54.827378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:54.838039 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68611227-e18d-4ccd-91b8-a0fecbadf9e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1230 microversion: 2.1 time: 0.429328 Jul 25 20:06:54.839118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 489/960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:54 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1230 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:54.849602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5efda78-d4c7-48e5-ab69-cfb90bd71f0b tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f196a095940>, body: {"security_group_rule": {"parent_group_id": "419ff69b-a485-445b-87d6-9de85303cb21", "ip_protocol": "tcp", "from_port": 749503090, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:54.865114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:54.869455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:54.874835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:54.875388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:55.090839 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f5efda78-d4c7-48e5-ab69-cfb90bd71f0b tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Invalid port range 749503090:22. Former value cannot be greater than the later Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5efda78-d4c7-48e5-ab69-cfb90bd71f0b tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 145 Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:55.095015 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: {"security_group_rule": {"parent_group_id": "419ff69b-a485-445b-87d6-9de85303cb21", "ip_protocol": "tcp", "from_port": 749503090, "to_port": 22}} Jul 25 20:06:55.096693 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid port range 749503090:22. Former value cannot be greater than the later Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '419ff69b-a485-445b-87d6-9de85303cb21', 'ip_protocol': 'tcp', 'from_port': 749503090, 'to_port': 22}}} Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 749503090:22. Former value cannot be greater than the later Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:55.097617 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 749503090:22. Former value cannot be greater than the later Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 749503090:22. Former value cannot be greater than the later Jul 25 20:06:55.099099 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.102002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5efda78-d4c7-48e5-ab69-cfb90bd71f0b tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: Invalid port range 749503090:22. Former value cannot be greater than the later {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:55.103510 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5efda78-d4c7-48e5-ab69-cfb90bd71f0b tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.262937 Jul 25 20:06:55.105132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 490/961] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:54 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:55.124568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d83a042-a18c-4955-916e-9d3c8c4063dc tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f196c08ca60>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-254369469", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:55.130069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3d83a042-a18c-4955-916e-9d3c8c4063dc tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Security group id should be uuid Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d83a042-a18c-4955-916e-9d3c8c4063dc tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 130 Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:55.160066 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-254369469", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:55.161895 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group id should be uuid Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-254369469', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:55.162942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 25 20:06:55.164457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:55.168463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d83a042-a18c-4955-916e-9d3c8c4063dc tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: Security group id should be uuid {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:55.188879 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d83a042-a18c-4955-916e-9d3c8c4063dc tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.073429 Jul 25 20:06:55.195519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 491/962] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:55 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 20:06:55.222009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a29c5a8-1c23-455b-b660-f6625d1d9f8e tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969fb63a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-701279893", "description": "tempest-description-606683212"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:56.370827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:56.385167 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fdbdf33c-d612-4967-b827-c3e827e7cd4b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 1.562917 Jul 25 20:06:56.386101 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 472/963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:54 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:56.412943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:56.413966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:56.420739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:56.421461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:56.423659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:56.424315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:56.447130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a29c5a8-1c23-455b-b660-f6625d1d9f8e tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.247219 Jul 25 20:06:56.457368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 492/964] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:06:55 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:56.463543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfb2f6b-8a0c-4234-a4f8-60332408efab tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969b54e50>, body: {"security_group_rule": {"parent_group_id": "96efd958-e31c-4c2d-a98c-229a97eb60e1", "ip_protocol": "tempest-999-1696333957", "from_port": 22, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:56.679178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:56.694455 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-906d94dd-ca7a-4dc9-82c1-c8a81ed747f7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1292 microversion: 2.1 time: 0.288530 Jul 25 20:06:56.695206 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 473/965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:56 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:57.010557 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6bfb2f6b-8a0c-4234-a4f8-60332408efab tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Invalid IP protocol tempest-999-1696333957. Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfb2f6b-8a0c-4234-a4f8-60332408efab tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 157 Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:57.012334 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: {"security_group_rule": {"parent_group_id": "96efd958-e31c-4c2d-a98c-229a97eb60e1", "ip_protocol": "tempest-999-1696333957", "from_port": 22, "to_port": 22}} Jul 25 20:06:57.014372 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid IP protocol tempest-999-1696333957. Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'security_group_rule': {'parent_group_id': '96efd958-e31c-4c2d-a98c-229a97eb60e1', 'ip_protocol': 'tempest-999-1696333957', 'from_port': 22, 'to_port': 22}}} Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1696333957. Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.015299 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1696333957. Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1696333957. Jul 25 20:06:57.016746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.018539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bfb2f6b-8a0c-4234-a4f8-60332408efab tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: Invalid IP protocol tempest-999-1696333957. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:57.018539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6bfb2f6b-8a0c-4234-a4f8-60332408efab tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.554976 Jul 25 20:06:57.018539 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 493/966] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:56 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 556 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:06:57.030973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7e7a083-3a43-4a3a-bfea-9ffaecf41a6f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f19698df700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-536872427", "description": "tempest-description-850536984"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:57.054396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5f0101b-da0f-4487-813e-1f296cfe9636 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.062066 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:06:57.062066 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:06:57.097891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5f0101b-da0f-4487-813e-1f296cfe9636 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/487381553" status: 202 len: 0 microversion: 2.1 time: 0.047361 Jul 25 20:06:57.099163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 494/967] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:06:57 2022] DELETE /compute/v2.1/flavors/487381553 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:57.113375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed5be286-bf0c-48fa-8f78-c6e151ea2e25 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.212491 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed5be286-bf0c-48fa-8f78-c6e151ea2e25 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.106210 Jul 25 20:06:57.218747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 495/968] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:06:57 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:57.234967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2206c116-2c09-49bb-8fb6-6e4ee9032fda tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.297841 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2206c116-2c09-49bb-8fb6-6e4ee9032fda tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/716673613" status: 202 len: 0 microversion: 2.1 time: 0.068157 Jul 25 20:06:57.299048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 496/969] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:06:57 2022] DELETE /compute/v2.1/flavors/716673613 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:06:57.309303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb463419-d6e9-4744-baf5-871325255059 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.347630 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb463419-d6e9-4744-baf5-871325255059 tempest-ServersWithSpecificFlavorTestJSON-843886851 tempest-ServersWithSpecificFlavorTestJSON-843886851-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042487 Jul 25 20:06:57.348822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 497/970] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:06:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:57.380516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.381875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:57.399510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.404065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.407252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.410851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.460312 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7e7a083-3a43-4a3a-bfea-9ffaecf41a6f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.433561 Jul 25 20:06:57.467192 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.468949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 474/971] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:06:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 HTTP/1.1 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:57.471598 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.473244 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f721cade-dbc8-4931-bbb9-16e7350cc163'} Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:57.474276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.475947 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.478532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:57.478532 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-526edbc8-1d53-448e-9cae-8f46db16a51a tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 404 len: 111 microversion: 2.1 time: 0.100633 Jul 25 20:06:57.481650 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 498/972] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:57 2022] DELETE /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:57.482061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.483432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:57.490583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.491390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.492478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.493117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.495295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67561f5a-f30a-46f6-a479-c155d5fbe7a1 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969ff2160>, body: {"security_group_rule": {"parent_group_id": "ee55e557-ab21-4eb0-a5d7-d028fafecffd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:57.686834 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-67561f5a-f30a-46f6-a479-c155d5fbe7a1 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67561f5a-f30a-46f6-a479-c155d5fbe7a1 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 138 Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:57.689797 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: {"security_group_rule": {"parent_group_id": "ee55e557-ab21-4eb0-a5d7-d028fafecffd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 25 20:06:57.691978 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ee55e557-ab21-4eb0-a5d7-d028fafecffd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.693533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 25 20:06:57.695581 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.706657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67561f5a-f30a-46f6-a479-c155d5fbe7a1 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:57.706657 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67561f5a-f30a-46f6-a479-c155d5fbe7a1 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.220955 Jul 25 20:06:57.711582 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 499/973] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:57 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:57.727936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.732299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: f721cade-dbc8-4931-bbb9-16e7350cc163] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:57.739788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:57.751116 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c4038e54-339b-4cfd-bed3-385353dce0d8 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.280785 Jul 25 20:06:57.758095 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 475/974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:57 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:57.761580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.762427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.763951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.764581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.776421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:57.777388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:57.792633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.793278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.794393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:57.795000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:57.800546 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 HTTP/1.1 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:57.802315 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.804267 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f721cade-dbc8-4931-bbb9-16e7350cc163'} Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:57.805262 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. Jul 25 20:06:57.807409 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:57.812146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance f721cade-dbc8-4931-bbb9-16e7350cc163 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:57.812146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0c3dbde-c8fe-4d23-9886-0bc026149e69 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163" status: 404 len: 111 microversion: 2.1 time: 0.090395 Jul 25 20:06:57.812483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 500/975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:57 2022] GET /compute/v2.1/servers/f721cade-dbc8-4931-bbb9-16e7350cc163 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:57.821385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ce4de19e-d672-4ca4-ade3-8ccf8a3aa944 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f1969b23310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-797425324", "description": "tempest-description-296938201"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:58.084701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:58.095141 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87a47c63-0982-422f-985a-044bf6b8e918 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1292 microversion: 2.1 time: 0.335685 Jul 25 20:06:58.098393 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 476/976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:57 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1292 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:58.111957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:58.116855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:58.133110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.133678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.135870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.137053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.181437 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 HTTP/1.1 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:58.189307 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.191025 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9318170e-8c6e-480a-96f5-45a0caa25c69'} Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:58.191946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.193576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.197026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:58.198316 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-721f2c94-054f-46c3-aac3-55592b2395be tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 404 len: 111 microversion: 2.1 time: 0.098065 Jul 25 20:06:58.199509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 477/977] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:06:58 2022] DELETE /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:58.248077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:58.250696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] [instance: 9318170e-8c6e-480a-96f5-45a0caa25c69] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:58.263885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.264549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.265489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.268681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.295834 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] HTTP exception thrown: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Request method failure captured: Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 HTTP/1.1 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vcOg-qyD4mmKzcN1d6xyHDNJJ12NhIGa2fNbcFyJV-V580vJkROVSxYYbhF0L-rg-xhwqExGsIdZ34T8SkCS-FY_KFE-p4Uv9jJxqli3fByLewlP5KHBiFRByosaTWdW7vNXBhVOa9Im2NUdB6o5itywN5xuDGkvJGLUxrKDpYQGcs Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:58.298279 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4af4a4328b6d404f8e80abe01cd5b883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4af4a4328b6d404f8e80abe01cd5b883"}]}] Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 4af4a4328b6d404f8e80abe01cd5b883 Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934 Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9dbcf9f54120415792c4b620078b8a0a Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-369854934-project Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.300744 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9318170e-8c6e-480a-96f5-45a0caa25c69'} Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:58.301713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. Jul 25 20:06:58.303186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.304776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] Returning 404 to user: Instance 9318170e-8c6e-480a-96f5-45a0caa25c69 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:58.305817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ff83e27-b366-4b78-a3f3-72baec13e851 tempest-ServersWithSpecificFlavorTestJSON-369854934 tempest-ServersWithSpecificFlavorTestJSON-369854934-project] 10.222.0.48 "GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69" status: 404 len: 111 microversion: 2.1 time: 0.099673 Jul 25 20:06:58.306711 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 478/978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:58 2022] GET /compute/v2.1/servers/9318170e-8c6e-480a-96f5-45a0caa25c69 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:58.760215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ce4de19e-d672-4ca4-ade3-8ccf8a3aa944 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.946707 Jul 25 20:06:58.761419 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 501/979] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:06:57 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:58.782923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:58.784346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:58.785126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b897348-3cbe-49d0-9fe1-34b091465bb9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f19698adf70>, body: {"security_group_rule": {"parent_group_id": "d16ed0b3-83f0-49c7-b6f2-71b4e7b073dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 732611162}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:58.813341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.815308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.817323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:58.820870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:58.854874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:06:58.967594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3b897348-3cbe-49d0-9fe1-34b091465bb9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b897348-3cbe-49d0-9fe1-34b091465bb9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 145 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:58.970015 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: {"security_group_rule": {"parent_group_id": "d16ed0b3-83f0-49c7-b6f2-71b4e7b073dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 732611162}} Jul 25 20:06:58.972115 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd16ed0b3-83f0-49c7-b6f2-71b4e7b073dd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 732611162}}} Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.973070 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 Jul 25 20:06:58.975238 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:58.978360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b897348-3cbe-49d0-9fe1-34b091465bb9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 400 to user: Invalid port range 22:732611162. Valid TCP ports should be between 1-65535 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:58.980243 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b897348-3cbe-49d0-9fe1-34b091465bb9 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.208354 Jul 25 20:06:58.981066 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 479/980] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:58 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:06:59.001304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Action: 'create', calling method: .version_select at 0x7f19698c89d0>, body: {"security_group_rule": {"parent_group_id": "ecbee6e7-540e-4814-8f50-ca28668f6ffc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:59.237116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:06:59.238083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Neutron security group ecbee6e7-540e-4814-8f50-ca28668f6ffc not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:06:59.238976 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.238976 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 138 Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:06:59.241556 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: {"security_group_rule": {"parent_group_id": "ecbee6e7-540e-4814-8f50-ca28668f6ffc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 25 20:06:59.243182 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ecbee6e7-540e-4814-8f50-ca28668f6ffc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:06:59.249519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 25 20:06:59.250981 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.252492 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 404 to user: Security group ecbee6e7-540e-4814-8f50-ca28668f6ffc does not exist Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-ad94353b-5d0f-4faa-b676-c8d90d49b89e'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:59.254021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6424e99-91c4-4805-8962-f3fb72d91b09 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.256379 Jul 25 20:06:59.256177 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 480/981] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:06:58 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:59.262060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0e7cb24e-3c3e-4111-9fcc-11a153be8cee req-2dd7ed5a-ff24-4fee-84f4-f8722e66872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71d479f-ea35-4df6-9c60-8921866f46ed", "name": "network-vif-plugged", "status": "completed", "tag": "bfef752e-c174-4d45-9069-65163b583813"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:06:59.290612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0e7cb24e-3c3e-4111-9fcc-11a153be8cee req-2dd7ed5a-ff24-4fee-84f4-f8722e66872a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:59.291216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0e7cb24e-3c3e-4111-9fcc-11a153be8cee req-2dd7ed5a-ff24-4fee-84f4-f8722e66872a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:59.336268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0e7cb24e-3c3e-4111-9fcc-11a153be8cee req-2dd7ed5a-ff24-4fee-84f4-f8722e66872a service nova] Creating event network-vif-plugged:bfef752e-c174-4d45-9069-65163b583813 for instance a71d479f-ea35-4df6-9c60-8921866f46ed on n-h1-845775-3 Jul 25 20:06:59.355900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0e7cb24e-3c3e-4111-9fcc-11a153be8cee req-2dd7ed5a-ff24-4fee-84f4-f8722e66872a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109290 Jul 25 20:06:59.358151 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 481/982] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:06:59.370627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:59.382879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:06:59.406115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:59.406856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:59.407961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:06:59.427314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:06:59.591473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:06:59.632418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb421a1b-508e-4884-b73b-2c5b2bf820a3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.850260 Jul 25 20:06:59.638909 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 502/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:58 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:06:59.658709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969bb2f70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:06:59.859624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:06:59.865047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Neutron security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 not found {{(pid=119724) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 25 20:06:59.866227 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] HTTP exception thrown: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.866227 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Request method failure captured: Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-security-group-rules/3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 HTTP/1.1 Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfRV4LS70s3PreE-NI3Scv4gDK9PN5YchjfE3aIUD0DwQHK6Qe0fwkT5mrXpha9vdkQdJxaO1_ScUZPqHIV8xNkP9608p6vWplFMWJfvRX9XnMbRJwVAgLXh4urQlGzpuXcCDUlVtu3TeRh5ksvMkBHfqqQYWQSfgwehWXeuYY8v2M Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:06:59.878705 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e03311596d47419580e138fd04711a2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e03311596d47419580e138fd04711a2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e03311596d47419580e138fd04711a2d"}]}] Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e03311596d47419580e138fd04711a2d Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830 Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 26eef2fee876490f99b501ad6c82077d Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.881914 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3e9bdf01-91eb-4e7a-b21c-8b87ef559e42'} Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.883744 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 25 20:06:59.887329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.892064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Returning 404 to user: Security group rule 3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 does not exist Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-4c7fd392-4d54-4d71-8741-30dcac541593'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:06:59.899808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c767fcdd-8a40-4158-87b4-2a53a751550f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/3e9bdf01-91eb-4e7a-b21c-8b87ef559e42" status: 404 len: 199 microversion: 2.1 time: 0.256975 Jul 25 20:06:59.904588 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 503/984] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Jul 25 20:06:59 2022] DELETE /compute/v2.1/os-security-group-rules/3e9bdf01-91eb-4e7a-b21c-8b87ef559e42 => generated 199 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:06:59.921656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb452d5b-2689-4e5c-a390-e00fc53b6a50 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969a85af0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:00.252293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:00.266583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eddf2d1c-6b69-4339-8e02-12a5ea00acc4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 0.901377 Jul 25 20:07:00.280320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 482/985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:06:59 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:00.567077 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb452d5b-2689-4e5c-a390-e00fc53b6a50 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d16ed0b3-83f0-49c7-b6f2-71b4e7b073dd" status: 202 len: 0 microversion: 2.1 time: 0.654911 Jul 25 20:07:00.568495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 504/986] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:06:59 2022] DELETE /compute/v2.1/os-security-groups/d16ed0b3-83f0-49c7-b6f2-71b4e7b073dd => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:00.578581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10c8917e-38c5-4a57-a025-7edfc4dbd7a8 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969ca3670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:00.658076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:00.658696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:00.686773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:00.686773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:00.686773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:00.686773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:01.432820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:01.461304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c358b28-5059-4f74-aa03-5f0ec4901d27 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1370 microversion: 2.1 time: 0.802269 Jul 25 20:07:01.463994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 505/987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:00 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1370 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:01.830688 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10c8917e-38c5-4a57-a025-7edfc4dbd7a8 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ee55e557-ab21-4eb0-a5d7-d028fafecffd" status: 202 len: 0 microversion: 2.1 time: 1.257062 Jul 25 20:07:01.837075 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 483/988] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:07:00 2022] DELETE /compute/v2.1/os-security-groups/ee55e557-ab21-4eb0-a5d7-d028fafecffd => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:01.871637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:01.874210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:01.884285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:01.897443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:01.898392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:01.899802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:01.900487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:01.938992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1728306109", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "474142bd-b6db-42e4-b8e5-a59a376c1800"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:02.079213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] validate_networks() for [('474142bd-b6db-42e4-b8e5-a59a376c1800', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:07:02.474410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:02.513152 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c406d623-cc48-4816-89ad-5fb243b9d4ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 0.673995 Jul 25 20:07:02.514987 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 484/989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:01 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:02.547360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4440173f-2c4d-443a-bac9-fdafc696af0f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f19699c0c10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:02.563099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:02.632221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:03.382957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=25 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:03.942798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:07:03.943439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:07:03.944135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:07:03.944710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:07:03.945273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:07:03.966066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:03.966724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:03.967552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:03.968069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.003170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:07:04.039278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for user bbff966c24e646fdb7faad71581dc208 and project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:07:04.052628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4440173f-2c4d-443a-bac9-fdafc696af0f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/96efd958-e31c-4c2d-a98c-229a97eb60e1" status: 202 len: 0 microversion: 2.1 time: 1.534330 Jul 25 20:07:04.053774 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 485/990] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:07:02 2022] DELETE /compute/v2.1/os-security-groups/96efd958-e31c-4c2d-a98c-229a97eb60e1 => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:04.063867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4da9ae68-8a5d-4ef5-a5b0-8c8a71a50c00 req-b8a4020d-8d54-4a63-bfc1-1b49d4c5f7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:04.093006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4da9ae68-8a5d-4ef5-a5b0-8c8a71a50c00 req-b8a4020d-8d54-4a63-bfc1-1b49d4c5f7b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:04.095600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:07:04.104581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:07:04.108161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4da9ae68-8a5d-4ef5-a5b0-8c8a71a50c00 req-b8a4020d-8d54-4a63-bfc1-1b49d4c5f7b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.145770 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4da9ae68-8a5d-4ef5-a5b0-8c8a71a50c00 req-b8a4020d-8d54-4a63-bfc1-1b49d4c5f7b3 service nova] Creating event network-changed:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:07:04.157945 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4da9ae68-8a5d-4ef5-a5b0-8c8a71a50c00 req-b8a4020d-8d54-4a63-bfc1-1b49d4c5f7b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099353 Jul 25 20:07:04.159087 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 486/991] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:04.179983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:04.180815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:04.208302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:04.209277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.211447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:04.219831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26c5e1fa-7aa0-4202-a347-84d6ead7b02b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.753863 Jul 25 20:07:04.221244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 506/992] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:07:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:07:04.229235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:04.230152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:04.232923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.241169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:04.241557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.243129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:04.244072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:04.891572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:04.909829 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2be5c893-69f2-4862-b768-72e2499e9ae4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 0.686407 Jul 25 20:07:04.913596 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 507/993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:04 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:04.927570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f0b2159-0b44-4c4b-9213-05c16141cc65 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969df7b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:05.048753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:05.058001 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-27004db1-b076-4382-8e11-51e38305ab62 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1556 microversion: 2.1 time: 0.897671 Jul 25 20:07:05.063356 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 487/994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:04 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1556 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:05.076266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65249aad-25fc-46c7-a287-a3e719a68568 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:05.077260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65249aad-25fc-46c7-a287-a3e719a68568 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:05.292004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65249aad-25fc-46c7-a287-a3e719a68568 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:05.307986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65249aad-25fc-46c7-a287-a3e719a68568 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1218 microversion: 2.1 time: 0.242871 Jul 25 20:07:05.327197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 488/995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:05 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:05.359510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:05.360695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:05.374550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:05.375552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:05.377098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:05.378026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:05.600363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57403cde-6507-4444-9759-565a6892f88d tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257298 Jul 25 20:07:05.602550 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 489/996] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:07:05 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:05.760630 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f0b2159-0b44-4c4b-9213-05c16141cc65 tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/419ff69b-a485-445b-87d6-9de85303cb21" status: 202 len: 0 microversion: 2.1 time: 0.843889 Jul 25 20:07:05.761381 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 508/997] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:07:04 2022] DELETE /compute/v2.1/os-security-groups/419ff69b-a485-445b-87d6-9de85303cb21 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:05.777703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3149069-b4f7-4493-a201-a145757c5b6f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] Calling method '.version_select at 0x7f1969d15040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:05.939709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:05.940374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:05.955917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:05.956439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:05.957270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:05.958262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:07.247545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:07.261575 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74f98a25-4c98-4042-ab06-7b6e1afeadb7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 1.323273 Jul 25 20:07:07.264392 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 509/998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:05 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:07.278349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:07.279196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:07.293595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:07.294899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:07.295960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:07.296603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:07.459249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:07.481699 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca10230d-73ac-4b95-be73-a0cdb0f715af tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1278 microversion: 2.1 time: 0.215868 Jul 25 20:07:07.483772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 510/999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:07 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:07.877914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3149069-b4f7-4493-a201-a145757c5b6f tempest-SecurityGroupRulesNegativeTestJSON-1237595830 tempest-SecurityGroupRulesNegativeTestJSON-1237595830-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/25efd624-5f09-4047-823c-f5929dba9974" status: 202 len: 0 microversion: 2.1 time: 2.110128 Jul 25 20:07:07.879197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 490/1000] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:07:05 2022] DELETE /compute/v2.1/os-security-groups/25efd624-5f09-4047-823c-f5929dba9974 => generated 0 bytes in 2113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:08.294942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:08.295662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:08.332796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:08.342773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:08.348703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:08.351120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:08.567266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6e166234-c563-4dbb-88cd-4b449cbf6719 req-b87f29b8-d8b1-4618-bb8b-9d68cac8c8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a71d479f-ea35-4df6-9c60-8921866f46ed", "tag": "bfef752e-c174-4d45-9069-65163b583813"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:08.584685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6e166234-c563-4dbb-88cd-4b449cbf6719 req-b87f29b8-d8b1-4618-bb8b-9d68cac8c8bf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:08.585147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6e166234-c563-4dbb-88cd-4b449cbf6719 req-b87f29b8-d8b1-4618-bb8b-9d68cac8c8bf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:08.614301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6e166234-c563-4dbb-88cd-4b449cbf6719 req-b87f29b8-d8b1-4618-bb8b-9d68cac8c8bf service nova] Creating event network-changed:bfef752e-c174-4d45-9069-65163b583813 for instance a71d479f-ea35-4df6-9c60-8921866f46ed on n-h1-845775-3 Jul 25 20:07:08.639791 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6e166234-c563-4dbb-88cd-4b449cbf6719 req-b87f29b8-d8b1-4618-bb8b-9d68cac8c8bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218171 Jul 25 20:07:08.657116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 491/1001] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:08.666717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:08.667648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:08.677757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:08.680772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:08.681834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:08.685052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:08.760507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:08.775446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5102f2b-1545-402c-9859-5cc34deb1978 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 0.487354 Jul 25 20:07:08.776575 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 511/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:08 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:08.809593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:08.818416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:08.822393 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42580543-e696-43b9-b2bd-b20d0617c19d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1276 microversion: 2.1 time: 0.163388 Jul 25 20:07:08.838927 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 492/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:08 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:09.144241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1971150f-435c-4704-aad3-143fa50da0c2 req-8ce13ba0-a0bd-45fa-b3ab-80a3ea777a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "name": "network-vif-plugged", "status": "completed", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:09.159492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1971150f-435c-4704-aad3-143fa50da0c2 req-8ce13ba0-a0bd-45fa-b3ab-80a3ea777a02 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:09.160230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1971150f-435c-4704-aad3-143fa50da0c2 req-8ce13ba0-a0bd-45fa-b3ab-80a3ea777a02 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:09.195934 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1971150f-435c-4704-aad3-143fa50da0c2 req-8ce13ba0-a0bd-45fa-b3ab-80a3ea777a02 service nova] Creating event network-vif-plugged:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:07:09.209868 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1971150f-435c-4704-aad3-143fa50da0c2 req-8ce13ba0-a0bd-45fa-b3ab-80a3ea777a02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068796 Jul 25 20:07:09.213279 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 512/1004] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:09.599909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:09.607344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:09.639047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:09.639640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:09.640647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:09.642455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:09.803199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:09.804631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:09.817452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:09.817452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:09.818168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:09.818608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:10.784751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:07:10.810673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b260b78f-9e36-4f04-bbdc-8392ec708d76 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 2421 microversion: 2.25 time: 1.216845 Jul 25 20:07:10.824060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 493/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:09 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 2421 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:10.824060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:10.824060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:10.825130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:10.825602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:10.831883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:10.831883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:10.897411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:10.910799 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d4b6610-fe2a-4944-aee7-8d8559016886 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1360 microversion: 2.1 time: 1.112872 Jul 25 20:07:10.913227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 513/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:09 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1360 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:10.932391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845775-3", "block_migration": "auto"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:10.939863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:10.954166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:10.954948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:10.956114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:10.957178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:11.012959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'flavor' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:07:11.042834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Going to try to live migrate instance to n-h1-845775-3 {{(pid=119724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:07:11.055083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:11.074962 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e93b4496-af96-411b-b863-a1e2945d1539 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1276 microversion: 2.1 time: 0.262141 Jul 25 20:07:11.075558 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 494/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:10 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:11.939942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:11.953805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:11.966966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:11.967656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:11.968789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:11.969339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:12.275927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:12.298891 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53093c8c-b9ad-496b-9fbe-a8a560a9e4c4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1544 microversion: 2.1 time: 0.367092 Jul 25 20:07:12.315327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 495/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:11 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1544 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:12.315327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:12.315327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:12.346639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:12.350332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:12.351737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:12.352703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:12.688074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:12.718768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e963e6c-a029-4b61-a6bc-85e8e47acc59 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.415721 Jul 25 20:07:12.732855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 496/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:12 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:12.740255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:12.741393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:12.756029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:12.756667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:12.757996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:12.759620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:12.921205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98dea2f6-cc28-40cb-a33c-dfbff8d411d4 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187011 Jul 25 20:07:12.922248 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 497/1010] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:07:12 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:13.745229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:13.745930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:13.761419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:13.761879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:13.762825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:13.763369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:13.948162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2c8bbc2-2682-425f-ba09-942c8a67dcd8 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/action" status: 202 len: 0 microversion: 2.25 time: 3.032495 Jul 25 20:07:13.950155 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 514/1011] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:07:10 2022] POST /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/action => generated 0 bytes in 3035 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:07:13.986993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:14.082399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-607322892", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "fc86a3b0-dce7-409f-8e0e-bcf88032c34a"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:14.104510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:14.187736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:14.190315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] validate_networks() for [('fc86a3b0-dce7-409f-8e0e-bcf88032c34a', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:07:14.213955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ae4b095-c99c-4d63-ab4b-3b7ed1633b1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.473151 Jul 25 20:07:14.214805 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 498/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:13 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:14.230618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:14.232504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:14.250887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:14.252076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:14.253424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:14.257526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:15.067256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:15.091386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:15.098322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:15.100517 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2c5cc5a6-98c6-44c6-8535-886c97104f67 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.884080 Jul 25 20:07:15.108761 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 499/1013] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:14 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:15.240159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:15.241187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:15.269343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:15.271001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:15.272648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:15.274981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:15.320892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:15.796092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:15.812059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8422715f-2e1a-4d45-b714-2b141404ed45 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.579038 Jul 25 20:07:15.820617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 500/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:15 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:15.977381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-53ebe002-1030-491e-b645-5eac57fafdeb req-45fab6fb-8872-4ab2-8f8e-07982304f18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311ddd9b-db98-4b21-a06c-a24f8b4ff6e5", "tag": "cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:15.994299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-53ebe002-1030-491e-b645-5eac57fafdeb req-45fab6fb-8872-4ab2-8f8e-07982304f18e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:15.998597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-53ebe002-1030-491e-b645-5eac57fafdeb req-45fab6fb-8872-4ab2-8f8e-07982304f18e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.038424 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-53ebe002-1030-491e-b645-5eac57fafdeb req-45fab6fb-8872-4ab2-8f8e-07982304f18e service nova] Creating event network-changed:cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9 for instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 on n-h2-845775-3 Jul 25 20:07:16.054279 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-53ebe002-1030-491e-b645-5eac57fafdeb req-45fab6fb-8872-4ab2-8f8e-07982304f18e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080806 Jul 25 20:07:16.055614 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 501/1015] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:16.134085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:16.136772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:16.156562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.163817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:07:16.164880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:07:16.165403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.165861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:07:16.166442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:07:16.167015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:07:16.167314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.167997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.183878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.184949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.185776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.192571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.247238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:07:16.261437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for user a5e02ce4bb4645e2a92ba0a5eed8ba0d and project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:07:16.293006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:07:16.298921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:07:16.382889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:16.451808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c3020ce-a918-468e-b6ee-1fb9d7fb4921 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499564 Jul 25 20:07:16.456293 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 515/1016] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:07:16.475267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c6f29085-b339-4844-bd84-d690c9d4ef7e req-4bd6c3b0-98e9-4983-b5d7-daf574233f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:16.512748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c6f29085-b339-4844-bd84-d690c9d4ef7e req-4bd6c3b0-98e9-4983-b5d7-daf574233f80 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.513633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c6f29085-b339-4844-bd84-d690c9d4ef7e req-4bd6c3b0-98e9-4983-b5d7-daf574233f80 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.548723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c6f29085-b339-4844-bd84-d690c9d4ef7e req-4bd6c3b0-98e9-4983-b5d7-daf574233f80 service nova] Creating event network-changed:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:07:16.558017 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c6f29085-b339-4844-bd84-d690c9d4ef7e req-4bd6c3b0-98e9-4983-b5d7-daf574233f80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100167 Jul 25 20:07:16.560380 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 516/1017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:16.572003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67d5b575-a7ba-4632-9aba-480df116d816 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:16.579387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67d5b575-a7ba-4632-9aba-480df116d816 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:16.723336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67d5b575-a7ba-4632-9aba-480df116d816 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:16.737012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67d5b575-a7ba-4632-9aba-480df116d816 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1207 microversion: 2.1 time: 0.175187 Jul 25 20:07:16.738614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 517/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:16 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1207 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:16.835619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:16.836848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:16.837007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:16.853599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:16.856187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:16.858655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.863272 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e48f048c-67aa-45ff-a565-80150ac72f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.733744 Jul 25 20:07:16.865287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 502/1019] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:16 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:16.866264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:16.870546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:16.879454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:17.407451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:17.427994 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24553326-f149-482f-baad-f8c654bce7e6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.596286 Jul 25 20:07:17.430623 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 518/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:16 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:17.763827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:17.765342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:17.787818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:17.789323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:17.790875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:17.795413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:17.909583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:17.910517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:17.929525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:17.932722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:17.935103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:17.938924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:18.107145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:18.130293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3cae2a66-8df7-4dd0-9e81-bc5ef6bf4a82 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1211 microversion: 2.1 time: 0.371582 Jul 25 20:07:18.142462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 503/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:17 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1211 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:18.458800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:18.459675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:18.488850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:18.490815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:18.499183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:18.501424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:18.793093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:18.816411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:18.824460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:18.826755 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d24dd22e-25a5-4404-9fe6-98cf163bcc8b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.925137 Jul 25 20:07:18.827945 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 519/1022] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:17 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:19.075905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:19.130299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbc921fc-bcac-4b91-a9dc-b976c529e4f7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.677453 Jul 25 20:07:19.135839 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 504/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:18 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:19.172911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:19.176820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:19.198167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:19.198167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:19.203137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:19.203812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:19.745215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:19.769221 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26b63695-d3a0-4ee8-93af-58b47f6eb2b5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1265 microversion: 2.1 time: 0.603974 Jul 25 20:07:19.774425 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 520/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:19 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1265 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:19.858863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:19.860063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:19.905107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:19.906387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:19.907614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:19.911087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:20.158054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:20.158863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:20.175994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:20.176801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:20.177988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:20.187990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:20.942674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:20.967302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:20.969416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:20.971033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-285ed781-7e05-43eb-a1dc-63874d8f6f6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 1.120218 Jul 25 20:07:20.972602 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 505/1025] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:19 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:20.983332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:20.984512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:21.005541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:21.006321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:21.009216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:21.010571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:21.042577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:21.054442 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4960ffd9-0d96-46e0-a4bd-bb25eefaca15 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.900414 Jul 25 20:07:21.055657 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 521/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:20 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:21.309328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:21.320739 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-282c5b51-adef-454a-a202-b84fe85c400b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1265 microversion: 2.1 time: 0.346043 Jul 25 20:07:21.323222 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 506/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:20 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:22.004758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:22.005643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:22.030291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.031333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:22.032517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.033161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:22.078957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:22.079925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:22.098233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.099132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:22.114848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.116186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:22.811386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:22.820572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:22.826680 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-588559c3-5168-4c6c-99bd-e9adc7c8c485 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.748620 Jul 25 20:07:22.828146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 507/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:22 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:22.843806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:22.847364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:22.848512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:22.854971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:22.863409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0379300-df4b-4e5c-b79c-849c524a76f1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.861849 Jul 25 20:07:22.864514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 522/1029] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:21 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:22.872489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.873335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:22.874377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:22.875038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:23.613949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:23.641360 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c4b03d00-380e-43e1-a7b8-ac93b7e61e2f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.811533 Jul 25 20:07:23.650294 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 508/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:22 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:23.853560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:23.855079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:23.867476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:23.868355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:23.869421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:23.870689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:23.906200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:23.907536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:23.914640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:23.926866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:23.927776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:23.928850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:23.929577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:24.489783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:24.498612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:24.507708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:24.514981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:24.516748 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc2a6681-95fd-45c8-8c25-90d2e4ad62c3 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.618114 Jul 25 20:07:24.522643 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 509/1031] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:23 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:24.531264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b2da8aa-71f6-42b7-ba75-954ed35da147 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.685226 Jul 25 20:07:24.532539 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 523/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:23 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:24.663502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:24.664163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:24.679540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:24.682926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:24.685721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:24.687263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.095971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:25.107252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e68e2d48-1387-4100-855d-ada164ff1301 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.447877 Jul 25 20:07:25.120063 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 524/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:24 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:25.150696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b559832a-e05e-4787-a3ec-59f33bc50e63 req-534b8cae-461b-457f-ac81-6bf6093ae2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311ddd9b-db98-4b21-a06c-a24f8b4ff6e5", "name": "network-vif-plugged", "status": "completed", "tag": "cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:25.167453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b559832a-e05e-4787-a3ec-59f33bc50e63 req-534b8cae-461b-457f-ac81-6bf6093ae2c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.168136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b559832a-e05e-4787-a3ec-59f33bc50e63 req-534b8cae-461b-457f-ac81-6bf6093ae2c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.180275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:25.183088 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b559832a-e05e-4787-a3ec-59f33bc50e63 req-534b8cae-461b-457f-ac81-6bf6093ae2c3 service nova] Creating event network-vif-plugged:cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9 for instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 on n-h2-845775-3 Jul 25 20:07:25.190400 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b559832a-e05e-4787-a3ec-59f33bc50e63 req-534b8cae-461b-457f-ac81-6bf6093ae2c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.666299 Jul 25 20:07:25.191616 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 510/1034] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:25.292423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e7786f5c-ad2f-4aa6-85e6-d8235a7c651f req-ce3b7c36-f4da-4f20-a178-9837d8be376b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808c68ad-c3ba-4664-96e6-c7adc355b17b", "tag": "7531a911-36c4-4442-afa7-7106f9c8927d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:25.341724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7786f5c-ad2f-4aa6-85e6-d8235a7c651f req-ce3b7c36-f4da-4f20-a178-9837d8be376b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.342340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7786f5c-ad2f-4aa6-85e6-d8235a7c651f req-ce3b7c36-f4da-4f20-a178-9837d8be376b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.390170 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e7786f5c-ad2f-4aa6-85e6-d8235a7c651f req-ce3b7c36-f4da-4f20-a178-9837d8be376b service nova] Creating event network-changed:7531a911-36c4-4442-afa7-7106f9c8927d for instance 808c68ad-c3ba-4664-96e6-c7adc355b17b on n-h1-845775-3 Jul 25 20:07:25.403948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e7786f5c-ad2f-4aa6-85e6-d8235a7c651f req-ce3b7c36-f4da-4f20-a178-9837d8be376b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116533 Jul 25 20:07:25.404943 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 525/1035] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:25.575098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:25.579043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:25.585198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:25.589333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:25.597938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.602009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.605447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.608387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.609760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.612722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:25.614623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:25.616151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:26.169048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:26.170005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:26.185469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0e0ab978-793e-49b9-8328-1c29fcfd4cb1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.631932 Jul 25 20:07:26.201462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:26.207369 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 511/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:25 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:26.223336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:26.225505 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c92a5119-eabc-467d-8076-a36f2b86a90e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.662713 Jul 25 20:07:26.227341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:26.228452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:26.236688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 526/1037] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:25 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:26.255635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:26.257168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:26.259107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:26.261266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:26.582697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e66ba30a-6496-44a1-b512-a35aac4e958d"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:26.592482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:26.601270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:26.619374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:26.622434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:26.623319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:26.623768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:26.745168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:26.772776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:26.787382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7422f66-4d07-45b4-a8e9-97f67ead14f2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.577740 Jul 25 20:07:26.788825 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 512/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:26 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:27.245534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:27.251466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:27.291386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:27.297796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:27.306530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:27.310242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:27.765768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:27.782103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81ec5937-c1fb-4f50-981e-59eda9bcd02a tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1318 microversion: 2.1 time: 0.559103 Jul 25 20:07:27.783446 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 513/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:27 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:27.790088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:27.791216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:27.813775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:27.815180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:27.817503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:27.818289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:27.856252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d396ce13-7f4b-4e9c-a0c4-f80e6bfa9bca tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "POST /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.280462 Jul 25 20:07:27.860147 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 527/1040] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:07:26 2022] POST /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 194 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.201413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f196991f5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.203570 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.203570 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:28.205943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.207022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.223685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:28.239151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:28.241004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:28.242664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bf09378-a561-4a6c-b7a9-2712cd6aff35 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.457669 Jul 25 20:07:28.244026 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 514/1041] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:27 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:28.252269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.254672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:28.256747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.257676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.262882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.263421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.264295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.265663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.307828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.308599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.319125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4425d93e-7844-4bd5-a5cd-07f8c68216da tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.456250 Jul 25 20:07:28.320434 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 528/1042] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:07:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.338554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f196991f040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.341107 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.341107 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:28.344137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.346769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.400737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.403036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.440806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.442028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.451816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-47ce44ff-c6bc-48e7-babe-a34ea13d0170 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1506 microversion: 2.1 time: 0.120177 Jul 25 20:07:28.452502 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 529/1043] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1506 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:28.472507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f196991f5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.475144 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.475144 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:28.477331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.478472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.508233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.508957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.540516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.541448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.571741 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a1108cd3-0863-41ec-a574-312371e12b73 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.103470 Jul 25 20:07:28.574317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 530/1044] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.591996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f1969a6b310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.593579 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.593579 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:28.595852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.596712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.665304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.668234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.674476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:28.688944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d60bcf5-58ca-46a2-8944-d741666630e7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.103756 Jul 25 20:07:28.691244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 531/1045] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.710735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b804649e-d7e8-4c3b-af55-cedade75c4cf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.458504 Jul 25 20:07:28.712178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 515/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:28.727750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e62ea803-ce77-4f2b-a17d-c6614127a411 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f1969d828b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.732221 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.732221 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:28.733949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e62ea803-ce77-4f2b-a17d-c6614127a411 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.734653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e62ea803-ce77-4f2b-a17d-c6614127a411 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.757750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e62ea803-ce77-4f2b-a17d-c6614127a411 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.044765 Jul 25 20:07:28.759039 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 532/1047] 10.222.0.48 () {58 vars in 1179 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.785340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f196984f310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.787201 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.787201 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:28.790675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.792007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.826713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.827996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.829374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.830286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:28.842105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.844609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.848447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.848447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.855878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.856971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.870816 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-20f1c47c-f85b-446d-91f6-fbdeaaf0ab95 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094399 Jul 25 20:07:28.872782 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 516/1048] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.891650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f19698e1dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.894539 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.894539 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:28.897546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.898739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.932597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.934899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:28.948841 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ecc78940-3dba-4f53-8607-7497d3f4c81b tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.064419 Jul 25 20:07:28.966071 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 517/1049] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:28.974146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f196984f5e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:28.975217 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:28.975217 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:28.978674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:28.979138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.014899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.015344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.042159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-566e4b8e-1df7-4a34-9660-e89c471bcfc7 tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.074483 Jul 25 20:07:29.043469 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 518/1050] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:29.057599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Calling method '.version_select at 0x7f1969a515e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:29.058628 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:29.058628 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:29.060389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.060836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.093133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.093578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.125065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.125523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.155666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c84aadf-d534-4c8c-985a-94d82ee666bc tempest-HypervisorAdminTestJSON-87834279 tempest-HypervisorAdminTestJSON-87834279-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.101462 Jul 25 20:07:29.156316 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 519/1051] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Jul 25 20:07:29 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:29.276379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:29.277593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:29.301036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.301745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.302677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.303124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.352448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:29.365875 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f35d94a-fb7c-410a-8694-acb00e041535 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1508 microversion: 2.1 time: 0.541248 Jul 25 20:07:29.367685 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 533/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:28 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:29.390171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:29.390802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:29.401803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.402259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.403095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.403539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.755704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:29.767018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:29.774663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:29.783943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:29.788323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd6fc1c7-9ff9-46c8-9016-039e1378508f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1508 microversion: 2.1 time: 0.402403 Jul 25 20:07:29.788850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0792a983-3477-4c71-bef8-c55ef040d073 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.517923 Jul 25 20:07:29.789508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 520/1053] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:29 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:29.816196 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 534/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:29 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:29.817405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:29.817405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:29.837619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.839499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.842948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.843559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:29.843975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.848021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:29.863042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.863635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:29.866889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:29.868292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.069720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:07:30.072571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:07:30.080725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:07:30.082520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:07:30.084247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:07:30.148281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:30.169798 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3472d1b-219c-49ab-9ac3-a8e22fc5f31f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.364785 Jul 25 20:07:30.174657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 521/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:29 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:30.278819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:30.311113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.312469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.315621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.318141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.429309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f68e8149-de2f-4bdf-9a86-287e5f84b867 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "POST /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5/action" status: 202 len: 1110 microversion: 2.1 time: 0.593099 Jul 25 20:07:30.451966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 535/1056] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:07:29 2022] POST /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5/action => generated 1110 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 25 20:07:30.459796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:30.464219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:30.513986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.525742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.530326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.531196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.822299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:30.823115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:30.836677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.837135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.837948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:30.838478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:30.847430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:30.864926 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68645156-11aa-4597-a161-e99c416b6657 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.410075 Jul 25 20:07:30.888571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 522/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:30 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:31.136226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:31.153451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:31.154957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:31.167042 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dbdb7d82-53d6-470a-8cfe-23bb885ab370 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.352381 Jul 25 20:07:31.167639 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 536/1058] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:30 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:31.196007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:31.197204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:31.211603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:31.212755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:31.213816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:31.214419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:31.519625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:31.548072 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ca1512d5-4a1b-44d4-ae99-b8dc55c73203 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.355755 Jul 25 20:07:31.548700 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 523/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:31 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:31.900737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:31.901870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:31.931056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:31.931965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:31.934403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:31.935482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:32.182702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:32.199141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:32.203519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:32.227766 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c51e6a69-08eb-4349-b9d6-3b9c44239001 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.332231 Jul 25 20:07:32.230579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=82 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:32.261542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 537/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:31 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:32.265561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:32.267024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:32.269530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:32.270946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:32.542444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:32.559674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:32.561941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:32.563532 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-40bbab75-cd23-49b8-8b17-c1e2563deec8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.374154 Jul 25 20:07:32.576175 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 524/1061] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:32 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:32.582759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:32.584290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:32.612851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:32.613824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:32.615355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:32.616222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:32.652256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:32.890775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:32.917951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-039519c1-802e-4f2c-8347-a26cdb6d2dac tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.349704 Jul 25 20:07:32.921078 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 538/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:32 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:33.108701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1b82a837-cd1e-44e0-9038-88f04a4ca636 req-89026fd8-7991-4305-95bb-f736b947b48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c68ad-c3ba-4664-96e6-c7adc355b17b", "name": "network-vif-plugged", "status": "completed", "tag": "7531a911-36c4-4442-afa7-7106f9c8927d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:33.119581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b82a837-cd1e-44e0-9038-88f04a4ca636 req-89026fd8-7991-4305-95bb-f736b947b48c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:33.120334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b82a837-cd1e-44e0-9038-88f04a4ca636 req-89026fd8-7991-4305-95bb-f736b947b48c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:33.134465 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1b82a837-cd1e-44e0-9038-88f04a4ca636 req-89026fd8-7991-4305-95bb-f736b947b48c service nova] Creating event network-vif-plugged:7531a911-36c4-4442-afa7-7106f9c8927d for instance 808c68ad-c3ba-4664-96e6-c7adc355b17b on n-h1-845775-3 Jul 25 20:07:33.150719 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1b82a837-cd1e-44e0-9038-88f04a4ca636 req-89026fd8-7991-4305-95bb-f736b947b48c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045895 Jul 25 20:07:33.151971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 525/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:33.272244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:33.274128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:33.283884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:33.285075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:33.286217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:33.287412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:33.596747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:33.598231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:33.623772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:33.629689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:33.634366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:33.634996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:34.408957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:34.426445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66a5dc25-1f72-4417-b8aa-2212b4235c30 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 1.158788 Jul 25 20:07:34.427260 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 539/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:33 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:34.448685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:34.449449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:34.478602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:34.479057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:34.482841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:34.483602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:34.829631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:34.849442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:34.854298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:34.857258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fda30a21-deeb-4bb9-978d-8eabe3ac7f0e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 1.268739 Jul 25 20:07:34.860270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 526/1065] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:33 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:35.035937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:35.057658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8dcdae85-fe0e-4586-b12f-9a266c55e755 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.623345 Jul 25 20:07:35.061412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 540/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:34 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:35.455617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:35.456924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:35.466780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.467693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.468706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.469313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.692265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Calling method '.version_select at 0x7f196982d820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:35.693097 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:35.693097 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:35.694757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.695212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.711877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.712396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.725106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.725584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.732941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f91330a8-32b9-4c3e-9073-037e24af11bb tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.214472 Jul 25 20:07:35.742210 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 541/1067] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:07:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:07:35.823521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:35.849637 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98e4ca96-a405-4361-9fc0-646b39c0d327 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.399229 Jul 25 20:07:35.851287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 527/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:35 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:35.892977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:35.894537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:35.938549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.940939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:35.947575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:35.949186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:36.103527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7585a944-ff78-47d2-ac54-d5a429c144ef tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Calling method '.version_select at 0x7f19698fa9d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:36.106090 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:36.106090 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:36.108244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7585a944-ff78-47d2-ac54-d5a429c144ef tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1962e0631d4b40a28b645911718e9f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00342f01f4ce494b8602d5283cb38bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7585a944-ff78-47d2-ac54-d5a429c144ef tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Request method failure captured: Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hypervisors/n-h1-845775-3/search HTTP/1.1 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vgGRQHnQSw8pQKhRnf6s5EFRyvFE9OjD2hpLFZBUAIZ2nvbsTBMaE-rwNFAik6WaBoPdIGD3g2Z_gaj6rsV-zRQ8DsVbfffSf5a1gSh58gVZHeQaGpKJ8zKdIH4y7Zs3GSbTgXxBprsqqSqbz4DE9BYA1PHhLkscgEcU38EGv0G-N0 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 00342f01f4ce494b8602d5283cb38bb1 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:07:36.111337 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00342f01f4ce494b8602d5283cb38bb1"}]}] Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 00342f01f4ce494b8602d5283cb38bb1 Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-166899712-project Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1962e0631d4b40a28b645911718e9f93 Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712-project Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 20:07:36.113034 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'n-h1-845775-3'} Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:07:36.113953 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 25 20:07:36.115913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.119343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7585a944-ff78-47d2-ac54-d5a429c144ef tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:36.119343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7585a944-ff78-47d2-ac54-d5a429c144ef tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-845775-3/search" status: 403 len: 117 microversion: 2.1 time: 0.369345 Jul 25 20:07:36.121082 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 542/1069] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Jul 25 20:07:35 2022] GET /compute/v2.1/os-hypervisors/n-h1-845775-3/search => generated 117 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:36.129695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:36.130806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:36.147808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:36.148910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:36.150642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:36.151681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:36.803039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:36.806989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:36.825401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:36.830761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:36.832168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:36.833521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b807d929-bfec-4a25-a36d-c6ffc0ab29b2 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.947846 Jul 25 20:07:36.835038 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 528/1070] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:35 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:36.843828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Calling method '.version_select at 0x7f19698c8a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:36.847968 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:36.847968 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:36.854544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:36.858166 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a76cefb-416c-48ec-bbd0-c51719f9c9ea tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1307 microversion: 2.1 time: 0.735514 Jul 25 20:07:36.858527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:36.859922 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 543/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:36 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1307 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:36.884146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Request method failure captured: Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgHz4u9y-EoM_HfABwYq7luPuqOQCTeMga8CcYnhyWZUSzWuN7drt2SfRIHBFFwU11rE-vNvW47m_rRrLqVeQCkgd7zauCYgGlO1fGWVfR3fhxw-NiVI2SqTejQeNwQm3Z98c1UZuBU2X5S-FyqpVQG7UR30A2Oo-Bzr9YhSKgrbtQ Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d9753389d282400dbf994fa898e9b08e Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:07:36.885662 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9753389d282400dbf994fa898e9b08e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9753389d282400dbf994fa898e9b08e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9753389d282400dbf994fa898e9b08e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9753389d282400dbf994fa898e9b08e"}]}] Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d9753389d282400dbf994fa898e9b08e Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7b8d37700b0d4452b168d261acea556d Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 20:07:36.888794 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:36.890470 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffadb06d-a778-4b95-ad56-7b2f344fa6e3 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.050781 Jul 25 20:07:36.900145 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 529/1072] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:07:36 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:36.903417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:36.904079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:36.923712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:36.924228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:36.925096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:36.925942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.029694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e94bfaba-c03d-4a9d-979a-8092306a3e22 req-27d54f85-1fb5-4712-9ba8-84f8e52a20cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "name": "network-vif-unplugged", "status": "completed", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:37.061165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e94bfaba-c03d-4a9d-979a-8092306a3e22 req-27d54f85-1fb5-4712-9ba8-84f8e52a20cf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.062147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e94bfaba-c03d-4a9d-979a-8092306a3e22 req-27d54f85-1fb5-4712-9ba8-84f8e52a20cf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.084347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e94bfaba-c03d-4a9d-979a-8092306a3e22 req-27d54f85-1fb5-4712-9ba8-84f8e52a20cf service nova] Creating event network-vif-unplugged:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:07:37.091293 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e94bfaba-c03d-4a9d-979a-8092306a3e22 req-27d54f85-1fb5-4712-9ba8-84f8e52a20cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.229692 Jul 25 20:07:37.096524 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 544/1073] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:37.102555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Calling method '.version_select at 0x7f19698d0940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.103800 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:37.103800 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:37.106504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.107298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.143550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.144751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.173566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.174381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.183104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-85529a91-717a-4648-a817-8c2918000e65 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.084912 Jul 25 20:07:37.184481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 545/1074] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:37.197870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3360843c-8f35-43a4-8a8a-067c82bfd74c tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Calling method '.version_select at 0x7f19698d0670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.198752 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:37.198752 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:07:37.200332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3360843c-8f35-43a4-8a8a-067c82bfd74c tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1962e0631d4b40a28b645911718e9f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00342f01f4ce494b8602d5283cb38bb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3360843c-8f35-43a4-8a8a-067c82bfd74c tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Request method failure captured: Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vgGRQHnQSw8pQKhRnf6s5EFRyvFE9OjD2hpLFZBUAIZ2nvbsTBMaE-rwNFAik6WaBoPdIGD3g2Z_gaj6rsV-zRQ8DsVbfffSf5a1gSh58gVZHeQaGpKJ8zKdIH4y7Zs3GSbTgXxBprsqqSqbz4DE9BYA1PHhLkscgEcU38EGv0G-N0 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 00342f01f4ce494b8602d5283cb38bb1 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:07:37.202205 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00342f01f4ce494b8602d5283cb38bb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00342f01f4ce494b8602d5283cb38bb1"}]}] Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 00342f01f4ce494b8602d5283cb38bb1 Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712 Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-166899712-project Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1962e0631d4b40a28b645911718e9f93 Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-166899712-project Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1'} Jul 25 20:07:37.204688 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:07:37.206726 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 25 20:07:37.209612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.213584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3360843c-8f35-43a4-8a8a-067c82bfd74c tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:37.213584 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3360843c-8f35-43a4-8a8a-067c82bfd74c tempest-HypervisorAdminNegativeUnderV252Test-166899712 tempest-HypervisorAdminNegativeUnderV252Test-166899712-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010360 Jul 25 20:07:37.213584 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 546/1075] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:07:37.219521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Calling method '.version_select at 0x7f1969e8a4c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.222728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.229030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.243649 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] HTTP exception thrown: No hypervisor matching '1746fa35-d9ad-432d-8a51-412f86071a6b' could be found. Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Request method failure captured: Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-hypervisors/1746fa35-d9ad-432d-8a51-412f86071a6b/servers HTTP/1.1 Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vgHz4u9y-EoM_HfABwYq7luPuqOQCTeMga8CcYnhyWZUSzWuN7drt2SfRIHBFFwU11rE-vNvW47m_rRrLqVeQCkgd7zauCYgGlO1fGWVfR3fhxw-NiVI2SqTejQeNwQm3Z98c1UZuBU2X5S-FyqpVQG7UR30A2Oo-Bzr9YhSKgrbtQ Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d9753389d282400dbf994fa898e9b08e Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:07:37.246305 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9753389d282400dbf994fa898e9b08e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9753389d282400dbf994fa898e9b08e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9753389d282400dbf994fa898e9b08e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9753389d282400dbf994fa898e9b08e"}]}] Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d9753389d282400dbf994fa898e9b08e Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314 Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7b8d37700b0d4452b168d261acea556d Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: exception: No hypervisor matching '1746fa35-d9ad-432d-8a51-412f86071a6b' could be found. Jul 25 20:07:37.248115 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1746fa35-d9ad-432d-8a51-412f86071a6b'} Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1746fa35-d9ad-432d-8a51-412f86071a6b' could be found. Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.249068 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1746fa35-d9ad-432d-8a51-412f86071a6b' could be found. Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:37.250532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] Returning 404 to user: No hypervisor matching '1746fa35-d9ad-432d-8a51-412f86071a6b' could be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:37.251633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41d641a5-e9ac-4940-8a47-5352275a22e7 tempest-HypervisorAdminNegativeUnderV252Test-125955314 tempest-HypervisorAdminNegativeUnderV252Test-125955314-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1746fa35-d9ad-432d-8a51-412f86071a6b/servers" status: 404 len: 123 microversion: 2.1 time: 0.038979 Jul 25 20:07:37.259430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 547/1076] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/os-hypervisors/1746fa35-d9ad-432d-8a51-412f86071a6b/servers => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:07:37.389378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:37.404444 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3044d2c5-c70b-4200-b5c5-826a5c3ffa1c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.509708 Jul 25 20:07:37.404957 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 530/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:36 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:37.865773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.868787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:37.887128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.887596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.891797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.892981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.897670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:37.903405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:37.950869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.954125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:37.963045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:37.967164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:38.715875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:38.725884 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-101a191e-825e-45af-9161-2cf827316db3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1487 microversion: 2.1 time: 0.842922 Jul 25 20:07:38.740303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:38.741784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 531/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1487 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:38.761655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:38.762339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:38.762709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:38.769713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:38.772853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:38.773950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:38.775598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:38.776368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:38.779484 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e58d1db-b31c-4868-acba-191502e8d4c6 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.917739 Jul 25 20:07:38.780917 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 548/1079] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:37 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:38.786603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:38.788831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:38.804288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:38.804982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:38.806077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:38.806579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:38.972335 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-621d2b97-dc4e-4c6b-8aa9-2fae6ce884d5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b/action" status: 202 len: 0 microversion: 2.1 time: 0.188380 Jul 25 20:07:38.975385 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 549/1080] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:07:38 2022] POST /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:38.994476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:38.996344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:39.010943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:39.012257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:39.013940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:39.016363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:39.286198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:39.323483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:39.329687 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94ea6231-9a0b-4b91-843b-7ef093f37511 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.584408 Jul 25 20:07:39.344069 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 532/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:38 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:39.344859 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c526358-434c-4bbe-bb4f-10d379bae8fb tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1492 microversion: 2.1 time: 0.350876 Jul 25 20:07:39.344859 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 550/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:38 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1492 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:39.364704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-539dfaad-44a2-433d-8b1a-891ef0855e20 req-f61c2a27-c8f3-4137-8536-153734c84e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:39.399828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-539dfaad-44a2-433d-8b1a-891ef0855e20 req-f61c2a27-c8f3-4137-8536-153734c84e90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:39.400936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-539dfaad-44a2-433d-8b1a-891ef0855e20 req-f61c2a27-c8f3-4137-8536-153734c84e90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:39.441008 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-539dfaad-44a2-433d-8b1a-891ef0855e20 req-f61c2a27-c8f3-4137-8536-153734c84e90 service nova] Creating event network-changed:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:07:39.465738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-539dfaad-44a2-433d-8b1a-891ef0855e20 req-f61c2a27-c8f3-4137-8536-153734c84e90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126861 Jul 25 20:07:39.467029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 533/1083] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:39.811751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:39.814497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:39.835433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:39.836197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:39.839471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:39.840513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:40.021317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-933408140", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "72f4ff33-8bc5-480f-b423-c54dec664490"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:40.138950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] validate_networks() for [('72f4ff33-8bc5-480f-b423-c54dec664490', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:07:40.431493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:40.448824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:40.452550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:40.455179 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34cad5bd-8cb3-4f2b-a6f5-53b7936b1408 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.652248 Jul 25 20:07:40.456657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 534/1084] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:39 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:07:40.465229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:40.466619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:40.489072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:40.491786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:40.493925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:40.495127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:40.972671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:40.997546 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ccfe592-0f85-4376-bdbb-175f38bf5633 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.537819 Jul 25 20:07:41.023009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 535/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:40 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:41.032945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:41.034249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:41.046798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.047315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.048790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.049592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.422176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:41.442567 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9a1b18f-4b82-4d5e-921b-f18c41e7789f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 200 len: 1472 microversion: 2.1 time: 0.417979 Jul 25 20:07:41.445005 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 536/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:41 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:41.458106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:07:41.460361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:07:41.460361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:07:41.462309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:07:41.464715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:07:41.488384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1789842389"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:41.488843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.489467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.491175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.491965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.498702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:41.529855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.531834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.545847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Getting quotas for project 7e4a6f8f8c9e4d3292eeff692f5d3689. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:07:41.549466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.559436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.561646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Getting quotas for user 5cdeb86807774780b9aaadfacbacf43e and project 7e4a6f8f8c9e4d3292eeff692f5d3689. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:07:41.600771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:07:41.609056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:07:41.850731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2cb56f44-33fd-41ba-962b-81f51786f801 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358500 Jul 25 20:07:41.862747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 551/1087] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:07:41.880571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:41.882264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:41.893370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.894693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:41.896336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:41.897325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:42.248963 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45a8df6f-19fb-4a58-b51e-3ba2e69b33cc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b/action" status: 202 len: 0 microversion: 2.1 time: 0.773108 Jul 25 20:07:42.254640 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 537/1088] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:07:41 2022] POST /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 20:07:42.273093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e01e4db1-c531-46fa-835a-df15070631c9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:42.275341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e01e4db1-c531-46fa-835a-df15070631c9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:42.513799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e01e4db1-c531-46fa-835a-df15070631c9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:42.527726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e01e4db1-c531-46fa-835a-df15070631c9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1215 microversion: 2.1 time: 0.271355 Jul 25 20:07:42.535254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 538/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:42 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:42.550749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:42.554038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:42.588754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:42.594604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:42.607717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:42.609825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:42.695728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:42.709960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:42.717840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:42.719687 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e840637-8d0f-4323-8351-710dea9fc49a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.855285 Jul 25 20:07:42.724302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 552/1090] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:41 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:42.743694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc08de3c-a7ee-4286-904e-44f3181d6032 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698fa670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:42.887184 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc08de3c-a7ee-4286-904e-44f3181d6032 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.144156 Jul 25 20:07:42.899752 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 553/1091] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:42 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:43.224449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:43.240073 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e659323-da08-4f64-9f53-952f3316056d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.702676 Jul 25 20:07:43.241770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 539/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:42 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:43.567824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:43.569391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:43.592267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:43.592884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:43.596255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:43.596859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:43.757653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:43.758229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:43.782883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:43.795750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:43.796263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:43.797109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:43.797572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:43.837651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92b7cf72-a0b9-4f14-a016-e0ca9f52befd tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1211 microversion: 2.1 time: 0.274552 Jul 25 20:07:43.852547 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 554/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:43 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1211 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:43.940022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-76ec3ae5-ffa5-4f1c-a85f-a053e1830424 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196991fca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:44.053272 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-76ec3ae5-ffa5-4f1c-a85f-a053e1830424 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.147265 Jul 25 20:07:44.055500 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 555/1094] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:43 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:44.272124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:44.273827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:44.299268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:44.300139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:44.322395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:44.326329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:44.327280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:44.328550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:44.329019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:44.329850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:44.337604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-366779da-7c33-4669-ae36-604add3432bb tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.584525 Jul 25 20:07:44.340387 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 540/1095] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:43 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:44.401924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ec6e3d5-d73e-4f87-bd12-3c63ace1ec4b"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:44.405901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:44.424571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:44.441291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:44.445898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:44.450958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:44.812463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:44.828802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0253ea77-04de-4589-84f2-0a8dc82f96e5 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.564705 Jul 25 20:07:44.831438 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 556/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:44 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:45.190765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae4ee84c-bfa2-4565-a40f-8b7300b3f613 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "POST /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791898 Jul 25 20:07:45.200987 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 541/1097] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:07:44 2022] POST /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:45.227512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.230305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:45.248987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:45.252070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:45.254353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:45.255727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:45.297482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:45.300238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:45.310774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:45.348151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:45.352356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:45.354623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:45.424537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:45.446493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44025fb7-34b7-47f4-a763-edc95d9be4ca tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1273 microversion: 2.1 time: 0.247008 Jul 25 20:07:45.448337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 542/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1273 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:45.457802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ce1403e-c381-43de-a760-788b18df5055 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698219d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:45.572760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ce1403e-c381-43de-a760-788b18df5055 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.122123 Jul 25 20:07:45.573010 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 543/1099] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:45 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:45.686544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1476216859", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:45.782466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:07:46.462112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:07:46.463858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:07:46.465523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:07:46.466512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:07:46.467463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:07:46.512252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:46.513568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:46.515297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:46.519759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:46.588755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:07:46.601506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:07:46.651161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:07:46.655765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:07:46.778689 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4237f96-edf5-4e05-af03-0aee101d86d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200437 Jul 25 20:07:46.780270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 544/1100] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:07:46.789823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:46.791234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:46.803252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:46.804468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:46.806039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:46.807190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:47.410189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:47.444233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:47.451643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:47.456307 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6937ebde-24a8-4321-bee3-b4a775749479 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.674189 Jul 25 20:07:47.462589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 545/1101] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:46 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:47.476596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:47.493469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:47.527098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:47.530896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:47.533822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:47.534533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.019401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:48.023949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:48.054218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71149ac6-7dd0-4989-8a71-6ac41e01e008 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.588261 Jul 25 20:07:48.073168 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 546/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:47 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:48.102008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4b685d99-8361-459d-9124-9ebbf1b1687f req-18740a24-1665-40de-b879-71dc7fb24e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "name": "network-vif-unplugged", "status": "completed", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:48.139826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4b685d99-8361-459d-9124-9ebbf1b1687f req-18740a24-1665-40de-b879-71dc7fb24e09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:48.141528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4b685d99-8361-459d-9124-9ebbf1b1687f req-18740a24-1665-40de-b879-71dc7fb24e09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.202591 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4b685d99-8361-459d-9124-9ebbf1b1687f req-18740a24-1665-40de-b879-71dc7fb24e09 service nova] Creating event network-vif-unplugged:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h2-845775-3 Jul 25 20:07:48.218613 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4b685d99-8361-459d-9124-9ebbf1b1687f req-18740a24-1665-40de-b879-71dc7fb24e09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142437 Jul 25 20:07:48.221105 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 547/1103] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:48.235303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:48.237570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:48.252740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:48.254092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.255957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:48.257082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.638864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:48.660460 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-edf5610f-878e-4fc2-b57e-3ba9e54c1ea3 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.437254 Jul 25 20:07:48.669809 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 548/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:48 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:48.687662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f1f2356-8994-4eb7-89a5-80a3644c07bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697d6c10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:48.830561 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f1f2356-8994-4eb7-89a5-80a3644c07bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.156373 Jul 25 20:07:48.832770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 549/1105] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:48 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:48.843645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:48.846357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:48.858591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:48.877903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.888167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:48.893614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:48.928376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] HTTP exception thrown: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Request method failure captured: Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments/e66ba30a-6496-44a1-b512-a35aac4e958d HTTP/1.1 Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 74 Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vey9mCauCTrvhB9grgIGz1ryRrCCtrHA7VkHLsZ-iJEPhhHvlQeiXlkVPw9nPySzxnnFUckrY66sGiTG1CLlMma2foqytJSqV5jK4r4OopHej6RLU8gMUxY1kLHh64NMLkIOioxBHsoS1k3QOm87oEmTHAGVoaQLpir9NMPYbjNnII Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: fc8c7bafd69b4d9d9d23430eb905b8fe Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:07:48.974590 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}] Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: fc8c7bafd69b4d9d9d23430eb905b8fe Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesAdminNegativeTest-407779021-project-admin Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 0f36e898142c417a87359c66cc6734c7 Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesAdminNegativeTest-407779021-project-admin Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: {"volumeAttachment": {"volumeId": "ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc"}} Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:07:48.976413 n-d-845775-3 devstack@n-api.service[119724]: exception: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': 'd6390f85-ea47-471e-b3ba-eb2f11646e27', 'id': 'e66ba30a-6496-44a1-b512-a35aac4e958d', 'body': {'volumeAttachment': {'volumeId': 'ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc'}}} Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:48.977499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. (HTTP 404) (Request-ID: req-b5ab3f97-796d-4c52-831c-fe51b6a920a7) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:07:48.979004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:07:48.980629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. Jul 25 20:07:48.982258 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:07:48.984402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Returning 400 to user: Volume ae22a9a2-fc40-4dc8-9df9-7c62a1b9a8cc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:07:48.984402 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1275ac3-5b43-4ee7-9879-343a0e7819a7 tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments/e66ba30a-6496-44a1-b512-a35aac4e958d" status: 400 len: 107 microversion: 2.1 time: 4.144052 Jul 25 20:07:48.984402 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 557/1106] 10.222.0.48 () {60 vars in 1433 bytes} [Mon Jul 25 20:07:44 2022] PUT /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments/e66ba30a-6496-44a1-b512-a35aac4e958d => generated 107 bytes in 4146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:07:49.007966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1782f877-ddfd-4fa8-b185-3fc0e1984f16 req-14e476b1-2707-41d5-897f-f7693a1a8c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4ed05e-edb6-4304-8706-13a53bf30ec6", "tag": "50ebf8f8-08b2-4892-b535-82bd753cfe71"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:49.050529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1782f877-ddfd-4fa8-b185-3fc0e1984f16 req-14e476b1-2707-41d5-897f-f7693a1a8c99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.050972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1782f877-ddfd-4fa8-b185-3fc0e1984f16 req-14e476b1-2707-41d5-897f-f7693a1a8c99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.073840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1782f877-ddfd-4fa8-b185-3fc0e1984f16 req-14e476b1-2707-41d5-897f-f7693a1a8c99 service nova] Creating event network-changed:50ebf8f8-08b2-4892-b535-82bd753cfe71 for instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 on n-h2-845775-3 Jul 25 20:07:49.084740 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1782f877-ddfd-4fa8-b185-3fc0e1984f16 req-14e476b1-2707-41d5-897f-f7693a1a8c99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103872 Jul 25 20:07:49.089129 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 558/1107] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:49.108994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:49.110608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:49.142136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.145371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.147075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.149997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.177894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:49.204411 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d4b1ed01-532f-4884-a467-90dde86003dd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1213 microversion: 2.1 time: 0.360037 Jul 25 20:07:49.209259 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:48 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1213 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:49.232659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:49.237769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:49.276752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.284212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.289359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.294135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.633017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:49.649597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:49.653960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:49.662733 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58f930a9-1859-4b03-95f0-378dd3cfee9e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.569919 Jul 25 20:07:49.664170 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 559/1109] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:49 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:49.687453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:49.695886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:49.726788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.727626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.729125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.733097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.854145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:49.870800 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ce7fec3-a64e-4d7a-85b5-8fff65a56649 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.658211 Jul 25 20:07:49.871986 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 551/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:49 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:49.888434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:49.889066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:49.903478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.904304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:49.905331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:49.906057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:50.102519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lazy-loading 'services' on Instance uuid d6390f85-ea47-471e-b3ba-eb2f11646e27 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:07:50.259097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:50.435323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-483b5d52-ba56-42f2-882c-12bf700d2726 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments/e66ba30a-6496-44a1-b512-a35aac4e958d" status: 202 len: 0 microversion: 2.1 time: 0.768532 Jul 25 20:07:50.436638 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 560/1111] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:07:49 2022] DELETE /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments/e66ba30a-6496-44a1-b512-a35aac4e958d => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:07:50.443942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2cc452f-ac67-4ee1-8f61-cfbb08b5f992 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196983ab80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:50.532405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2cc452f-ac67-4ee1-8f61-cfbb08b5f992 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.093484 Jul 25 20:07:50.534507 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 561/1112] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:50 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:50.555334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:50.556258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:50.568610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:50.569354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:50.571021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:50.572589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:50.900885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:50.929708 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc191c7a-c8c2-4970-a437-fb277e202943 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 1.056201 Jul 25 20:07:50.930982 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 552/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:49 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:50.942340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ee478028-86b2-4bcf-9b56-4ed3f5c8ab34 req-e6d7dd91-6951-47f5-8efa-383986ac6f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c68ad-c3ba-4664-96e6-c7adc355b17b", "name": "network-vif-plugged", "status": "completed", "tag": "7531a911-36c4-4442-afa7-7106f9c8927d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:50.978364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ee478028-86b2-4bcf-9b56-4ed3f5c8ab34 req-e6d7dd91-6951-47f5-8efa-383986ac6f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:50.981865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ee478028-86b2-4bcf-9b56-4ed3f5c8ab34 req-e6d7dd91-6951-47f5-8efa-383986ac6f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:50.994453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:51.009377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a701d59e-c4ed-469c-8a51-eeda5f382dec tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1275 microversion: 2.1 time: 0.460340 Jul 25 20:07:51.029992 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 562/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:50 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1275 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:51.042549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:51.047224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:51.050294 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ee478028-86b2-4bcf-9b56-4ed3f5c8ab34 req-e6d7dd91-6951-47f5-8efa-383986ac6f5c service nova] Creating event network-vif-plugged:7531a911-36c4-4442-afa7-7106f9c8927d for instance 808c68ad-c3ba-4664-96e6-c7adc355b17b on n-h1-845775-3 Jul 25 20:07:51.060834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.061807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.063207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.064161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.076649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ee478028-86b2-4bcf-9b56-4ed3f5c8ab34 req-e6d7dd91-6951-47f5-8efa-383986ac6f5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143508 Jul 25 20:07:51.083985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 553/1115] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:51.108066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:51.108805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:51.118654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.119467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.126478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3dbfbfa-16d9-4c01-9f85-1ef15a932170 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094487 Jul 25 20:07:51.127432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.127852 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 563/1116] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:51.128275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.137523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:51.139327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:51.157862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.161513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.162528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:51.163068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:51.515419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:51.575316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:51.640668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:51.662229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2300934-c0f1-4f01-b9cb-bf24fa3d6af9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.529376 Jul 25 20:07:51.676863 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 564/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:51.694518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01422e63-db0b-42d2-bd60-eedea7fe3492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698d0af0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:51.729847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:51.745298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:51.749237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:51.750985 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf1222b3-0dcb-4c56-83b3-bda430b2daf4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.663928 Jul 25 20:07:51.752197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 554/1118] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:51.818478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-01422e63-db0b-42d2-bd60-eedea7fe3492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.139888 Jul 25 20:07:51.822779 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 565/1119] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:51.959872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:51.963414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:51.998306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.000273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.001182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.001648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.013729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.017687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:52.063093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.066460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.069897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.074395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.351444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:52.373137 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae2e4060-8644-4d4d-af0f-ff48c0a9bc34 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.419401 Jul 25 20:07:52.375229 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 555/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:52.390118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.392857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:52.418748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.419365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.422409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.423978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.620900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:52.634697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-70bac5a4-934b-4ddf-ab04-6f1788bd8c9e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1275 microversion: 2.1 time: 0.256296 Jul 25 20:07:52.649992 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 556/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:52.663224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.666449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:52.677154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.678994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.681388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.684639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.735781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8ec93d7-ac02-4202-a922-e06b6bfeb079 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1813 microversion: 2.1 time: 0.734578 Jul 25 20:07:52.736625 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 566/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:51 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1813 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:52.762506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.763990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:52.771649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1422c4f9-347a-42c5-a1b3-970f3681cbc7 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119499 Jul 25 20:07:52.773268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 557/1123] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:52.782639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.785504 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:07:52.785504 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:07:52.786902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.787374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.788868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.789453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.791923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.800466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.802075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.816647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.835666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bb591df-4168-4930-a606-a19a78d6d0fd tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060078 Jul 25 20:07:52.837876 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 558/1124] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:52.850492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:52.851086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:52.863442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.863650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:52.864544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:52.865658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:53.397641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:53.413090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:53.426043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:53.426746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:53.436458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ceacb27-e850-444f-a4dd-15186b0abd38 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.587587 Jul 25 20:07:53.452086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 559/1125] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:53.464523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32442386-bf78-4680-8811-2c53f239fa63 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969844c10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.470908 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6529fff-37f2-4e83-b653-20b5c517e798 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.713201 Jul 25 20:07:53.473712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 567/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:52 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:53.485245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.490630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:53.510517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:53.511201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:53.517766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:53.518420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:53.622578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32442386-bf78-4680-8811-2c53f239fa63 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.180788 Jul 25 20:07:53.623196 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 560/1127] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:53 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:53.666329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:53.666956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:53.681859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:53.682300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:53.683122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:53.684477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.228980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:54.238730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-419a4214-96d6-43b5-beb9-e226c601b421 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.762710 Jul 25 20:07:54.243504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 568/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:53 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:54.251230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.263348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:54.282853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.286659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:54.287680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.291052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.294363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.304734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-24fe8558-e3d3-43ea-8337-bf55bc32b5ef tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.642725 Jul 25 20:07:54.308886 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 561/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:53 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:07:54.366539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b4de8cb-181e-401e-8990-4e41ba973bb5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121469 Jul 25 20:07:54.371694 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 569/1130] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:54 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:54.478074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.478771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:54.495133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:54.496413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:54.503516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.507525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.510357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.518624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.528119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.528768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:54.529632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:54.530074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.149902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:55.168794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:55.176334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:55.187597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:55.193519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05700b64-c0aa-465f-bbba-41efdb80cf1d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1813 microversion: 2.25 time: 0.720472 Jul 25 20:07:55.197092 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 562/1131] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:54 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1813 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:55.199698 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc78e2a0-e8b1-4cac-8c0d-ea222b94ef33 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.709662 Jul 25 20:07:55.224462 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 570/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:54 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:55.227271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e80d95f6-5e78-4875-bfc2-e349db9de81b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969844ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:55.269395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:55.270698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:55.304753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.305248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.312635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.314627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.334266 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e80d95f6-5e78-4875-bfc2-e349db9de81b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.129506 Jul 25 20:07:55.336088 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 563/1133] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:55 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:55.341921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:55.343616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:55.353804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.354739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.356511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.357356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.889756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:55.904817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8a9d1db9-cca9-458e-b8dd-03f6a7d49db4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.566884 Jul 25 20:07:55.912478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 564/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:55 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:55.920623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:55.934738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:55.960859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.961425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.962673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:55.965353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:55.973881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:56.002825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5126c62-4337-4c7f-b2cd-296df940fb84 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.741848 Jul 25 20:07:56.028046 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 571/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:55 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:56.048494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6ef0623b-9682-4d65-9298-703cb2e47fc5 req-d73d3b2d-06cb-404a-85c3-8e791d1d824b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7621d37-160c-4885-8f49-abe92624f69a", "tag": "3f8c6ea8-c0dd-4216-85ce-f51302d56122"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:56.093851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6ef0623b-9682-4d65-9298-703cb2e47fc5 req-d73d3b2d-06cb-404a-85c3-8e791d1d824b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:56.094462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6ef0623b-9682-4d65-9298-703cb2e47fc5 req-d73d3b2d-06cb-404a-85c3-8e791d1d824b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:56.142322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6ef0623b-9682-4d65-9298-703cb2e47fc5 req-d73d3b2d-06cb-404a-85c3-8e791d1d824b service nova] Creating event network-changed:3f8c6ea8-c0dd-4216-85ce-f51302d56122 for instance d7621d37-160c-4885-8f49-abe92624f69a on n-h1-845775-3 Jul 25 20:07:56.147889 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b623d4d3-aaeb-423d-8846-f4fcef6d3e6a tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233024 Jul 25 20:07:56.167603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 565/1136] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:55 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:56.171873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6ef0623b-9682-4d65-9298-703cb2e47fc5 req-d73d3b2d-06cb-404a-85c3-8e791d1d824b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142052 Jul 25 20:07:56.177690 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 572/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:56.238998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:56.239928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:56.244256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:56.247349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:56.282739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:56.284820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:56.287903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:56.288684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:56.289527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:56.295300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:56.298295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:56.305160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:56.643731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:56.815946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:56.848364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87b8a008-6082-4f5d-a12e-e3e9a4cc1990 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.620742 Jul 25 20:07:56.851521 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 566/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:56 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:56.890102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a69d972-7c9d-45ba-b001-139ff0cdb808 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697d6ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:56.949777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:56.971202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:56.974924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:56.998518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-196ebd18-15d5-4c30-afc0-9783349384e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1803 microversion: 2.25 time: 0.765422 Jul 25 20:07:57.013050 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 573/1139] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:56 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1803 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:57.025776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a69d972-7c9d-45ba-b001-139ff0cdb808 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.168557 Jul 25 20:07:57.029081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.029794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.036466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 567/1140] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:56 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:57.051513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.051972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.053087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.053539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.065059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f8d2116-6707-4485-95a6-d6531afd66c6 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '.version_select at 0x7f19697d6e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.088751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f8d2116-6707-4485-95a6-d6531afd66c6 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.100563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f8d2116-6707-4485-95a6-d6531afd66c6 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.147998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f8d2116-6707-4485-95a6-d6531afd66c6 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.110363 Jul 25 20:07:57.154495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 568/1141] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:57.166082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.170538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.197723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.212535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.214294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.217867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.324802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:57.372042 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5d49296-c15a-4f24-821e-44ddd251e7af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.356348 Jul 25 20:07:57.372541 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 574/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:57.394358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-969c8229-a480-4c59-b8f7-96b1a76b78d1 req-bb5c98a1-c07b-4d3e-accb-5e0a36702836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4ed05e-edb6-4304-8706-13a53bf30ec6", "name": "network-vif-plugged", "status": "completed", "tag": "50ebf8f8-08b2-4892-b535-82bd753cfe71"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:07:57.439952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-969c8229-a480-4c59-b8f7-96b1a76b78d1 req-bb5c98a1-c07b-4d3e-accb-5e0a36702836 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.440669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-969c8229-a480-4c59-b8f7-96b1a76b78d1 req-bb5c98a1-c07b-4d3e-accb-5e0a36702836 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.460758 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-969c8229-a480-4c59-b8f7-96b1a76b78d1 req-bb5c98a1-c07b-4d3e-accb-5e0a36702836 service nova] Creating event network-vif-plugged:50ebf8f8-08b2-4892-b535-82bd753cfe71 for instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 on n-h2-845775-3 Jul 25 20:07:57.469429 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-969c8229-a480-4c59-b8f7-96b1a76b78d1 req-bb5c98a1-c07b-4d3e-accb-5e0a36702836 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095171 Jul 25 20:07:57.475278 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 575/1143] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:57.488514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.492396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.502283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.502852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.503959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.504583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.552863 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7257031-f2cf-4a21-90e3-d4c9a85c09e6 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075388 Jul 25 20:07:57.554352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 576/1144] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:57.562291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:57.565544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.566547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.574316 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da8dc11f-905b-44f4-94ee-6b0a9bdc3b48 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.417444 Jul 25 20:07:57.578062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.578739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.580296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.581001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.587799 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 569/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:57.826388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:07:57.848575 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd718b18-75f4-410a-86e8-dcada20667ed tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 2421 microversion: 2.25 time: 0.292038 Jul 25 20:07:57.850391 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 577/1146] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 2421 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:57.878634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.880314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.890387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:57.891865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:57.900660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.903102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.904788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.906791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.909247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.910213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.911383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:57.912215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:57.916225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:58.308870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:58.321207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:07:58.327607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c1d52a5f-0981-4a86-97cb-ba7e712df0a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.456832 Jul 25 20:07:58.342323 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 570/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:58.353190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eab09238-a9d2-4890-bef5-3cef61aa6bcf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697d6550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:58.376007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb112c56-2218-4593-b037-6d779e95a552 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 2421 microversion: 2.25 time: 0.498913 Jul 25 20:07:58.378432 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 578/1148] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:07:57 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 2421 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:07:58.415178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:58.421399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:58.454832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.456679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.460967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.461868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.501033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eab09238-a9d2-4890-bef5-3cef61aa6bcf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.157013 Jul 25 20:07:58.502110 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 571/1149] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:58 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:58.579848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:58.584745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:58.594451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.595262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.597184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.599655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.661825 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aa04f3d4-6c08-4a14-9766-e5ad0b6cd034 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094755 Jul 25 20:07:58.680425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 572/1150] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:58 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:58.687921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:58.688817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:58.711563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:58.713597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.714314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.715677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:58.716757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:58.888382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:58.891933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:07:58.916412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c111231f-b27d-4935-8c22-11c906f5126c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.499833 Jul 25 20:07:58.918721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 579/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:58 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:59.031994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:59.044494 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-138ffc4a-f377-4d5c-9b83-0672b23f24a9 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1315 microversion: 2.1 time: 0.358388 Jul 25 20:07:59.062904 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 573/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:58 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:59.358198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:59.372228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:59.388491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.389268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:59.390401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.391091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:59.517450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bbc0c1b7-44ad-4e1e-9bd7-c8340f616e85 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697d6ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:59.639329 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bbc0c1b7-44ad-4e1e-9bd7-c8340f616e85 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.125698 Jul 25 20:07:59.685225 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 574/1153] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:07:59 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:59.697240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:07:59.712604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d05cdc69-fb2c-4b89-bf4a-e2f575b2577f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.362608 Jul 25 20:07:59.715889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:59.724177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:59.728983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 580/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:59 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:07:59.745437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.745962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:59.747363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.748430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:59.814095 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f30203ca-c5db-40a8-b44d-aa4eb08a8001 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118741 Jul 25 20:07:59.815422 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 575/1155] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:07:59 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:07:59.939197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:07:59.940436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:07:59.951925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.953172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:07:59.954834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:07:59.955784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.094351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.095202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.106349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.106349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.106940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.107954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.306816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:00.319983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7a40a9d-a405-4d48-af0a-980560a9b031 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.384388 Jul 25 20:08:00.321898 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 581/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:07:59 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:00.407252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:00.418791 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be28db93-cac6-4a0b-b1b8-cad9eb02a1ad tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1503 microversion: 2.1 time: 0.340845 Jul 25 20:08:00.420327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 576/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:00 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1503 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:00.445884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.447497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.455179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.455927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.457572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.458274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.571549 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e663c87a-d463-40a2-87ff-1d4686d939a1 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.128823 Jul 25 20:08:00.573515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 582/1158] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Jul 25 20:08:00 2022] DELETE /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6/os-server-password => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:00.594106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.595291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.604068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.605261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.606750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.607379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.662123 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2b03d215-c549-47e7-817b-0abc3516e7d8 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.072353 Jul 25 20:08:00.663979 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 577/1159] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Jul 25 20:08:00 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6/os-server-password => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:08:00.669337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a40c2c93-f063-46ba-861b-ba5f16491f10 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698973a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.679848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.680548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.690767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.691507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.692530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.693114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.725296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:00.770059 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a40c2c93-f063-46ba-861b-ba5f16491f10 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.107729 Jul 25 20:08:00.771329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 583/1160] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:00 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:00.781179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.784618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.796578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.797706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.799337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.800405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.919560 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63a476a0-777a-4f49-93f4-6d407e998544 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 204 len: 0 microversion: 2.1 time: 0.243243 Jul 25 20:08:00.923360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 578/1161] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:00 2022] DELETE /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:00.934645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:00.939540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:00.952539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.953747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:00.955384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:00.956486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.026852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d35e3696-d324-48ef-a585-9d660a97342c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101038 Jul 25 20:08:01.028674 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 579/1162] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:00 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:01.038728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:01.039501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:01.050105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.054286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.056508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.059949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.087066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:01.104538 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-969dfeab-5476-432b-85e2-c40c016c4d5f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.331451 Jul 25 20:08:01.113056 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 584/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:00 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:01.343592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:01.356202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:01.356832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:01.367097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0796c661-920c-4a01-b6a0-6495aad44856 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1509 microversion: 2.1 time: 0.337132 Jul 25 20:08:01.367734 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 580/1164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:01 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:01.367890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.368670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.369596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:01.370048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:01.576327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:01.586256 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac898e1c-6656-4ebd-9ed7-3c8cc977e869 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.233787 Jul 25 20:08:01.596123 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 585/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:01 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:01.796495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-770ead95-2c36-400d-ae6d-b1fe87a8694c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698c8940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:01.876540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-770ead95-2c36-400d-ae6d-b1fe87a8694c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.087164 Jul 25 20:08:01.877408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 581/1166] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:01 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:02.045040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:02.051206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:02.068137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.068137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.071713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.071713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.127451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e858ee66-610d-4557-8c9b-32c056969fbd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087185 Jul 25 20:08:02.135017 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 586/1167] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:02 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:02.146306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:02.147220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:02.181163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.181728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.182810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.183610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.399089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:02.403782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:02.440510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.441361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.442666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.447022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.614134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:02.630608 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42b1cfcd-3109-4d0b-8307-608e5aa85168 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.491926 Jul 25 20:08:02.646288 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 582/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:02 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:02.657794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:02.658729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:02.696579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.697147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.698331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:02.699578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:02.798587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:03.023493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:03.049647 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-949368a2-27b5-4c5e-bb99-fab32b8fc890 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1509 microversion: 2.1 time: 0.658271 Jul 25 20:08:03.067607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 587/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:02 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1509 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:03.094714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-670eff8c-a2d5-4544-8fad-ff5701f29754 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196973bd30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:03.168585 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-670eff8c-a2d5-4544-8fad-ff5701f29754 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.111566 Jul 25 20:08:03.170388 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 588/1170] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:03 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:03.190332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:03.195668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:03.206543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.207748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.209013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.210231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.259764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53804799-362d-47c1-b582-3e45bd974224 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075914 Jul 25 20:08:03.270687 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 589/1171] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:03 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:08:03.344195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:03.383701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23495778-9a67-4ed7-9769-36854d464a95 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.735161 Jul 25 20:08:03.384515 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 583/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:02 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:03.659279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:03.659941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:03.690960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.692867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.693737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.694183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.790886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-046325e8-3cca-4016-9e45-1ed4a3ff5897 req-03fc68c9-bec0-4b40-87fa-c683037d6442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7621d37-160c-4885-8f49-abe92624f69a", "name": "network-vif-plugged", "status": "completed", "tag": "3f8c6ea8-c0dd-4216-85ce-f51302d56122"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:03.823680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-046325e8-3cca-4016-9e45-1ed4a3ff5897 req-03fc68c9-bec0-4b40-87fa-c683037d6442 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.828984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-046325e8-3cca-4016-9e45-1ed4a3ff5897 req-03fc68c9-bec0-4b40-87fa-c683037d6442 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.867342 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-046325e8-3cca-4016-9e45-1ed4a3ff5897 req-03fc68c9-bec0-4b40-87fa-c683037d6442 service nova] Creating event network-vif-plugged:3f8c6ea8-c0dd-4216-85ce-f51302d56122 for instance d7621d37-160c-4885-8f49-abe92624f69a on n-h1-845775-3 Jul 25 20:08:03.889531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-046325e8-3cca-4016-9e45-1ed4a3ff5897 req-03fc68c9-bec0-4b40-87fa-c683037d6442 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102462 Jul 25 20:08:03.890956 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 584/1173] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:03.904660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:03.905584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:03.922251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.923005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:03.923969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:03.926859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.249711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lazy-loading 'services' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:04.343212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:04.357054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d4498b89-94f5-4644-8b1a-2288bd5115a0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.703556 Jul 25 20:08:04.366809 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 590/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:03 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:04.394440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:04.402704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:04.424873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:04.425197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.426296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:04.426834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.564120 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6cdb4243-36e6-4240-8a4f-a9d6d1016d05 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments/d4da9f33-4e75-4e68-9f90-15cc129a45b8" status: 202 len: 0 microversion: 2.25 time: 0.668659 Jul 25 20:08:04.565213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 585/1175] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Jul 25 20:08:03 2022] DELETE /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments/d4da9f33-4e75-4e68-9f90-15cc129a45b8 => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:04.592893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12635d3f-7196-458d-b85b-31e700834323 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698dfee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:04.699788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cdeb86807774780b9aaadfacbacf43e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4a6f8f8c9e4d3292eeff692f5d3689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:04.702365 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12635d3f-7196-458d-b85b-31e700834323 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.135479 Jul 25 20:08:04.702961 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 586/1176] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:04 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:04.716959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:04.725142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:04.727464 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2c13db1-620f-4f6a-88d4-176df4efa1e0 tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 200 len: 1467 microversion: 2.1 time: 0.357436 Jul 25 20:08:04.728908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 591/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:04 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 1467 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:04.743170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-981178012", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b88c6120-1420-4049-8355-169945b30a10"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:04.789933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:04.790578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.797099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:04.797731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:04.883719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] validate_networks() for [('b88c6120-1420-4049-8355-169945b30a10', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:05.203339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:05.221542 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2aa1dbaa-1abd-4500-b184-91888ee4e1b1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1317 microversion: 2.1 time: 0.517493 Jul 25 20:08:05.241079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 587/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:04 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:05.251864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:05.256324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:05.286488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.299232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.300619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.301232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.389821 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07d8af83-f4a1-48ea-bb8a-15fa35e16373 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147461 Jul 25 20:08:05.391984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 588/1179] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:05 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:05.399729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3bd94d1f-a512-4562-a388-06523f8f7c2d req-2de8dc14-b09c-45e6-ba57-edb67901c758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4ed05e-edb6-4304-8706-13a53bf30ec6", "name": "network-vif-deleted", "tag": "50ebf8f8-08b2-4892-b535-82bd753cfe71"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:05.411646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3bd94d1f-a512-4562-a388-06523f8f7c2d req-2de8dc14-b09c-45e6-ba57-edb67901c758 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.412461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3bd94d1f-a512-4562-a388-06523f8f7c2d req-2de8dc14-b09c-45e6-ba57-edb67901c758 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.433470 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3bd94d1f-a512-4562-a388-06523f8f7c2d req-2de8dc14-b09c-45e6-ba57-edb67901c758 service nova] Creating event network-vif-deleted:50ebf8f8-08b2-4892-b535-82bd753cfe71 for instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 on n-h2-845775-3 Jul 25 20:08:05.447521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3bd94d1f-a512-4562-a388-06523f8f7c2d req-2de8dc14-b09c-45e6-ba57-edb67901c758 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052972 Jul 25 20:08:05.449783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 589/1180] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:05.456274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:05.457551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:05.471943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.472700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.475373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:05.476005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:05.501840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:06.115417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:06.145302 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3f5beb7-ef77-410e-842d-f1836fca735c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.688848 Jul 25 20:08:06.146794 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 590/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:05 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:06.168626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:06.169733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:06.170443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:06.171072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:06.171554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:06.173053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05b60130-b55e-4085-8582-5abc6f33fc9b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969e05f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.186526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.187336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.188396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.189151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.212567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:06.231056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Getting quotas for user 87596ed917d44ee68e1c99fdfb615691 and project 00a02caecccc4d029158f69fde1e1ea3. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:06.250860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:06.253594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:06.317531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e0bfaed-e86d-4bd8-9b77-d4c4ca24aad4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584290 Jul 25 20:08:06.319714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 592/1182] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:06.327169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.327992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] [instance: ea4ed05e-edb6-4304-8706-13a53bf30ec6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.342030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.342536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.343358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.343993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.362691 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] HTTP exception thrown: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Request method failure captured: Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 HTTP/1.1 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vgLypCBPzYy7npdu87dN8PD2zjz4wJVc-DN3ku_XDFMcMLDk2tZytgFJ4XTzUA6YAbq7EkD-N3fsGL5_OBYgW8qEhoaaMc1UeGW_es7NZMdPB10W0Qw9QRsJxDDboknTU9nW1ZVH4fpX3FOka1qnmqT9ogIil85nMWJkllc9kDwrUE Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7e4a6f8f8c9e4d3292eeff692f5d3689 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerPasswordTestJSON-862975178 Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:08:06.364970 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7e4a6f8f8c9e4d3292eeff692f5d3689"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7e4a6f8f8c9e4d3292eeff692f5d3689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7e4a6f8f8c9e4d3292eeff692f5d3689"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7e4a6f8f8c9e4d3292eeff692f5d3689"}]}] Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerPasswordTestJSON-862975178 Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7e4a6f8f8c9e4d3292eeff692f5d3689 Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerPasswordTestJSON-862975178 Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerPasswordTestJSON-862975178-project Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5cdeb86807774780b9aaadfacbacf43e Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerPasswordTestJSON-862975178-project Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. Jul 25 20:08:06.367299 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'ea4ed05e-edb6-4304-8706-13a53bf30ec6'} Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:06.369449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. Jul 25 20:08:06.373858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:06.379705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] Returning 404 to user: Instance ea4ed05e-edb6-4304-8706-13a53bf30ec6 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:06.379705 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-db4c7850-d8a7-4c87-b7bb-79fed032322e tempest-ServerPasswordTestJSON-862975178 tempest-ServerPasswordTestJSON-862975178-project] 10.222.0.48 "GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6" status: 404 len: 111 microversion: 2.1 time: 0.044962 Jul 25 20:08:06.383396 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05b60130-b55e-4085-8582-5abc6f33fc9b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.217045 Jul 25 20:08:06.385812 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/ea4ed05e-edb6-4304-8706-13a53bf30ec6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:06.386860 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 591/1184] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:06.394760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4386b80d-a7b3-4722-8084-c310b2940d58 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.395387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4386b80d-a7b3-4722-8084-c310b2940d58 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.396103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.400856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.418044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.418751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.423387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.424059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.661956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4386b80d-a7b3-4722-8084-c310b2940d58 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:06.679754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4386b80d-a7b3-4722-8084-c310b2940d58 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1217 microversion: 2.1 time: 0.287979 Jul 25 20:08:06.696141 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 592/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:06.718128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:06.737245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.771481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.772392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.775989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.779416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.869975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-817f4c2e-73e1-4010-9aa0-98c87661ed1f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.171879 Jul 25 20:08:06.876263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 593/1186] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:06.881809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f3d9709-181f-4c51-a986-2cf4e61cdc72", "device": "/dev/xvdb"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:06.887029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:06.895110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:06.907214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.908066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.909275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:06.909982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:06.929955 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a6a764b-8cb4-442c-b3c4-d75f727f20ed tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1467 microversion: 2.1 time: 0.542027 Jul 25 20:08:06.948428 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1467 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:07.068026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:07.068902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:07.079087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.092503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.094565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.099444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.348757 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f940eaee-21e9-4938-8751-eee8307992ce tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473999 Jul 25 20:08:07.350505 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 594/1188] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:08:06 2022] POST /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:07.386166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:07.393109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:07.410881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.415267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.417539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:07.422051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:07.885259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec0ef34a-865f-4334-80ee-35466c62a950 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1618 microversion: 2.1 time: 0.931729 Jul 25 20:08:07.887900 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 595/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:06 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1618 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:07.900137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a9cffa55-7588-4e9d-8d21-020532731769 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698faee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:07.966891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:07.979814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5ebd296-e900-4a9c-bdf6-858a637c2e96 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.626513 Jul 25 20:08:07.997062 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 595/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:07 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:08.014030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:08.014782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:08.032776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a9cffa55-7588-4e9d-8d21-020532731769 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.143283 Jul 25 20:08:08.033040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.033515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.035832 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 596/1191] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:07 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:08.036102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.036656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.045279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:08.048339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:08.067827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.068603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.069698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:08.070441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:08.132942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d212099e-7bbb-488b-92f6-18529ba28873 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094793 Jul 25 20:08:08.134336 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 597/1192] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:08 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:08.135538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:08.147211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: .version_select at 0x7f196983ab80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1581560582", "policies": ["affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:08.150707 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8f9decf-c1c1-4bd9-8acb-b8c53b460dee tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1213 microversion: 2.1 time: 0.152409 Jul 25 20:08:08.152590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 596/1193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:07 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:08.208632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:08.238039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:08.307904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:08.381672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:08.398131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:08.443213 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-804e7573-b041-431a-9791-4b2e5a2cee43 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.304910 Jul 25 20:08:08.444444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 598/1194] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Jul 25 20:08:08 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:08.537994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1849171037", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "15be9b85-d7de-41a1-b424-07204f5ec5df"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:08.652503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:09.005045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:09.006516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:09.029032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.033322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.038389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.049028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.314536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:09.315755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:09.320458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:09.321740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:09.325813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:09.437777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.438651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.440025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.440841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.469842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:09.481295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:09.506653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 2 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:09.510587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:09.530135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:09.543207 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d35eeda1-7e2b-405f-a2a5-dbfb3f00d813 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.542503 Jul 25 20:08:09.544310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 599/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:08 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:09.550387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3a159c1-625d-42bc-8d0c-e9f3acfb0f58 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697189d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:09.607287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119723) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 25 20:08:09.625475 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3a159c1-625d-42bc-8d0c-e9f3acfb0f58 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.079777 Jul 25 20:08:09.635781 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 600/1196] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:09 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:09.637251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:09.641795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:09.644093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:09.644631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:09.654685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.655258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.656249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.656873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.681809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:09.707727 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e90f49b-79db-4294-8f5d-b6ec9bf15725 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069959 Jul 25 20:08:09.718265 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 601/1197] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:09 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:09.723798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:09.724479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:09.732244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.732794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.733669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:09.734227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:09.763927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:09.774795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:09.805017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=71b1ea58-8f94-4b4b-9827-16346eb85ae3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:09.840774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:09.849376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f16fe35-b95e-4886-adb0-4122f66a79e0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1275 microversion: 2.1 time: 0.129830 Jul 25 20:08:09.849996 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 602/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:09 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:09.922581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:09.934279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:09.946327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:10.005415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:10.012245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:10.062731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1afceae7-ce4a-4202-8769-a1019956fa14 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.529523 Jul 25 20:08:10.063607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 597/1199] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1532 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:08:10.071512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.077807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:10.078591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Searching by: {'deleted': False, 'project_id': 'ce2718565d4b48ab8235a338f7282313'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:08:10.126434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.126954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.127889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.128365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.286407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:08:10.381574 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c99d892-8c73-4d8b-9264-a68c834922cd tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.313646 Jul 25 20:08:10.388905 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 603/1200] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/servers => generated 1004 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:10.394578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-56a9ada7-8b76-4b22-a842-d45f99e4c8b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.395277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-56a9ada7-8b76-4b22-a842-d45f99e4c8b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:10.554462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-56a9ada7-8b76-4b22-a842-d45f99e4c8b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:10.564006 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-56a9ada7-8b76-4b22-a842-d45f99e4c8b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1219 microversion: 2.1 time: 0.172663 Jul 25 20:08:10.580065 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 598/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:10.581054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.582325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:10.592273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.593153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.594257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.595221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.654886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8a5ee02-e584-4da2-929c-214137f0be8f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969672d30>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.793992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8a5ee02-e584-4da2-929c-214137f0be8f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.144232 Jul 25 20:08:10.794639 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 599/1202] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:10.813961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.817008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:10.827505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.827973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.832914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.833391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:10.931112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:10.940874 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0877e82-3e04-4046-a00e-8e15d53e8ede tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.375095 Jul 25 20:08:10.952266 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 604/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:10.957777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:10.957777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:10.983266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:10.994696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:11.003906 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-27fab15b-2588-4436-8d58-60026a7a7578 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.207172 Jul 25 20:08:11.005147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:11.007054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:11.033171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 600/1204] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:11.278924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:11.294706 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c865fe59-0dbc-44af-8d61-dd850c3c739e tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1275 microversion: 2.1 time: 0.349648 Jul 25 20:08:11.311892 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 605/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:10 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:11.591303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9909888a-dd29-4d5f-a186-2d28dffbdec4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:11.591898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9909888a-dd29-4d5f-a186-2d28dffbdec4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:11.819645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b95de216-e31b-4c11-baaf-3fbebb6c6db0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698d0430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:11.931893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b95de216-e31b-4c11-baaf-3fbebb6c6db0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.117174 Jul 25 20:08:11.933980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 606/1206] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:11 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:11.966525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:11.967478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:12.004299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9909888a-dd29-4d5f-a186-2d28dffbdec4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:12.007700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.013361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.016929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.016929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.036274 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9909888a-dd29-4d5f-a186-2d28dffbdec4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1219 microversion: 2.1 time: 0.450013 Jul 25 20:08:12.037400 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 601/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:11 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1219 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:12.051955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:12.057126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:12.118006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.118410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.119288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.119748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.349449 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0c358be7-9847-4677-b65a-7a54332a0567 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.301873 Jul 25 20:08:12.355877 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 602/1208] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:12 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:08:12.367537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:12.368641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:12.393008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.402068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:12.403324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:12.405540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.252368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:13.265239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-db463d13-6113-400b-b43b-c997736fb9f6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 1.303943 Jul 25 20:08:13.272071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 607/1209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:11 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:13.280153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f1c06c0-2eb8-495c-a701-5b8ad1c58d40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196965f160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:13.286328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:13.326853 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-600e9b9f-2c02-4657-b6df-ef12140f9f7c tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.962157 Jul 25 20:08:13.329617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 603/1210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:12 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:13.335265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:13.353414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:13.378251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.383943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.385652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.387241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.406951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f1c06c0-2eb8-495c-a701-5b8ad1c58d40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1414 microversion: 2.1 time: 0.131006 Jul 25 20:08:13.416199 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 608/1211] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:13 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:13.437112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:13.439781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:13.463272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.467021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.468512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.469247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.569237 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8dfa8b9-23f6-4a9d-9472-c0e72b25eefe tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.148834 Jul 25 20:08:13.575520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 609/1212] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:13 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:13.610085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1f5ee977-8e40-45bc-a71d-a78094a999ef req-ffc6c0de-a003-4c15-b10c-da2d34caa950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ddffa07-040a-4c5f-931d-93b7ddb07f18", "tag": "6a8d50a6-8438-4dee-ac64-d645517428a9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:13.635006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1f5ee977-8e40-45bc-a71d-a78094a999ef req-ffc6c0de-a003-4c15-b10c-da2d34caa950 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:13.635808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1f5ee977-8e40-45bc-a71d-a78094a999ef req-ffc6c0de-a003-4c15-b10c-da2d34caa950 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:13.647463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:13.675523 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1f5ee977-8e40-45bc-a71d-a78094a999ef req-ffc6c0de-a003-4c15-b10c-da2d34caa950 service nova] Creating event network-changed:6a8d50a6-8438-4dee-ac64-d645517428a9 for instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 on n-h2-845775-3 Jul 25 20:08:13.684235 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1f5ee977-8e40-45bc-a71d-a78094a999ef req-ffc6c0de-a003-4c15-b10c-da2d34caa950 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081606 Jul 25 20:08:13.685682 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 610/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:13.690924 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9cdb964f-a64b-4244-b4d5-9e4d93a64cad tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1271 microversion: 2.1 time: 0.359107 Jul 25 20:08:13.694768 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 604/1214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:13 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:14.311082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:14.315564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:14.329932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.330667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:14.331605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.332234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:14.371599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:14.372447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:14.391507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.392717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:14.393763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:14.394645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.053393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:15.107039 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e902309-57cc-47f1-a187-11fca0ceeb5b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1515 microversion: 2.1 time: 0.808407 Jul 25 20:08:15.124085 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 611/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:14 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1515 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:15.139548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-309c3a8a-aba7-4750-87d3-23db4a2079d7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196972a820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.143439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:15.182440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2991b7e-2374-4404-adb8-55f3553a92d8 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.815085 Jul 25 20:08:15.204505 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 605/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:14 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:15.221886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.226943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:15.241434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.242837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.244430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.246085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.251109 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-309c3a8a-aba7-4750-87d3-23db4a2079d7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1423 microversion: 2.1 time: 0.132926 Jul 25 20:08:15.257903 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 612/1217] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:15 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1423 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:15.263085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.264495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:15.285570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.286123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.288498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:15.292997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:15.313743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e88c2706-88cc-4f84-87a7-7569841f2880 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106095 Jul 25 20:08:15.315127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 606/1218] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:15 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:08:15.324908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6f2444d-8c24-4be1-8f9e-f42d63600003 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969685ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.462133 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6f2444d-8c24-4be1-8f9e-f42d63600003 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 200 len: 1423 microversion: 2.1 time: 0.144254 Jul 25 20:08:15.463106 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 607/1219] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:08:15 2022] GET /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:15.491905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:15.506221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e8b7b641-38ff-4045-aa23-f3b0065072b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698634c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:15.509072 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-af2ecbbe-cd7c-46d4-afea-ecc434360c2a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1279 microversion: 2.1 time: 0.251320 Jul 25 20:08:15.509670 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 613/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:15 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:16.158248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:16.159319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:16.177691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.179310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.181651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.188973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.437594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e8b7b641-38ff-4045-aa23-f3b0065072b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 204 len: 0 microversion: 2.1 time: 0.956076 Jul 25 20:08:16.443975 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 608/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:15 2022] DELETE /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:16.449868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:16.450658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:16.469066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.470180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.472814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.474637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.899187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:16.909232 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0aa6893e-814f-4f3a-8764-149025c1d4a7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.758847 Jul 25 20:08:16.910356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 614/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:16 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:16.918424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:16.922190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:16.932782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.933557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:16.934385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.936145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.936853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.947000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-72d2f632-0c24-4856-ba7e-3a7abc7b2a26 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.500080 Jul 25 20:08:16.948713 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 609/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:16 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:16.961861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:16.962615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:16.975816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.977466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.978431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:16.983210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:16.985026 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8440a53c-6a16-4873-909f-f6151eb8bfd4 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.072767 Jul 25 20:08:16.987115 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 615/1224] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:08:16 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:16.996341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:16.997506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:17.007500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.008276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.009444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.010637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.069438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:17.215104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:17.228133 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa8c8bb9-e833-4497-85cd-3c649d976bb2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1277 microversion: 2.1 time: 0.239372 Jul 25 20:08:17.228383 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5eb81b1-27f9-42f3-af35-1fa42597d984 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 204 len: 0 microversion: 2.1 time: 0.274713 Jul 25 20:08:17.230129 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 616/1225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:16 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:17.230806 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 610/1226] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:16 2022] DELETE /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:17.240901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:17.250539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:17.267154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.268010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.269063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.273816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.374300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1bb0219b-743d-4645-b5a4-c29650f66ff1 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140780 Jul 25 20:08:17.376553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 617/1227] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:17 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:17.391718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:17.392340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:17.408461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.410491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.411708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:17.412416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:17.494166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:17.501706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1497348657", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "fc86a3b0-dce7-409f-8e0e-bcf88032c34a"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:17.574371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] validate_networks() for [('fc86a3b0-dce7-409f-8e0e-bcf88032c34a', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:18.302466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lazy-loading 'services' on Instance uuid a71d479f-ea35-4df6-9c60-8921866f46ed {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:18.427601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:18.775900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98c62c24-2eb3-4636-b342-e2734040b419 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments/6ec6e3d5-d73e-4f87-bd12-3c63ace1ec4b" status: 202 len: 0 microversion: 2.1 time: 1.390085 Jul 25 20:08:18.796755 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 611/1228] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:08:17 2022] DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments/6ec6e3d5-d73e-4f87-bd12-3c63ace1ec4b => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:08:18.826184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:18.843375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:18.862957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:18.870053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:18.871755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:18.872825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.179626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:19.184881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:19.185862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:19.187983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:19.188565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:19.231826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.232665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.240677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.246430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.306592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:19.325603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for user a5e02ce4bb4645e2a92ba0a5eed8ba0d and project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:19.391866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:19.404380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:19.451187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:19.545026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:19.559376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-758c9f42-0173-4d27-9f60-d12223f9529d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.760539 Jul 25 20:08:19.562204 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a72d6c7-ba8b-4e5c-b7a8-beea35f87578 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064423 Jul 25 20:08:19.566279 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 618/1229] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:19.566566 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 612/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:18 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:19.588390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:19.596972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:19.598329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:19.598966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:19.621432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.621891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.626784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.630858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.632315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.635041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:19.636952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:19.641691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:20.646866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:20.662831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57ccdd83-4feb-45bd-b71e-02de7afa8b89 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 1.091995 Jul 25 20:08:20.665112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 619/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:19 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:20.681467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4cb45270-ec58-443a-a0e5-3f463068471a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:20.698432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4cb45270-ec58-443a-a0e5-3f463068471a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:20.725885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:20.743052 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11607e98-5df2-4167-a05b-c50f604301ee tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 1.173759 Jul 25 20:08:20.759144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 613/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:19 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:20.773613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:20.774660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:20.793731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:20.794600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:20.795651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:20.796369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:20.897413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4cb45270-ec58-443a-a0e5-3f463068471a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:20.907010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4cb45270-ec58-443a-a0e5-3f463068471a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1208 microversion: 2.1 time: 0.238213 Jul 25 20:08:20.926828 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 620/1233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:20 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1208 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:20.938438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ebb4b82f-4857-48d3-8d59-10a71b2313ba req-b23ac7f1-1826-4f89-a8c0-643d3a22e2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c68ad-c3ba-4664-96e6-c7adc355b17b", "name": "network-vif-unplugged", "status": "completed", "tag": "7531a911-36c4-4442-afa7-7106f9c8927d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:20.962056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ebb4b82f-4857-48d3-8d59-10a71b2313ba req-b23ac7f1-1826-4f89-a8c0-643d3a22e2c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:20.969159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ebb4b82f-4857-48d3-8d59-10a71b2313ba req-b23ac7f1-1826-4f89-a8c0-643d3a22e2c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.011600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ebb4b82f-4857-48d3-8d59-10a71b2313ba req-b23ac7f1-1826-4f89-a8c0-643d3a22e2c3 service nova] Creating event network-vif-unplugged:7531a911-36c4-4442-afa7-7106f9c8927d for instance 808c68ad-c3ba-4664-96e6-c7adc355b17b on n-h1-845775-3 Jul 25 20:08:21.018351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ebb4b82f-4857-48d3-8d59-10a71b2313ba req-b23ac7f1-1826-4f89-a8c0-643d3a22e2c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089239 Jul 25 20:08:21.019793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 621/1234] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:21.205707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5afceb47-e4a3-48a5-8484-28e71a78301b req-dd5625cb-11af-415e-a4fc-2fbc3f21a27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808c68ad-c3ba-4664-96e6-c7adc355b17b", "name": "network-vif-deleted", "tag": "7531a911-36c4-4442-afa7-7106f9c8927d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:21.244813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5afceb47-e4a3-48a5-8484-28e71a78301b req-dd5625cb-11af-415e-a4fc-2fbc3f21a27d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.246436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5afceb47-e4a3-48a5-8484-28e71a78301b req-dd5625cb-11af-415e-a4fc-2fbc3f21a27d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.273137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5afceb47-e4a3-48a5-8484-28e71a78301b req-dd5625cb-11af-415e-a4fc-2fbc3f21a27d service nova] Creating event network-vif-deleted:7531a911-36c4-4442-afa7-7106f9c8927d for instance 808c68ad-c3ba-4664-96e6-c7adc355b17b on n-h1-845775-3 Jul 25 20:08:21.280430 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5afceb47-e4a3-48a5-8484-28e71a78301b req-dd5625cb-11af-415e-a4fc-2fbc3f21a27d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085842 Jul 25 20:08:21.285306 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 622/1235] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:08:21.291270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:21.309437 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9030a31c-ff58-40b7-a0f5-f847a957daa1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.546173 Jul 25 20:08:21.327252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 614/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:20 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:21.691215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:21.692118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:21.732178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.733030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.734641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.735246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.764325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:21.765586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:21.794360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.794838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:21.795622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:21.801408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:22.034795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=28 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:22.595303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:22.605401 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e46e3060-2a11-4738-af15-adb4b88897d9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.920896 Jul 25 20:08:22.614115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:22.623977 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cac1aa74-fb54-43a1-bfd2-f8da577a600e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.863873 Jul 25 20:08:22.632514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 623/1237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:21 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:22.641589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 615/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:21 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:22.658406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:22.661296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:22.662741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:22.663862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:22.696934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:22.705692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:22.706535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:22.707196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:22.708221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:22.709806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:22.715369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:22.716209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:22.826356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:23.060775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:23.085120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-482a9e77-5ee5-452f-af65-8bd8d9dbb376 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1278 microversion: 2.1 time: 0.443728 Jul 25 20:08:23.099992 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 624/1239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:22 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1278 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:23.388815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:23.416874 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-330fc315-8912-4922-8d47-132050f2c602 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.773038 Jul 25 20:08:23.419012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 616/1240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:22 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:23.497555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-64f9202a-8ad2-42ac-874a-7e619f062372 req-0adf19f1-2d25-4520-a0ee-a13306c7b7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e7d944-d21c-44ae-bb16-005770324ef4", "tag": "f6452a44-0fb1-4e56-9bfb-5062ea8b095f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:23.541044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64f9202a-8ad2-42ac-874a-7e619f062372 req-0adf19f1-2d25-4520-a0ee-a13306c7b7c6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:23.542709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64f9202a-8ad2-42ac-874a-7e619f062372 req-0adf19f1-2d25-4520-a0ee-a13306c7b7c6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:23.582239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-64f9202a-8ad2-42ac-874a-7e619f062372 req-0adf19f1-2d25-4520-a0ee-a13306c7b7c6 service nova] Creating event network-changed:f6452a44-0fb1-4e56-9bfb-5062ea8b095f for instance a4e7d944-d21c-44ae-bb16-005770324ef4 on n-h2-845775-3 Jul 25 20:08:23.603969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-64f9202a-8ad2-42ac-874a-7e619f062372 req-0adf19f1-2d25-4520-a0ee-a13306c7b7c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115555 Jul 25 20:08:23.617757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 625/1241] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:08:23.663896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:23.668349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:23.669485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:23.672478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:23.692548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:23.699471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:23.700185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:23.700726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:23.702085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:23.702759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:23.708222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:23.713214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.413046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:24.433266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:24.442199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea56de89-d95d-4213-bf6d-516ada0dcd23 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.783767 Jul 25 20:08:24.455513 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48ec754d-0a20-4a41-9708-620224336972 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.802574 Jul 25 20:08:24.456259 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 626/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:23 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:24.467508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 617/1243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:23 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:24.499171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:24.500340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:24.506559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a39905c1-1340-46c9-aca3-8149b8780a0f req-3c7479d6-b3f1-4209-8500-09865c094864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b1ea58-8f94-4b4b-9827-16346eb85ae3", "tag": "5c9879bc-e873-4d0e-bf3d-5aee2774d7a4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:24.536056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:24.538676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.543986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:24.544220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a39905c1-1340-46c9-aca3-8149b8780a0f req-3c7479d6-b3f1-4209-8500-09865c094864 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:24.544548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a39905c1-1340-46c9-aca3-8149b8780a0f req-3c7479d6-b3f1-4209-8500-09865c094864 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.547280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.580337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a39905c1-1340-46c9-aca3-8149b8780a0f req-3c7479d6-b3f1-4209-8500-09865c094864 service nova] Creating event network-changed:5c9879bc-e873-4d0e-bf3d-5aee2774d7a4 for instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 on n-h2-845775-3 Jul 25 20:08:24.596344 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a39905c1-1340-46c9-aca3-8149b8780a0f req-3c7479d6-b3f1-4209-8500-09865c094864 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137080 Jul 25 20:08:24.598344 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 627/1244] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:24.608746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:24.610009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:24.623216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:24.624643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.628015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:24.638427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:24.983673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:24.999370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81e1951f-88f7-42db-907a-ac7400181f51 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1266 microversion: 2.1 time: 0.529765 Jul 25 20:08:25.012147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 618/1245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:24 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1266 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:25.321668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-90af9fac-af7a-405b-9b19-d487d7fd1fd7 req-e7dec726-d350-4699-9808-5bea3ff838f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311ddd9b-db98-4b21-a06c-a24f8b4ff6e5", "name": "network-vif-plugged", "status": "completed", "tag": "cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:25.411849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-90af9fac-af7a-405b-9b19-d487d7fd1fd7 req-e7dec726-d350-4699-9808-5bea3ff838f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:25.412631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-90af9fac-af7a-405b-9b19-d487d7fd1fd7 req-e7dec726-d350-4699-9808-5bea3ff838f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:25.503727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-90af9fac-af7a-405b-9b19-d487d7fd1fd7 req-e7dec726-d350-4699-9808-5bea3ff838f1 service nova] Creating event network-vif-plugged:cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9 for instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 on n-h2-845775-3 Jul 25 20:08:25.530092 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-90af9fac-af7a-405b-9b19-d487d7fd1fd7 req-e7dec726-d350-4699-9808-5bea3ff838f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217390 Jul 25 20:08:25.534665 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 619/1246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:08:25.551446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:25.562339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:25.585612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:25.587798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:25.593916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:25.596308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:25.968964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:25.988468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ac4f074-1b03-4ba1-968c-884c134ce5c8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 1.387902 Jul 25 20:08:25.993479 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 628/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:24 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:25.999236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:26.013046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:26.020278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:26.020997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:26.022243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:26.024400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:26.458796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:26.477953 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0dc6fc3-8c65-4780-b6d0-84df3dedd7c9 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.941207 Jul 25 20:08:26.483420 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:25 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:26.493056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:26.504500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:26.514803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:26.517207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:26.521165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:26.524531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:26.757118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:26.774577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c581c3bc-276e-4bef-8e98-88d09f416f09 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.779524 Jul 25 20:08:26.788246 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 629/1249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:25 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:27.017397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:27.018069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:27.034973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.035446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.036298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.036742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.277857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:27.312965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2930ec6a-77f7-45a7-9c2b-c52795f4305e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 0.808008 Jul 25 20:08:27.328514 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 621/1250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:26 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:27.328982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f8b517b3-2c1b-44ca-9a85-8b53cb8de77b req-020e4a17-5b8d-4588-b83c-104eec8fdfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819316d7-7a6c-464d-9d57-c9d1dedcc64e", "tag": "eabf546b-6c04-47d5-84fe-88b220a459d6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:27.350653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f8b517b3-2c1b-44ca-9a85-8b53cb8de77b req-020e4a17-5b8d-4588-b83c-104eec8fdfa1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.362989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f8b517b3-2c1b-44ca-9a85-8b53cb8de77b req-020e4a17-5b8d-4588-b83c-104eec8fdfa1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.389175 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f8b517b3-2c1b-44ca-9a85-8b53cb8de77b req-020e4a17-5b8d-4588-b83c-104eec8fdfa1 service nova] Creating event network-changed:eabf546b-6c04-47d5-84fe-88b220a459d6 for instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e on n-h1-845775-3 Jul 25 20:08:27.429454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f8b517b3-2c1b-44ca-9a85-8b53cb8de77b req-020e4a17-5b8d-4588-b83c-104eec8fdfa1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105746 Jul 25 20:08:27.431433 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 622/1251] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:27.506893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:27.514034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:27.521394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:27.537923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.539428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.540773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.542034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.544637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a86471fa-6874-4152-975a-13198b81e92d tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.529237 Jul 25 20:08:27.545734 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 630/1252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:27 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:27.632177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e037e9e3-4306-4efb-a3a0-ad76ada7f4b2 req-b11a08eb-e10c-4699-9c5f-60219ae756f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddffa07-040a-4c5f-931d-93b7ddb07f18", "name": "network-vif-plugged", "status": "completed", "tag": "6a8d50a6-8438-4dee-ac64-d645517428a9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:27.660461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e037e9e3-4306-4efb-a3a0-ad76ada7f4b2 req-b11a08eb-e10c-4699-9c5f-60219ae756f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.660816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e037e9e3-4306-4efb-a3a0-ad76ada7f4b2 req-b11a08eb-e10c-4699-9c5f-60219ae756f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.676885 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e037e9e3-4306-4efb-a3a0-ad76ada7f4b2 req-b11a08eb-e10c-4699-9c5f-60219ae756f1 service nova] Creating event network-vif-plugged:6a8d50a6-8438-4dee-ac64-d645517428a9 for instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 on n-h2-845775-3 Jul 25 20:08:27.684355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e037e9e3-4306-4efb-a3a0-ad76ada7f4b2 req-b11a08eb-e10c-4699-9c5f-60219ae756f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055751 Jul 25 20:08:27.685318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 631/1253] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:27.799406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:27.800511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:27.808684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:27.812594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.813504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.815197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:27.816455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:27.827320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99aaf5e9-d0ae-4756-a740-05e8958729d5 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.328694 Jul 25 20:08:27.827931 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 623/1254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:27 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:28.246792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:28.261535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-723f5641-feb8-4608-be38-390d791ca46b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.468974 Jul 25 20:08:28.262856 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:27 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:28.340677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:28.341726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:28.381020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.381986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.382373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.382788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.573856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:28.575723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:28.586009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.586653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.590523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.593129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.835602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:28.848155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1f089417-d25e-4c5a-8df3-5621c3c99bec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 0.515396 Jul 25 20:08:28.852787 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 624/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:28 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:28.859461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:28.861411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:28.873838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.874594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.875554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:28.879253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:28.979435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:29.003143 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a9a80362-3e67-485f-9548-2e43561d3d24 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1521 microversion: 2.1 time: 0.438484 Jul 25 20:08:29.005115 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 633/1257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:28 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:29.292817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:29.293813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:29.314819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:29.325927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:29.326791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:29.328638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:29.333284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.124448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:30.154109 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84e12307-4743-41db-8dd1-ed1f86879b9f tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 1.299461 Jul 25 20:08:30.155573 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 625/1258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:28 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:30.161780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:30.168803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:30.178029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.179793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.183671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.184865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.353136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:30.369991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eced961d-832c-4ff7-b4f4-87688795355c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 1.087153 Jul 25 20:08:30.388566 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 634/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:29 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:30.404944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:30.409730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:30.421341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.422270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.423579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.424273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.482593 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b475e3df-de49-481c-aa35-539e9e6d3baf tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091643 Jul 25 20:08:30.484066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 635/1260] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:30 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:08:30.492579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:30.494159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:30.511566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.515245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.518988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.521197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.904388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:30.909011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:30.929530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93dde73a-ce8f-4200-983b-41bb42977f26 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 0.771813 Jul 25 20:08:30.930509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 626/1261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:30 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:30.939321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:30.943733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:30.957104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.958613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:30.960389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:30.961478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:31.034762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60a570ef-ab64-4151-b5ea-72cd910ecd6b tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102067 Jul 25 20:08:31.036128 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:08:30 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:08:31.159125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:31.190603 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eac76ad8-a7b8-4a59-9bae-9e239ae1d37b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1506 microversion: 2.1 time: 0.704408 Jul 25 20:08:31.192925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:31.195966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:31.216599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:31.217430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 636/1263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:30 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:31.221077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:31.222316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:31.223037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:31.244095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:31.247291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:31.264192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:31.285755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:31.286444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:31.287382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:31.287876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:31.951179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:31.960514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:31.990630 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ab932ad-5391-4dcf-9990-ce8f8de69021 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1317 microversion: 2.1 time: 0.803280 Jul 25 20:08:31.991900 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 628/1264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:31 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:32.031249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:32.037457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:32.057840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:32.058601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:32.060016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:32.060809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:32.182071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:32.411118 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f06f1db8-f3c4-4137-918b-036a32210881 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 204 len: 0 microversion: 2.1 time: 0.413109 Jul 25 20:08:32.417887 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 629/1265] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:31 2022] DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:32.439691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:32.447260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:32.473387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:32.485260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:32.487235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:32.488466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.155356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:33.205303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-555c66b9-e98d-4b8d-bf0a-72d2d7dc4186 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 200 len: 1506 microversion: 2.1 time: 1.968426 Jul 25 20:08:33.211223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 637/1266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:31 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 1506 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:33.231521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:33.234773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:33.270727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:33.281960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.285855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:33.286568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.402847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:33.425992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-470f233e-20d1-495c-a9fe-0b6c54905df9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 1.002877 Jul 25 20:08:33.437177 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 630/1267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:32 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:33.473373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:33.481134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:33.515681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:33.519500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.524948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:33.526147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.845299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:33.877341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18020805-3f40-439c-8323-ca97a47099f7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 0.661843 Jul 25 20:08:33.882850 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 638/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:33 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:33.904526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-78582d4e-d28f-4211-91ab-17ffe90bee7a req-ed9f7727-e111-4f94-93c5-e60b1ddfa7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1ea58-8f94-4b4b-9827-16346eb85ae3", "name": "network-vif-plugged", "status": "completed", "tag": "5c9879bc-e873-4d0e-bf3d-5aee2774d7a4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:33.940215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-78582d4e-d28f-4211-91ab-17ffe90bee7a req-ed9f7727-e111-4f94-93c5-e60b1ddfa7ae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:33.950802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-78582d4e-d28f-4211-91ab-17ffe90bee7a req-ed9f7727-e111-4f94-93c5-e60b1ddfa7ae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:33.972759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:33.986035 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ea0380c-857a-4ecc-be9f-f24092f7b344 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1680 microversion: 2.1 time: 0.547288 Jul 25 20:08:33.987117 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 631/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:33 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1680 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:33.994286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:33.996649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:34.004870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.005738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.007399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.008480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.031941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-78582d4e-d28f-4211-91ab-17ffe90bee7a req-ed9f7727-e111-4f94-93c5-e60b1ddfa7ae service nova] Creating event network-vif-plugged:5c9879bc-e873-4d0e-bf3d-5aee2774d7a4 for instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 on n-h2-845775-3 Jul 25 20:08:34.064066 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-78582d4e-d28f-4211-91ab-17ffe90bee7a req-ed9f7727-e111-4f94-93c5-e60b1ddfa7ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178395 Jul 25 20:08:34.066868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 639/1270] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:34.086415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:34.087905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:34.109595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.111888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.114344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.116072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.220629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:34.413596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:34.467280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68d0759a-d179-450d-8212-f2175c5465be tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1506 microversion: 2.1 time: 0.473019 Jul 25 20:08:34.469629 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 632/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:33 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:34.491767 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-099cd19b-f476-4fae-8d6f-50caa1822fc0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 204 len: 0 microversion: 2.1 time: 0.420301 Jul 25 20:08:34.503295 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 640/1272] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:34 2022] DELETE /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:34.503833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:34.503833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:34.539595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:34.578437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.584355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.585699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:34.586452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:34.849522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2118106605", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "474142bd-b6db-42e4-b8e5-a59a376c1800"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:35.050892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] validate_networks() for [('474142bd-b6db-42e4-b8e5-a59a376c1800', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:35.199488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:35.231097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc455433-cf4c-42cb-8b2b-88acae59e76a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.757828 Jul 25 20:08:35.232615 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 633/1273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:34 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:35.247047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:35.253902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:35.280071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:35.282214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:35.288062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:35.290031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:35.979892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:36.014428 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-067682bf-8f63-4f84-be5e-a81099ac1d8c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 0.778201 Jul 25 20:08:36.015524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 634/1274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:35 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:36.030193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:36.031538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:36.057410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.058722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:36.060844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.062078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:36.836938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:36.856936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84327421-dbff-40aa-96fb-050281b8b7ee tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1680 microversion: 2.1 time: 0.838980 Jul 25 20:08:36.859457 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 635/1275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:36 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1680 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:36.869172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:36.871129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:36.888086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.889461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:36.891600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:36.892877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.242611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:37.244582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:37.245766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:37.246556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:37.247279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:37.287670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:37.289965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.294539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:37.296474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.407421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:37.425592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for user bbff966c24e646fdb7faad71581dc208 and project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:37.445913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:37.466789 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ce2515cf-64ae-4099-95d6-bdfdca7cf9bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.605250 Jul 25 20:08:37.470098 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 636/1276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:36 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:37.493925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-329449bf-3f41-48bb-821d-55e531ca2685 req-c0358ab7-430f-45c4-91b9-6e8844b3aa4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819316d7-7a6c-464d-9d57-c9d1dedcc64e", "name": "network-vif-plugged", "status": "completed", "tag": "eabf546b-6c04-47d5-84fe-88b220a459d6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:37.509244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:37.522202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:37.543321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-329449bf-3f41-48bb-821d-55e531ca2685 req-c0358ab7-430f-45c4-91b9-6e8844b3aa4e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:37.545402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-329449bf-3f41-48bb-821d-55e531ca2685 req-c0358ab7-430f-45c4-91b9-6e8844b3aa4e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.590925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-329449bf-3f41-48bb-821d-55e531ca2685 req-c0358ab7-430f-45c4-91b9-6e8844b3aa4e service nova] Creating event network-vif-plugged:eabf546b-6c04-47d5-84fe-88b220a459d6 for instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e on n-h1-845775-3 Jul 25 20:08:37.601200 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-329449bf-3f41-48bb-821d-55e531ca2685 req-c0358ab7-430f-45c4-91b9-6e8844b3aa4e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127842 Jul 25 20:08:37.602614 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 637/1277] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:37.618306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:37.620204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:37.647291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:37.648263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.649728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:37.650581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:37.738158 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35180a5a-38d8-4015-aa3e-9516ff8696ee tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.890647 Jul 25 20:08:37.770498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 641/1278] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:37.810361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b814036-f2f2-44ae-9102-3a0c6f076a02 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:37.842986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7b814036-f2f2-44ae-9102-3a0c6f076a02 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:38.494135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7b814036-f2f2-44ae-9102-3a0c6f076a02 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:38.517720 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b814036-f2f2-44ae-9102-3a0c6f076a02 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1218 microversion: 2.1 time: 0.744004 Jul 25 20:08:38.538101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 642/1279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:37 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1218 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:38.556634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:38.558930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:38.566461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:38.567284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:38.569175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:38.569925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:38.718078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:38.718874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:38.719696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lazy-loading 'fault' on Instance uuid a71d479f-ea35-4df6-9c60-8921866f46ed {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:38.747081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:39.084111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:39.097002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd5799d942424206a432a28f2b17a4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86043c5e784d48c1b34476ff21ebd69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:39.110046 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2d4b9dfb-dedf-4306-a54b-88edb4d24119 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 1.505836 Jul 25 20:08:39.116713 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 638/1280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:37 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:39.118738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e88153b-79ee-45d3-ac31-c4e724bd4366 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 200 len: 1330 microversion: 2.1 time: 0.568474 Jul 25 20:08:39.137320 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 643/1281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:38 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 1330 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:39.148626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:39.149655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:39.160612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.161777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.163208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.164271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.169539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-eae368db-5821-495a-902c-7b197cc9c8dc req-65ec462c-923a-4b5f-9f50-54c262a2fcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a71d479f-ea35-4df6-9c60-8921866f46ed", "name": "network-vif-deleted", "tag": "bfef752e-c174-4d45-9069-65163b583813"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:39.238551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eae368db-5821-495a-902c-7b197cc9c8dc req-65ec462c-923a-4b5f-9f50-54c262a2fcde service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.238551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eae368db-5821-495a-902c-7b197cc9c8dc req-65ec462c-923a-4b5f-9f50-54c262a2fcde service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.261048 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-eae368db-5821-495a-902c-7b197cc9c8dc req-65ec462c-923a-4b5f-9f50-54c262a2fcde service nova] Creating event network-vif-deleted:bfef752e-c174-4d45-9069-65163b583813 for instance a71d479f-ea35-4df6-9c60-8921866f46ed on n-h1-845775-3 Jul 25 20:08:39.273139 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-eae368db-5821-495a-902c-7b197cc9c8dc req-65ec462c-923a-4b5f-9f50-54c262a2fcde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150213 Jul 25 20:08:39.274686 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 639/1282] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:39.402656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "26b24390-3176-4c6e-aab2-163ba70b67d3"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:39.408618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:39.432163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.433245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.440070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.440706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.633807 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] HTTP exception thrown: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Request method failure captured: Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18/os-volume_attachments/4050d419-7ee7-45af-9dde-6958d8b27e8f HTTP/1.1 Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 74 Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vey9mCauCTrvhB9grgIGz1ryRrCCtrHA7VkHLsZ-iJEPhhHvlQeiXlkVPw9nPySzxnnFUckrY66sGiTG1CLlMma2foqytJSqV5jK4r4OopHej6RLU8gMUxY1kLHh64NMLkIOioxBHsoS1k3QOm87oEmTHAGVoaQLpir9NMPYbjNnII Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: fc8c7bafd69b4d9d9d23430eb905b8fe Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:08:39.652609 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fc8c7bafd69b4d9d9d23430eb905b8fe"}]}] Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: fc8c7bafd69b4d9d9d23430eb905b8fe Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-407779021 Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesAdminNegativeTest-407779021-project-admin Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 0f36e898142c417a87359c66cc6734c7 Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesAdminNegativeTest-407779021-project-admin Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: {"volumeAttachment": {"volumeId": "26b24390-3176-4c6e-aab2-163ba70b67d3"}} Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:08:39.655470 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '7ddffa07-040a-4c5f-931d-93b7ddb07f18', 'id': '4050d419-7ee7-45af-9dde-6958d8b27e8f', 'body': {'volumeAttachment': {'volumeId': '26b24390-3176-4c6e-aab2-163ba70b67d3'}}} Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:08:39.657110 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. (HTTP 404) (Request-ID: req-d3555af3-bfac-485d-9a73-deb45e44a65c) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:08:39.659179 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:39.668726 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. Jul 25 20:08:39.676771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:39.681786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] Returning 404 to user: Volume 4050d419-7ee7-45af-9dde-6958d8b27e8f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:39.681786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a44c5c14-4694-4960-8f22-59c7081baa3f tempest-VolumesAdminNegativeTest-407779021 tempest-VolumesAdminNegativeTest-407779021-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18/os-volume_attachments/4050d419-7ee7-45af-9dde-6958d8b27e8f" status: 404 len: 109 microversion: 2.1 time: 0.261320 Jul 25 20:08:39.681786 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 640/1283] 10.222.0.48 () {60 vars in 1433 bytes} [Mon Jul 25 20:08:39 2022] PUT /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18/os-volume_attachments/4050d419-7ee7-45af-9dde-6958d8b27e8f => generated 109 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:39.690199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:39.714001 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67928025-9cda-444d-bd69-f2a69735ad72 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 0.568929 Jul 25 20:08:39.738239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 644/1284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:39 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:39.751811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:39.757164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:39.782136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.782136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.789479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:39.790204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:39.976421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:39.995208 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d4f8045-3664-4ecc-b7f6-3dff15c8eeca tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1222 microversion: 2.1 time: 0.288363 Jul 25 20:08:40.001438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 641/1285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:39 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1222 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:40.154434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:40.162556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:40.166770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:40.167845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:40.194477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.195088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.196124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.196714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.198961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.199789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.204162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.205055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.263226 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] HTTP exception thrown: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Request method failure captured: Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed HTTP/1.1 Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vdw-6wWf6A2uL7AVJtRcSt2vZsR2Wn954AICveJ8vnbAShhIODZI31iyXqNJNkBfxTsIHzzgFFNEtXaqoOcBleHYzGr9JzdrJbtt0dk-_eRleeipF-W6pZwie9sftUShHzU8TCkwZTdjUO60WHLLSV2fsUVH7UJKenOQNDK2aPUKGs Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:08:40.265194 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}] Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: dd5799d942424206a432a28f2b17a4fe Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:40.267752 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a71d479f-ea35-4df6-9c60-8921866f46ed'} Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:40.269886 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:40.275569 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:40.281249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Returning 404 to user: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:40.281249 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-218096d1-aa4b-42af-81d7-b9eba4f8852e tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 404 len: 111 microversion: 2.1 time: 0.120525 Jul 25 20:08:40.288479 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 645/1286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:40 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:40.296190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-046cbdf6-782c-4b21-8f85-6da710cc34ef tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '.version_select at 0x7f196960cca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:40.353961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-046cbdf6-782c-4b21-8f85-6da710cc34ef tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-926690495" status: 202 len: 0 microversion: 2.1 time: 0.064221 Jul 25 20:08:40.354593 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 646/1287] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-926690495 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:08:40.676632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e7d944-d21c-44ae-bb16-005770324ef4", "name": "network-vif-plugged", "status": "completed", "tag": "f6452a44-0fb1-4e56-9bfb-5062ea8b095f"}, {"server_uuid": "311ddd9b-db98-4b21-a06c-a24f8b4ff6e5", "name": "network-vif-unplugged", "status": "completed", "tag": "cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:40.743649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.755014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.817856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] Creating event network-vif-plugged:f6452a44-0fb1-4e56-9bfb-5062ea8b095f for instance a4e7d944-d21c-44ae-bb16-005770324ef4 on n-h2-845775-3 Jul 25 20:08:40.822234 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] Creating event network-vif-unplugged:cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9 for instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 on n-h2-845775-3 Jul 25 20:08:40.852993 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f43319c7-8863-4d4a-9cd9-1b36de252efa req-c58955dc-0ca2-49dc-9632-5c0c783369ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.181110 Jul 25 20:08:40.857041 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 647/1288] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:08:40.886811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:40.891833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:40.921539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.922258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:40.923692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:40.929110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.306441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:42.331018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e236718-1d68-4d55-a809-4b05148f4801 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1319 microversion: 2.1 time: 1.470119 Jul 25 20:08:42.374557 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 648/1289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:40 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1319 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:42.387944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:42.391888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:42.397863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:42.406864 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbe2891e-81fa-4b93-b354-ddfb450d13ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1308 microversion: 2.1 time: 2.254722 Jul 25 20:08:42.407466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 642/1290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:40 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1308 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:08:42.418290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.419753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.421546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.422757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.680360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:42.704282 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ce4a5ad2-13dc-4443-8711-07bd4c979c8e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1276 microversion: 2.1 time: 0.324483 Jul 25 20:08:42.723641 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 649/1291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:42 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1276 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:42.738239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:42.744811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:42.779759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.781056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.785228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:42.815324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:42.817741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1838708441", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:42.973329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] validate_networks() for [('fa4e4c44-7e49-4a24-871f-cfe03e9ff1a6', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:44.165186 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff7eccc4-0d0f-421e-bd1c-f01dd4b5471d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1859 microversion: 2.1 time: 1.436454 Jul 25 20:08:44.169865 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 650/1292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:42 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1859 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:44.198532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5cbfa2f9-ed6c-4008-a06c-ab85a3b85fc2 req-06b1dcb0-deaf-4c8d-a8c1-de857239a4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311ddd9b-db98-4b21-a06c-a24f8b4ff6e5", "name": "network-vif-deleted", "tag": "cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:44.278820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5cbfa2f9-ed6c-4008-a06c-ab85a3b85fc2 req-06b1dcb0-deaf-4c8d-a8c1-de857239a4f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:44.284698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5cbfa2f9-ed6c-4008-a06c-ab85a3b85fc2 req-06b1dcb0-deaf-4c8d-a8c1-de857239a4f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:44.341508 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5cbfa2f9-ed6c-4008-a06c-ab85a3b85fc2 req-06b1dcb0-deaf-4c8d-a8c1-de857239a4f2 service nova] Creating event network-vif-deleted:cd1417f8-d8fb-46a1-bdcf-7ffe6c4a24c9 for instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 on n-h2-845775-3 Jul 25 20:08:44.356830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5cbfa2f9-ed6c-4008-a06c-ab85a3b85fc2 req-06b1dcb0-deaf-4c8d-a8c1-de857239a4f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176195 Jul 25 20:08:44.364773 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 651/1293] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:44.389275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:44.390568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:44.420128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:44.420927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:44.422318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:44.423084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.013713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:45.042884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9482ee17-0390-488c-a67a-57d81cb01465 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1468 microversion: 2.1 time: 0.672005 Jul 25 20:08:45.045464 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 652/1294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:44 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1468 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:45.096983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:45.101505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:45.133576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.134527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.137299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.138932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.416951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:08:45.419195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:08:45.420074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:08:45.420790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:08:45.421504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:08:45.476889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.477611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.478635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.479284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.535962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Getting quotas for project 10813483bba14011bc0cba01d3b52ca9. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:45.553290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Getting quotas for user 2c67ccc2a03e4e4fb57097603a0fe80e and project 10813483bba14011bc0cba01d3b52ca9. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:45.594458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:08:45.603527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:08:45.623801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:45.677088 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2597bda-ae78-4859-a079-6ad90473e3b9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1488 microversion: 2.1 time: 0.588238 Jul 25 20:08:45.678514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 653/1295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:45 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1488 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:45.703832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:45.709462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:45.720922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.723808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.725293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.728712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.767289 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c26eb1f6-3f2e-4de7-b470-05482100d278 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.349778 Jul 25 20:08:45.770207 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 643/1296] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:08:45.782671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845775-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:45.785763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:45.804066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.805220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.806256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:45.806774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:45.889440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lazy-loading 'flavor' on Instance uuid ae29a5e1-d80c-45f5-b11f-514b6cf29926 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:45.936924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Going to try to live migrate instance to n-h2-845775-3 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:08:46.268470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:46.586044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:46.603343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e932872f-57ab-42a5-b5dc-63c0221185b4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 0.911702 Jul 25 20:08:46.610364 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 654/1297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:45 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:46.625699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:46.630335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:46.652114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:46.657462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:46.658915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:46.659700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:47.312868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:47.897199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:47.941995 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3defc152-f143-4e08-b488-f4a2bfd74641 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 200 len: 1468 microversion: 2.1 time: 1.328100 Jul 25 20:08:47.980587 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 655/1298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:46 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 1468 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:48.023793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37eef1f0-783b-4433-81de-d0251d74496d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:48.075081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37eef1f0-783b-4433-81de-d0251d74496d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:48.084790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37eef1f0-783b-4433-81de-d0251d74496d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:48.424827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37eef1f0-783b-4433-81de-d0251d74496d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:08:48.549147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:48.593215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37eef1f0-783b-4433-81de-d0251d74496d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e/action" status: 202 len: 0 microversion: 2.1 time: 0.598433 Jul 25 20:08:48.598586 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 656/1299] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:08:47 2022] POST /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:08:48.607740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:48.608687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:48.634972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:48.635714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:48.639639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:48.641987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.131392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:49.176200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6e9fff4-68e0-4336-a870-3fb7ca74034b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1266 microversion: 2.1 time: 0.570195 Jul 25 20:08:49.180563 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 657/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:48 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1266 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:49.208865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:49.209721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:49.275467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.277064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.291568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:49.299050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:49.532724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:08:49.969222 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a7aaace-7f29-4cb9-823d-6a75b813f4ea tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 204 len: 0 microversion: 2.1 time: 0.782182 Jul 25 20:08:49.970316 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 658/1301] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:49 2022] DELETE /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:08:50.010033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:50.011329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:50.056590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:50.058049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:50.059804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:50.069233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:50.922914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:50.948654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d38e95c-ca92-45e4-9b75-c4c6ab3a4643 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 0.966551 Jul 25 20:08:50.956680 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 659/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:49 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:50.976510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:50.998416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:51.002653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Searching by: {'reservation_id': 'r-fv51j8ih', 'deleted': False, 'project_id': 'ce2718565d4b48ab8235a338f7282313'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:08:51.022006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:51.023338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:51.025245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:51.029086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:51.482221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:51.505803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:08:51.739385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:51.767324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:51.768388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.121046 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3caf29e1-42be-4118-ad45-a3df184fb8bf tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-fv51j8ih" status: 200 len: 2929 microversion: 2.1 time: 1.162251 Jul 25 20:08:52.132120 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 660/1303] 10.222.0.48 () {58 vars in 1197 bytes} [Mon Jul 25 20:08:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fv51j8ih => generated 2929 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:52.132120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:52.132120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:52.139403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.140185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.141181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.141747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.794442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:52.829335 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e108424-ecd1-47c2-b607-1111e653f5e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.706048 Jul 25 20:08:52.829953 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 661/1304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:52 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:52.885515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e96b7743-9195-474c-8d5f-635c7abcaf8e req-066a7198-afb7-48ae-87da-dbe4833a55be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a6db6b-ffb4-49a1-99f3-321986fdd30d", "tag": "8f665d04-b382-4c93-86b5-9e4b4afecc98"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:52.942506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e96b7743-9195-474c-8d5f-635c7abcaf8e req-066a7198-afb7-48ae-87da-dbe4833a55be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:52.943365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e96b7743-9195-474c-8d5f-635c7abcaf8e req-066a7198-afb7-48ae-87da-dbe4833a55be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:52.999421 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df187cbe-dec7-437c-a9a4-2dcc4872ab6d tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/action" status: 202 len: 0 microversion: 2.1 time: 7.227423 Jul 25 20:08:53.001488 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 644/1305] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:08:45 2022] POST /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/action => generated 0 bytes in 7230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:08:53.035471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:53.040964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:53.045459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e96b7743-9195-474c-8d5f-635c7abcaf8e req-066a7198-afb7-48ae-87da-dbe4833a55be service nova] Creating event network-changed:8f665d04-b382-4c93-86b5-9e4b4afecc98 for instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d on n-h1-845775-3 Jul 25 20:08:53.083311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e96b7743-9195-474c-8d5f-635c7abcaf8e req-066a7198-afb7-48ae-87da-dbe4833a55be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210271 Jul 25 20:08:53.095496 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 662/1306] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:53.098999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.113486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.114715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.119694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.155249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:53.160634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:53.194305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.197791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:53.203092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:53.206399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.542312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:54.585485 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-02e7570c-dbab-4d89-9cc0-891edbec26a0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1512 microversion: 2.1 time: 1.580065 Jul 25 20:08:54.596901 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 645/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:53 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1512 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:54.644741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:54.653473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:54.657554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:54.681274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.684383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.686123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.688928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.701786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0ffba0e-00e2-48c2-81df-61896191db2e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1314 microversion: 2.1 time: 1.604164 Jul 25 20:08:54.705854 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 663/1308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:53 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1314 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:54.711595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-456823ee-3c13-4055-9a78-1460aefae3b9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:54.767319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.server_groups [None req-456823ee-3c13-4055-9a78-1460aefae3b9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Querying cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) for 2 instances {{(pid=119724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 20:08:54.773080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-456823ee-3c13-4055-9a78-1460aefae3b9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.773994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-456823ee-3c13-4055-9a78-1460aefae3b9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.873355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-456823ee-3c13-4055-9a78-1460aefae3b9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/15be9b85-d7de-41a1-b424-07204f5ec5df" status: 200 len: 266 microversion: 2.1 time: 0.165619 Jul 25 20:08:54.878886 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 664/1309] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:08:54 2022] GET /compute/v2.1/os-server-groups/15be9b85-d7de-41a1-b424-07204f5ec5df => generated 266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:54.911457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:54.913754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:54.945042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.951344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:54.960339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:54.961381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:55.501286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:55.578380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:55.784757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:55.831033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9d2ab00-aab0-47b0-a22c-73744a3d1ce7 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 1.200114 Jul 25 20:08:55.831644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:55.839680 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 646/1310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:54 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:55.855915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:55.857239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:55.862470 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff76b112-531d-4b06-bee2-982d15d631da tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.978726 Jul 25 20:08:55.881521 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 665/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:54 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:55.892623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:55.893682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:55.895506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:55.896326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:55.897301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:55.902837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:55.913079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:55.914791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:55.915876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:55.916665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.515803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:56.543675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48ac0eaa-dbc5-4764-bd5d-4416159455fc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.701863 Jul 25 20:08:56.560077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 647/1312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:55 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:56.560563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:56.560794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:56.587080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.597511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.598806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.607688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.748832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.749306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.751236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lazy-loading 'fault' on Instance uuid 7ddffa07-040a-4c5f-931d-93b7ddb07f18 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:08:56.800509 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-352ec2cd-6375-47cc-93b5-053c03607887 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 200 len: 1619 microversion: 2.1 time: 0.916825 Jul 25 20:08:56.810749 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 666/1313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:55 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 1619 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:56.854897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4080ef68-7611-4178-b725-46db015fa1c1 req-769b50bd-b168-4773-bcbc-7a4f8b47460b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701bca35-9051-4dea-8c31-8e939fca4577", "tag": "c6425a59-ac42-417c-897e-952524054440"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:56.901785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4080ef68-7611-4178-b725-46db015fa1c1 req-769b50bd-b168-4773-bcbc-7a4f8b47460b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:56.910368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4080ef68-7611-4178-b725-46db015fa1c1 req-769b50bd-b168-4773-bcbc-7a4f8b47460b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:56.933290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:56.954696 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0ed8039a-d95b-4967-ba41-99f0e83b6213 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 200 len: 1307 microversion: 2.1 time: 0.402362 Jul 25 20:08:56.955603 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4080ef68-7611-4178-b725-46db015fa1c1 req-769b50bd-b168-4773-bcbc-7a4f8b47460b service nova] Creating event network-changed:c6425a59-ac42-417c-897e-952524054440 for instance 701bca35-9051-4dea-8c31-8e939fca4577 on n-h1-845775-3 Jul 25 20:08:56.960184 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 648/1314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:56 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 1307 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:56.979231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-19fae911-c53c-4fdc-a865-4524cc1a7779 req-532c3f95-66b3-4c2d-b906-211a2f0046c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ddffa07-040a-4c5f-931d-93b7ddb07f18", "name": "network-vif-deleted", "tag": "6a8d50a6-8438-4dee-ac64-d645517428a9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:56.984720 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4080ef68-7611-4178-b725-46db015fa1c1 req-769b50bd-b168-4773-bcbc-7a4f8b47460b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164713 Jul 25 20:08:56.991968 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 667/1315] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:57.018228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.022127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-19fae911-c53c-4fdc-a865-4524cc1a7779 req-532c3f95-66b3-4c2d-b906-211a2f0046c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.023512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.025086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-19fae911-c53c-4fdc-a865-4524cc1a7779 req-532c3f95-66b3-4c2d-b906-211a2f0046c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.047669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.049666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.051543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.055889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.062906 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-19fae911-c53c-4fdc-a865-4524cc1a7779 req-532c3f95-66b3-4c2d-b906-211a2f0046c2 service nova] Creating event network-vif-deleted:6a8d50a6-8438-4dee-ac64-d645517428a9 for instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 on n-h2-845775-3 Jul 25 20:08:57.081647 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-19fae911-c53c-4fdc-a865-4524cc1a7779 req-532c3f95-66b3-4c2d-b906-211a2f0046c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118786 Jul 25 20:08:57.086078 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 649/1316] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:57.103783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.107504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.120605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.121849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.124997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.128796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.161918 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] HTTP exception thrown: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Request method failure captured: Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed HTTP/1.1 Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vdw-6wWf6A2uL7AVJtRcSt2vZsR2Wn954AICveJ8vnbAShhIODZI31iyXqNJNkBfxTsIHzzgFFNEtXaqoOcBleHYzGr9JzdrJbtt0dk-_eRleeipF-W6pZwie9sftUShHzU8TCkwZTdjUO60WHLLSV2fsUVH7UJKenOQNDK2aPUKGs Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:08:57.164195 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}] Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: dd5799d942424206a432a28f2b17a4fe Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:57.165702 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a71d479f-ea35-4df6-9c60-8921866f46ed'} Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:57.166566 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:57.167934 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:08:57.171001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Returning 404 to user: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:57.172193 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ac49bd0-2702-43f9-9a79-725b0f69eaa3 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 404 len: 111 microversion: 2.1 time: 0.084398 Jul 25 20:08:57.173594 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 650/1317] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:08:57 2022] DELETE /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:57.179044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.180245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.201073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.201907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.203393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.208804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.580587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:57.607230 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee5ba8be-2d60-45b3-97ca-ab56497f9ff2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1314 microversion: 2.1 time: 0.613338 Jul 25 20:08:57.608481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 668/1318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:56 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:57.621704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.623304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.625572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c06ec597-0d52-456f-a456-4f98594a8bb0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 200 len: 1619 microversion: 2.1 time: 0.450331 Jul 25 20:08:57.645104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:08:57.647830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.648619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.649620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.650220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.656773 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 651/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:57 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 1619 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:57.680744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:57.681899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:57.706131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.707289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:57.708935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:57.709940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.087554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:58.106171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:58.112639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5f0c0f2-3b5b-42e8-9682-12442b9fd404 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 0.502121 Jul 25 20:08:58.113664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 669/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:57 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:58.121274 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-38e142a2-ffcf-4cbf-86ae-f219c7f96fc0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.461955 Jul 25 20:08:58.123501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:58.124940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] [instance: a71d479f-ea35-4df6-9c60-8921866f46ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:58.132585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 652/1321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:57 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:58.137861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.139751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.141947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:58.142702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.143094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:58.144708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.167854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.168237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.169027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.169656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.174189 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] HTTP exception thrown: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Request method failure captured: Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed HTTP/1.1 Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vdw-6wWf6A2uL7AVJtRcSt2vZsR2Wn954AICveJ8vnbAShhIODZI31iyXqNJNkBfxTsIHzzgFFNEtXaqoOcBleHYzGr9JzdrJbtt0dk-_eRleeipF-W6pZwie9sftUShHzU8TCkwZTdjUO60WHLLSV2fsUVH7UJKenOQNDK2aPUKGs Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:08:58.176344 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/86043c5e784d48c1b34476ff21ebd69f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/86043c5e784d48c1b34476ff21ebd69f"}]}] Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 86043c5e784d48c1b34476ff21ebd69f Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1459638553 Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: dd5799d942424206a432a28f2b17a4fe Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1459638553-project Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:58.178136 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a71d479f-ea35-4df6-9c60-8921866f46ed'} Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:58.179135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. Jul 25 20:08:58.180746 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.184548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] Returning 404 to user: Instance a71d479f-ea35-4df6-9c60-8921866f46ed could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:58.186090 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12c1e21f-66b0-402a-a9ba-7532e4d38241 tempest-AttachSCSIVolumeTestJSON-1459638553 tempest-AttachSCSIVolumeTestJSON-1459638553-project] 10.222.0.48 "GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed" status: 404 len: 111 microversion: 2.1 time: 0.070890 Jul 25 20:08:58.187332 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 670/1322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:58 2022] GET /compute/v2.1/servers/a71d479f-ea35-4df6-9c60-8921866f46ed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:58.202683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: .version_select at 0x7f196962da60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-186738595", "policies": ["anti-affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:58.238858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:58.250101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:58.379233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:08:58.389671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:08:58.457441 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d01148e3-6dea-4374-83f3-7a9cfe6cd316 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.261734 Jul 25 20:08:58.458170 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 671/1323] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Jul 25 20:08:58 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:08:58.480168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:58.500513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: 7ddffa07-040a-4c5f-931d-93b7ddb07f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:58.529552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.530033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.530838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.531284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.589250 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] HTTP exception thrown: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Request method failure captured: Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 HTTP/1.1 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vegYMUb1RXpMD27fE6c5-HwgZaLiSx-LczTUItrdz75abL25iX1XAmv_FTshyOVp4PsgvNUElQwAFmnzPTjgXf19RTluopSl-oVOORmMFMhzIApkj3qGNHeakyApL970qSichRpii6EDoSNM46TjLf8j-8B8YUrqURtDu-5fE_HXwI Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 00a02caecccc4d029158f69fde1e1ea3 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:08:58.590823 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a02caecccc4d029158f69fde1e1ea3"}]}] Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 00a02caecccc4d029158f69fde1e1ea3 Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesAdminNegativeTest-2050996409-project Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 87596ed917d44ee68e1c99fdfb615691 Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesAdminNegativeTest-2050996409-project Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. Jul 25 20:08:58.593377 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '7ddffa07-040a-4c5f-931d-93b7ddb07f18'} Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:08:58.594944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. Jul 25 20:08:58.597588 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:08:58.599773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Returning 404 to user: Instance 7ddffa07-040a-4c5f-931d-93b7ddb07f18 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:08:58.599773 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5a26754-b35d-44c7-93db-ecfc21a80d52 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18" status: 404 len: 111 microversion: 2.1 time: 0.133136 Jul 25 20:08:58.599773 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 672/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:58 2022] GET /compute/v2.1/servers/7ddffa07-040a-4c5f-931d-93b7ddb07f18 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:08:58.651588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:58.652806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:58.671394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.674000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.677083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:58.680159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:58.740762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:58.759965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d2eeaea-f4f7-42ed-80a0-6821fb8651e2 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.625449 Jul 25 20:08:58.776097 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 653/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:58 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:58.780348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1695587010", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "74a5607b-2f43-49e4-8281-c82be72e51b8"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:08:58.921787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:08:59.674920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:08:59.691759 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0836baef-e4b6-4451-bc86-7d27111e26e7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1314 microversion: 2.1 time: 1.049975 Jul 25 20:08:59.698346 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 673/1326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:58 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:08:59.706945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:08:59.708639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:08:59.722129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:59.723487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:08:59.724667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:08:59.725359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.043198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:09:00.044224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:09:00.044848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:09:00.045427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:09:00.046025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:09:00.079773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.080404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.081692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.082059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.105529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:00.112605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:00.128835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 2 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:09:00.132630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:09:00.144769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:00.165798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-788db99f-045b-4b72-ba22-b8d585aeb9db tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 0.465671 Jul 25 20:09:00.169084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 674/1327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:08:59 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:00.184724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:00.189330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:00.211631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.215349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.216799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.217726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:00.263962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:00.276990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:00.440580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:00.451946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:00.483860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:00.503938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=bdc7b0c6-f25a-439d-981e-778d3e193654,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:09:00.672297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:00.686263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:00.812224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:00.825734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:00.887379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-963bc18a-ab34-4863-aab7-2879217e58f2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.120487 Jul 25 20:09:00.888414 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 654/1328] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:08:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 2122 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:09:00.915287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-661162c3-68a1-408c-8948-d21699952d61 req-0c9b2865-ea39-42c4-b9f8-2c2f5d222f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a6db6b-ffb4-49a1-99f3-321986fdd30d", "name": "network-vif-plugged", "status": "completed", "tag": "8f665d04-b382-4c93-86b5-9e4b4afecc98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:00.964809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-661162c3-68a1-408c-8948-d21699952d61 req-0c9b2865-ea39-42c4-b9f8-2c2f5d222f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:00.968236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-661162c3-68a1-408c-8948-d21699952d61 req-0c9b2865-ea39-42c4-b9f8-2c2f5d222f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:01.020415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-661162c3-68a1-408c-8948-d21699952d61 req-0c9b2865-ea39-42c4-b9f8-2c2f5d222f5c service nova] Creating event network-vif-plugged:8f665d04-b382-4c93-86b5-9e4b4afecc98 for instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d on n-h1-845775-3 Jul 25 20:09:01.040222 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-661162c3-68a1-408c-8948-d21699952d61 req-0c9b2865-ea39-42c4-b9f8-2c2f5d222f5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137644 Jul 25 20:09:01.044692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 655/1329] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:01.059507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:01.060428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:01.078630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:01.079473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:01.080798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:01.082822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:01.209500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:01.510749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:01.532131 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71e8aaf2-cfc4-495f-9f88-34a4e0b0e3ea tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 1.360362 Jul 25 20:09:01.533132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 675/1330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:00 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:01.541602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:01.542714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:01.567684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:01.568263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:01.569840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:01.570381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.054139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:02.077171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a26776b1-702a-4db8-940e-49308afaed01 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 1.030670 Jul 25 20:09:02.079134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 656/1331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:01 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:02.102011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:02.124578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:02.146562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49f6b868-703b-4e76-8bce-2604b08464c5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1314 microversion: 2.1 time: 0.611576 Jul 25 20:09:02.155474 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 676/1332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:01 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:02.170514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:02.173759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:02.174154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Searching by: {'deleted': False, 'project_id': 'ce2718565d4b48ab8235a338f7282313'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:09:02.176241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:02.203804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.204979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.209392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.216471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.247819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.249073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.251728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.252646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.333539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:09:02.402516 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95cc22f0-f9b8-4ad0-855f-4bfd652a11ea tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.318194 Jul 25 20:09:02.406107 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 657/1333] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:09:02 2022] GET /compute/v2.1/servers => generated 1666 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:02.427644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5f23c6c0-6096-4014-81a0-18d5a5c8a122 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:02.428846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5f23c6c0-6096-4014-81a0-18d5a5c8a122 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:02.735590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5f23c6c0-6096-4014-81a0-18d5a5c8a122 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:02.766669 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5f23c6c0-6096-4014-81a0-18d5a5c8a122 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1219 microversion: 2.1 time: 0.346891 Jul 25 20:09:02.774495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 658/1334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:02 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1219 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:02.802320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:02.809512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:02.851444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.856118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:02.862836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:02.863889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.255647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:03.280467 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6ba5c0a-f5a3-468f-b79f-169ee5c7a5bc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1318 microversion: 2.1 time: 1.122647 Jul 25 20:09:03.285457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 677/1335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:02 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:03.307217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:03.308780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:03.344945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.353140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.360341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.361396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.688891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:03.712443 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2afd016-7660-4625-bbab-a39d3a92486b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.928809 Jul 25 20:09:03.715564 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 659/1336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:02 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:03.736087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:03.739734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:03.757725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.758870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:03.760627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:03.761699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.602818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:04.610049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:04.629082 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9cb9c0f8-a99a-444a-a436-9f318e141492 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 1.339646 Jul 25 20:09:04.635419 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 678/1337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:03 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:04.649588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-fe6b5f0e-652c-42a7-b07f-12b0d4d195b7 req-84b5c1a5-6097-4d29-a67d-f74347bdef7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701bca35-9051-4dea-8c31-8e939fca4577", "name": "network-vif-plugged", "status": "completed", "tag": "c6425a59-ac42-417c-897e-952524054440"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:04.656108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cecef080-f2f8-4f5e-b821-7abe46efdb1c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1314 microversion: 2.1 time: 0.938744 Jul 25 20:09:04.666703 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 660/1338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:03 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1314 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:04.666703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:04.666703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:04.686806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.687402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.688777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.689300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.695463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fe6b5f0e-652c-42a7-b07f-12b0d4d195b7 req-84b5c1a5-6097-4d29-a67d-f74347bdef7c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.704802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fe6b5f0e-652c-42a7-b07f-12b0d4d195b7 req-84b5c1a5-6097-4d29-a67d-f74347bdef7c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.737389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-fe6b5f0e-652c-42a7-b07f-12b0d4d195b7 req-84b5c1a5-6097-4d29-a67d-f74347bdef7c service nova] Creating event network-vif-plugged:c6425a59-ac42-417c-897e-952524054440 for instance 701bca35-9051-4dea-8c31-8e939fca4577 on n-h1-845775-3 Jul 25 20:09:04.755688 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-fe6b5f0e-652c-42a7-b07f-12b0d4d195b7 req-84b5c1a5-6097-4d29-a67d-f74347bdef7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117954 Jul 25 20:09:04.757416 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 679/1339] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:04.771814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:04.773433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:04.780639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.781810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.783506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:04.784487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:04.857834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:04.882033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-56538a6f-6bb4-47f2-b628-316cf4132222 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1289 microversion: 2.1 time: 0.222964 Jul 25 20:09:04.886736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 661/1340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:04 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1289 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:04.904917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1815291696", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "82f9b8d8-b338-4889-8e9c-d78340530deb"}], "block_device_mapping_v2": [{"uuid": "10781e12-6a7f-4eea-a364-9f28f28502e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:05.068632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] validate_networks() for [('82f9b8d8-b338-4889-8e9c-d78340530deb', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:09:05.167417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:05.196000 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c1e8425-eb68-46bc-931d-4c9d54478fd8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1508 microversion: 2.1 time: 0.435221 Jul 25 20:09:05.198810 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 680/1341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:04 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:05.212313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:05.215278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:05.241527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.242917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:05.245828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.248719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:05.268569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:05.625837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:05.642700 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0fbdc930-10d7-42e8-a2a2-5a6fa5e69743 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.440219 Jul 25 20:09:05.646798 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 681/1342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:05 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:05.663063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:05.668594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:05.684772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.685671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:05.686716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:05.687380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.271230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:06.292177 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a995ce48-c1a6-49e4-a55e-f820fb62ba7b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1508 microversion: 2.1 time: 0.627989 Jul 25 20:09:06.294418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 682/1343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:05 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1508 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:06.316356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:06.317478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:06.325166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.328861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:06.330015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:06.330639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.242541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:07.279077 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14d98a19-c294-487f-bcee-d38d4bfe1872 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.981839 Jul 25 20:09:07.284781 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 683/1344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:06 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:07.287326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:09:07.288586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:09:07.289682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:09:07.290547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:09:07.292049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:09:07.319841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:07.326743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:07.342929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.343376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.344380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.345782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.346698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.347914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.349234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:07.349699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:07.399088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:07.413682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Getting quotas for user 98399c84012545a88dc69f2cbc91cf69 and project a6e677726d0148b997afda26e08f4a3d. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:07.699071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:09:07.702403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10781e12-6a7f-4eea-a364-9f28f28502e7',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:09:08.136387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7be805d2-1454-4c4e-aa7f-b0cd094d434a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.244984 Jul 25 20:09:08.148347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 662/1345] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:09:08.167423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:08.173475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:08.199666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.202443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.206873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.208799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.409661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:08.556830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:08.603883 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-501cfbf5-a897-47dc-b20c-81a3e1a191bb tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1499 microversion: 2.1 time: 1.308293 Jul 25 20:09:08.609379 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 684/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:07 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1499 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:08.631720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:08.647855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:08.684264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.687049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.690968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.694210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.845657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:08.864494 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff3fbb53-03c6-4258-96be-6277e4f64446 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1319 microversion: 2.1 time: 0.714196 Jul 25 20:09:08.877349 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 663/1347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:08 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1319 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:08.896421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:08.897649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:08.930650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.932324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:08.933436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:08.936811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.017305 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd382a71-6f69-432a-b5c6-a392df91aa3b tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "PUT /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1080 microversion: 2.1 time: 0.403433 Jul 25 20:09:09.018327 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 685/1348] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:09:08 2022] PUT /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1080 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:09.027897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:09.056255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:09.057413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:09.312229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:09.325716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:09.339248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:09.344052 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-97acff0d-021e-4689-ba96-a17fbc2d716d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1104 microversion: 2.25 time: 0.322383 Jul 25 20:09:09.366633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 686/1349] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:09 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1104 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:09.390931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:09.393095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:09.405802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:09.406681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.408345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:09.409783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.777356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:09.795779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-201eb718-d253-4aa9-b5b3-bd7d9da7b1e3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.916729 Jul 25 20:09:09.805015 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 664/1350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:08 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:09.820015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:09.835881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:09.860062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:09.860868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.861476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:09.861951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:09.954716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lazy-loading 'flavor' on Instance uuid 701bca35-9051-4dea-8c31-8e939fca4577 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:09:10.064545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:10.114068 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd7d09b0-9be1-412a-bf72-c231c62d1643 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.738738 Jul 25 20:09:10.115494 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 687/1351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:09 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:10.130669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:10.131661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:10.161575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.163966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.168325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.171284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.372083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-27184596-3dbd-4bae-bd4f-d05cb489849c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "POST /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577/action" status: 200 len: 32 microversion: 2.1 time: 0.562058 Jul 25 20:09:10.377529 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 665/1352] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:09:09 2022] POST /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577/action => generated 32 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:09:10.389346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:10.390158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:10.413356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.419039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.420249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.424629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.855719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:10.871215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4fdd9db-bfe0-4909-8f8b-a62a89108a71 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1506 microversion: 2.1 time: 0.751315 Jul 25 20:09:10.876825 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 688/1353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:10 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:10.894609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:10.899203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:10.930255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.931156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:10.933004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:10.939397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.015106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:12.048874 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-56cec47f-d3e7-4676-9eae-b093599ee95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1319 microversion: 2.1 time: 1.662110 Jul 25 20:09:12.052081 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 666/1354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:10 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1319 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:12.085828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:12.086848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:12.118369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.127403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.128889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.129533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.295497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:12.377096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba623bb6-5d6b-4bcf-aded-688ed991ee2c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 1.493266 Jul 25 20:09:12.414876 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 689/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:10 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:12.446203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:12.447563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:12.477671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.486585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.488167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.495611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.718309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:12.768942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:12.791998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:12.805021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-637807c4-d65d-4581-a1fc-268630183e6e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1251 microversion: 2.25 time: 0.746880 Jul 25 20:09:12.832070 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 667/1356] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:12 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1251 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:12.832070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:12.832070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:12.855758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.856539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:12.857847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:12.858544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.006721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:14.044456 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8e1ef392-7bf0-449a-b85e-8d097b278d27 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 1.610730 Jul 25 20:09:14.063778 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 690/1357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:12 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:14.077313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:14.077933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:14.094001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.095424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.097327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.098602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.185986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:14.214714 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa664e01-d85f-41c4-974f-de2d2a3a8d35 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1506 microversion: 2.1 time: 1.395721 Jul 25 20:09:14.215599 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 668/1358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:12 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1506 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:14.262140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:14.263040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:14.283964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.284445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.285243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.285704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.372015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:09:14.611094 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0424e7b-866f-4444-903d-87e6f39ab303 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 204 len: 0 microversion: 2.1 time: 0.375613 Jul 25 20:09:14.612576 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 669/1359] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:09:14 2022] DELETE /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:09:14.640789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3a121b71-b93e-4f73-8f95-87698eaf6e28 req-1e63a758-8c49-4fa4-a767-33ebc6704820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b27a3f7-0303-403e-aa62-ab70ddd0dc77", "tag": "25326a4e-6115-4e9e-9806-aa6ad5513dfa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:14.674686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3a121b71-b93e-4f73-8f95-87698eaf6e28 req-1e63a758-8c49-4fa4-a767-33ebc6704820 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.675482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3a121b71-b93e-4f73-8f95-87698eaf6e28 req-1e63a758-8c49-4fa4-a767-33ebc6704820 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.699318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3a121b71-b93e-4f73-8f95-87698eaf6e28 req-1e63a758-8c49-4fa4-a767-33ebc6704820 service nova] Creating event network-changed:25326a4e-6115-4e9e-9806-aa6ad5513dfa for instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 on n-h1-845775-3 Jul 25 20:09:14.708319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3a121b71-b93e-4f73-8f95-87698eaf6e28 req-1e63a758-8c49-4fa4-a767-33ebc6704820 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089307 Jul 25 20:09:14.710003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 670/1360] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:14.718936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:14.720951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:14.734139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.735002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:14.737074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:14.737622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.048816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.068083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c9a1205-2315-4f63-865b-3fdd188973af tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 1.002329 Jul 25 20:09:15.089934 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 691/1361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:14 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:15.107104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:15.108655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:15.118633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.120095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.121970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.124533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.479644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.490160 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c194287a-a36a-4676-922a-b42c44a4ce6d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1319 microversion: 2.1 time: 0.778149 Jul 25 20:09:15.501008 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 671/1362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:14 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:15.525888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:15.527396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:15.541351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.542907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.544511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.546481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.731542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.744393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.747169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.749264 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-158ecddb-5044-4333-abca-c55d7ddda68c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1251 microversion: 2.25 time: 0.231760 Jul 25 20:09:15.750462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 672/1363] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:15 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1251 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:15.757062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:15.762144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:15.770931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.771472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.772636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.774357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.853520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:15.865112 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a96e133d-0770-4b80-89d7-1fe4be54dce5 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 0.772579 Jul 25 20:09:15.866910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 692/1364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:15 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:15.875273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:15.877585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:15.938574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.941038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:15.949316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:15.952931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.007123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:09:16.007818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:09:16.008477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:09:16.009064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:09:16.009662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:09:16.205873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:16.220380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.221449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.223403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.224692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.316571 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-023f0c71-b92d-429a-91ef-2991df0aaeea tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "POST /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d/action" status: 202 len: 1112 microversion: 2.1 time: 0.563728 Jul 25 20:09:16.318190 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 673/1365] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:09:15 2022] POST /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d/action => generated 1112 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 20:09:16.327939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:16.329813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:16.357599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.358709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.360542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.361558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.835708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:16.869262 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9de212a3-b38f-4c4f-aba6-7c47a4b4ff75 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1680 microversion: 2.1 time: 0.997178 Jul 25 20:09:16.872724 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 693/1366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:15 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1680 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:16.886007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:16.890650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:16.908514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.909977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:16.912359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:16.919654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.170382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:17.187304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7cc7881-ad26-41c4-9982-18159189b2a7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.866801 Jul 25 20:09:17.188932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 674/1367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:16 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:17.200302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:17.202205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:17.216220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:17.217767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.219772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:17.221139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.362001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:17.442407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=30 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:17.573266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:17.595306 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4669bbc3-d797-481e-8073-96817a232e5a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1498 microversion: 2.1 time: 0.717457 Jul 25 20:09:17.597630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 694/1368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:16 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1498 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:17.611316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:17.613169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:17.631109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:17.633826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.637574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:17.639201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.861064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:17.876548 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfc0b469-967d-4e5f-bb63-997c813343a4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 0.685133 Jul 25 20:09:17.891968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 675/1369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:17 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:17.891968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-256ea207-3846-43a4-bddf-2da1ddf2f900 req-9496785a-5ee2-4c9a-9a83-f5f37de1a3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc7b0c6-f25a-439d-981e-778d3e193654", "tag": "b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:17.923256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-256ea207-3846-43a4-bddf-2da1ddf2f900 req-9496785a-5ee2-4c9a-9a83-f5f37de1a3a7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:17.924909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-256ea207-3846-43a4-bddf-2da1ddf2f900 req-9496785a-5ee2-4c9a-9a83-f5f37de1a3a7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:17.976527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:17.983199 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-256ea207-3846-43a4-bddf-2da1ddf2f900 req-9496785a-5ee2-4c9a-9a83-f5f37de1a3a7 service nova] Creating event network-changed:b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7 for instance bdc7b0c6-f25a-439d-981e-778d3e193654 on n-h2-845775-3 Jul 25 20:09:17.995741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-256ea207-3846-43a4-bddf-2da1ddf2f900 req-9496785a-5ee2-4c9a-9a83-f5f37de1a3a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115634 Jul 25 20:09:17.998749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 676/1370] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:18.021638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:18.024239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:18.032381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:18.054546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.055294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:18.057334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.058542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:18.274655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:18.289754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52808c70-7c50-4266-93e4-28cb4be41932 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1319 microversion: 2.1 time: 0.687817 Jul 25 20:09:18.292483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 695/1371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:17 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1319 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:18.300924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:18.302275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:18.311725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.312289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:18.313092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.313640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:18.598059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:18.618669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:18.628792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:18.630352 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8cd1b25e-b057-466b-82e2-83a69748ea2e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1293 microversion: 2.25 time: 0.620546 Jul 25 20:09:18.631542 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 677/1372] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:18 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1293 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:18.637575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:18.638508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:18.647243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.648171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:18.649742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:18.651098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:19.321368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:19.334280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:19.354810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f3932c6-cdcd-4e5d-9122-07ad60c636ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 1.061214 Jul 25 20:09:19.376073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 696/1373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:18 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:19.376073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:19.376073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:19.378613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:19.380867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:19.382576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:19.385920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:19.964650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:20.003917 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad3446c4-d507-40c0-8dde-c5b96b1826fd tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1680 microversion: 2.1 time: 1.370263 Jul 25 20:09:20.036533 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 678/1374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:18 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1680 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:20.047287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:20.048464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:20.067698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.068521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.070137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.070995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.101209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:20.125681 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9d0df77-8f35-4785-a5fd-bc53bba4c057 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.767981 Jul 25 20:09:20.133229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 697/1375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:19 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:20.140337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:20.154849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:20.179462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.181932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.185935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.190299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.204227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:20.841809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:20.853935 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d7e13a8-31a6-42f9-835d-d274b641aa70 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 0.718131 Jul 25 20:09:20.854811 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 698/1376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:20 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:20.860589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:20.861475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:20.870450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.871634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.872673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.873317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.942379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:20.960748 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1a227f5-287c-47f8-be85-bd15246c598b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 200 len: 1475 microversion: 2.1 time: 0.922216 Jul 25 20:09:20.961977 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 679/1377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:20 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 1475 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:20.970189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:20.972746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:20.991056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.992598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:20.994468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:20.995639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:21.829574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:21.847730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-299d9ff6-7dd5-444c-9baf-1d35375d9cc2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1319 microversion: 2.1 time: 0.991028 Jul 25 20:09:21.861419 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 699/1378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:20 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:21.870110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f344df8a-5502-4c85-96a9-92c87b3f44e0 req-818032f8-0f4d-4daf-a54b-3b2d4011614a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b27a3f7-0303-403e-aa62-ab70ddd0dc77", "name": "network-vif-plugged", "status": "completed", "tag": "25326a4e-6115-4e9e-9806-aa6ad5513dfa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:21.924950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f344df8a-5502-4c85-96a9-92c87b3f44e0 req-818032f8-0f4d-4daf-a54b-3b2d4011614a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:21.925818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f344df8a-5502-4c85-96a9-92c87b3f44e0 req-818032f8-0f4d-4daf-a54b-3b2d4011614a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:21.980835 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f344df8a-5502-4c85-96a9-92c87b3f44e0 req-818032f8-0f4d-4daf-a54b-3b2d4011614a service nova] Creating event network-vif-plugged:25326a4e-6115-4e9e-9806-aa6ad5513dfa for instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 on n-h1-845775-3 Jul 25 20:09:22.006891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f344df8a-5502-4c85-96a9-92c87b3f44e0 req-818032f8-0f4d-4daf-a54b-3b2d4011614a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143283 Jul 25 20:09:22.008835 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 700/1379] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:22.023985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:22.029652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:22.032697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:22.055151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:22.061252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.062760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:22.065399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.079537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:22.085361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:22.088312 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c449c745-7502-4cf6-b16c-bcb4a5ea7d31 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1293 microversion: 2.25 time: 1.123435 Jul 25 20:09:22.123295 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 680/1380] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:20 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1293 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:22.143417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-180493235"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:22.149444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:22.169021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.170108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:22.171675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.172655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:22.770076 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4117557b-bb72-47d2-bdaa-8e75419f2acc tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e/action" status: 202 len: 0 microversion: 2.1 time: 0.632642 Jul 25 20:09:22.778046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:22.783462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 681/1381] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:09:22 2022] POST /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:09:22.793801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-249d0e9d-785b-4df0-8c02-d6c3574caf24 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 0.782121 Jul 25 20:09:22.799721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 701/1382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:22 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:22.842635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:22.846875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:22.907367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.914743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:22.919105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:22.927276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:23.326841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87596ed917d44ee68e1c99fdfb615691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a02caecccc4d029158f69fde1e1ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:23.349868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41093ff3-c268-4993-a2b2-2eabeac9ee32 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 200 len: 1613 microversion: 2.1 time: 0.557755 Jul 25 20:09:23.368527 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 682/1383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:22 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 1613 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:23.387612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:23.390578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:23.422037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:23.428465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:23.432697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:23.433294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:23.609727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:23.610461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:23.621768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:23.623556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:23.625460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:23.626446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:24.938817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:24.954745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-15fcd64c-5bd3-4604-a1a3-ded73215b274 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 2.149982 Jul 25 20:09:24.968074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:24.969742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 702/1384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:22 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:24.986755 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f41aa34-d93a-493c-a52d-548107295783 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 1.607896 Jul 25 20:09:24.987944 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 683/1385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:23 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:24.989341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f6fca05e-51fe-49e2-a02f-f6fb71c65661 req-8f6c693c-9dcf-488a-bdb4-4670317a16c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "name": "network-vif-unplugged", "status": "completed", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:24.999887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4ddcfe0-8421-48c8-abb5-1bfe7186e651 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969533f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:25.004320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6fca05e-51fe-49e2-a02f-f6fb71c65661 req-8f6c693c-9dcf-488a-bdb4-4670317a16c7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:25.005270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6fca05e-51fe-49e2-a02f-f6fb71c65661 req-8f6c693c-9dcf-488a-bdb4-4670317a16c7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:25.030055 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f6fca05e-51fe-49e2-a02f-f6fb71c65661 req-8f6c693c-9dcf-488a-bdb4-4670317a16c7 service nova] Creating event network-vif-unplugged:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:09:25.039732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f6fca05e-51fe-49e2-a02f-f6fb71c65661 req-8f6c693c-9dcf-488a-bdb4-4670317a16c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067419 Jul 25 20:09:25.047717 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 703/1386] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:25.061855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:25.073215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:25.097019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:25.103050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:25.108312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:25.109942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:25.187878 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4ddcfe0-8421-48c8-abb5-1bfe7186e651 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.195771 Jul 25 20:09:25.188971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 684/1387] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:24 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:25.221556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:25.229039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:25.267490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:25.270009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:25.274370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:25.276263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.126780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:26.145226 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3edbeb5-5c16-436a-abf2-f32ae506f36a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1469 microversion: 2.1 time: 1.094089 Jul 25 20:09:26.167388 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 704/1388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:25 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1469 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:26.211837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:26.218303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:26.242551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.244590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.248501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.250815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.523592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:26.549044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:26.551373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:26.563628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c678c100-e7b4-4c01-b818-592617750a71 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 1.356905 Jul 25 20:09:26.586274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 685/1389] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:25 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:26.612908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f1a562e6-8693-4923-a82c-6e97cc42a01d req-43a90134-449f-4102-a7a6-90be6515e3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc7b0c6-f25a-439d-981e-778d3e193654", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:26.626378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f1a562e6-8693-4923-a82c-6e97cc42a01d req-43a90134-449f-4102-a7a6-90be6515e3ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.626999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f1a562e6-8693-4923-a82c-6e97cc42a01d req-43a90134-449f-4102-a7a6-90be6515e3ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.663041 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f1a562e6-8693-4923-a82c-6e97cc42a01d req-43a90134-449f-4102-a7a6-90be6515e3ad service nova] Creating event network-vif-plugged:b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7 for instance bdc7b0c6-f25a-439d-981e-778d3e193654 on n-h2-845775-3 Jul 25 20:09:26.674009 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f1a562e6-8693-4923-a82c-6e97cc42a01d req-43a90134-449f-4102-a7a6-90be6515e3ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085250 Jul 25 20:09:26.677313 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 686/1390] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:26.689649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-11514d96-ed39-4ea3-81a8-254cc82e84f7 req-137c7e72-0001-4f74-9c4d-f7a5fecb0420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6390f85-ea47-471e-b3ba-eb2f11646e27", "name": "network-vif-deleted", "tag": "a15e061d-6acc-4e2b-a4aa-6196683e9412"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:26.703154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:26.733194 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6cfbb368-dd09-4aca-888f-28dbff565103 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 0.546015 Jul 25 20:09:26.733194 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 705/1391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:26 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:26.737852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-11514d96-ed39-4ea3-81a8-254cc82e84f7 req-137c7e72-0001-4f74-9c4d-f7a5fecb0420 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.737852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-11514d96-ed39-4ea3-81a8-254cc82e84f7 req-137c7e72-0001-4f74-9c4d-f7a5fecb0420 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.756745 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-11514d96-ed39-4ea3-81a8-254cc82e84f7 req-137c7e72-0001-4f74-9c4d-f7a5fecb0420 service nova] Creating event network-vif-deleted:a15e061d-6acc-4e2b-a4aa-6196683e9412 for instance d6390f85-ea47-471e-b3ba-eb2f11646e27 on n-h2-845775-3 Jul 25 20:09:26.761520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:26.763924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] [instance: d6390f85-ea47-471e-b3ba-eb2f11646e27] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:26.774065 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-11514d96-ed39-4ea3-81a8-254cc82e84f7 req-137c7e72-0001-4f74-9c4d-f7a5fecb0420 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093050 Jul 25 20:09:26.777300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:26.778749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 687/1392] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:26.782917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.784164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.785473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.786181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.795681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:26.796636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:26.810243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.811457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.813608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.814952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.844173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] HTTP exception thrown: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Request method failure captured: Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 HTTP/1.1 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vegYMUb1RXpMD27fE6c5-HwgZaLiSx-LczTUItrdz75abL25iX1XAmv_FTshyOVp4PsgvNUElQwAFmnzPTjgXf19RTluopSl-oVOORmMFMhzIApkj3qGNHeakyApL970qSichRpii6EDoSNM46TjLf8j-8B8YUrqURtDu-5fE_HXwI Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 00a02caecccc4d029158f69fde1e1ea3 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:09:26.848181 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00a02caecccc4d029158f69fde1e1ea3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00a02caecccc4d029158f69fde1e1ea3"}]}] Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 00a02caecccc4d029158f69fde1e1ea3 Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2050996409 Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesAdminNegativeTest-2050996409-project Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 87596ed917d44ee68e1c99fdfb615691 Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesAdminNegativeTest-2050996409-project Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. Jul 25 20:09:26.850596 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd6390f85-ea47-471e-b3ba-eb2f11646e27'} Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:09:26.852397 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. Jul 25 20:09:26.857255 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:26.861633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Returning 404 to user: Instance d6390f85-ea47-471e-b3ba-eb2f11646e27 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:09:26.861633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e295f30-5970-4ee5-837c-14c0ebfc8de4 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27" status: 404 len: 111 microversion: 2.1 time: 0.123487 Jul 25 20:09:26.861633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 706/1393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:26 2022] GET /compute/v2.1/servers/d6390f85-ea47-471e-b3ba-eb2f11646e27 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:09:26.867823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:26.869038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:26.886704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.886704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:26.889582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:26.890226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:27.297772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:27.323694 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5739741-48ca-40d2-9a75-db2d72f2ef4b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.541532 Jul 25 20:09:27.375577 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 688/1394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:26 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:27.387599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:27.389591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:27.403925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:27.405213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:27.407860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:27.409168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:27.441665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:27.473704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8973b3f9-adbd-480a-bf10-9d1f95270fc4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 0.610142 Jul 25 20:09:27.475232 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 707/1395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:26 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:27.496787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-39c0248e-fb54-48f0-af5f-0edd73cfcd3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196962d8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:27.669407 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-39c0248e-fb54-48f0-af5f-0edd73cfcd3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.191000 Jul 25 20:09:27.672184 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 708/1396] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:27 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:27.685366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d741b7b-9e39-4e41-8e91-c03c46c1ecf0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] Calling method '.version_select at 0x7f1969582ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:27.749961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d741b7b-9e39-4e41-8e91-c03c46c1ecf0 tempest-VolumesAdminNegativeTest-2050996409 tempest-VolumesAdminNegativeTest-2050996409-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119428391" status: 202 len: 0 microversion: 2.1 time: 0.071975 Jul 25 20:09:27.749961 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 709/1397] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119428391 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:09:27.771290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}, {"name": "network-changed", "server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:27.803626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:27.805049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:27.853137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] Creating event network-changed:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h2-845775-3 Jul 25 20:09:27.854585 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] Creating event network-changed:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:09:27.918392 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4e1c8aa4-52b7-49db-b2f3-0f7d9858907f req-6bc1d9c8-4708-412c-bb53-11d20e921b62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.156541 Jul 25 20:09:27.923664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 710/1398] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:27.947559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:27.950858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:27.980074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:27.981437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:27.983297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:27.984990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:29.001662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:29.044457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:29.060871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:29.064729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:29.068617 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a64810d-40b8-45fb-8c28-65338ea9a467 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1319 microversion: 2.1 time: 1.689508 Jul 25 20:09:29.075639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8f8bfe0-4bcb-4041-b3f5-8c2cd50a3f88 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 1.147138 Jul 25 20:09:29.088072 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 689/1399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:27 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1319 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:29.088612 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 711/1400] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:27 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:29.116733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:29.119686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:29.121695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:29.127715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:29.144634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:29.145331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:29.145899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:29.146179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:29.148081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:29.148937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:29.150382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:29.151647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:29.931177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:29.974246 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-afd3240f-3b7e-4db4-b86c-2286fb1368db tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.890195 Jul 25 20:09:29.976645 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 712/1401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:29 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:29.987703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:29.989321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:30.022636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:30.025352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:30.027295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:30.034489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:30.662168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:30.704694 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a1ad9128-5a5d-47ee-b867-efc6578e1a01 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 1.615417 Jul 25 20:09:30.713907 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 690/1402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:29 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:30.742766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5f009caa-3469-4c89-9e50-c0ffa4005ee5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196987dee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:30.909622 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5f009caa-3469-4c89-9e50-c0ffa4005ee5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.187126 Jul 25 20:09:30.925277 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 691/1403] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:30 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:30.944442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:30.946056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:30.961656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:30.962527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:30.964152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:30.965184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:31.392815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:31.429843 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-616a7c86-126b-4183-8584-01e4c04c7916 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 1.449394 Jul 25 20:09:31.431930 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 713/1404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:29 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:31.443365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:31.456812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:31.475907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:31.477630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:31.480463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:31.481624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:31.936082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:31.996731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f05420b-c623-47f2-b073-b8535d406948 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1468 microversion: 2.1 time: 1.068432 Jul 25 20:09:32.018552 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 692/1405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:30 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1468 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:32.047788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-03e1ed04-051f-42ed-a2f5-48bef9829234 req-251f1d28-8a98-4c46-8b3b-325e1ce3114c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819316d7-7a6c-464d-9d57-c9d1dedcc64e", "name": "network-vif-plugged", "status": "completed", "tag": "eabf546b-6c04-47d5-84fe-88b220a459d6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:32.111394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-03e1ed04-051f-42ed-a2f5-48bef9829234 req-251f1d28-8a98-4c46-8b3b-325e1ce3114c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:32.115744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-03e1ed04-051f-42ed-a2f5-48bef9829234 req-251f1d28-8a98-4c46-8b3b-325e1ce3114c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:32.164741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-03e1ed04-051f-42ed-a2f5-48bef9829234 req-251f1d28-8a98-4c46-8b3b-325e1ce3114c service nova] Creating event network-vif-plugged:eabf546b-6c04-47d5-84fe-88b220a459d6 for instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e on n-h1-845775-3 Jul 25 20:09:32.176930 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-03e1ed04-051f-42ed-a2f5-48bef9829234 req-251f1d28-8a98-4c46-8b3b-325e1ce3114c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162228 Jul 25 20:09:32.179410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 693/1406] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:32.193692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:32.195573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:32.207978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:32.208276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:32.210823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:32.213334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:32.214435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:32.245553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:32.267080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:32.269816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c58e735-1271-4f78-88cf-f09ad6a5480b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 0.835755 Jul 25 20:09:32.277089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 714/1407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:31 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:32.295570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:32.318093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:32.344252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:32.347906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:32.349420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:32.353745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:33.385142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:33.440697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2c2370c-e7cc-426f-aa48-df5a576976f0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 1.258405 Jul 25 20:09:33.441573 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 694/1408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:32 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:33.469357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:33.480066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5af28001-1e78-473b-9022-44f6661eaf9d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969533940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:33.489342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac2a1f93-4bd1-4e14-bd72-cd4b3ee743e6 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 1.210306 Jul 25 20:09:33.495706 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 715/1409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:32 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:33.530531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:33.547194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:33.558103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Searching by: {'reservation_id': 'r-wvjo62nl', 'deleted': False, 'project_id': 'ce2718565d4b48ab8235a338f7282313'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:09:33.581569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:33.584439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:33.598966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:33.604388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:33.644082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5af28001-1e78-473b-9022-44f6661eaf9d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.196935 Jul 25 20:09:33.651300 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 695/1410] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:33 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:33.680354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:33.682038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:33.705822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:33.717247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:33.719577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:33.720675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:34.218775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:09:34.267345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:34.308989 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b9a058b4-6e55-4217-9be7-7d3b20747af0 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 0.653553 Jul 25 20:09:34.316167 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 696/1411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:33 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:34.343839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:34.350066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:34.387619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:34.390675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:34.396298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:34.397843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:34.469722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:34.484975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:34.487010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:34.523554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:35.710059 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-21fe0efd-ba4e-4987-ba1e-d245d9e594f3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-wvjo62nl" status: 200 len: 2930 microversion: 2.1 time: 2.211888 Jul 25 20:09:35.728960 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 716/1412] 10.222.0.48 () {58 vars in 1197 bytes} [Mon Jul 25 20:09:33 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wvjo62nl => generated 2930 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:35.757759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:35.760183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:35.774855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:35.776214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:35.778458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:35.779689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:35.847910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:35.867721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:35.873699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:35.876250 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1200a5d0-addc-4261-9f8b-c0843fc6107b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 1.558191 Jul 25 20:09:35.877532 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 697/1413] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:34 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:35.896797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:35.904921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:35.934075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:35.934789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:35.939327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:35.945406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:36.196666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:36.234721 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-989f23d2-b68f-43f7-8821-fef281464698 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.502422 Jul 25 20:09:36.236528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 717/1414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:35 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:36.258404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0b51513f-d569-4187-a186-956ebcb3d398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196962d430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:36.409582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:36.443613 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0b51513f-d569-4187-a186-956ebcb3d398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.204495 Jul 25 20:09:36.444839 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 718/1415] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:36 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:36.452519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2f36780-e69b-464f-ac40-04d651ca1402 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 0.558225 Jul 25 20:09:36.454730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 698/1416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:35 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:36.458716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:36.465326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:36.481854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:36.483235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:36.485223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:36.486297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:36.930155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aa4574b0-7de5-4ab6-ab3d-089c5b4f9379 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:36.934293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:36.942844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:36.959948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53b9d8f1-f1c6-4f49-a1ec-bb0b11c77fb9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1517 microversion: 2.1 time: 0.513335 Jul 25 20:09:36.962128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 719/1417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:36 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:36.973137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee801589-8d60-48b9-b15a-95227cdb2144 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:36.988748 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aa4574b0-7de5-4ab6-ab3d-089c5b4f9379 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.532207 Jul 25 20:09:37.005589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 699/1418] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:09:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:37.022584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.server_groups [None req-ee801589-8d60-48b9-b15a-95227cdb2144 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Querying cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) for 2 instances {{(pid=119724) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 20:09:37.024912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee801589-8d60-48b9-b15a-95227cdb2144 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.025680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee801589-8d60-48b9-b15a-95227cdb2144 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.025993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bd2896c8-5825-4abe-93e6-e4523212fc6c req-c5f020c0-eca1-4290-9f8d-f4776a41f806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "name": "network-vif-unplugged", "status": "completed", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:37.081430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bd2896c8-5825-4abe-93e6-e4523212fc6c req-c5f020c0-eca1-4290-9f8d-f4776a41f806 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.082291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bd2896c8-5825-4abe-93e6-e4523212fc6c req-c5f020c0-eca1-4290-9f8d-f4776a41f806 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.111785 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee801589-8d60-48b9-b15a-95227cdb2144 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/74a5607b-2f43-49e4-8281-c82be72e51b8" status: 200 len: 270 microversion: 2.1 time: 0.144420 Jul 25 20:09:37.120301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 720/1419] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:09:36 2022] GET /compute/v2.1/os-server-groups/74a5607b-2f43-49e4-8281-c82be72e51b8 => generated 270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:37.131278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bd2896c8-5825-4abe-93e6-e4523212fc6c req-c5f020c0-eca1-4290-9f8d-f4776a41f806 service nova] Creating event network-vif-unplugged:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h1-845775-3 Jul 25 20:09:37.141654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:37.142725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:37.147997 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bd2896c8-5825-4abe-93e6-e4523212fc6c req-c5f020c0-eca1-4290-9f8d-f4776a41f806 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138980 Jul 25 20:09:37.149570 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 700/1420] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:37.160868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:37.162963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:37.167718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.168140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.175270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.180478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.181606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.182983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.184661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.185745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.731932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:37.778361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:37.786882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:37.790814 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f097606-02d9-41df-a704-395120168872 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 0.667874 Jul 25 20:09:37.793344 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 721/1421] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:37 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:37.810336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:37.811908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:37.843183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.843364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.846231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:37.848566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:37.932888 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96e286d3-e509-403a-814c-1b91e33295a7 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 200 len: 1620 microversion: 2.1 time: 0.780283 Jul 25 20:09:37.952825 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 701/1422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:37 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 1620 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:37.976169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34fd3bd9-24b8-4dee-ad03-30250297d2e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19695343a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:38.385843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:38.412798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-90a4c8e8-0185-43d8-bdcd-f3c9f53609af tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.617127 Jul 25 20:09:38.418211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 722/1423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:37 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:38.432799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:38.448269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:38.467977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:38.475636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:38.477228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:38.478792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.203664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34fd3bd9-24b8-4dee-ad03-30250297d2e6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 1.248879 Jul 25 20:09:39.206829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 702/1424] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:37 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:39.219479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:39.221419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:39.230002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:39.252196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.253759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.255437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.256640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.285546 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7450ef18-c1b4-40d0-a24f-f09e7d3d4131 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 0.845659 Jul 25 20:09:39.287538 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 723/1425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:38 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:39.357340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:39.358507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:39.383564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.392785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.395736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.396968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.864011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04c6328f-32b2-4c94-b2fd-ea786855d686 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1619 microversion: 2.1 time: 0.654593 Jul 25 20:09:39.880521 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 703/1426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:39 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1619 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:39.890164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:39.891355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:39.924047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.925151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:39.926941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:39.934538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:40.375305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:40.397536 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05282989-a6a7-46c6-9ca1-3da084877759 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1523 microversion: 2.1 time: 1.083408 Jul 25 20:09:40.404824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 724/1427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:39 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1523 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:40.421614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-250715434", "imageRef": "3e6c0854-1524-4b78-b5fc-1cd30c81c944", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:40.642083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:09:40.838912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:40.876495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:40.880935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:40.891664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5911fe89-bd52-4590-8268-c96a328176ce tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 1.008962 Jul 25 20:09:40.893811 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 704/1428] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:39 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:40.905714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:40.911486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:40.926391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:40.927602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:40.929119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:40.930043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:41.465584 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] Request method failure captured: Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 142 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vh_EcOzfTY8Wwsv96zVnrWcPKX-eFhuvfBjc9bfpaIwQt6JfyDJWW3wbpdpLxLe4oFZUVFD6FivRcMTEKkLW8XORr4niN4FrZ8zFePZ0eoJEAW8LmGpxaxtUSxgEG84lvvdSHefezvyaJMIEyEYVXMTg_BDBMxuE_VOCbmtIyMx6N4 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f0c936c72c6d458bb09d8317ec24ded0 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FlavorsV2NegativeTest-940907691 Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:09:41.473178 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0c936c72c6d458bb09d8317ec24ded0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f0c936c72c6d458bb09d8317ec24ded0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f0c936c72c6d458bb09d8317ec24ded0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0c936c72c6d458bb09d8317ec24ded0"}]}] Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FlavorsV2NegativeTest-940907691 Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f0c936c72c6d458bb09d8317ec24ded0 Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-940907691 Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FlavorsV2NegativeTest-940907691-project Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1cab75b5027f49e1834075008f621c5c Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FlavorsV2NegativeTest-940907691-project Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-250715434", "imageRef": "3e6c0854-1524-4b78-b5fc-1cd30c81c944", "flavorRef": "452"}} Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:09:41.475651 n-d-845775-3 devstack@n-api.service[119724]: exception: Flavor's memory is too small for requested image. Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-250715434', 'imageRef': '3e6c0854-1524-4b78-b5fc-1cd30c81c944', 'flavorRef': '452'}}} Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:41.477208 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:41.480069 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:09:41.487135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:09:41.489309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1bc9e45f-00d6-4cd9-bab3-953d6f2324c9 tempest-FlavorsV2NegativeTest-940907691 tempest-FlavorsV2NegativeTest-940907691-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.082323 Jul 25 20:09:41.497292 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 725/1429] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:09:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 1090 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:09:41.506630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81a44286-adba-4c1e-a9d1-3642fcd1851e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969799dc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:41.590827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:41.646802 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfd9d2f9-53dc-42e1-94bc-66e4fa9f501f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1718 microversion: 2.1 time: 0.750550 Jul 25 20:09:41.678269 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 705/1430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:40 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1718 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:41.692397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-87557640", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d7621d37-160c-4885-8f49-abe92624f69a"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:42.666685 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81a44286-adba-4c1e-a9d1-3642fcd1851e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 1.167135 Jul 25 20:09:42.689703 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 726/1431] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:41 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:42.718136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:09:42.741439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:42.742804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:42.760646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:42.762064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:42.764237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:42.765291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:43.749865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:43.765377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:43.806541 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3de9ec6-2e42-4f30-a0c1-4b65a80b1a06 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1505 microversion: 2.1 time: 1.096441 Jul 25 20:09:43.807687 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 727/1432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:42 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1505 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:43.823000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-28d0e83a-0474-4928-90ff-c165cd36450c req-7479dd9c-f38d-4a81-932a-2be227d013b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "name": "network-vif-plugged", "status": "completed", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:43.901151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-28d0e83a-0474-4928-90ff-c165cd36450c req-7479dd9c-f38d-4a81-932a-2be227d013b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:43.911587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-28d0e83a-0474-4928-90ff-c165cd36450c req-7479dd9c-f38d-4a81-932a-2be227d013b0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:43.936400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-28d0e83a-0474-4928-90ff-c165cd36450c req-7479dd9c-f38d-4a81-932a-2be227d013b0 service nova] Creating event network-vif-plugged:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h2-845775-3 Jul 25 20:09:43.950054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-28d0e83a-0474-4928-90ff-c165cd36450c req-7479dd9c-f38d-4a81-932a-2be227d013b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138642 Jul 25 20:09:43.964075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 728/1433] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:43.972505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:43.973582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:43.987464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:43.993182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:43.998869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:44.008551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:44.323025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:09:44.324284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:09:44.325823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:09:44.326705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:09:44.330995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:09:44.393815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:44.399426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:44.401685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:44.402698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:44.463534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:44.466767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:44.482439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:44.516144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:09:44.529190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:09:44.672859 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69b36db4-0dda-45cf-b99a-2578d3f92f0c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.992213 Jul 25 20:09:44.681932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 706/1434] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:09:44.691847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:44.692995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:44.735626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:44.736660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:44.741532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:44.742352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:45.178648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:45.216482 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc50a0b2-b552-481e-a399-f3f3430d726c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1523 microversion: 2.1 time: 1.249840 Jul 25 20:09:45.226008 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 729/1435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:43 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1523 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:45.250584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:45.263034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:45.310767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:45.325196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:45.340945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:45.342356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:46.376000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:46.424113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:46.436179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:46.449194 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d992317d-253a-4492-8133-ef1838d45e06 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1281 microversion: 2.25 time: 1.765411 Jul 25 20:09:46.456014 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 707/1436] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:44 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1281 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:46.489050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef7e788d-2134-4335-baec-8aaa230a9665 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19694fb310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:46.793937 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef7e788d-2134-4335-baec-8aaa230a9665 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.335197 Jul 25 20:09:46.794990 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 708/1437] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:46 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:46.825204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:46.826297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:46.849912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:46.850966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:46.864571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:46.866124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:46.989807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:47.020144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43b298a4-8363-4bd1-89e2-d61ef25d31ca tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1708 microversion: 2.1 time: 1.786814 Jul 25 20:09:47.027519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 730/1438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:45 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1708 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:47.059708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:47.063183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:47.077521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:47.083522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:47.085621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:47.087312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:47.087986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:47.131279 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f38f07a-f9bf-4e0a-bb08-2c42078cbd85 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1219 microversion: 2.1 time: 0.317171 Jul 25 20:09:47.138410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 709/1439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:46 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1219 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:47.156352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-83f6f168-4c58-49fe-98a8-28afb5bd1d7a req-7b94044f-9862-46be-a473-6dd49013ddd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a6db6b-ffb4-49a1-99f3-321986fdd30d", "name": "network-vif-plugged", "status": "completed", "tag": "8f665d04-b382-4c93-86b5-9e4b4afecc98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:47.199412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-83f6f168-4c58-49fe-98a8-28afb5bd1d7a req-7b94044f-9862-46be-a473-6dd49013ddd3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:47.200204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-83f6f168-4c58-49fe-98a8-28afb5bd1d7a req-7b94044f-9862-46be-a473-6dd49013ddd3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:47.240404 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-83f6f168-4c58-49fe-98a8-28afb5bd1d7a req-7b94044f-9862-46be-a473-6dd49013ddd3 service nova] Creating event network-vif-plugged:8f665d04-b382-4c93-86b5-9e4b4afecc98 for instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d on n-h1-845775-3 Jul 25 20:09:47.285376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-83f6f168-4c58-49fe-98a8-28afb5bd1d7a req-7b94044f-9862-46be-a473-6dd49013ddd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139611 Jul 25 20:09:47.287853 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 710/1440] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:09:47.317941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:47.325403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:47.356436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:47.358354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:47.362929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:47.365095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:48.015366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:48.048175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0ce3d9dc-de9b-43e9-8a60-c73bd07c69c2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1485 microversion: 2.1 time: 1.014127 Jul 25 20:09:48.053179 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 731/1441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:47 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1485 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:48.079786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81ea4c6b-f11b-4d09-a3ca-da2a709291cf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '.version_select at 0x7f1969888f70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:48.121061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81ea4c6b-f11b-4d09-a3ca-da2a709291cf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:48.122398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81ea4c6b-f11b-4d09-a3ca-da2a709291cf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:48.181135 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81ea4c6b-f11b-4d09-a3ca-da2a709291cf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.123421 Jul 25 20:09:48.189443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 732/1442] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:09:48 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:48.215202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:48.217185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:48.236739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:48.238256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:48.240648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:48.242124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:48.797701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:48.818844 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-204f0faa-b95e-45f7-8c3c-87fa713b42ef tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1523 microversion: 2.1 time: 1.522942 Jul 25 20:09:48.822345 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 711/1443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:47 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1523 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:48.834814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d666b15b-19bb-4a51-b3df-e0fedef62b7e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19695c5820>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:49.108847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d666b15b-19bb-4a51-b3df-e0fedef62b7e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.282664 Jul 25 20:09:49.110938 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 712/1444] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:48 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:49.123254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:49.125006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:49.142631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:49.148723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:49.150443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:49.168625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:49.170221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:49.808325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:49.837273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1971e79f-4d82-450c-a774-b5dc272126af tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1273 microversion: 2.1 time: 0.722600 Jul 25 20:09:49.842009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 713/1445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:49 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1273 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:49.865689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:49.867597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:49.904154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:49.911137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:49.914420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:49.917719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:50.317401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:50.340995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:50.351198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:50.356575 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5d601e58-628f-43a3-acea-05b06e1283af tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1477 microversion: 2.25 time: 2.163496 Jul 25 20:09:50.357335 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 733/1446] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:48 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1477 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:50.377090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1777193129", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:50.558350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] validate_networks() for [('fa4e4c44-7e49-4a24-871f-cfe03e9ff1a6', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:09:50.715174 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa2067ee-4d0f-4d6b-9116-1a294da9afe2 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1859 microversion: 2.1 time: 0.867179 Jul 25 20:09:50.728075 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 714/1447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:49 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1859 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:50.746569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:50.746569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:50.747827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:50.748474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:50.750071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:50.750350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:51.418433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:51.441478 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-080a3ffe-ed7f-4e54-9061-4b474fc4a11e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1508 microversion: 2.1 time: 0.723768 Jul 25 20:09:51.442273 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 715/1448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:50 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1508 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:51.468856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ba55e95-2a67-473b-a938-6b4470513a9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19695d5550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:51.668153 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ba55e95-2a67-473b-a938-6b4470513a9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.219977 Jul 25 20:09:51.669676 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 716/1449] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:51 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:52.335611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:52.335611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:52.362273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:52.363039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:52.364333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:52.365002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.013870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid bb495200-ec26-4477-bea0-13eccabd6397 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:09:53.073889 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f000137-d513-4b1d-a8f5-51685d0cb79f tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1970 microversion: 2.25 time: 1.402363 Jul 25 20:09:53.083051 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 717/1450] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:51 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1970 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:53.153524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:09:53.154335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:09:53.155040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:09:53.155695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:09:53.156546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:09:53.207972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.208705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.211009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.212498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.287859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Getting quotas for project 10813483bba14011bc0cba01d3b52ca9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:09:53.316638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Getting quotas for user 2c67ccc2a03e4e4fb57097603a0fe80e and project 10813483bba14011bc0cba01d3b52ca9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:09:53.379215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:09:53.393821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:09:53.556658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-be441344-3567-4095-bfa8-f2f2cd742f1e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.197601 Jul 25 20:09:53.557816 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 734/1451] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:09:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:09:53.571444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:53.572579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:53.598782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.599664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.601156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.601973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.656711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:53.660795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:53.688491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.702187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.703800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.706877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.846060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:53.875291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20020595-0471-4daf-9bbd-6ac338c92a28 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1273 microversion: 2.1 time: 0.306495 Jul 25 20:09:53.877120 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 735/1452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:53 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:53.909995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:53.914333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:53.951106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.952313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:53.956576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:53.965221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:54.438627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:54.501172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:55.273563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:55.278232 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f4122f5-a7fc-41b1-88b4-ee81c4d1c0bf tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1859 microversion: 2.1 time: 2.164391 Jul 25 20:09:55.279360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 718/1453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:53 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1859 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:55.321702 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a3e400e-14b5-4beb-ae6e-0967926f26a6 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 200 len: 1508 microversion: 2.1 time: 1.442037 Jul 25 20:09:55.322723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 736/1454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:53 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 1508 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:55.326598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69242b27-b904-4173-acfe-2ebd5c44c07d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969534670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:55.359476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:55.365817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:55.389894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:55.394672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:55.397837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:55.398537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:55.526004 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69242b27-b904-4173-acfe-2ebd5c44c07d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.239082 Jul 25 20:09:55.546970 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 719/1455] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:55 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:55.598391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:55.607585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:55.628377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:55.630014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:55.633028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:55.634174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:56.116681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:56.139333 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03e0d233-5f94-4343-8e1d-3439d782963e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1210 microversion: 2.1 time: 0.578147 Jul 25 20:09:56.156609 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 720/1456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:55 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1210 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:56.178051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:56.179564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:56.197122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:56.198796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:56.201011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:56.202831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:56.249555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:56.937881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid bb495200-ec26-4477-bea0-13eccabd6397 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:09:57.032987 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2fc8ce2-0126-4ecf-a58b-ec6a8a281948 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1970 microversion: 2.25 time: 1.708516 Jul 25 20:09:57.047696 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 737/1457] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:09:55 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1970 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:09:57.074769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:57.075651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:57.103973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:57.123435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:57.124573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:57.126521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:57.127553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:57.230724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:09:57.565466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:09:57.739274 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d98974b-f31d-4e51-bb94-912cc4629d20 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 204 len: 0 microversion: 2.1 time: 0.686779 Jul 25 20:09:57.767084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 738/1458] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:09:57 2022] DELETE /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:09:57.814809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:57.816569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:57.861073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:57.861886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:57.890656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:57.891460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:58.359678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lazy-loading 'services' on Instance uuid ae29a5e1-d80c-45f5-b11f-514b6cf29926 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:09:58.653018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a9e742b-fe84-458c-8c74-5833086e145f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments/4f3d9709-181f-4c51-a986-2cf4e61cdc72" status: 202 len: 0 microversion: 2.1 time: 0.896195 Jul 25 20:09:58.659915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 739/1459] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:09:57 2022] DELETE /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments/4f3d9709-181f-4c51-a986-2cf4e61cdc72 => generated 0 bytes in 906 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:09:58.730594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0fcef654-488d-4945-a052-fda7aa79ab8f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19696ed040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:58.981571 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0fcef654-488d-4945-a052-fda7aa79ab8f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.269800 Jul 25 20:09:58.982623 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 740/1460] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:09:58 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:59.013650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:59.024617 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:09:59.024617 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:09:59.028268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.029754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:59.030798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.031567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:59.090876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed2bf2b4-2f0a-4f62-b747-ee8e33864238 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.106409 Jul 25 20:09:59.092276 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 741/1461] 10.222.0.48 () {60 vars in 1217 bytes} [Mon Jul 25 20:09:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:09:59.101698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:59.105023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:59.158444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.159329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:59.161876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.162672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:59.779522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:59.815407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:09:59.827412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-17e3f34e-046e-4cc6-954b-729dbda51005 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1272 microversion: 2.1 time: 0.728312 Jul 25 20:09:59.828854 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 742/1462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:59 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1272 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:59.841486 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a57aec9-07c6-4192-b451-2cd8f93011a4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1315 microversion: 2.1 time: 3.683289 Jul 25 20:09:59.846009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-10812288", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "474142bd-b6db-42e4-b8e5-a59a376c1800"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:09:59.861018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 721/1463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:09:56 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1315 bytes in 3703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:09:59.875725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:09:59.897480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:09:59.909556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.916086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:09:59.917716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:09:59.918528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:00.079434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] validate_networks() for [('474142bd-b6db-42e4-b8e5-a59a376c1800', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:00.108187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aac93067-a98e-4ef3-b4ac-7e1b50d0507e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244840 Jul 25 20:10:00.121460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 722/1464] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:09:59 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:00.135548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845775-3", "block_migration": "auto"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:00.139830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:00.166188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:00.167361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:00.177075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:00.177971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:00.266901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'flavor' on Instance uuid bb495200-ec26-4477-bea0-13eccabd6397 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:10:00.317585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Going to try to live migrate instance to n-h1-845775-3 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:10:03.354840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:04.815643 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b9dfa1d-20ee-4976-a432-8ebe0f1aea6e tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397/action" status: 202 len: 0 microversion: 2.25 time: 4.691647 Jul 25 20:10:04.818600 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 723/1465] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:10:00 2022] POST /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397/action => generated 0 bytes in 4696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:04.827519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1a92c6d0-d9ea-4abe-b04c-b3424a7bc06e req-803ae46f-58cf-4d91-bb6c-c655e943b96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8daa55b-0aaf-4f3d-b83e-9a455707ecee", "tag": "5f932179-17d5-4826-9ed2-9c928956f752"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:04.897455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1a92c6d0-d9ea-4abe-b04c-b3424a7bc06e req-803ae46f-58cf-4d91-bb6c-c655e943b96f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:04.898563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1a92c6d0-d9ea-4abe-b04c-b3424a7bc06e req-803ae46f-58cf-4d91-bb6c-c655e943b96f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:04.962195 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1a92c6d0-d9ea-4abe-b04c-b3424a7bc06e req-803ae46f-58cf-4d91-bb6c-c655e943b96f service nova] Creating event network-changed:5f932179-17d5-4826-9ed2-9c928956f752 for instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee on n-h2-845775-3 Jul 25 20:10:04.972144 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1a92c6d0-d9ea-4abe-b04c-b3424a7bc06e req-803ae46f-58cf-4d91-bb6c-c655e943b96f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151348 Jul 25 20:10:04.974395 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 724/1466] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:04.996517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eba5dd43-c133-4764-89d4-2261b1d8f9d7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196963cb80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:05.169541 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eba5dd43-c133-4764-89d4-2261b1d8f9d7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1413 microversion: 2.1 time: 0.192512 Jul 25 20:10:05.170883 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 725/1467] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:10:04 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1413 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:05.188302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:05.189355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:05.215314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:05.216519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:05.219238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:05.222916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:05.467011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:05.468111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:05.468111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:05.468771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:05.469655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:05.508959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:05.509569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:05.510695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:05.511452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:05.646239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:05.689263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Getting quotas for user bbff966c24e646fdb7faad71581dc208 and project a3a8f843818649a0adecf75319dc51b7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:05.786862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:05.843837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:06.070748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e241cea-c2ee-413e-91e1-9b7a5cec7305 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.238150 Jul 25 20:10:06.078482 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 743/1468] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 6249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:06.091845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:06.098782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:06.133488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:06.134855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:06.137864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:06.157334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.055509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:08.083163 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35b8fa9f-6f5c-4a5f-ad82-d177c0c273bb tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1315 microversion: 2.1 time: 2.002790 Jul 25 20:10:08.104085 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 744/1469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:06 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1315 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:08.131075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:08.136601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:08.181352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.182434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.186541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.196195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.385476 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bb914f86-f05a-4302-a0f0-ffddc61e6c28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291181 Jul 25 20:10:08.393144 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 745/1470] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:10:08 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments => generated 197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:08.427017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:08.438946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:08.466868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.472845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.485811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.488064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.712938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:08.757532 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03f1d47e-19ce-4b74-a089-db84ea6141ba tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1314 microversion: 2.1 time: 3.584938 Jul 25 20:10:08.760338 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 726/1471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:05 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1314 bytes in 3589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:08.773517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:08.775864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:08.788187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.789692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:08.791495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:08.792652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:09.953262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:09.979807 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73705037-fc77-42ff-b292-177c858adfcf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1268 microversion: 2.1 time: 1.216219 Jul 25 20:10:10.016751 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 727/1472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:08 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1268 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:10.038303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-889b4eb3-58ab-4143-8845-fb79c834d2e5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969512b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:10.153039 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-889b4eb3-58ab-4143-8845-fb79c834d2e5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1422 microversion: 2.1 time: 0.135969 Jul 25 20:10:10.159431 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 728/1473] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:10:10 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1422 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:10.176235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-fcd77f0c-99e0-4969-9b2c-1708be0aa4af req-ae8cc82f-9ae6-4563-971e-f7f7f6c102e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a6db6b-ffb4-49a1-99f3-321986fdd30d", "name": "network-vif-deleted", "tag": "8f665d04-b382-4c93-86b5-9e4b4afecc98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:10.218531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fcd77f0c-99e0-4969-9b2c-1708be0aa4af req-ae8cc82f-9ae6-4563-971e-f7f7f6c102e7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:10.219409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fcd77f0c-99e0-4969-9b2c-1708be0aa4af req-ae8cc82f-9ae6-4563-971e-f7f7f6c102e7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:10.252974 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-fcd77f0c-99e0-4969-9b2c-1708be0aa4af req-ae8cc82f-9ae6-4563-971e-f7f7f6c102e7 service nova] Creating event network-vif-deleted:8f665d04-b382-4c93-86b5-9e4b4afecc98 for instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d on n-h1-845775-3 Jul 25 20:10:10.273513 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-fcd77f0c-99e0-4969-9b2c-1708be0aa4af req-ae8cc82f-9ae6-4563-971e-f7f7f6c102e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111815 Jul 25 20:10:10.276998 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 729/1474] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:10.534229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2139587567", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "0302ef33-7596-4a44-b642-610bcac781ad"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:10.619162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:10.661746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:10.666367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:10.670393 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-786be12b-bb6c-47e0-a199-9d69dab8fe50 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 2.274049 Jul 25 20:10:10.688101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] validate_networks() for [('0302ef33-7596-4a44-b642-610bcac781ad', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:10.689447 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 746/1475] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:08 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:10.704792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-920122d8-be09-437d-baf9-f1b33dcea121 req-3e6eff9d-668f-42d4-931d-1c1492ad1b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f316c3-4de5-49be-85b1-c731d274527c", "tag": "18f68a44-6f9c-469e-8205-d38c3ad2aa82"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:10.723860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-920122d8-be09-437d-baf9-f1b33dcea121 req-3e6eff9d-668f-42d4-931d-1c1492ad1b4a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:10.724806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-920122d8-be09-437d-baf9-f1b33dcea121 req-3e6eff9d-668f-42d4-931d-1c1492ad1b4a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:10.745284 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-920122d8-be09-437d-baf9-f1b33dcea121 req-3e6eff9d-668f-42d4-931d-1c1492ad1b4a service nova] Creating event network-changed:18f68a44-6f9c-469e-8205-d38c3ad2aa82 for instance c6f316c3-4de5-49be-85b1-c731d274527c on n-h1-845775-3 Jul 25 20:10:10.754046 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-920122d8-be09-437d-baf9-f1b33dcea121 req-3e6eff9d-668f-42d4-931d-1c1492ad1b4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061603 Jul 25 20:10:10.755720 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 747/1476] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:10.766617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:10.768137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:10.788873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:10.794293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:10.796365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:10.804501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:12.641657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:12.683271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00d1a236-67cb-4a27-ae05-f6cdc3d05f1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1315 microversion: 2.1 time: 1.925276 Jul 25 20:10:12.684914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 748/1477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:10 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1315 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:12.694113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:12.700435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:12.722195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:12.725676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:12.728298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:12.733074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:12.848083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c10a1089-06c7-4094-b38c-98b0dea5558c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161004 Jul 25 20:10:12.866809 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 749/1478] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:10:12 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:12.892800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:12.894183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:12.927604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:12.928479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:12.930831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:12.931661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.125318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:14.137654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8476921-3045-42ac-a430-9aa347f5dec7 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1314 microversion: 2.1 time: 1.268658 Jul 25 20:10:14.139258 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 750/1479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:12 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1314 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:14.144455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9474b8cc-015d-4afb-8eb0-eeb6f0533742 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969924700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:14.253390 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9474b8cc-015d-4afb-8eb0-eeb6f0533742 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 200 len: 1422 microversion: 2.1 time: 0.112550 Jul 25 20:10:14.261904 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 751/1480] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:10:14 2022] GET /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:14.275935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:14.280862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:14.297866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.302970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.305505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.312254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.523948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:14.524937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:14.527283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:14.528576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:14.531284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:14.532303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:14.555070 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24e094d3-1045-4684-b7ff-38ee506a064e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1274 microversion: 2.1 time: 0.291266 Jul 25 20:10:14.568250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 752/1481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:14 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:14.579566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.580254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.582504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:14.584553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.585236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.591755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:14.624077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.624998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.626243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.627110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:14.672560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Getting quotas for project 74c5c53cda6540d781ce0498fdc45738. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:14.701636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Getting quotas for user 5c8be0fca0854a378899cb027ce4d2a1 and project 74c5c53cda6540d781ce0498fdc45738. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:14.770358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:14.775878 n-d-845775-3 devstack@n-api.service[119723]: WARNING nova.utils [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2139587567 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-213958756 Jul 25 20:10:14.781433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:14.873713 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2349819c-517a-4b2d-a568-b74b68f4182e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.576258 Jul 25 20:10:14.880101 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 730/1482] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:14.890729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5b0f7f4e-524e-4809-aaef-03af7b698cf2 req-3afa9435-c3c5-48d9-b823-0b1b8a514b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8daa55b-0aaf-4f3d-b83e-9a455707ecee", "name": "network-vif-plugged", "status": "completed", "tag": "5f932179-17d5-4826-9ed2-9c928956f752"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:14.960758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5b0f7f4e-524e-4809-aaef-03af7b698cf2 req-3afa9435-c3c5-48d9-b823-0b1b8a514b5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:14.961578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5b0f7f4e-524e-4809-aaef-03af7b698cf2 req-3afa9435-c3c5-48d9-b823-0b1b8a514b5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:15.050003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5b0f7f4e-524e-4809-aaef-03af7b698cf2 req-3afa9435-c3c5-48d9-b823-0b1b8a514b5e service nova] Creating event network-vif-plugged:5f932179-17d5-4826-9ed2-9c928956f752 for instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee on n-h2-845775-3 Jul 25 20:10:15.080563 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5b0f7f4e-524e-4809-aaef-03af7b698cf2 req-3afa9435-c3c5-48d9-b823-0b1b8a514b5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196846 Jul 25 20:10:15.084339 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 731/1483] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:15.124167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:15.131979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:15.192381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:15.200398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:15.206158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:15.207813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:15.588461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:15.623460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:15.652303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:15.683935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:15.697073 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8bf3892f-00e0-454d-adb1-40e14aa7fc6d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 1.122638 Jul 25 20:10:15.728704 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 753/1484] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:14 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:15.741316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:15.748422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:15.771813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:15.775330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:15.775801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:15.784635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:15.785488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:15.883259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57b3c217-b438-4367-b324-e675ba39aadb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152352 Jul 25 20:10:15.899935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 754/1485] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:10:15 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:10:15.907844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9cc0108-af1d-465f-9725-7691e7f59413 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196973b790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:16.057583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:16.081969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5cd84eb-496a-4d7d-a2e1-404189d4f862 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1315 microversion: 2.1 time: 0.993029 Jul 25 20:10:16.101815 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 732/1486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:15 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:16.145947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f17932a-87e8-4a7f-bc06-cb2476e2f2c8 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:16.147655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f17932a-87e8-4a7f-bc06-cb2476e2f2c8 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:16.408224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f17932a-87e8-4a7f-bc06-cb2476e2f2c8 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:16.436974 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f17932a-87e8-4a7f-bc06-cb2476e2f2c8 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1232 microversion: 2.1 time: 0.328056 Jul 25 20:10:16.438292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 733/1487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:16 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1232 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:16.455843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:16.463044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:16.498144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:16.498805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:16.503707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:16.504438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:17.111252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:17.131971 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc74405e-1e7e-48af-aa3c-782a425c0378 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1314 microversion: 2.1 time: 0.691990 Jul 25 20:10:17.161162 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 734/1488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:16 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:17.183542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:17.184959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:17.225266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:17.226798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:17.229713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:17.233719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:17.785260 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9cc0108-af1d-465f-9725-7691e7f59413 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 204 len: 0 microversion: 2.1 time: 1.883161 Jul 25 20:10:17.786737 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 755/1489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:15 2022] DELETE /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 0 bytes in 1886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:17.812739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:17.816807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:17.871564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:17.875483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:17.890468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:17.891871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:18.691236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:18.712527 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39a443fe-31c4-4445-a51c-9320de73c7bd tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 1.547136 Jul 25 20:10:18.729674 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 735/1490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:17 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:18.754092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:18.755740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:18.778264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:18.779255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:18.782584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:18.787358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.293495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:19.324265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:19.327403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:19.332784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51cb278f-13d5-4eee-ad8f-5d24af2bfd2c tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 1.541014 Jul 25 20:10:19.356928 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 756/1491] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:17 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:19.376020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d0602058-c94a-4a7c-b1ce-7e92c34892d8 req-01ade0f2-fbd1-48a3-83ca-fe1849226fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819316d7-7a6c-464d-9d57-c9d1dedcc64e", "name": "network-vif-unplugged", "status": "completed", "tag": "eabf546b-6c04-47d5-84fe-88b220a459d6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:19.402003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d0602058-c94a-4a7c-b1ce-7e92c34892d8 req-01ade0f2-fbd1-48a3-83ca-fe1849226fb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.412273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d0602058-c94a-4a7c-b1ce-7e92c34892d8 req-01ade0f2-fbd1-48a3-83ca-fe1849226fb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.454731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d0602058-c94a-4a7c-b1ce-7e92c34892d8 req-01ade0f2-fbd1-48a3-83ca-fe1849226fb2 service nova] Creating event network-vif-unplugged:eabf546b-6c04-47d5-84fe-88b220a459d6 for instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e on n-h1-845775-3 Jul 25 20:10:19.465812 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d0602058-c94a-4a7c-b1ce-7e92c34892d8 req-01ade0f2-fbd1-48a3-83ca-fe1849226fb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107157 Jul 25 20:10:19.474657 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 757/1492] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:19.487967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:19.489487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:19.500760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.502522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.504960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.506331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.744205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:19.774014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79e978ca-9588-4990-b0a7-98ffaf00c0ac tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1302 microversion: 2.1 time: 0.291149 Jul 25 20:10:19.775885 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 758/1493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:19 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1302 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:19.783920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:19.793958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:19.795693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:19.806638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-752fa092-3cd1-47de-9de4-372d36bd2e79 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1465 microversion: 2.1 time: 1.074618 Jul 25 20:10:19.807914 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 736/1494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:18 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1465 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:19.820149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:19.825518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:19.841061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.844221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.846028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.846790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.850253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:19.870569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.871174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.872509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:19.873556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:19.958316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:10:20.063082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:20.245642 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c3324da7-3585-46d2-baec-8b1dba45c075 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 204 len: 0 microversion: 2.1 time: 0.462770 Jul 25 20:10:20.254271 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 759/1495] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:10:19 2022] DELETE /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:20.271887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:20.273618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:20.316698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:20.318676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:20.320455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:20.321551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:20.944809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:20.979315 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35491d20-ba00-4b91-a7f4-a0a94342ed3f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1314 microversion: 2.1 time: 1.169556 Jul 25 20:10:20.980536 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 737/1496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:19 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:20.986452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:20.987286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:21.023971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:21.024753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:21.026288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:21.027074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:21.129194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:21.173642 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d1df815-1023-4c89-a05e-c3c480049088 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.914730 Jul 25 20:10:21.196500 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 760/1497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:20 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:21.216375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-72800123-4026-4647-bd6d-b4afee067b75 req-5308c1e3-e6ac-4988-ab41-20fb3380cf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c292aa3a-c5ca-46d0-b608-ea0b168694a8", "tag": "b6a2911b-0c68-422e-b8ff-a61e098ae5aa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:21.251168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-72800123-4026-4647-bd6d-b4afee067b75 req-5308c1e3-e6ac-4988-ab41-20fb3380cf12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:21.252944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-72800123-4026-4647-bd6d-b4afee067b75 req-5308c1e3-e6ac-4988-ab41-20fb3380cf12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:21.290768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-72800123-4026-4647-bd6d-b4afee067b75 req-5308c1e3-e6ac-4988-ab41-20fb3380cf12 service nova] Creating event network-changed:b6a2911b-0c68-422e-b8ff-a61e098ae5aa for instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 on n-h1-845775-3 Jul 25 20:10:21.313520 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-72800123-4026-4647-bd6d-b4afee067b75 req-5308c1e3-e6ac-4988-ab41-20fb3380cf12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113958 Jul 25 20:10:21.314428 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 761/1498] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:21.331978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:21.335033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:21.352477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:21.353584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:21.355202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:21.356390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:22.282497 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94488650-2ef5-462f-bd28-60930483c836 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1616 microversion: 2.1 time: 1.297518 Jul 25 20:10:22.283553 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 738/1499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:20 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1616 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:22.323889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1078263851", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "fc86a3b0-dce7-409f-8e0e-bcf88032c34a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:22.515639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] validate_networks() for [('fc86a3b0-dce7-409f-8e0e-bcf88032c34a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:22.749516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:22.780102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:22.787907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:22.794836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9104b37-6f1a-48b3-a2f1-4fe3bd24c91a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 1.478368 Jul 25 20:10:22.798490 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 762/1500] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:21 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:22.823683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:22.825519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:22.846983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:22.857180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:22.859049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:22.860239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:23.189549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:23.214916 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-361a2652-a123-4859-a27c-3de2ffa0680b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1290 microversion: 2.1 time: 0.401566 Jul 25 20:10:23.221288 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 763/1501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:22 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1290 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:23.241150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6d5fa22e-2d0d-48d5-b26a-b4b1fa6f9441 req-b7ed53ad-903d-445a-8879-4e9650253f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f316c3-4de5-49be-85b1-c731d274527c", "name": "network-vif-plugged", "status": "completed", "tag": "18f68a44-6f9c-469e-8205-d38c3ad2aa82"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:23.279833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6d5fa22e-2d0d-48d5-b26a-b4b1fa6f9441 req-b7ed53ad-903d-445a-8879-4e9650253f98 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:23.289252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6d5fa22e-2d0d-48d5-b26a-b4b1fa6f9441 req-b7ed53ad-903d-445a-8879-4e9650253f98 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:23.339992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6d5fa22e-2d0d-48d5-b26a-b4b1fa6f9441 req-b7ed53ad-903d-445a-8879-4e9650253f98 service nova] Creating event network-vif-plugged:18f68a44-6f9c-469e-8205-d38c3ad2aa82 for instance c6f316c3-4de5-49be-85b1-c731d274527c on n-h1-845775-3 Jul 25 20:10:23.355731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6d5fa22e-2d0d-48d5-b26a-b4b1fa6f9441 req-b7ed53ad-903d-445a-8879-4e9650253f98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131075 Jul 25 20:10:23.361930 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 764/1502] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:23.393991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:23.409354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:23.457996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:23.458807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:23.469860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:23.471290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:24.634837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:24.661094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:24.679453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-704474bf-0af3-4c87-b592-1047eb1e008d tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1314 microversion: 2.1 time: 1.302644 Jul 25 20:10:24.681165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 765/1503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:23 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1314 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:24.690044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:24.692437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:24.704056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:24.705344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:24.706964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:24.707629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:25.365580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:25.385915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc8fb42f-0609-4b6e-b4c5-2a88a0f62afb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.702299 Jul 25 20:10:25.387225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 766/1504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:24 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:25.397501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1647432809", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d7621d37-160c-4885-8f49-abe92624f69a"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:25.511379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:25.512678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:25.513253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:25.514067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:25.514739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:25.515486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:25.535603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:25.536686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:25.539724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:25.541282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:25.602073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:25.614165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for user a5e02ce4bb4645e2a92ba0a5eed8ba0d and project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:25.640276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:25.645552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:25.728746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2767d3e1-05cc-4942-bb43-98c3701b0ff9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.420178 Jul 25 20:10:25.734104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 739/1505] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:26.057764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e0a1c9b-1225-4f14-9174-386451da7c72 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Calling method '.version_select at 0x7f19694f69d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:26.109704 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1e0a1c9b-1225-4f14-9174-386451da7c72 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e0a1c9b-1225-4f14-9174-386451da7c72 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/e349ebfd-8923-43f8-95e2-6efccfd94553/metadata/os_distro HTTP/1.1 Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:10:26.122780 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'image_id': 'e349ebfd-8923-43f8-95e2-6efccfd94553', 'id': 'os_distro'} Jul 25 20:10:26.125891 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:26.131118 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e349ebfd-8923-43f8-95e2-6efccfd94553 Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:26.135150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e349ebfd-8923-43f8-95e2-6efccfd94553 could not be found. Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:26.139636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:26.143557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e0a1c9b-1225-4f14-9174-386451da7c72 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:26.151484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e0a1c9b-1225-4f14-9174-386451da7c72 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "DELETE /compute/v2.1/images/e349ebfd-8923-43f8-95e2-6efccfd94553/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.412557 Jul 25 20:10:26.154467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 740/1506] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Jul 25 20:10:25 2022] DELETE /compute/v2.1/images/e349ebfd-8923-43f8-95e2-6efccfd94553/metadata/os_distro => generated 62 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:26.178043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:26.179963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:26.194863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:26.196791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:26.198654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:26.200295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.531773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:27.545882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:27.551081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:27.553913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:27.557904 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83a3afef-0b88-4029-8bc8-e34ce9d552a1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 1.400581 Jul 25 20:10:27.570745 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 741/1507] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:26 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:27.579469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d9ef14c4-b3db-4ef1-8b8d-e17a505bc724 req-40e30068-033f-4ece-808f-b2312f1dd721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819316d7-7a6c-464d-9d57-c9d1dedcc64e", "name": "network-vif-deleted", "tag": "eabf546b-6c04-47d5-84fe-88b220a459d6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:27.597495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d9ef14c4-b3db-4ef1-8b8d-e17a505bc724 req-40e30068-033f-4ece-808f-b2312f1dd721 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:27.598476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d9ef14c4-b3db-4ef1-8b8d-e17a505bc724 req-40e30068-033f-4ece-808f-b2312f1dd721 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.618059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d9ef14c4-b3db-4ef1-8b8d-e17a505bc724 req-40e30068-033f-4ece-808f-b2312f1dd721 service nova] Creating event network-vif-deleted:eabf546b-6c04-47d5-84fe-88b220a459d6 for instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e on n-h1-845775-3 Jul 25 20:10:27.630361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d9ef14c4-b3db-4ef1-8b8d-e17a505bc724 req-40e30068-033f-4ece-808f-b2312f1dd721 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057383 Jul 25 20:10:27.632228 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 742/1508] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:27.643871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:27.645816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:27.646380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:27.647154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:27.648767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:27.649885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:27.650422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:27.661597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:27.662727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.664477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:27.665252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.669331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:27.728623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:27.731040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.731488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:27.733101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:27.791434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:27.806989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:27.848827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:27.855226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:28.014642 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c85d08f5-68dd-4283-832a-13383b0b6968 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.622999 Jul 25 20:10:28.017769 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 767/1509] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:28.039947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:28.041547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:28.067682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.078099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:28.081139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.083839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:28.518194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:28.530386 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b19d3633-38b3-4219-9671-e8bc657c6159 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 0.895581 Jul 25 20:10:28.531607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 743/1510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:27 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:28.538500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:28.553242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:28.565281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.566860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:28.568491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.569568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:28.772505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:28.795014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ed84558-5e57-4448-9555-fbb7bec0ec90 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1278 microversion: 2.1 time: 0.261652 Jul 25 20:10:28.795826 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 744/1511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:28 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:28.817807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc8fc6b5-cc33-4f80-a7e7-2f7193296106 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Calling method '.version_select at 0x7f19696305e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:28.903730 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-cc8fc6b5-cc33-4f80-a7e7-2f7193296106 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc8fc6b5-cc33-4f80-a7e7-2f7193296106 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/299d39a0-06b3-4553-9d90-10b0b54a6f86/metadata/os_version HTTP/1.1 Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:10:28.908900 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'image_id': '299d39a0-06b3-4553-9d90-10b0b54a6f86', 'id': 'os_version'} Jul 25 20:10:28.921391 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:28.925830 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 299d39a0-06b3-4553-9d90-10b0b54a6f86 Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:28.940822 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 299d39a0-06b3-4553-9d90-10b0b54a6f86 could not be found. Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:28.943149 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:28.944609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc8fc6b5-cc33-4f80-a7e7-2f7193296106 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:28.946642 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc8fc6b5-cc33-4f80-a7e7-2f7193296106 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "GET /compute/v2.1/images/299d39a0-06b3-4553-9d90-10b0b54a6f86/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.107070 Jul 25 20:10:28.946642 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 745/1512] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Jul 25 20:10:28 2022] GET /compute/v2.1/images/299d39a0-06b3-4553-9d90-10b0b54a6f86/metadata/os_version => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:28.946642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:28.946642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:28.965085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.965526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:28.966733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:28.968175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:29.018479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:29.049767 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0a30f48-810d-445d-8fef-af8e22c42a58 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1499 microversion: 2.1 time: 1.030220 Jul 25 20:10:29.072123 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 768/1513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:28 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1499 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:29.072123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45595d69-bb88-43ed-80ea-ab4fafe70d62 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:29.072123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45595d69-bb88-43ed-80ea-ab4fafe70d62 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:29.254120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-45595d69-bb88-43ed-80ea-ab4fafe70d62 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:29.272550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45595d69-bb88-43ed-80ea-ab4fafe70d62 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1217 microversion: 2.1 time: 0.213345 Jul 25 20:10:29.274459 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 769/1514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:29 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:29.284376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-da66d6b5-36fd-411e-af1e-a43c29ba8b21 req-c871dee5-7f4c-4616-8cbb-589fbb18e3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a584a078-6165-4f0b-a3a4-f1eab751b971", "tag": "e8b21f3a-5c80-420a-a64e-218ca730bdcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:29.311988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-da66d6b5-36fd-411e-af1e-a43c29ba8b21 req-c871dee5-7f4c-4616-8cbb-589fbb18e3f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:29.312806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-da66d6b5-36fd-411e-af1e-a43c29ba8b21 req-c871dee5-7f4c-4616-8cbb-589fbb18e3f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:29.335922 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-da66d6b5-36fd-411e-af1e-a43c29ba8b21 req-c871dee5-7f4c-4616-8cbb-589fbb18e3f4 service nova] Creating event network-changed:e8b21f3a-5c80-420a-a64e-218ca730bdcf for instance a584a078-6165-4f0b-a3a4-f1eab751b971 on n-h2-845775-3 Jul 25 20:10:29.349638 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-da66d6b5-36fd-411e-af1e-a43c29ba8b21 req-c871dee5-7f4c-4616-8cbb-589fbb18e3f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070535 Jul 25 20:10:29.350688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 770/1515] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:29.371425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:29.372356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:29.393601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:29.394384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:29.406454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:29.406933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.072096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:30.086292 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3961ece8-1895-4b59-8c8a-25b155c48251 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 1.165969 Jul 25 20:10:30.087889 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 746/1516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:28 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:30.096969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fef164ed-15ce-4dce-9900-9040e7469fbb tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Calling method '.version_select at 0x7f19694f6ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:30.138017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fef164ed-15ce-4dce-9900-9040e7469fbb tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fef164ed-15ce-4dce-9900-9040e7469fbb tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/2e093cb6-3f0e-42c9-80c8-eeea1c1df33e/metadata HTTP/1.1 Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:10:30.143423 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'image_id': '2e093cb6-3f0e-42c9-80c8-eeea1c1df33e'} Jul 25 20:10:30.146905 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:30.148514 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e093cb6-3f0e-42c9-80c8-eeea1c1df33e Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:30.150483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e093cb6-3f0e-42c9-80c8-eeea1c1df33e could not be found. Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:30.154805 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:30.159030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fef164ed-15ce-4dce-9900-9040e7469fbb tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:30.162847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fef164ed-15ce-4dce-9900-9040e7469fbb tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "GET /compute/v2.1/images/2e093cb6-3f0e-42c9-80c8-eeea1c1df33e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060388 Jul 25 20:10:30.162847 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 747/1517] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:10:30 2022] GET /compute/v2.1/images/2e093cb6-3f0e-42c9-80c8-eeea1c1df33e/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:30.178176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:30.185932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:30.187159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:30.211572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.212534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.214605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.215844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.242808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:30.250023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:30.256351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6a28711-a811-43e6-ab47-1b4bb5362b79 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.898493 Jul 25 20:10:30.273497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lazy-loading 'flavor' on Instance uuid c6f316c3-4de5-49be-85b1-c731d274527c {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:10:30.309905 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 771/1518] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:29 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:30.333337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:30.335121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:30.369991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.371206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.376668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.382227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.536710 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09f8a23d-86d1-4c80-a8ca-109f9348ace8 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "POST /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c/action" status: 200 len: 32 microversion: 2.1 time: 0.377418 Jul 25 20:10:30.543210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 748/1519] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:10:30 2022] POST /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:10:30.575649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:30.577847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:30.610666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.612862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:30.614999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:30.617051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:31.521679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:31.567484 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4157bc9e-f777-40f7-b965-5e5ccaf17b36 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 1.253657 Jul 25 20:10:31.597935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 772/1520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:30 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:31.617895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5394ff07-a64f-4c82-9f79-7c5b35bf27cd tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Action: 'update_all', calling method: .version_select at 0x7f1969ff29d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:31.699748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5394ff07-a64f-4c82-9f79-7c5b35bf27cd tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:31.738635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5394ff07-a64f-4c82-9f79-7c5b35bf27cd tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/images/737d0ee9-bca3-409a-bd38-04dff44d2763/metadata HTTP/1.1 Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 57 Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:10:31.740740 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:10:31.744606 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'image_id': '737d0ee9-bca3-409a-bd38-04dff44d2763', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:31.753777 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 737d0ee9-bca3-409a-bd38-04dff44d2763 Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:31.756396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 737d0ee9-bca3-409a-bd38-04dff44d2763 could not be found. Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:31.760797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:31.764767 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:31.768015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5394ff07-a64f-4c82-9f79-7c5b35bf27cd tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:31.768015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5394ff07-a64f-4c82-9f79-7c5b35bf27cd tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "PUT /compute/v2.1/images/737d0ee9-bca3-409a-bd38-04dff44d2763/metadata" status: 404 len: 62 microversion: 2.1 time: 0.134911 Jul 25 20:10:31.768015 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 773/1521] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:10:31 2022] PUT /compute/v2.1/images/737d0ee9-bca3-409a-bd38-04dff44d2763/metadata => generated 62 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:31.777107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:31.778717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:31.790698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1197ab6-5f07-4dd2-a223-eee126ffa310 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 1.231963 Jul 25 20:10:31.794575 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 749/1522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:30 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:31.805368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:31.807129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:31.807331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:31.808153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:31.813486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:31.816786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:31.824603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:31.826669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:31.829164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:31.830573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.350639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:32.388591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8c376b2-6b13-4171-b5fa-c40a48230508 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1275 microversion: 2.1 time: 0.638052 Jul 25 20:10:32.390645 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 774/1523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:31 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1275 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:32.419327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:32.422148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:32.448956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.453456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.456656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:32.461280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:32.943439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:32.983613 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23d2c771-30fe-482f-a24b-8b0e7506425c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 1.184324 Jul 25 20:10:32.986714 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 750/1524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:31 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:33.010205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:33.014178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:33.041389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.042525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.044154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.046315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.137657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:33.157852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f6a9684-4f2a-4a97-8f95-b26cfe2da841 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.765258 Jul 25 20:10:33.170161 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 775/1525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:32 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:33.178144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-bafa18c4-0999-4d30-ae90-96c72c4ecc6e req-c49b52a5-5f65-44b1-b733-9b5b10ef6be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "name": "network-vif-unplugged", "status": "completed", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:33.243464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bafa18c4-0999-4d30-ae90-96c72c4ecc6e req-c49b52a5-5f65-44b1-b733-9b5b10ef6be9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.244347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bafa18c4-0999-4d30-ae90-96c72c4ecc6e req-c49b52a5-5f65-44b1-b733-9b5b10ef6be9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.305359 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-bafa18c4-0999-4d30-ae90-96c72c4ecc6e req-c49b52a5-5f65-44b1-b733-9b5b10ef6be9 service nova] Creating event network-vif-unplugged:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h2-845775-3 Jul 25 20:10:33.330282 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-bafa18c4-0999-4d30-ae90-96c72c4ecc6e req-c49b52a5-5f65-44b1-b733-9b5b10ef6be9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153979 Jul 25 20:10:33.332445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 776/1526] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:33.352918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:33.353523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d149876d-cdf6-407a-a911-cd5a89a077ae tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Action: 'update', calling method: .version_select at 0x7f196982dca0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:33.378293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:33.388340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:33.404421 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f10e07e3-d1cf-42da-b46e-43ba3186447a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.410452 Jul 25 20:10:33.405455 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 751/1527] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:32 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:33.424823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:33.443368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:33.458281 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d149876d-cdf6-407a-a911-cd5a89a077ae tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d149876d-cdf6-407a-a911-cd5a89a077ae tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/images/7e0733c2-5101-4138-aad8-00488f333092/metadata/os_distro HTTP/1.1 Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 30 Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:10:33.466034 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: {"meta": {"os_distro": "alt"}} Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:10:33.467850 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'image_id': '7e0733c2-5101-4138-aad8-00488f333092', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:33.469363 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7e0733c2-5101-4138-aad8-00488f333092 Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:33.470641 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e0733c2-5101-4138-aad8-00488f333092 could not be found. Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:33.473536 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:33.478738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:33.483499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.483499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.483499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.491367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.492738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d149876d-cdf6-407a-a911-cd5a89a077ae tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:33.492738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d149876d-cdf6-407a-a911-cd5a89a077ae tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "PUT /compute/v2.1/images/7e0733c2-5101-4138-aad8-00488f333092/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.147086 Jul 25 20:10:33.492738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 777/1528] 10.222.0.48 () {60 vars in 1310 bytes} [Mon Jul 25 20:10:33 2022] PUT /compute/v2.1/images/7e0733c2-5101-4138-aad8-00488f333092/metadata/os_distro => generated 62 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:33.510051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:33.539343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:33.570049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.574193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:33.579541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:33.581795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.452116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:34.473331 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41cde0d5-4d2c-4c16-8c69-6391f8a48997 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.988770 Jul 25 20:10:34.474777 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 778/1529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:33 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:34.488537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:34.490265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:34.500289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:34.501606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.504207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:34.505609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.557008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:34.596821 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd904ceb-9567-438a-8125-dea093deab0f tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 1.184250 Jul 25 20:10:34.600553 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 752/1530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:33 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:34.616507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86d3e358-96a3-4ef6-a745-1c2dc8736296 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Action: 'create', calling method: .version_select at 0x7f196a2964c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:34.674970 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-86d3e358-96a3-4ef6-a745-1c2dc8736296 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] HTTP exception thrown: Image not found. Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86d3e358-96a3-4ef6-a745-1c2dc8736296 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Request method failure captured: Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/images/db2ebd6c-62d1-4013-bc58-40b3d32d7095/metadata HTTP/1.1 Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 57 Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3viupu18nL3Zk7scl0xV4JRQeMZ7wemhFsQ5Q05i8dOyyQr7T4bWpVbBrJ4sPuDguwxUKybN-QKLnPCEWQJKAgELBD2wvOuS_oy3BPnulpMHFXJ-X_tLJtoJiH05ZTEopCafrE_XD4ML3RMZEyPn3uEjY3W1JpgSZQfnrrSvHyEHfCQ Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:10:34.678584 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/236fd89dcb1344ef898c45ec81aad12d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/236fd89dcb1344ef898c45ec81aad12d"}]}] Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 236fd89dcb1344ef898c45ec81aad12d Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968 Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 4db8333fef18442ab2897ac17c0a8c3b Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2052387968-project Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:10:34.682253 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'image_id': 'db2ebd6c-62d1-4013-bc58-40b3d32d7095', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:34.684707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db2ebd6c-62d1-4013-bc58-40b3d32d7095 Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:34.687887 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db2ebd6c-62d1-4013-bc58-40b3d32d7095 could not be found. Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:34.693924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:34.708644 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:34.716317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86d3e358-96a3-4ef6-a745-1c2dc8736296 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:34.716317 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-86d3e358-96a3-4ef6-a745-1c2dc8736296 tempest-ImagesMetadataNegativeTestJSON-2052387968 tempest-ImagesMetadataNegativeTestJSON-2052387968-project] 10.222.0.48 "POST /compute/v2.1/images/db2ebd6c-62d1-4013-bc58-40b3d32d7095/metadata" status: 404 len: 62 microversion: 2.1 time: 0.090916 Jul 25 20:10:34.716317 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 753/1531] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Jul 25 20:10:34 2022] POST /compute/v2.1/images/db2ebd6c-62d1-4013-bc58-40b3d32d7095/metadata => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:34.760311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:34.761433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:34.770156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:34.771684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.773455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:34.774282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.799784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:34.833009 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-65e9ea3b-5727-45ab-ac11-3c1ec7c7c7d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1275 microversion: 2.1 time: 0.352480 Jul 25 20:10:34.838141 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 779/1532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:34 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:34.852562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-65ff6584-47a1-4cf0-8e82-06b9b6013d21 req-96d2ede2-0dab-4447-a6fb-3c7626c27939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f865fb-665a-4252-9093-d8116d13512f", "tag": "18c133a8-0de0-445a-b71c-1e04cb703a24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:34.889992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-65ff6584-47a1-4cf0-8e82-06b9b6013d21 req-96d2ede2-0dab-4447-a6fb-3c7626c27939 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:34.890517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-65ff6584-47a1-4cf0-8e82-06b9b6013d21 req-96d2ede2-0dab-4447-a6fb-3c7626c27939 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:34.932900 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-65ff6584-47a1-4cf0-8e82-06b9b6013d21 req-96d2ede2-0dab-4447-a6fb-3c7626c27939 service nova] Creating event network-changed:18c133a8-0de0-445a-b71c-1e04cb703a24 for instance 16f865fb-665a-4252-9093-d8116d13512f on n-h1-845775-3 Jul 25 20:10:34.948986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-65ff6584-47a1-4cf0-8e82-06b9b6013d21 req-96d2ede2-0dab-4447-a6fb-3c7626c27939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107520 Jul 25 20:10:34.952883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 780/1533] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:34.971282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:34.974218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:35.009449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.010260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.011644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.012206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.233733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:35.257693 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87242b97-bbcd-42d7-be4c-6f60e6eb555b tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.504891 Jul 25 20:10:35.257693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 754/1534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:34 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:35.273548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:35.279010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:35.295712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.297669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.299285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.300397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.543217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:35.564350 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e5bdbd1-04c0-4f42-ab9b-7c3df70de69e tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.607191 Jul 25 20:10:35.568214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:35.619317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 781/1535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:34 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:35.630156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-781e1a96-cf92-4273-8b88-726a1c1e0e1b req-51cf8e45-5103-449a-9ef7-4d4e47ef8dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:35.634604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:35.650227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-781e1a96-cf92-4273-8b88-726a1c1e0e1b req-51cf8e45-5103-449a-9ef7-4d4e47ef8dce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.651206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-781e1a96-cf92-4273-8b88-726a1c1e0e1b req-51cf8e45-5103-449a-9ef7-4d4e47ef8dce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.672161 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-781e1a96-cf92-4273-8b88-726a1c1e0e1b req-51cf8e45-5103-449a-9ef7-4d4e47ef8dce service nova] Creating event network-changed:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h2-845775-3 Jul 25 20:10:35.682786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-781e1a96-cf92-4273-8b88-726a1c1e0e1b req-51cf8e45-5103-449a-9ef7-4d4e47ef8dce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059472 Jul 25 20:10:35.684723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 782/1536] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:35.692019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:35.693677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:35.721317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.722448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.724605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:35.725732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:35.821391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:36.303550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:36.338681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:36.349227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:36.351634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53a4477a-99fd-46e5-82df-c5a38d8d6ffa tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 1.093144 Jul 25 20:10:36.358801 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 755/1537] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:35 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:36.378518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:36.380189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:36.448412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:36.454978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:36.459625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:36.468096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:37.388557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:37.418345 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b7a98a4c-1ae3-4e7f-95a2-df60d45496ab tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 1.731007 Jul 25 20:10:37.419343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 783/1538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:35 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:37.437156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:37.437831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:37.450858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:37.451327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:37.452252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:37.460141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:37.748405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:38.268664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:38.296373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dcc8524-bf33-4a2d-bd6b-75b9853ba323 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 1.933653 Jul 25 20:10:38.298776 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 756/1539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:36 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:38.313050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:38.315872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:38.324884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.325987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:38.327530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.329287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:38.386580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:38.409747 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-01667927-b188-4cfa-95f4-882a222cfbb7 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.986867 Jul 25 20:10:38.415875 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 784/1540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:37 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:38.450916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:38.455902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:38.480599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.481918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:38.483462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:38.484689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.268941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:39.330207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:39.366547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e202470c-55d6-4760-bffb-a1a8e80ca631 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 1.060283 Jul 25 20:10:39.374653 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 757/1541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:38 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:39.386360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:39.401004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ec2e6f9c-a75c-4b40-99f3-03e3ca81477f req-d1aa21d0-99db-47f0-bbe6-413c2df18f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c292aa3a-c5ca-46d0-b608-ea0b168694a8", "name": "network-vif-plugged", "status": "completed", "tag": "b6a2911b-0c68-422e-b8ff-a61e098ae5aa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:39.404442 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd4fc747-7ae0-432b-816f-1a28c2f2d96f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.984506 Jul 25 20:10:39.414017 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 785/1542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:38 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:39.426820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:39.428547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:39.443889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ec2e6f9c-a75c-4b40-99f3-03e3ca81477f req-d1aa21d0-99db-47f0-bbe6-413c2df18f5f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.452953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.454601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.456923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.459441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ec2e6f9c-a75c-4b40-99f3-03e3ca81477f req-d1aa21d0-99db-47f0-bbe6-413c2df18f5f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.465676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.513668 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ec2e6f9c-a75c-4b40-99f3-03e3ca81477f req-d1aa21d0-99db-47f0-bbe6-413c2df18f5f service nova] Creating event network-vif-plugged:b6a2911b-0c68-422e-b8ff-a61e098ae5aa for instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 on n-h1-845775-3 Jul 25 20:10:39.545975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ec2e6f9c-a75c-4b40-99f3-03e3ca81477f req-d1aa21d0-99db-47f0-bbe6-413c2df18f5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161275 Jul 25 20:10:39.546935 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 758/1543] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:39.555169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:39.557430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:39.582883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.584351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:39.586136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:39.587182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.236610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:40.240362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:40.256267 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b220efe4-b8ee-4a7f-a606-63a34b11e945 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.707598 Jul 25 20:10:40.269349 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 759/1544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:39 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:40.291132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:40.293734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:40.306241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:40.309732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.311111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.313611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.314558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.318688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:40.323733 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-39a8d660-dc1b-4f65-8b56-8272822b86e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.906654 Jul 25 20:10:40.353482 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 786/1545] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:39 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:40.369402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:40.376388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:40.399191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.402881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.404851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.406828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.846455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:40.852213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:40.881993 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6246a717-4863-4073-9747-de8c2edc1855 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 0.597453 Jul 25 20:10:40.883817 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 760/1546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:40 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:40.919822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:40.922770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:40.967124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.967797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:40.968833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:40.969985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.114838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:41.159357 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dccb23f3-d5d8-4586-8d8e-25423b14f683 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.803497 Jul 25 20:10:41.160423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 787/1547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:40 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:41.193692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:41.194351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:41.206000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:41.206831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.221825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:41.222083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.667573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:41.714925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15700fce-a65c-4f7e-926a-effc7a162437 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.805763 Jul 25 20:10:41.716134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 761/1548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:40 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:41.801439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:41.849378 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8e1c2c71-f4c9-4abf-b005-cb5619301f09 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1316 microversion: 2.1 time: 0.687369 Jul 25 20:10:41.850991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 788/1549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:41 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:41.870116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7076aa91-c584-422d-bab8-3e5149cdbd3a req-2e21032b-e7d8-454c-bf7a-a65a6d3a50b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27e4f7b-113a-43d4-bab6-b381c2adc288", "tag": "1df20579-5153-49f6-a5cf-0ab7bf0b070a"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:41.912363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7076aa91-c584-422d-bab8-3e5149cdbd3a req-2e21032b-e7d8-454c-bf7a-a65a6d3a50b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:41.913593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7076aa91-c584-422d-bab8-3e5149cdbd3a req-2e21032b-e7d8-454c-bf7a-a65a6d3a50b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:41.949933 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7076aa91-c584-422d-bab8-3e5149cdbd3a req-2e21032b-e7d8-454c-bf7a-a65a6d3a50b3 service nova] Creating event network-changed:1df20579-5153-49f6-a5cf-0ab7bf0b070a for instance d27e4f7b-113a-43d4-bab6-b381c2adc288 on n-h2-845775-3 Jul 25 20:10:41.970796 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7076aa91-c584-422d-bab8-3e5149cdbd3a req-2e21032b-e7d8-454c-bf7a-a65a6d3a50b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117428 Jul 25 20:10:41.976539 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 789/1550] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:41.994380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:41.997372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:42.023819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.028297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.031635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.032378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.221671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59ee2824-cbfb-4932-a04a-55da647b89a9 tempest-ListImageFiltersNegativeTestJSON-602883198 tempest-ListImageFiltersNegativeTestJSON-602883198-project] Calling method '.version_select at 0x7f1969672f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:42.270654 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-59ee2824-cbfb-4932-a04a-55da647b89a9 tempest-ListImageFiltersNegativeTestJSON-602883198 tempest-ListImageFiltersNegativeTestJSON-602883198-project] HTTP exception thrown: Image not found. Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59ee2824-cbfb-4932-a04a-55da647b89a9 tempest-ListImageFiltersNegativeTestJSON-602883198 tempest-ListImageFiltersNegativeTestJSON-602883198-project] Request method failure captured: Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/7469442f-e20b-4fc3-abaf-748fe43ef757 HTTP/1.1 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vjAYwrcMIRcSjSBEWVl90eGJYCexJnjs-k0KjFdlm4PuzH_nebNyHfRbjLNqpB5F5xjbQlqGCk9ih9NWCq3qRFRtWnvBjOO-DgpURXzFrgeY9r90XAcv9BOrenT9_Uakh26_EXHVArJgwbzqgrO1Azr5yflDQnBBfWraeZJigKOGlI Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 63e54b4aabc5419baaf7426993b17a14 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-602883198 Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:10:42.274199 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/63e54b4aabc5419baaf7426993b17a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_63e54b4aabc5419baaf7426993b17a14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/63e54b4aabc5419baaf7426993b17a14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/63e54b4aabc5419baaf7426993b17a14"}]}] Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-602883198 Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 63e54b4aabc5419baaf7426993b17a14 Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-602883198 Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListImageFiltersNegativeTestJSON-602883198-project Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 0119acf272e5489c91836ccadcd0b297 Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-602883198-project Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7469442f-e20b-4fc3-abaf-748fe43ef757'} Jul 25 20:10:42.277675 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:42.280150 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7469442f-e20b-4fc3-abaf-748fe43ef757 Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:10:42.287176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7469442f-e20b-4fc3-abaf-748fe43ef757 could not be found. Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:10:42.292687 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:10:42.297352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59ee2824-cbfb-4932-a04a-55da647b89a9 tempest-ListImageFiltersNegativeTestJSON-602883198 tempest-ListImageFiltersNegativeTestJSON-602883198-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:42.300901 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59ee2824-cbfb-4932-a04a-55da647b89a9 tempest-ListImageFiltersNegativeTestJSON-602883198 tempest-ListImageFiltersNegativeTestJSON-602883198-project] 10.222.0.48 "GET /compute/v2.1/images/7469442f-e20b-4fc3-abaf-748fe43ef757" status: 404 len: 62 microversion: 2.1 time: 0.562804 Jul 25 20:10:42.300901 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 762/1551] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:10:41 2022] GET /compute/v2.1/images/7469442f-e20b-4fc3-abaf-748fe43ef757 => generated 62 bytes in 566 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:10:42.300901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:42.302454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:42.311635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.312283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.313291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.313907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.615415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:42.637328 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd6788e8-8702-4aca-b302-a8798fa97f9c tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.658539 Jul 25 20:10:42.644317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 790/1552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:41 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:42.684219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:42.684967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:42.711087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.711555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.716122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.716594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.778568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:42.812211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:42.825218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:42.831139 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4cb478b8-b8f8-4286-83e7-135e14094f97 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.539617 Jul 25 20:10:42.833481 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 763/1553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:42 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:42.880071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:42.881845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:42.898893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.900309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:42.902721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:42.906832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.331187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:43.344222 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-163d238e-aef7-4fb6-94ba-ffc4c8af76c1 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 0.695290 Jul 25 20:10:43.345547 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 791/1554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:42 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:43.355338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-aaca9488-cdbd-4ef7-a5d1-2b7ad33ec8d9 req-e40bd81f-9e15-499a-b148-76deb14c6588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584a078-6165-4f0b-a3a4-f1eab751b971", "name": "network-vif-plugged", "status": "completed", "tag": "e8b21f3a-5c80-420a-a64e-218ca730bdcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:43.375761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aaca9488-cdbd-4ef7-a5d1-2b7ad33ec8d9 req-e40bd81f-9e15-499a-b148-76deb14c6588 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.376451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aaca9488-cdbd-4ef7-a5d1-2b7ad33ec8d9 req-e40bd81f-9e15-499a-b148-76deb14c6588 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.402313 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-aaca9488-cdbd-4ef7-a5d1-2b7ad33ec8d9 req-e40bd81f-9e15-499a-b148-76deb14c6588 service nova] Creating event network-vif-plugged:e8b21f3a-5c80-420a-a64e-218ca730bdcf for instance a584a078-6165-4f0b-a3a4-f1eab751b971 on n-h2-845775-3 Jul 25 20:10:43.410815 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-aaca9488-cdbd-4ef7-a5d1-2b7ad33ec8d9 req-e40bd81f-9e15-499a-b148-76deb14c6588 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061774 Jul 25 20:10:43.412215 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 792/1555] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:43.420579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:43.421415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:43.438311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:43.439779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.448938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.448938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.448938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.455265 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b764a612-4a63-4af8-9673-56966e88e146 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.604373 Jul 25 20:10:43.459613 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 764/1556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:42 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:43.469346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:43.471597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:43.482443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.484650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.489230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.490008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.780355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:43.798214 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77a6f00e-5db6-4e7d-b04f-841a68fd407c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.384232 Jul 25 20:10:43.824027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 793/1557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:43 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:43.838691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:43.839781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:43.854951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.855952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:43.856878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:43.857529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.009931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.023320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b33d676e-3f89-4643-9f89-5200e2a8563c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1506 microversion: 2.1 time: 0.560778 Jul 25 20:10:44.055792 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 765/1558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:43 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:44.068465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:44.069548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:44.076789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.077947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.078991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.079906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.181262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.196835 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef56beb6-2276-4e7d-b08b-45dfc80bea02 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.369593 Jul 25 20:10:44.198076 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 794/1559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:43 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:44.219854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:44.221786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:44.239107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.240398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.243539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.245811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.489501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.506731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.517202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.519956 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9682fcf-1fd8-4d33-b45b-506e0bd20537 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.461360 Jul 25 20:10:44.537683 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 766/1560] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:44 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:44.547655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:44.549383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:44.585736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.586857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.589072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.589792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.631275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:44.659403 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b73671b-11f2-4e58-b5a3-46b82d2f34bf tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1506 microversion: 2.1 time: 0.459922 Jul 25 20:10:44.660762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 795/1561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:44 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:44.665845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:44.677449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:44.688559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.696886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:44.707763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:44.708779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.171164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:45.178874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:45.195353 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a59b12e-ea85-4077-a1b2-451c1724398d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1332 microversion: 2.1 time: 0.655213 Jul 25 20:10:45.196500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 767/1562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:44 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1332 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:45.199867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34ad514c-30b5-44d3-b4f1-ef4fcc751026 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.537652 Jul 25 20:10:45.202004 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 796/1563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:44 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:45.223828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:45.236430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:45.240380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:45.244312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:45.257810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.260432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.262429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.264003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.266400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.271384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.275384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.277905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.515122 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57a2a145-6eba-46a6-a7c4-cd3e75aa50cc tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "PUT /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1078 microversion: 2.1 time: 0.301524 Jul 25 20:10:45.531781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 768/1564] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:10:45 2022] PUT /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1078 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:45.545258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:45.546587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:45.564846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.566170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:45.567815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:45.569127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.055945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.092377 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ecfb1105-4c29-449c-a2f7-32f8cd9d2b76 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.555538 Jul 25 20:10:46.118079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 769/1565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:45 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:46.135678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "name": "network-vif-unplugged", "status": "completed", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}, {"server_uuid": "16f865fb-665a-4252-9093-d8116d13512f", "name": "network-vif-plugged", "status": "completed", "tag": "18c133a8-0de0-445a-b71c-1e04cb703a24"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:46.166586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.167785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.197110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] Creating event network-vif-unplugged:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h2-845775-3 Jul 25 20:10:46.198320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] Creating event network-vif-plugged:18c133a8-0de0-445a-b71c-1e04cb703a24 for instance 16f865fb-665a-4252-9093-d8116d13512f on n-h1-845775-3 Jul 25 20:10:46.218250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.240081 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e2e8d0c-623c-47c6-aa71-d1d9bec633f2 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 1.035838 Jul 25 20:10:46.241532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 797/1566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:45 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:46.242794 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a3f771d5-64b5-4e8c-ad63-271a9834a6da req-e97efb55-1b81-40c9-be53-c1c02212c050 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.121627 Jul 25 20:10:46.247664 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 770/1567] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:46.262577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:46.266897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:46.270765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:46.274141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:46.293708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.294490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.296300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.296824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.298930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.300246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.300477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.302943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.898128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.925078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.928404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.931482 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a5302d0-d390-4dc0-aa85-6fd5a9b5949d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.680769 Jul 25 20:10:46.941307 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 771/1568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:46 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:46.951081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:46.965298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:46.977849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.988858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:46.990396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:46.993271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:46.998283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.024479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f977e91f-8d99-4a67-afa2-48f47c97b944 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1504 microversion: 2.1 time: 0.780169 Jul 25 20:10:47.035714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 798/1569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:46 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1504 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:47.057423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:47.059831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:47.119999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:47.122174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.127967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:47.131248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.549341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:47.553236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:47.564132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a81a9f9-da2f-410b-b1d8-901c2dc7006b tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.533436 Jul 25 20:10:47.576209 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 799/1570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:47 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:47.583934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc31642c-4439-4741-a9ed-e59260dbaf5e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1532 microversion: 2.1 time: 0.640723 Jul 25 20:10:47.587058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 772/1571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:46 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1532 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:47.592116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:47.592746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:47.630586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:47.631573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.633416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:47.634361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:47.965874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-228421e8-10d0-409a-915b-e482f5ffd4bd tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f19695c5820>, body: {"keypair": {"name": "tempest-keypair-959085382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTsvjCso6OqQinPrCLd/se1a+lGnwd+N/sUyjCTwtPbxc/QAUvmqkxr/0xStsezyO6/vWo0yb4bS//7S/1ac+dCvfh/k0YsqNdzPThdhbbtVhf+vp4Tgln4bO++C3ZjEg=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:48.003222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-228421e8-10d0-409a-915b-e482f5ffd4bd tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:48.015413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-228421e8-10d0-409a-915b-e482f5ffd4bd tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:48.043767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:48.065134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-228421e8-10d0-409a-915b-e482f5ffd4bd tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.486976 Jul 25 20:10:48.066481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 800/1572] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:10:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:48.068592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6107e84f-e2be-4f6b-be98-29a1e9f12d68 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1504 microversion: 2.1 time: 0.480109 Jul 25 20:10:48.070971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 773/1573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:47 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:48.093820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:48.095031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:48.102329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.103167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.104359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.105241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.107845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:48.109157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:48.123331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.127120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.131121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.131718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.513712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:48.532180 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-703b6b1f-f370-4553-a891-46b9532bf864 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1308 microversion: 2.1 time: 0.463179 Jul 25 20:10:48.533511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 801/1574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:48 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:48.543081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35eb7200-708e-42e8-9cdf-9012f02f3c9a tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'create', calling method: .version_select at 0x7f1969c71b80>, body: {"pool": "72fbcb55-45db-4218-9d9d-4b0d790cebc6"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:48.570165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:48.586699 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-472d07ba-36d7-4630-98e1-a607d462b29e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.503203 Jul 25 20:10:48.588148 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 774/1575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:48 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:48.597344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:48.598810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:48.611176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.612547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:48.614452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:48.615521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.202745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:49.241501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:49.245040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:49.247258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0d32a7f-e12f-48fd-a880-8f7d2b7bb63f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1487 microversion: 2.25 time: 0.657244 Jul 25 20:10:49.248844 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 775/1576] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:48 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1487 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:49.261439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4e19296-6684-41c5-bfda-d7f6e68e2898 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f1969530b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:49.286579 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4e19296-6684-41c5-bfda-d7f6e68e2898 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-959085382" status: 200 len: 497 microversion: 2.1 time: 0.035583 Jul 25 20:10:49.293508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 776/1577] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Jul 25 20:10:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-959085382 => generated 497 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:49.300879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:49.303476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:49.312697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.313713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.315305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.316315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.441845 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-66a0bc60-d0c0-4f4d-885b-c181633000ed tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "PUT /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1080 microversion: 2.1 time: 0.146343 Jul 25 20:10:49.443394 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 777/1578] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:10:49 2022] PUT /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1080 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:49.452717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:49.454237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:49.465925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.466812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.467869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.468511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.719678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:49.722434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:49.730380 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aba6fbbb-2146-4b5f-bf64-9176d2a1fe13 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.285020 Jul 25 20:10:49.733485 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 778/1579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:49 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:49.737992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b62a2ec1-e7cf-4872-9581-363f219b7054 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f19697d6dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:49.763903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b62a2ec1-e7cf-4872-9581-363f219b7054 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959085382" status: 202 len: 0 microversion: 2.1 time: 0.031332 Jul 25 20:10:49.764875 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 779/1580] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:10:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959085382 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:10:49.772623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:49.773284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:49.780965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.781835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:49.782527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:49.783681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.099794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:50.110278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7b1d9fa-56a8-4433-ae6c-7bf23adb028f tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1506 microversion: 2.1 time: 0.344511 Jul 25 20:10:50.132683 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 780/1581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:49 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:50.132683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:50.132683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:50.132683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:50.132683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.133634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.133634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.133634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.802379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:50.812803 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-960c45f1-0a91-4b28-8e1b-18359b211635 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1489 microversion: 2.1 time: 0.700152 Jul 25 20:10:50.813562 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 781/1582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:50 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1489 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:50.851568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:50.852724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:50.864728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.865785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:50.868560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:50.869515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.258369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.266905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da065922-52d6-4297-9225-c936d79456b9 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.439858 Jul 25 20:10:51.281804 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 782/1583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:50 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:51.287950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fea64f05-5fbd-4449-a644-b5e3f3aee18d tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f19695c5e50>, body: {"keypair": {"name": "tempest-keypair-1885903804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ0rp99NZZsEZPLgPZt3EwYhjGESHcyTjkb8qZ5EF9XTGrWTZkKf6spmPJHdTxFOEfpEVPN0mAUf7tyxLyBZbFcBwJI7RWsg2tt3m3jkiZujjPpVywB7/52Wg3ARP/IIQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:51.309204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fea64f05-5fbd-4449-a644-b5e3f3aee18d tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:51.317841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fea64f05-5fbd-4449-a644-b5e3f3aee18d tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:51.371544 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fea64f05-5fbd-4449-a644-b5e3f3aee18d tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087780 Jul 25 20:10:51.372922 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 783/1584] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:10:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:51.378580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:51.379314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:51.387173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.387729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.388627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.389146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.502284 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35eb7200-708e-42e8-9cdf-9012f02f3c9a tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.964345 Jul 25 20:10:51.503158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 802/1585] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:10:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:51.509035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:51.510017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:51.532285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.532992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.533898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.534439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.539576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:51.672831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.686506 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57546db8-ad8d-4cca-8da0-31180c72bfa8 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1506 microversion: 2.1 time: 0.311889 Jul 25 20:10:51.700394 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 784/1586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:51 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:51.715800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-228d17a0-c6e0-48bc-8470-7ec0a38a41b7 req-108210d7-9e18-4836-abae-375e6c148414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27e4f7b-113a-43d4-bab6-b381c2adc288", "name": "network-vif-plugged", "status": "completed", "tag": "1df20579-5153-49f6-a5cf-0ab7bf0b070a"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:51.736510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-228d17a0-c6e0-48bc-8470-7ec0a38a41b7 req-108210d7-9e18-4836-abae-375e6c148414 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.737510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-228d17a0-c6e0-48bc-8470-7ec0a38a41b7 req-108210d7-9e18-4836-abae-375e6c148414 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.753057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-228d17a0-c6e0-48bc-8470-7ec0a38a41b7 req-108210d7-9e18-4836-abae-375e6c148414 service nova] Creating event network-vif-plugged:1df20579-5153-49f6-a5cf-0ab7bf0b070a for instance d27e4f7b-113a-43d4-bab6-b381c2adc288 on n-h2-845775-3 Jul 25 20:10:51.761205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-228d17a0-c6e0-48bc-8470-7ec0a38a41b7 req-108210d7-9e18-4836-abae-375e6c148414 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054917 Jul 25 20:10:51.766878 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 785/1587] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:51.776171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:51.777435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:51.785622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.786236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.787373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.788287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.808290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.827486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.843349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:51.845300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8bad27e-46fa-421d-b993-7c55bad2a21e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1477 microversion: 2.25 time: 0.341093 Jul 25 20:10:51.846067 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 803/1588] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:51 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:51.851323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:51.854725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:51.867290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.868064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.869044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:51.869649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:51.898957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lazy-loading 'flavor' on Instance uuid 16f865fb-665a-4252-9093-d8116d13512f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:10:52.039459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48f45103-a441-4caa-acb9-ddb0c9a8c2d3 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f/action" status: 202 len: 0 microversion: 2.1 time: 0.190862 Jul 25 20:10:52.040469 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 804/1589] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:10:51 2022] POST /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:10:52.046632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28b9836c-0ca4-4a29-81c3-2cae46aad42f tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f1969cc20d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.066340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:52.076314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f05485b-934b-475b-a6d5-214623fdd44d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1317 microversion: 2.1 time: 0.307103 Jul 25 20:10:52.090093 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28b9836c-0ca4-4a29-81c3-2cae46aad42f tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885903804" status: 202 len: 0 microversion: 2.1 time: 0.038544 Jul 25 20:10:52.090093 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 805/1590] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1885903804 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:10:52.091721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 786/1591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:51 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:52.094868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: .version_select at 0x7f196c4abca0>, body: {"addFloatingIp": {"address": "172.25.3.25"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:52.101654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.102476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:52.106677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:52.110387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.111210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.112557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.113577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.132890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.133747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.135019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.136658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.155449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:10:52.265407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Acquired lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:10:52.319768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-932762eb-b6ba-4786-aee9-6b75a91c6d97 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 204 len: 0 microversion: 2.1 time: 0.224728 Jul 25 20:10:52.324097 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 787/1592] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:10:52 2022] DELETE /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:52.333294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe22e691-a09f-48f3-ad43-fbaab87b6bcc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '.version_select at 0x7f19695c54c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.340657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe22e691-a09f-48f3-ad43-fbaab87b6bcc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.341950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe22e691-a09f-48f3-ad43-fbaab87b6bcc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.357097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe22e691-a09f-48f3-ad43-fbaab87b6bcc tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2956 microversion: 2.25 time: 0.034510 Jul 25 20:10:52.357964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 788/1593] 10.222.0.48 () {60 vars in 1184 bytes} [Mon Jul 25 20:10:52 2022] GET /compute/v2.1/os-migrations => generated 2956 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:52.365883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.368786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:52.380269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.382586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.384313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.385148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.790143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:52.805828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c4e0a89-b612-407d-94c9-ae75f55f4ecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1497 microversion: 2.1 time: 0.446355 Jul 25 20:10:52.816425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 789/1594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:52 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1497 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:52.816425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cfc3412-31a4-4208-a60a-0095e49e3a56 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f1969772940>, body: {"keypair": {"name": "tempest-keypair-1973948587", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:52.855747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5cfc3412-31a4-4208-a60a-0095e49e3a56 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:52.867065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5cfc3412-31a4-4208-a60a-0095e49e3a56 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:52.909885 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cfc3412-31a4-4208-a60a-0095e49e3a56 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.100667 Jul 25 20:10:52.911216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 790/1595] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:10:52 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:52.920520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:52.921445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:52.936126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.942143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:52.942143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:52.942143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:53.501312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:53.514228 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f90fd941-53f6-4c00-a24f-ff8c6f8813c1 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1485 microversion: 2.1 time: 0.600919 Jul 25 20:10:53.524620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 791/1596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:52 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1485 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:53.525134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:53.526150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:53.539635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:53.540652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:53.541796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:53.542171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:53.590711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:10:53.685923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Instance is already in deleting state, ignoring this request Jul 25 20:10:53.687512 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a7160c7d-ab7a-4469-8cfe-b5d1a4230bd4 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 204 len: 0 microversion: 2.1 time: 0.169297 Jul 25 20:10:53.688523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 792/1597] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:10:53 2022] DELETE /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:10:53.698155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:53.698887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:53.713280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:53.714023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:53.715140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:53.715923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.634472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] Lazy-loading 'services' on Instance uuid bb495200-ec26-4477-bea0-13eccabd6397 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:10:54.664585 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8c0217d-9e0c-49ef-9973-bb229b01e509 tempest-LiveAutoBlockMigrationV225Test-52782498 tempest-LiveAutoBlockMigrationV225Test-52782498-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1970 microversion: 2.25 time: 0.970840 Jul 25 20:10:54.666018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 793/1598] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:53 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1970 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:54.675908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6fa6a618-5360-415a-abd4-fa5a11fd5a7b tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f196964e550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:54.742730 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6fa6a618-5360-415a-abd4-fa5a11fd5a7b tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973948587" status: 202 len: 0 microversion: 2.1 time: 0.074419 Jul 25 20:10:54.745042 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 794/1599] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973948587 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:10:54.757673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:54.758356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:54.777521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.779399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:54.781252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:54.782629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.214083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:55.227161 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3139e534-cd7b-462c-838e-ca3655814526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1467 microversion: 2.1 time: 0.480179 Jul 25 20:10:55.228254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 795/1600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:54 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1467 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:55.233990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:55.234767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:55.246551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.246933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.248952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.249479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.373666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:55.408726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7022ac61-82b6-41dd-8336-8d12c408db88 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "POST /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c/action" status: 202 len: 0 microversion: 2.1 time: 0.178670 Jul 25 20:10:55.414991 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 796/1601] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:10:55 2022] POST /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:10:55.416090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:55.416794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:55.424021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.424540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.425492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.426027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.477053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.477515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.477993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lazy-loading 'fault' on Instance uuid c292aa3a-c5ca-46d0-b608-ea0b168694a8 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:10:55.625262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:10:55.629214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbff966c24e646fdb7faad71581dc208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a8f843818649a0adecf75319dc51b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:55.642865 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-847b2a89-86d9-486c-a77f-0c6320d2f7a1 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 200 len: 1306 microversion: 2.1 time: 0.228522 Jul 25 20:10:55.645716 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 797/1602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:55 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:55.667013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:55.667641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:55.688568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.689220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:55.690182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:55.690614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.020332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:56.041973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e618c5d-6748-4757-8487-a986699859ee tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 200 len: 1480 microversion: 2.1 time: 0.379789 Jul 25 20:10:56.042571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 798/1603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:55 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 1480 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:56.047891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:56.048237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:56.066273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.067090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.068204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.068816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.152956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:10:56.317772 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-30f22e4e-e932-4308-9861-199d1001e82e tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 204 len: 0 microversion: 2.25 time: 0.272634 Jul 25 20:10:56.320118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 799/1604] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:10:56 2022] DELETE /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:10:56.351927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ff64ab3-65a8-46d7-8974-0413ab9812a9 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f1969530c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1903931827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfxUkTgxvdw+JYqHe7yHmlvtfW3HJ2nTZMf4wogl9UV24aPBwXQZI7V96gMkL+O8Hf+btNPNevFBjRgP3bZHzSFU701S+6T2HFaxvKL1p/2hNUezx+E0kul7KMJvTVQGA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:56.375403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9ff64ab3-65a8-46d7-8974-0413ab9812a9 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:56.385534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9ff64ab3-65a8-46d7-8974-0413ab9812a9 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:56.415255 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ff64ab3-65a8-46d7-8974-0413ab9812a9 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.092464 Jul 25 20:10:56.416796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 800/1605] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:10:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:56.422940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d63889eb-5879-4e97-9905-bb43fe2dd1a9 req-cbdb7bc7-3a70-4d82-a5ac-21e5d84008e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c292aa3a-c5ca-46d0-b608-ea0b168694a8", "name": "network-vif-deleted", "tag": "b6a2911b-0c68-422e-b8ff-a61e098ae5aa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:56.441183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d63889eb-5879-4e97-9905-bb43fe2dd1a9 req-cbdb7bc7-3a70-4d82-a5ac-21e5d84008e2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.441723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d63889eb-5879-4e97-9905-bb43fe2dd1a9 req-cbdb7bc7-3a70-4d82-a5ac-21e5d84008e2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.467021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d63889eb-5879-4e97-9905-bb43fe2dd1a9 req-cbdb7bc7-3a70-4d82-a5ac-21e5d84008e2 service nova] Creating event network-vif-deleted:b6a2911b-0c68-422e-b8ff-a61e098ae5aa for instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 on n-h1-845775-3 Jul 25 20:10:56.476729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d63889eb-5879-4e97-9905-bb43fe2dd1a9 req-cbdb7bc7-3a70-4d82-a5ac-21e5d84008e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057499 Jul 25 20:10:56.477577 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 801/1606] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:56.486554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:56.487352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:56.497208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.498021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.500082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.501240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.814491 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b9443a9-6ff1-4ef8-938b-deda4863b4a0 tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1618 microversion: 2.1 time: 0.331027 Jul 25 20:10:56.814491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 802/1607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:56 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1618 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:56.821644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:56.821644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:56.831676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.832171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.833362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.833820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.885868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Updating instance_info_cache with network_info: [{"id": "e8b21f3a-5c80-420a-a64e-218ca730bdcf", "address": "fa:16:3e:81:b5:ec", "network": {"id": "0302ef33-7596-4a44-b642-610bcac781ad", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-551146-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "74c5c53cda6540d781ce0498fdc45738", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape8b21f3a-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:10:56.904987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Releasing lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:10:56.914048 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ebad2ee4-0924-4928-8c3d-e36b40414c8d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 202 len: 0 microversion: 2.1 time: 4.830396 Jul 25 20:10:56.915772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 806/1608] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:10:52 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 0 bytes in 4834 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:10:56.925812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4f0eb424-9e91-477a-b86b-c85a5c6f96b4 req-12656e83-5315-44b3-a372-fe3640bd92cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a584a078-6165-4f0b-a3a4-f1eab751b971", "tag": "e8b21f3a-5c80-420a-a64e-218ca730bdcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:56.934579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:10:56.946863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f0eb424-9e91-477a-b86b-c85a5c6f96b4 req-12656e83-5315-44b3-a372-fe3640bd92cf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:56.948406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f0eb424-9e91-477a-b86b-c85a5c6f96b4 req-12656e83-5315-44b3-a372-fe3640bd92cf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:56.967991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4f0eb424-9e91-477a-b86b-c85a5c6f96b4 req-12656e83-5315-44b3-a372-fe3640bd92cf service nova] Creating event network-changed:e8b21f3a-5c80-420a-a64e-218ca730bdcf for instance a584a078-6165-4f0b-a3a4-f1eab751b971 on n-h2-845775-3 Jul 25 20:10:56.980666 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4f0eb424-9e91-477a-b86b-c85a5c6f96b4 req-12656e83-5315-44b3-a372-fe3640bd92cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063072 Jul 25 20:10:56.981383 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 807/1609] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:56.989385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-761169383"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:56.993201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:57.018956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.019590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.021165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.021913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.164816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:57.203227 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-992553e9-622c-47c2-a100-591af379ce9c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1493 microversion: 2.1 time: 0.387455 Jul 25 20:10:57.204884 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 803/1610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:56 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1493 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:10:57.230112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:57.230745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:57.244491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.245295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.247052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.247966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.364549 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9bd4d617-edda-4317-9943-731b2b548a94 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f/action" status: 202 len: 0 microversion: 2.1 time: 0.379823 Jul 25 20:10:57.367999 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 808/1611] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:10:56 2022] POST /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:10:57.375062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bebfbb6-f922-4820-a5b3-ca3451e541c6 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f19697999d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-543638748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk80DFXrreXhuGshURie95s0PrM73hFv8XwO/jSO6ykaVmuAj9w+kh9Cle9IGGFaMuuFAuRk/r3bU7qCu+fLvkeOyatRr9CxpkzCqA+sgN8t7JBWTC+8vtQR4r/A0dWuA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:57.407655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5bebfbb6-f922-4820-a5b3-ca3451e541c6 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:57.427272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5bebfbb6-f922-4820-a5b3-ca3451e541c6 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:57.476772 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bebfbb6-f922-4820-a5b3-ca3451e541c6 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.106147 Jul 25 20:10:57.484418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 809/1612] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:10:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:10:57.497425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:10:57.499137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: c292aa3a-c5ca-46d0-b608-ea0b168694a8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:10:57.511075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.512256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.513509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:57.514308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:57.539125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] HTTP exception thrown: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Request method failure captured: Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 HTTP/1.1 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfk6g4IS7SW7RMWqI2CT7r82MEV7U2tLGYSZOnvIfwY-osOyeQexzDqI0Kp5e1GHBOn4VEX_oi6UN9z2wS36TcolLj0BBcpfvllFyXpSzmujWU4tMx1mRYENdYqhhY6DzQIdotQyc3_89LzQsPf6Y7p-X23C_wnB3fNmuGFhHRgXC8 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:10:57.543330 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}] Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: bbff966c24e646fdb7faad71581dc208 Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. Jul 25 20:10:57.546646 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c292aa3a-c5ca-46d0-b608-ea0b168694a8'} Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:10:57.551205 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. Jul 25 20:10:57.560472 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:10:57.566829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Returning 404 to user: Instance c292aa3a-c5ca-46d0-b608-ea0b168694a8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:10:57.566829 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e733e67-f785-4489-9f17-2e4617032ec9 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8" status: 404 len: 111 microversion: 2.1 time: 0.059669 Jul 25 20:10:57.566829 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 810/1613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:10:57 2022] GET /compute/v2.1/servers/c292aa3a-c5ca-46d0-b608-ea0b168694a8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:10:57.569316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-545286616", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "21bb1d6f-b1ef-4bf4-9acf-77064489ef62"}], "block_device_mapping_v2": [{"uuid": "c5c13f13-afb5-4f96-88b5-9ae9ea2187be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:57.646270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:57.658259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:57.660431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:10:57.666534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] validate_networks() for [('21bb1d6f-b1ef-4bf4-9acf-77064489ef62', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:10:57.668907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0f4fd9d-b7c8-4d56-a3ea-1194ad04efad tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1483 microversion: 2.25 time: 0.462500 Jul 25 20:10:57.671993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 804/1614] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:10:57 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1483 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:10:57.684495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dca08df5-396a-444a-bd49-498dd53bfe79 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'create', calling method: .version_select at 0x7f19697123a0>, body: {"pool": "72fbcb55-45db-4218-9d9d-4b0d790cebc6"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:58.693796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:10:58.695127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:10:58.695946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:10:58.696787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:10:58.697547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:10:58.713039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:58.713855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:58.715241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:10:58.715993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:10:58.746918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:10:58.758465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Getting quotas for user 1d0f300b7de441108c3efcee70e8f920 and project b920e56f4052452a8f53673b16d2c370. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:10:58.892614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:10:58.897115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5c13f13-afb5-4f96-88b5-9ae9ea2187be',volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:10:59.121806 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3a29b44-938a-44a6-a8bd-fd53a1a2c4a9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562297 Jul 25 20:10:59.129243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 811/1615] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:10:59.139260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-893766294", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d7621d37-160c-4885-8f49-abe92624f69a"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:10:59.260749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:11:00.155034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:11:00.156026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:11:00.156274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:11:00.156489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:11:00.157116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:11:00.171269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.172056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.173770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.174582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.199218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:11:00.206027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Getting quotas for user 06b1d24b7c6b4b858546831e1b5b0508 and project ce2718565d4b48ab8235a338f7282313. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:11:00.222369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:11:00.226636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:11:00.316201 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-adf89500-0030-4df1-b2aa-9f45826256b2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184312 Jul 25 20:11:00.317881 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 812/1616] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:11:00.325428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-943722b0-8169-45d0-a65b-22c7d565278d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969b54b80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:00.423521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-943722b0-8169-45d0-a65b-22c7d565278d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.103130 Jul 25 20:11:00.424599 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 813/1617] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:00 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:00.433785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac0c6bf5-8575-4deb-90c8-55e8ff960e3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Action: 'create', calling method: .version_select at 0x7f1969bc79d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-229737446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl9HBhvCvZOj45Nv5T2wH38GFuF4rXwlaRIYA37UakFqlnuExpZyXIFSFlYNgdhwzW60WnEydXTNIh3OebNHsmorZ4W+NhjM3Aj7uhY0O6BCXw+O6cxbq3IR0bhH+ZdTA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:00.464780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ac0c6bf5-8575-4deb-90c8-55e8ff960e3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:11:00.477584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ac0c6bf5-8575-4deb-90c8-55e8ff960e3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Getting quotas for user 4b5933c48bfe41828941a7182f447c2f and project b43e99b5712c40b88dba0126e8fce74c. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:11:00.536920 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac0c6bf5-8575-4deb-90c8-55e8ff960e3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.110118 Jul 25 20:11:00.538468 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 814/1618] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:11:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:00.551879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:00.552950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:00.564155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.565068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.566462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.567507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.592085 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] HTTP exception thrown: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Request method failure captured: Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d HTTP/1.1 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfk6g4IS7SW7RMWqI2CT7r82MEV7U2tLGYSZOnvIfwY-osOyeQexzDqI0Kp5e1GHBOn4VEX_oi6UN9z2wS36TcolLj0BBcpfvllFyXpSzmujWU4tMx1mRYENdYqhhY6DzQIdotQyc3_89LzQsPf6Y7p-X23C_wnB3fNmuGFhHRgXC8 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:00.595569 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}] Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: bbff966c24e646fdb7faad71581dc208 Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:00.597332 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '11a6db6b-ffb4-49a1-99f3-321986fdd30d'} Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:00.598524 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:00.601025 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:00.604350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Returning 404 to user: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:00.605479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43486386-ea8f-430b-8708-2aedbf2cf674 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 404 len: 111 microversion: 2.1 time: 0.065525 Jul 25 20:11:00.606607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 815/1619] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:00 2022] DELETE /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:00.614464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:00.615324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:00.616788 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dca08df5-396a-444a-bd49-498dd53bfe79 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.938726 Jul 25 20:11:00.627123 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 805/1620] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:10:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:00.627392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.627392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.627587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4e0a3e9b-be88-4ab8-baf2-5e2b137b0e4b req-f3071678-6bfd-4074-aacc-6a03aab0ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb495200-ec26-4477-bea0-13eccabd6397", "name": "network-vif-deleted", "tag": "b01b49b2-a1bd-4622-a2e1-5ee06c56eccd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:00.627699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.627699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.643453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e0a3e9b-be88-4ab8-baf2-5e2b137b0e4b req-f3071678-6bfd-4074-aacc-6a03aab0ea5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.644300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e0a3e9b-be88-4ab8-baf2-5e2b137b0e4b req-f3071678-6bfd-4074-aacc-6a03aab0ea5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.664429 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4e0a3e9b-be88-4ab8-baf2-5e2b137b0e4b req-f3071678-6bfd-4074-aacc-6a03aab0ea5d service nova] Creating event network-vif-deleted:b01b49b2-a1bd-4622-a2e1-5ee06c56eccd for instance bb495200-ec26-4477-bea0-13eccabd6397 on n-h1-845775-3 Jul 25 20:11:00.673019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4e0a3e9b-be88-4ab8-baf2-5e2b137b0e4b req-f3071678-6bfd-4074-aacc-6a03aab0ea5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053127 Jul 25 20:11:00.674330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 806/1621] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:00.682210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:00.683165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:00.692081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.692894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:00.695131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:00.696165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.023295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.042071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.044024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.045469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-370a6c70-859e-43ae-8672-6f5c804832e9 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1266 microversion: 2.25 time: 0.369431 Jul 25 20:11:01.047338 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 807/1622] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:00 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:01.057950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:01.059230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:01.073702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.074978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.076916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.078226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.156715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.166553 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbccdac6-b5db-4575-9d60-59e5e802731c tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1499 microversion: 2.1 time: 0.558450 Jul 25 20:11:01.185296 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 816/1623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:00 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1499 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:01.222482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:01.224959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:01.233702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.243415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.252562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-284c1ef5-dcef-4eb6-81dd-50164b200391 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1168 microversion: 2.1 time: 0.203583 Jul 25 20:11:01.253354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.255083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.255745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.260527 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 808/1624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:01 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1168 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:01.274226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33f87aca-a8fa-4018-8b13-2c3ec654f608 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f1969772550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:01.285834 n-d-845775-3 devstack@n-api.service[119723]: WARNING oslo_db.sqlalchemy.utils [None req-33f87aca-a8fa-4018-8b13-2c3ec654f608 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:11:01.295502 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33f87aca-a8fa-4018-8b13-2c3ec654f608 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.033065 Jul 25 20:11:01.296707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 809/1625] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:11:01 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:01.305374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:01.306714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 11a6db6b-ffb4-49a1-99f3-321986fdd30d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:01.316202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:01.320000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.321427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.323068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.324113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.402047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] HTTP exception thrown: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Request method failure captured: Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d HTTP/1.1 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfk6g4IS7SW7RMWqI2CT7r82MEV7U2tLGYSZOnvIfwY-osOyeQexzDqI0Kp5e1GHBOn4VEX_oi6UN9z2wS36TcolLj0BBcpfvllFyXpSzmujWU4tMx1mRYENdYqhhY6DzQIdotQyc3_89LzQsPf6Y7p-X23C_wnB3fNmuGFhHRgXC8 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:01.410286 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}] Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: bbff966c24e646fdb7faad71581dc208 Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:01.412467 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '11a6db6b-ffb4-49a1-99f3-321986fdd30d'} Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:01.414096 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. Jul 25 20:11:01.415520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:01.418607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Returning 404 to user: Instance 11a6db6b-ffb4-49a1-99f3-321986fdd30d could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:01.418607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4eb73fa8-0e4a-450f-b1fe-32b12251644c tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d" status: 404 len: 111 microversion: 2.1 time: 0.114350 Jul 25 20:11:01.420771 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 810/1626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:01 2022] GET /compute/v2.1/servers/11a6db6b-ffb4-49a1-99f3-321986fdd30d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:01.438574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: .version_select at 0x7f196c4a6550>, body: {"addFloatingIp": {"address": "172.25.3.150"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:01.443170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:01.456002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.457204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.458469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.459262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.473495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:01.502443 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0f2ba85-6715-4cad-9803-837e98ffde82 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1220 microversion: 2.1 time: 0.313693 Jul 25 20:11:01.507925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 817/1627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:01 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1220 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:01.523171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:01.529144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:01.558269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.558925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.566317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:01.567269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:01.647013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:01.704661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Acquired lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:11:01.958036 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0ca22f9-8d80-48e1-989a-90919924625f tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 204 len: 0 microversion: 2.1 time: 0.447486 Jul 25 20:11:01.964772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 818/1628] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:01 2022] DELETE /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:01.995560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-76c7d712-8d0e-4e03-bc99-62939bde6900 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f1969e0a5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:02.071531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-76c7d712-8d0e-4e03-bc99-62939bde6900 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-229737446" status: 202 len: 0 microversion: 2.1 time: 0.103945 Jul 25 20:11:02.077348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 819/1629] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-229737446 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:02.105687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:02.114624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:02.128221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:02.128677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:02.129508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:02.129958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:02.167470 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] HTTP exception thrown: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Request method failure captured: Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 HTTP/1.1 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfk6g4IS7SW7RMWqI2CT7r82MEV7U2tLGYSZOnvIfwY-osOyeQexzDqI0Kp5e1GHBOn4VEX_oi6UN9z2wS36TcolLj0BBcpfvllFyXpSzmujWU4tMx1mRYENdYqhhY6DzQIdotQyc3_89LzQsPf6Y7p-X23C_wnB3fNmuGFhHRgXC8 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:02.169216 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}] Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: bbff966c24e646fdb7faad71581dc208 Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:02.171709 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '311ddd9b-db98-4b21-a06c-a24f8b4ff6e5'} Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:02.173033 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:02.174725 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:02.181913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Returning 404 to user: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:02.181913 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cbf9549a-d706-4b62-a4e2-ed12b5c42f29 tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 404 len: 111 microversion: 2.1 time: 0.088797 Jul 25 20:11:02.189058 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 820/1630] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:02 2022] DELETE /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:02.203666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-267d01e8-c471-4a6e-abba-8ccfae4a89a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698d0310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:02.324264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-267d01e8-c471-4a6e-abba-8ccfae4a89a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.132380 Jul 25 20:11:02.324878 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 821/1631] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:02 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:02.369963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:02.371025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:02.379801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:02.380706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:02.382545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:02.383193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:02.958682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:02.972093 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1409fc0e-3c88-4dde-9d87-758557a46412 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.620307 Jul 25 20:11:02.996460 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 822/1632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:02 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:03.003515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62c0716c-30c4-4abf-9e70-7c5cc6bfbb89 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f19699069d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.032289 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62c0716c-30c4-4abf-9e70-7c5cc6bfbb89 tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-543638748" status: 202 len: 0 microversion: 2.1 time: 0.034446 Jul 25 20:11:03.033321 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 823/1633] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:11:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-543638748 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:03.049935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.050453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:03.062807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.063226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.064503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.064953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.232439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:03.253382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:03.259492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:03.264881 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13da74c1-4c98-4fb0-ba0d-7ebb7a2c1c09 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1266 microversion: 2.25 time: 0.221866 Jul 25 20:11:03.265794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 824/1634] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:03 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:03.271046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.271673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] [instance: 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:03.281038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6.", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:11:03.281907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Releasing lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:11:03.282740 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.282740 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Request method failure captured: Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action HTTP/1.1 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 46 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vig6DvJjFKwncycPYHFuczqnrLCb3it11WhuHHtQKDJSMFhHX1bytadjG9kh9K_FZTX0m26bXhBh12WtJTxTPo2GdvnQeuLqYNHzu7qWrsRw6A4zSOfgE9XJvD04ggKdArCa9R4gHZZV47ui1gm1tY9f5rgys9ONGt4wsj2rwtUP3A Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:03.285248 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}] Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5c8be0fca0854a378899cb027ce4d2a1 Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: {"addFloatingIp": {"address": "172.25.3.150"}} Jul 25 20:11:03.288789 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a584a078-6165-4f0b-a3a4-f1eab751b971', 'body': {'addFloatingIp': {'address': '172.25.3.150'}}} Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.290471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:11:03.292716 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.295031 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.299402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Returning 400 to user: Cannot associate floating IP 172.25.3.150 (b89fae4c-9ad4-44f1-ad46-f613e0f5462c) with port e8b21f3a-5c80-420a-a64e-218ca730bdcf using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 72fbcb55-45db-4218-9d9d-4b0d790cebc6. Jul 25 20:11:03.302145 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-9ddfa782-bc1f-490e-b452-376fc00374e1'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:03.303655 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cab487b2-6d69-46ab-a330-1616fc29b37d tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 400 len: 381 microversion: 2.1 time: 1.858241 Jul 25 20:11:03.303655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 811/1635] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:01 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 381 bytes in 1878 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:03.307495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.312537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.313418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.315459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.316957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:03.320175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.326111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:03.328809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.329272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.330061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.330500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.356206 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] HTTP exception thrown: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Request method failure captured: Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 HTTP/1.1 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfk6g4IS7SW7RMWqI2CT7r82MEV7U2tLGYSZOnvIfwY-osOyeQexzDqI0Kp5e1GHBOn4VEX_oi6UN9z2wS36TcolLj0BBcpfvllFyXpSzmujWU4tMx1mRYENdYqhhY6DzQIdotQyc3_89LzQsPf6Y7p-X23C_wnB3fNmuGFhHRgXC8 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:03.357759 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3a8f843818649a0adecf75319dc51b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3a8f843818649a0adecf75319dc51b7"}]}] Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a3a8f843818649a0adecf75319dc51b7 Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-139162644 Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: bbff966c24e646fdb7faad71581dc208 Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-139162644-project Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:03.361376 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '311ddd9b-db98-4b21-a06c-a24f8b4ff6e5'} Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:03.363073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. Jul 25 20:11:03.365499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:03.373014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] Returning 404 to user: Instance 311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:03.373014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7082fc13-99d2-4c9b-ad40-5bb9188261cb tempest-ServerDiskConfigTestJSON-139162644 tempest-ServerDiskConfigTestJSON-139162644-project] 10.222.0.48 "GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5" status: 404 len: 111 microversion: 2.1 time: 0.092569 Jul 25 20:11:03.373014 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 825/1636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:03 2022] GET /compute/v2.1/servers/311ddd9b-db98-4b21-a06c-a24f8b4ff6e5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:03.373014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.373014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:03.381248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.381731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.382583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:03.383026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:03.569671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:03.583324 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-951f0e5e-1863-4c6c-b873-f067bec0f34a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1268 microversion: 2.1 time: 0.222327 Jul 25 20:11:03.601597 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 826/1637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:03 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1268 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:03.615668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d92e78ac-521b-4f24-a58a-4b02d665aa3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] Calling method '.version_select at 0x7f1969a96e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.666399 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d92e78ac-521b-4f24-a58a-4b02d665aa3a tempest-KeyPairsV2TestJSON-1707349620 tempest-KeyPairsV2TestJSON-1707349620-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1903931827" status: 202 len: 0 microversion: 2.1 time: 0.058451 Jul 25 20:11:03.668913 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 827/1638] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Jul 25 20:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1903931827 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:03.683621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-15f8cd6c-e0db-491c-9abc-08804261560e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '.version_select at 0x7f1969b23700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:03.829876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:03.859555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e3551e7-25f3-4e29-88e3-01af1aa12c06 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 0.556041 Jul 25 20:11:03.873709 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 812/1639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:03 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:03.904256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b942560-3df8-4cfe-9b73-19b451838a70 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969530430>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:04.128965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b942560-3df8-4cfe-9b73-19b451838a70 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.250701 Jul 25 20:11:04.131377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 813/1640] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:03 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:04.161365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:04.168207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:04.196748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:04.201228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:04.202838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:04.206567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:05.090214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:05.107662 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80b93f02-7861-4400-af79-321635b1fa61 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.962369 Jul 25 20:11:05.108315 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 814/1641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:04 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:05.135630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:05.137078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:05.177247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:05.177996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:05.179379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:05.180496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:05.541717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:05.623462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:05.637538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:05.644519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ea592f49-be77-4204-9788-580a7046d6e8 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1266 microversion: 2.25 time: 0.522445 Jul 25 20:11:05.647953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 815/1642] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:05 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1266 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:05.669987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a27035ac-9c51-4fcf-9bb4-3601e1ef1702 req-08c52520-8a11-4719-bf30-9b925e7a8cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f865fb-665a-4252-9093-d8116d13512f", "name": "network-vif-plugged", "status": "completed", "tag": "18c133a8-0de0-445a-b71c-1e04cb703a24"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:05.716235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a27035ac-9c51-4fcf-9bb4-3601e1ef1702 req-08c52520-8a11-4719-bf30-9b925e7a8cea service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:05.717552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a27035ac-9c51-4fcf-9bb4-3601e1ef1702 req-08c52520-8a11-4719-bf30-9b925e7a8cea service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:05.753120 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a27035ac-9c51-4fcf-9bb4-3601e1ef1702 req-08c52520-8a11-4719-bf30-9b925e7a8cea service nova] Creating event network-vif-plugged:18c133a8-0de0-445a-b71c-1e04cb703a24 for instance 16f865fb-665a-4252-9093-d8116d13512f on n-h1-845775-3 Jul 25 20:11:05.764659 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a27035ac-9c51-4fcf-9bb4-3601e1ef1702 req-08c52520-8a11-4719-bf30-9b925e7a8cea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113979 Jul 25 20:11:05.767186 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 816/1643] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:05.785355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:05.788472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:05.804344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:05.805578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:05.807572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:05.809016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:06.076011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:06.107000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a4c054c-9c8b-4d1d-b0c0-d2008ec3e8ac tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1274 microversion: 2.1 time: 0.334834 Jul 25 20:11:06.126203 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 817/1644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:05 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1274 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:06.139911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:06.139911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:06.158395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:06.159170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:06.160455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:06.171996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:06.266456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:06.393560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:06.599790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:06.624370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b9a9ca6-47ec-45c0-abc6-3c4c61578a54 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 0.504487 Jul 25 20:11:06.636079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 818/1645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:06 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:06.645936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a7ca51a-bb78-4261-a172-d2db3ddf7a1f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19697f8040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:06.795817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a7ca51a-bb78-4261-a172-d2db3ddf7a1f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.165682 Jul 25 20:11:06.800797 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 819/1646] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:06 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:06.820224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:06.821591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:06.846111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:06.847207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:06.848915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:06.849558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:07.551027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:07.612573 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b86a847-391c-4006-a14b-b3fed50f8e91 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.809963 Jul 25 20:11:07.620265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 820/1647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:06 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:07.666403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:07.667987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:07.702818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:07.709350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:07.719507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:07.721143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:07.940343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:07.961659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:07.965177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:07.967945 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3da2a990-cb45-416d-a5ee-9b476c39a167 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 200 len: 1266 microversion: 2.25 time: 0.341720 Jul 25 20:11:07.969475 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 821/1648] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:07 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:07.979836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:07.981380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:07.995660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:07.997034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:07.998539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:07.999538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:08.447568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:08.473273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7beed777-4624-440f-bdc7-2d93297b7c4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1274 microversion: 2.1 time: 0.496353 Jul 25 20:11:08.474414 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 822/1649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:07 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1274 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:08.487496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-fe9a0e75-aac7-4b4f-951c-c8aed6e75994 req-e08794ee-fed6-4ee9-b941-677abcc9397e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:08.566146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fe9a0e75-aac7-4b4f-951c-c8aed6e75994 req-e08794ee-fed6-4ee9-b941-677abcc9397e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:08.566931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fe9a0e75-aac7-4b4f-951c-c8aed6e75994 req-e08794ee-fed6-4ee9-b941-677abcc9397e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:08.680962 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-fe9a0e75-aac7-4b4f-951c-c8aed6e75994 req-e08794ee-fed6-4ee9-b941-677abcc9397e service nova] Creating event network-changed:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:11:08.711506 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-fe9a0e75-aac7-4b4f-951c-c8aed6e75994 req-e08794ee-fed6-4ee9-b941-677abcc9397e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225151 Jul 25 20:11:08.720580 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 823/1650] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:08.749119 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-15f8cd6c-e0db-491c-9abc-08804261560e tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/b89fae4c-9ad4-44f1-ad46-f613e0f5462c" status: 202 len: 0 microversion: 2.1 time: 5.078132 Jul 25 20:11:08.750136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 828/1651] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:11:03 2022] DELETE /compute/v2.1/os-floating-ips/b89fae4c-9ad4-44f1-ad46-f613e0f5462c => generated 0 bytes in 5081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:08.763384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:08.764691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:08.771553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7261d14a-d33e-4a47-a836-1f7b087138e9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196944a5e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:08.837786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:08.843444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:08.852506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:08.853298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:08.983100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7261d14a-d33e-4a47-a836-1f7b087138e9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.223075 Jul 25 20:11:08.987994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 829/1652] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:08 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:08.996077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:09.002751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:09.027240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:09.037191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:09.038056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:09.038701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:09.752059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:09.808355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e704c19d-fcbd-4b7e-abe4-b14a7ead1198 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 1.081034 Jul 25 20:11:09.823427 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 824/1653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:08 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:09.829013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: .version_select at 0x7f196c4a6430>, body: {"removeFloatingIp": {"address": "172.25.3.25"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:09.972380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:09.990183 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0829bed8-132b-4c02-8ad2-dd7cbca8696a tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 200 len: 1505 microversion: 2.1 time: 0.992538 Jul 25 20:11:10.008404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 830/1654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:08 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 1505 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:10.013710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:10.014325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: bb495200-ec26-4477-bea0-13eccabd6397] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:10.050910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:10.056830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.058465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.061300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.062914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.089104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] HTTP exception thrown: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Request method failure captured: Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 HTTP/1.1 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbfs4FQ829XT5bFniUkv6Cm8A7y5c2T1vOsf7zogQgRaijaH3jD2lqsg-7sYIv3e81HqLALpPsoCNHXQL5a4IN2VHGtAnIaphE2F_iTUB5r3F_PIitodWpTF2A7ualTkimKNZegUnMiO0BjmNWQdQTXbD0frGWn577anhcvVom8lGs Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:10.092310 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}] Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 98399c84012545a88dc69f2cbc91cf69 Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. Jul 25 20:11:10.095417 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'bb495200-ec26-4477-bea0-13eccabd6397'} Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:10.097035 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. Jul 25 20:11:10.099654 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:10.107759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Returning 404 to user: Instance bb495200-ec26-4477-bea0-13eccabd6397 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:10.109334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3fe49e70-9048-4ccc-82d1-ca19516c9952 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397" status: 404 len: 111 microversion: 2.25 time: 0.099785 Jul 25 20:11:10.111353 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 831/1655] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:10 2022] GET /compute/v2.1/servers/bb495200-ec26-4477-bea0-13eccabd6397 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:10.119626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:10.120535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:10.131686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.132864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.148257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.150340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.216189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:10.496275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=24 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:10.563819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:10.595564 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2bd903ee-bc69-4d49-be13-0bd86c6edf90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1274 microversion: 2.1 time: 0.479932 Jul 25 20:11:10.596690 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 832/1656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:10 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1274 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:10.618073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b6812e0-abbb-4881-8151-3628ea8c330d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19692d0790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:10.625968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:10.667905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.679547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.690233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.691538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.754886 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b6812e0-abbb-4881-8151-3628ea8c330d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.154186 Jul 25 20:11:10.762233 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 833/1657] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:10 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:10.781657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-01ac8021-1561-4c8f-a71f-6270d7e55c10 req-5d6412d4-5658-4984-a03f-fe109494592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f316c3-4de5-49be-85b1-c731d274527c", "name": "network-vif-deleted", "tag": "18f68a44-6f9c-469e-8205-d38c3ad2aa82"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:10.806947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-01ac8021-1561-4c8f-a71f-6270d7e55c10 req-5d6412d4-5658-4984-a03f-fe109494592c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.810097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-01ac8021-1561-4c8f-a71f-6270d7e55c10 req-5d6412d4-5658-4984-a03f-fe109494592c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.843132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-01ac8021-1561-4c8f-a71f-6270d7e55c10 req-5d6412d4-5658-4984-a03f-fe109494592c service nova] Creating event network-vif-deleted:18f68a44-6f9c-469e-8205-d38c3ad2aa82 for instance c6f316c3-4de5-49be-85b1-c731d274527c on n-h1-845775-3 Jul 25 20:11:10.864852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-01ac8021-1561-4c8f-a71f-6270d7e55c10 req-5d6412d4-5658-4984-a03f-fe109494592c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100715 Jul 25 20:11:10.872142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 834/1658] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:10.890844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:10.897570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:10.919603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.921546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:10.926615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:10.927575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:12.121535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Acquired lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:11:13.151545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:13.174884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0879a1aa-d1db-4c9b-9ed9-5cfd6f0c1aa8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 2.298970 Jul 25 20:11:13.176457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 835/1659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:10 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:13.192314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:13.197766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: c6f316c3-4de5-49be-85b1-c731d274527c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:13.221873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:13.227626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:13.230334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:13.235847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:13.282944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] HTTP exception thrown: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Request method failure captured: Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c HTTP/1.1 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vhJbTplqTsIQ77mi3snaMTXeGI19lniLVAzijs41UlymjPJ075BsD0XwMlDF1Dhj2R8l-vEj_nkG_tclKpWf0bDPEseuZZXWRs86gsDRtcOG7jfaqCbqXhu4mo9EzNbxPDGLfcMIJuCjxRDLQKpdmuQMVBRj5KLca8w1ED9n3Lk2o8 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 10813483bba14011bc0cba01d3b52ca9 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:13.285653 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10813483bba14011bc0cba01d3b52ca9"}]}] Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 10813483bba14011bc0cba01d3b52ca9 Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueTestJSON-1112153894-project Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2c67ccc2a03e4e4fb57097603a0fe80e Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueTestJSON-1112153894-project Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. Jul 25 20:11:13.287193 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c6f316c3-4de5-49be-85b1-c731d274527c'} Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:13.289319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. Jul 25 20:11:13.291291 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:13.297219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Returning 404 to user: Instance c6f316c3-4de5-49be-85b1-c731d274527c could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:13.299132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-330f9835-0c5e-4116-af51-aaf4ff63c4af tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c" status: 404 len: 111 microversion: 2.1 time: 0.120454 Jul 25 20:11:13.307166 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 836/1660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:13 2022] GET /compute/v2.1/servers/c6f316c3-4de5-49be-85b1-c731d274527c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:13.314773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:13.324909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:13.342236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:13.346937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:13.349604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:13.353535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:15.120556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:15.145712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c7a705f-511a-4817-8bf8-69b4f9fb1ae9 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 1.831305 Jul 25 20:11:15.160150 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 837/1661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:13 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:15.165378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67bf5bcc-f289-4ff9-91c4-540e6dc36947 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698f5940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:15.277120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67bf5bcc-f289-4ff9-91c4-540e6dc36947 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.115435 Jul 25 20:11:15.283516 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 838/1662] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:15 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:15.291712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:15.296802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:15.316696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:15.317545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:15.319218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:15.320499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:15.393063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:15.541254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2a9c58d7-04f2-46b2-8c80-7c01a253e312 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 204 len: 0 microversion: 2.1 time: 0.250595 Jul 25 20:11:15.543633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 839/1663] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:15 2022] DELETE /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:15.561744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:15.562792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:15.584194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:15.586926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:15.588739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:15.590295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:16.300584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:16.324950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7a2f2ca-f54d-4127-b711-632e5a3a4a10 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 0.778622 Jul 25 20:11:16.326362 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 840/1664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:15 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:16.358024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-167f0279-da55-48ff-8fc2-55db455b6b0d req-c7be6dc4-ceb6-46e0-9232-fa69b3e11318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e", "tag": "98028763-8b86-4a94-bf28-aa8a26c180d2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:16.397070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-167f0279-da55-48ff-8fc2-55db455b6b0d req-c7be6dc4-ceb6-46e0-9232-fa69b3e11318 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:16.397731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-167f0279-da55-48ff-8fc2-55db455b6b0d req-c7be6dc4-ceb6-46e0-9232-fa69b3e11318 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:16.456411 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-167f0279-da55-48ff-8fc2-55db455b6b0d req-c7be6dc4-ceb6-46e0-9232-fa69b3e11318 service nova] Creating event network-changed:98028763-8b86-4a94-bf28-aa8a26c180d2 for instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e on n-h1-845775-3 Jul 25 20:11:16.479388 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-167f0279-da55-48ff-8fc2-55db455b6b0d req-c7be6dc4-ceb6-46e0-9232-fa69b3e11318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150643 Jul 25 20:11:16.485559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 841/1665] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:16.516093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:16.516093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:16.546672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:16.547548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:16.558147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:16.560616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:16.968275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Building network info cache for instance {{(pid=119723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:11:17.283203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:17.321645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d29b4e6-aba4-4f73-90ab-1656efae204e tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1491 microversion: 2.1 time: 0.834193 Jul 25 20:11:17.371835 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 842/1666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:16 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1491 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:17.379405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:17.391764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:17.424269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:17.425265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:17.436098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:17.439050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:19.090903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:19.145925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2eb0a261-133a-4394-96a2-fdea30d9d431 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 1.769382 Jul 25 20:11:19.151179 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 843/1667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:17 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:19.180375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-629abf32-021d-4ca6-a186-07b2dbb4c57b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698f5790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:19.360260 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-629abf32-021d-4ca6-a186-07b2dbb4c57b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.199031 Jul 25 20:11:19.361567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 844/1668] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:19 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:19.402329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b8539ae1-a538-42f8-8caa-926949b29e96 req-ea0adc2b-93f7-40b1-bf11-69c5fdaf9906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a584a078-6165-4f0b-a3a4-f1eab751b971", "tag": "e8b21f3a-5c80-420a-a64e-218ca730bdcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:19.477034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8539ae1-a538-42f8-8caa-926949b29e96 req-ea0adc2b-93f7-40b1-bf11-69c5fdaf9906 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:19.491444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8539ae1-a538-42f8-8caa-926949b29e96 req-ea0adc2b-93f7-40b1-bf11-69c5fdaf9906 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:19.557716 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b8539ae1-a538-42f8-8caa-926949b29e96 req-ea0adc2b-93f7-40b1-bf11-69c5fdaf9906 service nova] Creating event network-changed:e8b21f3a-5c80-420a-a64e-218ca730bdcf for instance a584a078-6165-4f0b-a3a4-f1eab751b971 on n-h2-845775-3 Jul 25 20:11:19.589323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b8539ae1-a538-42f8-8caa-926949b29e96 req-ea0adc2b-93f7-40b1-bf11-69c5fdaf9906 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214977 Jul 25 20:11:19.598576 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 845/1669] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:19.618126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:19.636914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:19.671294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:19.678632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:19.680814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:19.680814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:20.553201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Updating instance_info_cache with network_info: [{"id": "e8b21f3a-5c80-420a-a64e-218ca730bdcf", "address": "fa:16:3e:81:b5:ec", "network": {"id": "0302ef33-7596-4a44-b642-610bcac781ad", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-551146-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "74c5c53cda6540d781ce0498fdc45738", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape8b21f3a-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:11:20.606255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Releasing lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:11:20.608608 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a1ff912-b6a0-445c-82d1-e2a2c78798a2 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 202 len: 0 microversion: 2.1 time: 10.783801 Jul 25 20:11:20.622021 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 825/1670] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:09 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 0 bytes in 10797 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:11:20.650664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:20.659288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:20.696509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:20.700393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:20.707137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:20.713202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:20.713798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:20.753956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:20.794852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c49a6509-a732-4aaa-bed6-f443504797b8 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 1.194321 Jul 25 20:11:20.802168 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 846/1671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:19 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:20.826138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:20.829437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:20.851462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:20.854467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:20.856962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:20.861228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:21.545513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:21.564305 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b090befe-f872-44d4-a06f-a5de2aa84853 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1491 microversion: 2.1 time: 0.938414 Jul 25 20:11:21.565396 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 826/1672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:20 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1491 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:21.594217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b533321-31e7-4a93-9705-cbdc861ad995 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196984f310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:21.655488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:21.689831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c790346-601e-437e-b1e7-71186add9179 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 0.883193 Jul 25 20:11:21.698586 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 847/1673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:20 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:21.719045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e37389c-b10b-4935-a1c1-01da87efe399 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '.version_select at 0x7f1969aa9160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:21.815852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b533321-31e7-4a93-9705-cbdc861ad995 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.234883 Jul 25 20:11:21.828968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 827/1674] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:21 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:21.854884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:21.866058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:21.898176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:21.899382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:21.900732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:21.900732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:23.599120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:23.618258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aee25ae2-09d5-4ec6-8fbe-a11d8ec0a950 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1210 microversion: 2.1 time: 1.787938 Jul 25 20:11:23.636829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 828/1675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:21 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1210 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:23.656270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:23.657328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:23.665784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:23.666636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:23.667832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:23.668775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:25.195834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c67ccc2a03e4e4fb57097603a0fe80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10813483bba14011bc0cba01d3b52ca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:25.210734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93505df9-343d-4d69-bd32-30feaa6b8139 tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 200 len: 1491 microversion: 2.1 time: 1.571512 Jul 25 20:11:25.220411 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 829/1676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:23 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 1491 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:25.256680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:25.259224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:25.284800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:25.285712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:25.287532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:25.288279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:25.915398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:25.958576 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfe55003-2db3-4a44-9bc2-de35b479bb6e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 0.735980 Jul 25 20:11:25.981963 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 830/1677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:25 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:26.012359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-924dc213-d94b-4571-9813-be1560b3d01e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698addc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:26.143580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-924dc213-d94b-4571-9813-be1560b3d01e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.159364 Jul 25 20:11:26.151729 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 831/1678] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:25 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:26.166266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cc0a7b0b-fe98-4244-bcce-1380147b4020 req-67f453c4-3bba-4c77-ba37-98aabd407c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701bca35-9051-4dea-8c31-8e939fca4577", "name": "network-vif-deleted", "tag": "c6425a59-ac42-417c-897e-952524054440"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:26.259568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cc0a7b0b-fe98-4244-bcce-1380147b4020 req-67f453c4-3bba-4c77-ba37-98aabd407c51 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:26.266279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cc0a7b0b-fe98-4244-bcce-1380147b4020 req-67f453c4-3bba-4c77-ba37-98aabd407c51 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:26.373410 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cc0a7b0b-fe98-4244-bcce-1380147b4020 req-67f453c4-3bba-4c77-ba37-98aabd407c51 service nova] Creating event network-vif-deleted:c6425a59-ac42-417c-897e-952524054440 for instance 701bca35-9051-4dea-8c31-8e939fca4577 on n-h1-845775-3 Jul 25 20:11:26.414005 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cc0a7b0b-fe98-4244-bcce-1380147b4020 req-67f453c4-3bba-4c77-ba37-98aabd407c51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260004 Jul 25 20:11:26.427315 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 832/1679] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:26.460987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:26.462873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:26.526042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:26.537529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:26.546662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:26.547486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:26.902422 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e37389c-b10b-4935-a1c1-01da87efe399 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/f1401cef-f04a-4ba3-9553-988ce189454d" status: 202 len: 0 microversion: 2.1 time: 5.201863 Jul 25 20:11:26.903500 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 848/1680] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:11:21 2022] DELETE /compute/v2.1/os-floating-ips/f1401cef-f04a-4ba3-9553-988ce189454d => generated 0 bytes in 5204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:26.918528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:26.923614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] [instance: 701bca35-9051-4dea-8c31-8e939fca4577] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:26.961237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:26.962261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:26.967778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:26.968867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:27.032629 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] HTTP exception thrown: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Request method failure captured: Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 HTTP/1.1 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vhJbTplqTsIQ77mi3snaMTXeGI19lniLVAzijs41UlymjPJ075BsD0XwMlDF1Dhj2R8l-vEj_nkG_tclKpWf0bDPEseuZZXWRs86gsDRtcOG7jfaqCbqXhu4mo9EzNbxPDGLfcMIJuCjxRDLQKpdmuQMVBRj5KLca8w1ED9n3Lk2o8 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 10813483bba14011bc0cba01d3b52ca9 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:27.036136 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/10813483bba14011bc0cba01d3b52ca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/10813483bba14011bc0cba01d3b52ca9"}]}] Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 10813483bba14011bc0cba01d3b52ca9 Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueTestJSON-1112153894 Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueTestJSON-1112153894-project Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2c67ccc2a03e4e4fb57097603a0fe80e Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueTestJSON-1112153894-project Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. Jul 25 20:11:27.040075 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '701bca35-9051-4dea-8c31-8e939fca4577'} Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:27.041975 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. Jul 25 20:11:27.044905 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.050139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] Returning 404 to user: Instance 701bca35-9051-4dea-8c31-8e939fca4577 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:27.050139 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07298cdf-7974-4547-81ef-0c8cc73b76db tempest-ServerRescueTestJSON-1112153894 tempest-ServerRescueTestJSON-1112153894-project] 10.222.0.48 "GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577" status: 404 len: 111 microversion: 2.1 time: 0.142240 Jul 25 20:11:27.050756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 849/1681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:26 2022] GET /compute/v2.1/servers/701bca35-9051-4dea-8c31-8e939fca4577 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:27.063898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc137bc5-e1a3-4cee-8d3a-07d4f7e63bdd tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc137bc5-e1a3-4cee-8d3a-07d4f7e63bdd tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Request method failure captured: Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action HTTP/1.1 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 34 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vig6DvJjFKwncycPYHFuczqnrLCb3it11WhuHHtQKDJSMFhHX1bytadjG9kh9K_FZTX0m26bXhBh12WtJTxTPo2GdvnQeuLqYNHzu7qWrsRw6A4zSOfgE9XJvD04ggKdArCa9R4gHZZV47ui1gm1tY9f5rgys9ONGt4wsj2rwtUP3A Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:27.069968 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}] Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5c8be0fca0854a378899cb027ce4d2a1 Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: {"addFloatingIp": {"address": ""}} Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:11:27.072159 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a584a078-6165-4f0b-a3a4-f1eab751b971', 'body': {'addFloatingIp': {'address': ''}}} Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi '' Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:27.073595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:11:27.075748 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:11:27.078179 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 25 20:11:27.078179 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:27.080093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc137bc5-e1a3-4cee-8d3a-07d4f7e63bdd tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:27.081812 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc137bc5-e1a3-4cee-8d3a-07d4f7e63bdd tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 400 len: 142 microversion: 2.1 time: 0.029310 Jul 25 20:11:27.083553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 850/1682] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:27 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 142 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:27.092522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:27.093915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:27.106920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:27.107775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:27.109133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:27.110202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:27.796318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:27.814089 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0791a5a2-426a-4329-a16a-a7d4701b3c74 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 1.383870 Jul 25 20:11:27.851749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:27.852931 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 833/1683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:26 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:27.868604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c59c2a26-d614-4daf-8062-56a66e56d306 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 0.775343 Jul 25 20:11:27.870435 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 851/1684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:27 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:27.885742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:27.893269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60cb6422-a97e-4951-a902-f3b6bd0a5f89 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19692bddc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:27.901765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:27.917720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:27.918224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:27.929638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:27.940976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:28.003577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Acquired lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:11:28.069482 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60cb6422-a97e-4951-a902-f3b6bd0a5f89 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.197608 Jul 25 20:11:28.078392 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 852/1685] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:27 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:28.619113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Releasing lock "refresh_cache-a584a078-6165-4f0b-a3a4-f1eab751b971" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:11:28.619934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] HTTP exception thrown: floating IP not found Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Request method failure captured: Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action HTTP/1.1 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 41 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vig6DvJjFKwncycPYHFuczqnrLCb3it11WhuHHtQKDJSMFhHX1bytadjG9kh9K_FZTX0m26bXhBh12WtJTxTPo2GdvnQeuLqYNHzu7qWrsRw6A4zSOfgE9XJvD04ggKdArCa9R4gHZZV47ui1gm1tY9f5rgys9ONGt4wsj2rwtUP3A Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:28.623331 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}] Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5c8be0fca0854a378899cb027ce4d2a1 Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: exception: floating IP not found Jul 25 20:11:28.626552 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a584a078-6165-4f0b-a3a4-f1eab751b971', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:28.628530 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 25 20:11:28.631732 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.638716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Returning 404 to user: floating IP not found {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:28.638716 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d02d6655-de0a-4c69-8a8c-1b51f7c6f70b tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 404 len: 67 microversion: 2.1 time: 0.771236 Jul 25 20:11:28.638716 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 834/1686] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:27 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 67 bytes in 773 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:11:28.651570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:28.653666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:28.677658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec6c3631-9f37-4817-9d9a-dba5939cda90 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2087121467", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:28.682006 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ec6c3631-9f37-4817-9d9a-dba5939cda90 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] HTTP exception thrown: min_count must be <= max_count Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec6c3631-9f37-4817-9d9a-dba5939cda90 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Request method failure captured: Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 184 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vjvp6jGIFa1HktS-WV9f-WP4OupdFvIJo3Zj-UQPG65d_KRfhf8oeptWbiExyq4_TJoRks5VAkPIJ-LSitWmp2rjxge9-G1rXffGsD7TXp7Z9aEMllzLBYEXS2ohJ2j5--14qbC22Qpstp5ynGDTw_CPlLKZNCw-_OhSs7J-JXl190 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:28.687271 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}] Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6488077e11ce46b2884ae78f99c54539 Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:28.690709 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2087121467", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: exception: min_count must be <= max_count Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2087121467', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:11:28.692887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 25 20:11:28.696215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:28.697975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:28.698156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec6c3631-9f37-4817-9d9a-dba5939cda90 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Returning 400 to user: min_count must be <= max_count {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:28.700437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec6c3631-9f37-4817-9d9a-dba5939cda90 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.619441 Jul 25 20:11:28.700437 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 853/1687] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:28 2022] POST /compute/v2.1/servers => generated 74 bytes in 621 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:11:28.704773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:28.704773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:28.713217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:28.746077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9b7ba58-7807-4df7-9010-20232827ec38 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Action: 'action', calling method: .version_select at 0x7f196c695a60>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:28.849451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:29.183262 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c463300-0765-4d36-a334-8e9f7fb00a9a tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 204 len: 0 microversion: 2.25 time: 0.554748 Jul 25 20:11:29.186605 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 835/1688] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:11:28 2022] DELETE /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:11:29.200744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-77dc967f-d040-499a-9c4c-8922c054153f req-a4aedf61-888d-4110-a11d-9ee0c5529c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e", "name": "network-vif-plugged", "status": "completed", "tag": "98028763-8b86-4a94-bf28-aa8a26c180d2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:29.207829 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e9b7ba58-7807-4df7-9010-20232827ec38 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9b7ba58-7807-4df7-9010-20232827ec38 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Request method failure captured: Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action HTTP/1.1 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 44 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vig6DvJjFKwncycPYHFuczqnrLCb3it11WhuHHtQKDJSMFhHX1bytadjG9kh9K_FZTX0m26bXhBh12WtJTxTPo2GdvnQeuLqYNHzu7qWrsRw6A4zSOfgE9XJvD04ggKdArCa9R4gHZZV47ui1gm1tY9f5rgys9ONGt4wsj2rwtUP3A Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:29.209969 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}] Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5c8be0fca0854a378899cb027ce4d2a1 Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:11:29.212911 n-d-845775-3 devstack@n-api.service[119724]: exception: Floating IP not found for address 0.0.0.0. Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a584a078-6165-4f0b-a3a4-f1eab751b971', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:29.214653 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 25 20:11:29.220798 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.226782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9b7ba58-7807-4df7-9010-20232827ec38 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:29.226782 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9b7ba58-7807-4df7-9010-20232827ec38 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action" status: 404 len: 88 microversion: 2.1 time: 0.491590 Jul 25 20:11:29.226782 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 854/1689] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:28 2022] POST /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971/action => generated 88 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:11:29.227643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d90180a7-0c7a-408b-88b9-c9deff9ddf5a tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-549837364", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "max_count": 0}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d90180a7-0c7a-408b-88b9-c9deff9ddf5a tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Request method failure captured: Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 167 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vjvp6jGIFa1HktS-WV9f-WP4OupdFvIJo3Zj-UQPG65d_KRfhf8oeptWbiExyq4_TJoRks5VAkPIJ-LSitWmp2rjxge9-G1rXffGsD7TXp7Z9aEMllzLBYEXS2ohJ2j5--14qbC22Qpstp5ynGDTw_CPlLKZNCw-_OhSs7J-JXl190 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:29.243648 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}] Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6488077e11ce46b2884ae78f99c54539 Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-549837364", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "max_count": 0}} Jul 25 20:11:29.245352 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-549837364', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'max_count': 0}}} Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 0 Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.246382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:29.248231 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d90180a7-0c7a-408b-88b9-c9deff9ddf5a tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d90180a7-0c7a-408b-88b9-c9deff9ddf5a tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026279 Jul 25 20:11:29.250690 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 855/1690] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:29.264275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-77dc967f-d040-499a-9c4c-8922c054153f req-a4aedf61-888d-4110-a11d-9ee0c5529c8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:29.265308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-77dc967f-d040-499a-9c4c-8922c054153f req-a4aedf61-888d-4110-a11d-9ee0c5529c8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:29.273266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:29.274158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:29.294603 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-77dc967f-d040-499a-9c4c-8922c054153f req-a4aedf61-888d-4110-a11d-9ee0c5529c8e service nova] Creating event network-vif-plugged:98028763-8b86-4a94-bf28-aa8a26c180d2 for instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e on n-h1-845775-3 Jul 25 20:11:29.303607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:29.304094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:29.304925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:29.305400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:29.310070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-77dc967f-d040-499a-9c4c-8922c054153f req-a4aedf61-888d-4110-a11d-9ee0c5529c8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121107 Jul 25 20:11:29.311695 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 836/1691] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:29.320073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:29.321396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:29.331456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:29.332803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:29.333897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:29.334909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:29.385127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:30.036989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:30.066449 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f909e1f6-2960-47b3-96a8-9283ec1ef157 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 0.752140 Jul 25 20:11:30.068486 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 837/1692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:29 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:30.091473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a16f7e1a-1bc9-474c-8592-8f92ff17e954 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196987bee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:30.241131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a16f7e1a-1bc9-474c-8592-8f92ff17e954 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.167315 Jul 25 20:11:30.256274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 838/1693] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:30 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:30.267481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:30.269639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:30.283221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.285346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.287118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.288726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.438613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:30.454957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:30.481120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aaac179d-fe0b-407b-b153-bf3b002a2420 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 1.220258 Jul 25 20:11:30.485359 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 856/1694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:29 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:30.534117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:30.541440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:30.587862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.590452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.594084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.603435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.680104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:30.873781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59e32d61-de45-4ad6-8916-c356dcaffa14 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 204 len: 0 microversion: 2.1 time: 0.382035 Jul 25 20:11:30.879240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 857/1695] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:30 2022] DELETE /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:30.893779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f8d4e77-a54b-4dea-bf96-93d9e0224fce tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-138730959", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "max_count": 2.5}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f8d4e77-a54b-4dea-bf96-93d9e0224fce tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Request method failure captured: Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 169 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vjvp6jGIFa1HktS-WV9f-WP4OupdFvIJo3Zj-UQPG65d_KRfhf8oeptWbiExyq4_TJoRks5VAkPIJ-LSitWmp2rjxge9-G1rXffGsD7TXp7Z9aEMllzLBYEXS2ohJ2j5--14qbC22Qpstp5ynGDTw_CPlLKZNCw-_OhSs7J-JXl190 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:30.909682 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}] Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6488077e11ce46b2884ae78f99c54539 Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-138730959", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "max_count": 2.5}} Jul 25 20:11:30.912712 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-138730959', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'max_count': 2.5}}} Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:30.914249 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:30.917098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f8d4e77-a54b-4dea-bf96-93d9e0224fce tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f8d4e77-a54b-4dea-bf96-93d9e0224fce tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029359 Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 858/1696] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:30 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:30.924903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:30.926341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:30.939101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:30.957833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.961260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.964332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:30.964792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:30.966118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:30.970322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:30.978729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6e0212a-53e7-44f7-a234-a1d6ae6546cd tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1731 microversion: 2.25 time: 0.715824 Jul 25 20:11:30.993612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 839/1697] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:30 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1731 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:31.042295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2f1a60c-466d-4f0a-8466-55608c99b9ac tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2059167295", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 0}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2f1a60c-466d-4f0a-8466-55608c99b9ac tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Request method failure captured: Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 168 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vjvp6jGIFa1HktS-WV9f-WP4OupdFvIJo3Zj-UQPG65d_KRfhf8oeptWbiExyq4_TJoRks5VAkPIJ-LSitWmp2rjxge9-G1rXffGsD7TXp7Z9aEMllzLBYEXS2ohJ2j5--14qbC22Qpstp5ynGDTw_CPlLKZNCw-_OhSs7J-JXl190 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:31.059502 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}] Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6488077e11ce46b2884ae78f99c54539 Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2059167295", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 0}} Jul 25 20:11:31.062371 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2059167295', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'min_count': 0}}} Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 0 Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.064167 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:31.067325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:31.070109 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:11:31.070109 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:11:31.070109 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 25 20:11:31.070109 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.074834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2f1a60c-466d-4f0a-8466-55608c99b9ac tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:31.074834 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c2f1a60c-466d-4f0a-8466-55608c99b9ac tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.038691 Jul 25 20:11:31.074834 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 840/1698] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:31.113668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:31.114433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:31.123058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:31.123827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:31.124867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:31.125488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:31.413214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:31.427485 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8cbb2f7-dfa7-4bf2-a903-ba458a3e9249 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1538 microversion: 2.1 time: 0.513202 Jul 25 20:11:31.428167 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 859/1699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:30 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1538 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:31.456755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa6e81d2-3491-4a14-931b-c54a7727d0e0 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-722852793", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 2.5}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa6e81d2-3491-4a14-931b-c54a7727d0e0 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Request method failure captured: Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 169 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vjvp6jGIFa1HktS-WV9f-WP4OupdFvIJo3Zj-UQPG65d_KRfhf8oeptWbiExyq4_TJoRks5VAkPIJ-LSitWmp2rjxge9-G1rXffGsD7TXp7Z9aEMllzLBYEXS2ohJ2j5--14qbC22Qpstp5ynGDTw_CPlLKZNCw-_OhSs7J-JXl190 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:31.481296 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5be747ee0a74e05aaadfdf583e218ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5be747ee0a74e05aaadfdf583e218ba"}]}] Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d5be747ee0a74e05aaadfdf583e218ba Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1356696041 Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6488077e11ce46b2884ae78f99c54539 Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1356696041-project Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-722852793", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 2.5}} Jul 25 20:11:31.484423 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-722852793', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'min_count': 2.5}}} Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 2.5 Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.486679 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:31.490206 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:31.492945 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:11:31.492945 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:11:31.492945 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 25 20:11:31.492945 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:31.496862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa6e81d2-3491-4a14-931b-c54a7727d0e0 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:31.498205 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa6e81d2-3491-4a14-931b-c54a7727d0e0 tempest-MultipleCreateNegativeTestJSON-1356696041 tempest-MultipleCreateNegativeTestJSON-1356696041-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.050997 Jul 25 20:11:31.501721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 860/1700] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:31.539329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c061c81-d7a8-43ed-8b6c-67dccc0e8e24 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969278280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:31.617846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:31.651555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46a243f3-29b3-43a3-b499-6776993450d1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1316 microversion: 2.1 time: 0.547690 Jul 25 20:11:31.652176 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 841/1701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:31 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:31.671407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:31.672631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:31.691165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:31.692160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:31.693216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:31.700977 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c061c81-d7a8-43ed-8b6c-67dccc0e8e24 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.193052 Jul 25 20:11:31.702090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:31.702298 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 861/1702] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:31 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:32.016498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:32.027541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:32.057058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.064986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:32.067257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.068940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:32.201059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:32.215386 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-694ec461-5a3f-477e-9b89-37ac6e788de9 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 0.561214 Jul 25 20:11:32.216823 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 842/1703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:31 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:32.456264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:32.462210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:32.492868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.493980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:32.497726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.498438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:32.520283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:32.550718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:32.562690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:32.566944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3f4ce38-cc81-4bcf-b000-ce44efd7a28b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1731 microversion: 2.25 time: 0.560716 Jul 25 20:11:32.571985 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 862/1704] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:32 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1731 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:32.698953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:32.703012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:32.743748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.745100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:32.746753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:32.751396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:33.287933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:33.362037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-647328b4-ed31-4a7d-a30e-bb8a6623cb4e tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1465 microversion: 2.1 time: 0.668534 Jul 25 20:11:33.369980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 863/1705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:32 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1465 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:33.409203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f45a410-7984-41da-b2f4-23fd44eb78f5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196944a790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:33.415589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:33.440992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e649ce13-f2f0-49d0-aa08-c319cf5e1912 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1538 microversion: 2.1 time: 0.989647 Jul 25 20:11:33.483916 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 843/1706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:32 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1538 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:33.499843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:33.501062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:33.520226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:33.521163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:33.522713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:33.523332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:33.556958 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f45a410-7984-41da-b2f4-23fd44eb78f5 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.183945 Jul 25 20:11:33.557713 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 864/1707] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:33 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:33.565171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:33.567151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:33.591477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:33.592677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:33.597873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:33.598756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:34.293907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d72383e7-f125-4f21-a823-63895fe88e3f tempest-ServersOnMultiNodesTest-2101301785 tempest-ServersOnMultiNodesTest-2101301785-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1616 microversion: 2.1 time: 0.734684 Jul 25 20:11:34.297618 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 865/1708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:33 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1616 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:34.312132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:34.312732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:34.348582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:34.349123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:34.351006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:34.351456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:34.636819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:34.657966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4edfb1cf-ebc2-4a9f-a337-c7c1db44c6f2 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 1.171302 Jul 25 20:11:34.658591 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 844/1709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:33 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:34.677749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:34.678538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:34.701239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:34.707891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:34.710077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:34.710756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:34.839659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:35.012132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:35.047822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:35.050651 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3be950d0-ffec-494b-aaaa-3c568e9953d0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 204 len: 0 microversion: 2.1 time: 0.386896 Jul 25 20:11:35.053014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:35.055554 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 845/1710] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:34 2022] DELETE /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:35.058445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf568b0c-7e4a-42f7-8c9d-f109d2c918ac tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1731 microversion: 2.25 time: 0.754786 Jul 25 20:11:35.060974 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 866/1711] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:34 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1731 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:35.071276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:35.074254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-03b904f2-58af-401f-9495-a241d2296063 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19692d0dc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:35.076348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:35.093764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.110689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:35.112528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.123436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:35.186079 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-03b904f2-58af-401f-9495-a241d2296063 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.120995 Jul 25 20:11:35.187783 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 867/1712] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:35 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:35.203399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:35.204133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:35.227999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.229035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:35.231524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.245746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:35.904399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:35.916764 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a541f088-5604-4a60-8202-98928e1e4973 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1538 microversion: 2.1 time: 0.859195 Jul 25 20:11:35.917374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 846/1713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:35 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1538 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:35.960544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:35.967690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:35.968676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:35.980559 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c66a7ac4-7ab0-4ebc-b9b7-3c9626ec05b6 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1471 microversion: 2.1 time: 0.791164 Jul 25 20:11:35.985400 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 868/1714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:35 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1471 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:35.987309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.988131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:35.989205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:35.989839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:36.097233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:36.098882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:36.110411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:36.113966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:36.119793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:36.120825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:36.373731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:36.389946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:36.396011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:36.406487 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29c18d9d-a7e6-4fd2-8a99-e15938c8682d tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1663 microversion: 2.25 time: 0.313603 Jul 25 20:11:36.407932 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 869/1715] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:36 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1663 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:36.413804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-17c0c7eb-41c1-4abb-9d67-d6afe3ee5803 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19692808b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:36.613826 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-17c0c7eb-41c1-4abb-9d67-d6afe3ee5803 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.203872 Jul 25 20:11:36.631722 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 870/1716] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:36 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:36.759437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ec8a3a97-b44d-4764-857b-711d5bc45753 req-383d8068-b978-43bb-b3f3-d2035e9753de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584a078-6165-4f0b-a3a4-f1eab751b971", "name": "network-vif-deleted", "tag": "e8b21f3a-5c80-420a-a64e-218ca730bdcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:36.789559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ec8a3a97-b44d-4764-857b-711d5bc45753 req-383d8068-b978-43bb-b3f3-d2035e9753de service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:36.790783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ec8a3a97-b44d-4764-857b-711d5bc45753 req-383d8068-b978-43bb-b3f3-d2035e9753de service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:36.832611 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ec8a3a97-b44d-4764-857b-711d5bc45753 req-383d8068-b978-43bb-b3f3-d2035e9753de service nova] Creating event network-vif-deleted:e8b21f3a-5c80-420a-a64e-218ca730bdcf for instance a584a078-6165-4f0b-a3a4-f1eab751b971 on n-h2-845775-3 Jul 25 20:11:36.846335 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ec8a3a97-b44d-4764-857b-711d5bc45753 req-383d8068-b978-43bb-b3f3-d2035e9753de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098152 Jul 25 20:11:36.848735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 871/1717] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:11:36.903555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:36.919276 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2bfdf465-def5-4b34-a5d3-55a33eecc799 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 1.000789 Jul 25 20:11:36.920350 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 847/1718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:35 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:36.952465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:36.953979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:37.003392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.005238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.008092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.008637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.020716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:37.022651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:37.063734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.064567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.066332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.076396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.103167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.103978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.104424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lazy-loading 'fault' on Instance uuid a584a078-6165-4f0b-a3a4-f1eab751b971 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:11:37.366794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c8be0fca0854a378899cb027ce4d2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c5c53cda6540d781ce0498fdc45738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:37.391971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ebdbfd9-1f68-4d45-9b74-38fa959f51cb tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 200 len: 1322 microversion: 2.1 time: 0.448620 Jul 25 20:11:37.401730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 872/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:36 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:37.420921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-69921b15-b929-4f58-a06a-ccc694600ad4 req-544f7fc3-6289-45f6-b756-e66db41e1465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa91e534-590c-47c7-90b2-91cf13df6e38", "name": "network-vif-deleted", "tag": "c6aec7e3-268b-4497-9aed-1c4ebdd80105"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:37.467149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-69921b15-b929-4f58-a06a-ccc694600ad4 req-544f7fc3-6289-45f6-b756-e66db41e1465 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.469743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-69921b15-b929-4f58-a06a-ccc694600ad4 req-544f7fc3-6289-45f6-b756-e66db41e1465 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.506786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-69921b15-b929-4f58-a06a-ccc694600ad4 req-544f7fc3-6289-45f6-b756-e66db41e1465 service nova] Creating event network-vif-deleted:c6aec7e3-268b-4497-9aed-1c4ebdd80105 for instance fa91e534-590c-47c7-90b2-91cf13df6e38 on n-h1-845775-3 Jul 25 20:11:37.525634 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-69921b15-b929-4f58-a06a-ccc694600ad4 req-544f7fc3-6289-45f6-b756-e66db41e1465 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120885 Jul 25 20:11:37.528886 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 873/1720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:37.544078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:37.550819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:37.571719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.572340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.573362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.573909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.652182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:37.652904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:37.653770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lazy-loading 'fault' on Instance uuid fa91e534-590c-47c7-90b2-91cf13df6e38 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:11:38.323158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:38.374090 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fe9f84c-d7af-45de-982e-3f630e3ce95c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1471 microversion: 2.1 time: 1.358634 Jul 25 20:11:38.375566 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 848/1721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:37 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1471 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:38.399990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b45c5476-69a9-4944-a24a-1d91d80627d8 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196987d310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:38.489771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:38.521976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:38.526403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:38.528136 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b45c5476-69a9-4944-a24a-1d91d80627d8 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.150567 Jul 25 20:11:38.529916 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8af8c11c-94c0-4ed5-b8b8-0df78b5902e1 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 200 len: 1374 microversion: 2.25 time: 0.991356 Jul 25 20:11:38.531204 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 849/1722] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:38 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:38.538722 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 874/1723] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:37 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 1374 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:38.562470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:38.569679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:38.571521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] [instance: a584a078-6165-4f0b-a3a4-f1eab751b971] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:38.574971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:38.608886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:38.612773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:38.613044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:38.615328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:38.615917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:38.616085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:38.619383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:38.620968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:38.652089 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] HTTP exception thrown: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Request method failure captured: Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 HTTP/1.1 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vig6DvJjFKwncycPYHFuczqnrLCb3it11WhuHHtQKDJSMFhHX1bytadjG9kh9K_FZTX0m26bXhBh12WtJTxTPo2GdvnQeuLqYNHzu7qWrsRw6A4zSOfgE9XJvD04ggKdArCa9R4gHZZV47ui1gm1tY9f5rgys9ONGt4wsj2rwtUP3A Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:38.656796 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74c5c53cda6540d781ce0498fdc45738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74c5c53cda6540d781ce0498fdc45738"}]}] Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 74c5c53cda6540d781ce0498fdc45738 Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171 Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5c8be0fca0854a378899cb027ce4d2a1 Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. Jul 25 20:11:38.658440 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a584a078-6165-4f0b-a3a4-f1eab751b971'} Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:38.659482 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. Jul 25 20:11:38.661761 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:38.667451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] Returning 404 to user: Instance a584a078-6165-4f0b-a3a4-f1eab751b971 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:38.668771 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e5c2e4f8-70e6-4cdd-b0ee-ee4bd3f86b73 tempest-FloatingIPsAssociationNegativeTestJSON-770223171 tempest-FloatingIPsAssociationNegativeTestJSON-770223171-project] 10.222.0.48 "GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971" status: 404 len: 111 microversion: 2.1 time: 0.128992 Jul 25 20:11:38.674540 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 875/1724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:38 2022] GET /compute/v2.1/servers/a584a078-6165-4f0b-a3a4-f1eab751b971 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:39.199441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ca56ee8a-76cb-49e2-9b99-bf03493bbd08 req-c0d7df0d-ba4c-4ab1-91fb-6d47ec0744a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "name": "network-vif-plugged", "status": "completed", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:39.242681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca56ee8a-76cb-49e2-9b99-bf03493bbd08 req-c0d7df0d-ba4c-4ab1-91fb-6d47ec0744a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:39.253139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca56ee8a-76cb-49e2-9b99-bf03493bbd08 req-c0d7df0d-ba4c-4ab1-91fb-6d47ec0744a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:39.303325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ca56ee8a-76cb-49e2-9b99-bf03493bbd08 req-c0d7df0d-ba4c-4ab1-91fb-6d47ec0744a5 service nova] Creating event network-vif-plugged:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:11:39.327352 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ca56ee8a-76cb-49e2-9b99-bf03493bbd08 req-c0d7df0d-ba4c-4ab1-91fb-6d47ec0744a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130540 Jul 25 20:11:39.334490 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 876/1725] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:11:39.406513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:39.418743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:39.451146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:39.452157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:39.456458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:39.461280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:40.413278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:40.435641 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ce64d777-5faa-439a-b90e-b57512043fd4 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 200 len: 1471 microversion: 2.1 time: 1.038924 Jul 25 20:11:40.468152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:40.468998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 877/1726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:39 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 1471 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:40.475770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-797f4493-d46f-4ad8-afda-ed58c19b7882 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969a96670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:40.496876 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e28b280-354a-44a8-b740-4c611383a62d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 1.944865 Jul 25 20:11:40.501936 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 850/1727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:38 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:40.531157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:40.532014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: fa91e534-590c-47c7-90b2-91cf13df6e38] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:40.583661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:40.586438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:40.595656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:40.603884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:40.621550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-797f4493-d46f-4ad8-afda-ed58c19b7882 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.157770 Jul 25 20:11:40.631945 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 878/1728] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:40 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:40.649436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9a99443d-ee40-4d41-ae16-6bbc6743ed6a req-8519c182-1f49-4c91-8732-332158f4709b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e", "name": "network-vif-deleted", "tag": "98028763-8b86-4a94-bf28-aa8a26c180d2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:40.661136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:40.668537 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] HTTP exception thrown: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Request method failure captured: Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 HTTP/1.1 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vbfs4FQ829XT5bFniUkv6Cm8A7y5c2T1vOsf7zogQgRaijaH3jD2lqsg-7sYIv3e81HqLALpPsoCNHXQL5a4IN2VHGtAnIaphE2F_iTUB5r3F_PIitodWpTF2A7ualTkimKNZegUnMiO0BjmNWQdQTXbD0frGWn577anhcvVom8lGs Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:40.675267 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}] Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 98399c84012545a88dc69f2cbc91cf69 Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. Jul 25 20:11:40.678821 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'fa91e534-590c-47c7-90b2-91cf13df6e38'} Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:40.680655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. Jul 25 20:11:40.682920 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:40.691374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Returning 404 to user: Instance fa91e534-590c-47c7-90b2-91cf13df6e38 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:40.694058 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2a01d2f-df6c-4abf-8dd7-245b3f4cd4bf tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38" status: 404 len: 111 microversion: 2.25 time: 0.185761 Jul 25 20:11:40.696677 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 851/1729] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:40 2022] GET /compute/v2.1/servers/fa91e534-590c-47c7-90b2-91cf13df6e38 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:40.704600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9a99443d-ee40-4d41-ae16-6bbc6743ed6a req-8519c182-1f49-4c91-8732-332158f4709b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:40.705069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9a99443d-ee40-4d41-ae16-6bbc6743ed6a req-8519c182-1f49-4c91-8732-332158f4709b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:40.715111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97798beb-92e9-46ca-bd4b-6c9e5ac6bef0 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '.version_select at 0x7f19698c89d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:40.761011 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9a99443d-ee40-4d41-ae16-6bbc6743ed6a req-8519c182-1f49-4c91-8732-332158f4709b service nova] Creating event network-vif-deleted:98028763-8b86-4a94-bf28-aa8a26c180d2 for instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e on n-h1-845775-3 Jul 25 20:11:40.761782 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97798beb-92e9-46ca-bd4b-6c9e5ac6bef0 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178710913" status: 204 len: 0 microversion: 2.25 time: 0.057400 Jul 25 20:11:40.769721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 852/1730] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Jul 25 20:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178710913 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:11:40.789147 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9a99443d-ee40-4d41-ae16-6bbc6743ed6a req-8519c182-1f49-4c91-8732-332158f4709b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147669 Jul 25 20:11:40.790545 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 879/1731] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:41.492530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:41.493797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:41.531571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.532512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:41.536997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.540326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:41.542854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:41.546098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:41.574576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.577434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:41.580831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.582272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:41.637469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e HTTP/1.1 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:41.654308 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. Jul 25 20:11:41.657293 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e'} Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:41.659087 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. Jul 25 20:11:41.663409 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:41.669056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:41.678198 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9bd783dd-c0b9-4b46-8f12-93ecbab580e1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e" status: 404 len: 111 microversion: 2.1 time: 0.197912 Jul 25 20:11:41.680982 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 853/1732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:41 2022] GET /compute/v2.1/servers/a2ae2fdc-8c9c-42d9-91c5-bb5a527fe10e => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:41.718137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2021e59b-bc85-4804-92d1-f124514631d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196987d310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:41.900529 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2021e59b-bc85-4804-92d1-f124514631d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1439 microversion: 2.1 time: 0.213533 Jul 25 20:11:41.903177 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 854/1733] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:41 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1439 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:41.918554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:41.921839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:41.949968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.950818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:41.952237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:41.953102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:42.033848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:42.306020 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45182a50-837b-4077-89fa-82866d23fe70 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 204 len: 0 microversion: 2.1 time: 0.397830 Jul 25 20:11:42.309013 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 855/1734] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:41 2022] DELETE /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:42.320845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:42.321852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:42.329702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:42.331149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:42.332255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:42.333043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:42.484994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:42.502028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ae382c8-7a51-448c-bdef-fa0f3c0cf010 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1198 microversion: 2.1 time: 0.967455 Jul 25 20:11:42.517575 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 880/1735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:41 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1198 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:42.926464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-978ad7c7-0bf7-4d3a-a26b-44a18474bf64 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969bc7280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:43.029408 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-978ad7c7-0bf7-4d3a-a26b-44a18474bf64 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1448 microversion: 2.1 time: 0.110209 Jul 25 20:11:43.031629 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 881/1736] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:42 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1448 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:43.054619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c75ed92c-5a78-4ceb-95fb-30d3f0d05239 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969a96670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:43.155728 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c75ed92c-5a78-4ceb-95fb-30d3f0d05239 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 200 len: 1448 microversion: 2.1 time: 0.105668 Jul 25 20:11:43.155728 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 882/1737] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:11:43 2022] GET /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 1448 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:43.183324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c513dfe9-5a73-47b6-a428-c017354f3b4d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196ebaa1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:43.207300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:43.231167 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-abde352b-e91f-4e19-973e-259f5b7e989a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1473 microversion: 2.1 time: 0.915994 Jul 25 20:11:43.243897 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 856/1738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:42 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1473 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:43.539005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:43.541334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:43.583285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:43.584661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:43.591586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:43.594303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:43.623640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:44.475388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:44.489166 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-017365ea-d8a2-4c68-becf-8a6f9dbce3d5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1381 microversion: 2.1 time: 0.954639 Jul 25 20:11:44.492721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 857/1739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:43 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1381 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:11:44.501924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:44.502569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:44.524200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:44.524991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:44.526294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:44.526800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:44.883939 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c513dfe9-5a73-47b6-a428-c017354f3b4d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 204 len: 0 microversion: 2.1 time: 1.706634 Jul 25 20:11:44.884867 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 883/1740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:43 2022] DELETE /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 0 bytes in 1709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:11:44.899213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:44.901664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:44.987020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:44.987809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:44.989256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:44.990051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:45.089374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:45.772338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:45.797973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5aeb69bc-abee-4a14-be48-931053b17376 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1473 microversion: 2.1 time: 1.303696 Jul 25 20:11:45.824306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 858/1741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:44 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1473 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:45.836339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:45.837844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:45.869781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:45.872441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:45.884439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:45.885044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:45.984929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:46.293605 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d34bed8d-b224-4ec7-b0ae-e2b94f219aec tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 204 len: 0 microversion: 2.1 time: 0.465056 Jul 25 20:11:46.296676 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 859/1742] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:45 2022] DELETE /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:46.308873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:46.311878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:46.352165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:46.352867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:46.353843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:46.354424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:46.445251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:46.649521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3be1fd7b-4681-4591-b000-17459eeb5f43 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 204 len: 0 microversion: 2.25 time: 0.346255 Jul 25 20:11:46.651400 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 860/1743] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:11:46 2022] DELETE /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:11:46.667152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:46.672446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:46.698956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:46.703823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:46.709597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:46.712726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:47.386988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:47.401981 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66cfe87e-9773-475b-9d56-3353ee97648c tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1532 microversion: 2.1 time: 2.508083 Jul 25 20:11:47.403018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:47.404585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:47.407416 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dd9e19a-f03b-416f-ad87-a8e8231fb02f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1549 microversion: 2.25 time: 0.750174 Jul 25 20:11:47.407630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 884/1744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:44 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1532 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:47.409793 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 861/1745] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:46 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1549 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:11:47.421467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-53960676-bd29-45ce-bf36-9402792c93a8 req-9e6760e2-46ff-4aa0-98b6-007a46219230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f865fb-665a-4252-9093-d8116d13512f", "name": "network-vif-unplugged", "status": "completed", "tag": "18c133a8-0de0-445a-b71c-1e04cb703a24"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:47.431193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-412199828", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "fc86a3b0-dce7-409f-8e0e-bcf88032c34a"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:47.439497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-53960676-bd29-45ce-bf36-9402792c93a8 req-9e6760e2-46ff-4aa0-98b6-007a46219230 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:47.444894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-53960676-bd29-45ce-bf36-9402792c93a8 req-9e6760e2-46ff-4aa0-98b6-007a46219230 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:47.470974 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-53960676-bd29-45ce-bf36-9402792c93a8 req-9e6760e2-46ff-4aa0-98b6-007a46219230 service nova] Creating event network-vif-unplugged:18c133a8-0de0-445a-b71c-1e04cb703a24 for instance 16f865fb-665a-4252-9093-d8116d13512f on n-h1-845775-3 Jul 25 20:11:47.476617 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-53960676-bd29-45ce-bf36-9402792c93a8 req-9e6760e2-46ff-4aa0-98b6-007a46219230 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065330 Jul 25 20:11:47.478063 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 862/1746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:47.483955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:47.485000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:47.492117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:47.492854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:47.493790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:47.494443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:48.566116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] validate_networks() for [('fc86a3b0-dce7-409f-8e0e-bcf88032c34a', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:11:48.607986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:48.628381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d32d10d6-1aeb-451b-a296-933cf9a61f45 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 200 len: 1473 microversion: 2.1 time: 1.148155 Jul 25 20:11:48.629958 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 863/1747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:47 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 1473 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:48.639609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:48.641149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:48.654017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:48.655071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:48.657218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:48.658676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:50.705363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99ec9b5c-4351-4e1b-85dd-c8ec9291dc93 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1532 microversion: 2.1 time: 2.072785 Jul 25 20:11:50.711036 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 864/1748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:48 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1532 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:50.732809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:50.736325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:50.754539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:50.761030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:50.762010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:50.763004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:50.763663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.092675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:11:52.093435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:11:52.094136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:11:52.094559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:11:52.095105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:11:52.120140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.120975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.122015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.122635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.195254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:11:52.210441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Getting quotas for user a5e02ce4bb4645e2a92ba0a5eed8ba0d and project aa09b4e706904790a2a127f3d15e11ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:11:52.274824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:11:52.278973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:11:52.423995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:52.447303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:52.456544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:52.462670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7fa3ed7-3dfd-48b9-8fe4-bb721db1fc4b tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 200 len: 1549 microversion: 2.25 time: 1.745921 Jul 25 20:11:52.465397 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 865/1749] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:50 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 1549 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:52.488974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:52.490523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d27e4f7b-113a-43d4-bab6-b381c2adc288] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:52.499983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64d6c535-054e-420b-af13-234b0830f398 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.090761 Jul 25 20:11:52.500682 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 885/1750] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 5092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:11:52.514870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-fca3bcac-a494-45bf-8f88-57098654f9e2 req-13edb048-9286-4ca2-b6eb-361ee4aae74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27e4f7b-113a-43d4-bab6-b381c2adc288", "name": "network-vif-deleted", "tag": "1df20579-5153-49f6-a5cf-0ab7bf0b070a"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:52.523121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.525169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.530706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.531897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.549657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fca3bcac-a494-45bf-8f88-57098654f9e2 req-13edb048-9286-4ca2-b6eb-361ee4aae74a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.550111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fca3bcac-a494-45bf-8f88-57098654f9e2 req-13edb048-9286-4ca2-b6eb-361ee4aae74a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.614730 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. Jul 25 20:11:52.617856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-fca3bcac-a494-45bf-8f88-57098654f9e2 req-13edb048-9286-4ca2-b6eb-361ee4aae74a service nova] Creating event network-vif-deleted:1df20579-5153-49f6-a5cf-0ab7bf0b070a for instance d27e4f7b-113a-43d4-bab6-b381c2adc288 on n-h2-845775-3 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 HTTP/1.1 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:11:52.621783 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. Jul 25 20:11:52.623907 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd27e4f7b-113a-43d4-bab6-b381c2adc288'} Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:52.625114 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. Jul 25 20:11:52.626838 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:11:52.628566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-fca3bcac-a494-45bf-8f88-57098654f9e2 req-13edb048-9286-4ca2-b6eb-361ee4aae74a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125592 Jul 25 20:11:52.629254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance d27e4f7b-113a-43d4-bab6-b381c2adc288 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:52.632278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81b846d4-b9fb-4a9e-b425-c99579401bb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288" status: 404 len: 111 microversion: 2.1 time: 0.165510 Jul 25 20:11:52.642018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 866/1751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:52 2022] GET /compute/v2.1/servers/d27e4f7b-113a-43d4-bab6-b381c2adc288 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:11:52.646919 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 886/1752] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:52.650803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:52.666029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf89e00-f30f-4499-810a-a732dcff6a19", "name": "network-vif-deleted", "tag": "67179d26-9761-4b7f-b070-c15e611e24ef"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:52.669860 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:11:52.669860 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:11:52.673351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.674829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.678594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.679326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.714729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.715289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.737337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] Creating event network-vif-deleted:67179d26-9761-4b7f-b070-c15e611e24ef for instance 6bf89e00-f30f-4499-810a-a732dcff6a19 on n-h1-845775-3 Jul 25 20:11:52.757664 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109895 Jul 25 20:11:52.765155 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 887/1753] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:52.767145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:52.768261 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d00e0515-4abb-4010-bcc2-4daeb12c326d req-f26fc378-0bf4-4aaf-a323-ca345a8724f1 service nova] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001922 Jul 25 20:11:52.768630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 888/1754] 10.222.0.48 () {56 vars in 886 bytes} [Mon Jul 25 20:11:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 20:11:52.798272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-565d61dd-8f9c-4380-9bc1-a2bb965a8c40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:52.799027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-565d61dd-8f9c-4380-9bc1-a2bb965a8c40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:52.818943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfa05242-4178-43b7-b063-c2b0fb2be24b tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.174224 Jul 25 20:11:52.820839 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 867/1755] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:11:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:52.844952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:52.846308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:52.861043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.867971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.869816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:52.870824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:52.951496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:53.178187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03730db5-9316-484a-b236-7dd0f7905833 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 204 len: 0 microversion: 2.1 time: 0.351989 Jul 25 20:11:53.188859 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 868/1756] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:11:52 2022] DELETE /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:11:53.207207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845775-3", "block_migration": false, "disk_over_commit": false}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:53.210007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:53.271766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:53.272360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:53.273617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:53.274226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:53.396583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lazy-loading 'flavor' on Instance uuid 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:11:53.451615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Going to try to live migrate instance to n-h1-845775-3 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:11:53.504327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-565d61dd-8f9c-4380-9bc1-a2bb965a8c40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:53.525587 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-565d61dd-8f9c-4380-9bc1-a2bb965a8c40 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1207 microversion: 2.1 time: 0.737972 Jul 25 20:11:53.529745 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 889/1757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:52 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1207 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:53.561901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:53.565082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:11:53.568080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:53.603938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:53.612068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:53.629777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:53.637706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.451490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:54.472409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-532f47e5-a075-4a22-8e39-a74a2783f526 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1471 microversion: 2.1 time: 0.940118 Jul 25 20:11:54.480872 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 890/1758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:53 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1471 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:54.504792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:54.507888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: 6bf89e00-f30f-4499-810a-a732dcff6a19] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:54.529891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.530352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.532817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.533897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.605690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] HTTP exception thrown: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Request method failure captured: Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 HTTP/1.1 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbfs4FQ829XT5bFniUkv6Cm8A7y5c2T1vOsf7zogQgRaijaH3jD2lqsg-7sYIv3e81HqLALpPsoCNHXQL5a4IN2VHGtAnIaphE2F_iTUB5r3F_PIitodWpTF2A7ualTkimKNZegUnMiO0BjmNWQdQTXbD0frGWn577anhcvVom8lGs Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:11:54.607796 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}] Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 98399c84012545a88dc69f2cbc91cf69 Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. Jul 25 20:11:54.610071 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6bf89e00-f30f-4499-810a-a732dcff6a19'} Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:11:54.611276 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. Jul 25 20:11:54.612910 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:11:54.614281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Returning 404 to user: Instance 6bf89e00-f30f-4499-810a-a732dcff6a19 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:11:54.614281 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f1af0d82-431c-4637-94f4-7988a3e81150 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19" status: 404 len: 111 microversion: 2.25 time: 0.127500 Jul 25 20:11:54.626711 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 891/1759] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:54 2022] GET /compute/v2.1/servers/6bf89e00-f30f-4499-810a-a732dcff6a19 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:11:54.639642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:54.641288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:54.658853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.663830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.670082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.672265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.895461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:54.921198 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b850f286-1719-483f-957e-4d4bfafccd8e tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1203 microversion: 2.1 time: 0.292495 Jul 25 20:11:54.921834 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 892/1760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:54 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1203 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:54.938358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:54.938358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:54.948661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.949187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:54.950107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:54.950596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:55.036621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:11:55.333577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f53e523-76c4-4550-aaf9-c80ed61a0e96 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 204 len: 0 microversion: 2.25 time: 0.409902 Jul 25 20:11:55.335018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 893/1761] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:11:54 2022] DELETE /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:11:55.345839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-970f0d8a-14f6-4621-bec1-d0c6a20731eb req-6f7f350a-be11-4e67-81d4-f6835f314be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f865fb-665a-4252-9093-d8116d13512f", "name": "network-vif-deleted", "tag": "18c133a8-0de0-445a-b71c-1e04cb703a24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:55.388052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-970f0d8a-14f6-4621-bec1-d0c6a20731eb req-6f7f350a-be11-4e67-81d4-f6835f314be0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:55.389649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-970f0d8a-14f6-4621-bec1-d0c6a20731eb req-6f7f350a-be11-4e67-81d4-f6835f314be0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:55.449488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-970f0d8a-14f6-4621-bec1-d0c6a20731eb req-6f7f350a-be11-4e67-81d4-f6835f314be0 service nova] Creating event network-vif-deleted:18c133a8-0de0-445a-b71c-1e04cb703a24 for instance 16f865fb-665a-4252-9093-d8116d13512f on n-h1-845775-3 Jul 25 20:11:55.476082 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-970f0d8a-14f6-4621-bec1-d0c6a20731eb req-6f7f350a-be11-4e67-81d4-f6835f314be0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139180 Jul 25 20:11:55.484387 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 894/1762] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:11:55.512197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:55.515530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:55.564019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:55.566944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:55.577041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:55.579657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:56.922464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:56.952581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:56.960168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98399c84012545a88dc69f2cbc91cf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e677726d0148b997afda26e08f4a3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:56.961907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ead23fff-77ab-43c3-b9f7-6e0e02a28f51 tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 200 len: 1565 microversion: 2.25 time: 1.475559 Jul 25 20:11:56.962778 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 895/1763] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:11:55 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 1565 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:11:57.006208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:57.006862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:57.072473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:57.073297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:57.074792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:57.075519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:57.700086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52406a8e-ff8b-484f-baa4-d4918e843694 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801/action" status: 202 len: 0 microversion: 2.1 time: 4.509753 Jul 25 20:11:57.700911 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 869/1764] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:11:53 2022] POST /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801/action => generated 0 bytes in 4511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:11:57.739585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1992735655", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6ed9192e-12a5-45d7-bfa9-37a1b8df80cd"}, {"uuid": "c04331c2-055b-4d2b-9777-62740b93017f"}, {"uuid": "6ed9192e-12a5-45d7-bfa9-37a1b8df80cd"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:11:57.927122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] validate_networks() for [('6ed9192e-12a5-45d7-bfa9-37a1b8df80cd', None, None, None, None, None), ('c04331c2-055b-4d2b-9777-62740b93017f', None, None, None, None, None), ('6ed9192e-12a5-45d7-bfa9-37a1b8df80cd', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:11:59.334324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:59.346509 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10830e33-294a-4759-9cb7-7ba02098d546 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1471 microversion: 2.1 time: 2.367558 Jul 25 20:11:59.347950 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 896/1765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:56 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1471 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:59.369596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:59.370466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:11:59.394318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:59.394886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:59.395997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:11:59.396449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:11:59.931973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:11:59.949961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66a22c47-5cd5-4d80-b3ce-65a663f18932 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1265 microversion: 2.1 time: 0.600481 Jul 25 20:11:59.957559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 897/1766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:59 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1265 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:11:59.985086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:11:59.985943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:00.002631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:00.007104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:00.008853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:00.011264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:00.965007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:00.985793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12d29419-6a32-4a63-a7b5-cd52d690175c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.025487 Jul 25 20:12:00.993137 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 898/1767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:11:59 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:01.013966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:01.017401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] [instance: d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:01.046071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:01.046828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:01.047902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:01.048567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:01.090576 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] HTTP exception thrown: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Request method failure captured: Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb HTTP/1.1 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vbfs4FQ829XT5bFniUkv6Cm8A7y5c2T1vOsf7zogQgRaijaH3jD2lqsg-7sYIv3e81HqLALpPsoCNHXQL5a4IN2VHGtAnIaphE2F_iTUB5r3F_PIitodWpTF2A7ualTkimKNZegUnMiO0BjmNWQdQTXbD0frGWn577anhcvVom8lGs Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.25 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:01.100583 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6e677726d0148b997afda26e08f4a3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6e677726d0148b997afda26e08f4a3d"}]}] Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a6e677726d0148b997afda26e08f4a3d Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-732376418 Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 98399c84012545a88dc69f2cbc91cf69 Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-732376418-project Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. Jul 25 20:12:01.102627 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb'} Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:01.103693 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. Jul 25 20:12:01.106365 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:01.108849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] Returning 404 to user: Instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:01.108849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de22070a-cb79-4ace-b462-e1055735182f tempest-LiveAutoBlockMigrationV225Test-732376418 tempest-LiveAutoBlockMigrationV225Test-732376418-project] 10.222.0.48 "GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb" status: 404 len: 111 microversion: 2.25 time: 0.110929 Jul 25 20:12:01.110532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 899/1768] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:12:00 2022] GET /compute/v2.1/servers/d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:12:01.129038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-187da363-4fd0-469c-b640-2aac7dbfa1c6 req-ea8c8870-87ee-48d6-aeb7-e3dc8661fa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb", "name": "network-vif-deleted", "tag": "a4b02e3e-188f-496a-a499-d133132d9b05"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:01.206939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-187da363-4fd0-469c-b640-2aac7dbfa1c6 req-ea8c8870-87ee-48d6-aeb7-e3dc8661fa1f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:01.211216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-187da363-4fd0-469c-b640-2aac7dbfa1c6 req-ea8c8870-87ee-48d6-aeb7-e3dc8661fa1f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:01.293106 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-187da363-4fd0-469c-b640-2aac7dbfa1c6 req-ea8c8870-87ee-48d6-aeb7-e3dc8661fa1f service nova] Creating event network-vif-deleted:a4b02e3e-188f-496a-a499-d133132d9b05 for instance d95dbc28-28e9-4f9f-b9ce-8ed8c4b955fb on n-h1-845775-3 Jul 25 20:12:01.322725 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-187da363-4fd0-469c-b640-2aac7dbfa1c6 req-ea8c8870-87ee-48d6-aeb7-e3dc8661fa1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208858 Jul 25 20:12:01.324972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 900/1769] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:01.347510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:01.349367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:01.366579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:01.367584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:01.369971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:01.372930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:02.020774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:02.054348 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43ff9a0d-6fbf-4c77-b26c-96bac5e22bf0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 200 len: 1300 microversion: 2.1 time: 0.726620 Jul 25 20:12:02.077064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 901/1770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:01 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 1300 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:02.150151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:02.697559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-95ff0021-8f3a-43a1-bba7-a94615bcf68e tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Action: 'create', calling method: .version_select at 0x7f1969280820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-826530030"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:02.704186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:03.509618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:03.709424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:03.780200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-95ff0021-8f3a-43a1-bba7-a94615bcf68e tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.717292 Jul 25 20:12:03.781483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 902/1771] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Jul 25 20:12:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 20:12:03.788142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:03.789808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:03.798680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:03.799456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:03.800493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:03.801402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:05.876282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:05.890704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dbe6a1f1-ff23-4809-8243-de689b5643a7 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 2.107301 Jul 25 20:12:05.891469 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 903/1772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:03 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:05.912531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5dda90eb-8ccf-4c3e-a0ed-118fe499415f req-3f2cd279-5f1b-49ad-b461-cfd83d8dd217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8daa55b-0aaf-4f3d-b83e-9a455707ecee", "name": "network-vif-deleted", "tag": "5f932179-17d5-4826-9ed2-9c928956f752"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:05.924245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5dda90eb-8ccf-4c3e-a0ed-118fe499415f req-3f2cd279-5f1b-49ad-b461-cfd83d8dd217 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:05.925595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5dda90eb-8ccf-4c3e-a0ed-118fe499415f req-3f2cd279-5f1b-49ad-b461-cfd83d8dd217 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:05.949707 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5dda90eb-8ccf-4c3e-a0ed-118fe499415f req-3f2cd279-5f1b-49ad-b461-cfd83d8dd217 service nova] Creating event network-vif-deleted:5f932179-17d5-4826-9ed2-9c928956f752 for instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee on n-h2-845775-3 Jul 25 20:12:05.967251 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5dda90eb-8ccf-4c3e-a0ed-118fe499415f req-3f2cd279-5f1b-49ad-b461-cfd83d8dd217 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059208 Jul 25 20:12:05.969444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 904/1773] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:05.985195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:05.986569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:06.000220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.001621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.003188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.004524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.065758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:06.066371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:06.067041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:06.067612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:06.068415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:06.087754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.088636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.089806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.090490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.136201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Getting quotas for project cb643c0372d04a3495e515c2a76a3697. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:06.151036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Getting quotas for user 23377768dc934265bf4eb9550084d731 and project cb643c0372d04a3495e515c2a76a3697. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:06.191191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:06.194918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:06.273979 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c9d012c8-9065-42cd-859c-30695ff71671 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.572157 Jul 25 20:12:06.275463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 870/1774] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 8574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:12:06.280789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:06.282265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: b8daa55b-0aaf-4f3d-b83e-9a455707ecee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:06.290434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.291356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.292774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.293533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.312013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee HTTP/1.1 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:06.314388 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. Jul 25 20:12:06.316373 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b8daa55b-0aaf-4f3d-b83e-9a455707ecee'} Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:06.318296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. Jul 25 20:12:06.319816 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:06.323096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance b8daa55b-0aaf-4f3d-b83e-9a455707ecee could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:06.324430 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c348df9e-696b-40e1-8445-7b6e603dc733 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee" status: 404 len: 111 microversion: 2.1 time: 0.047609 Jul 25 20:12:06.328825 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 871/1775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:06 2022] GET /compute/v2.1/servers/b8daa55b-0aaf-4f3d-b83e-9a455707ecee => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:06.350328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c30fdc2e-ba67-42ff-b81a-2a3362792f55 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196a11c820>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:06.479318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c30fdc2e-ba67-42ff-b81a-2a3362792f55 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 200 len: 345 microversion: 2.1 time: 0.148701 Jul 25 20:12:06.480612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 872/1776] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:06 2022] GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:06.486397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-681c813a-80df-495e-be1b-5a3df23b881b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:06.487602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-681c813a-80df-495e-be1b-5a3df23b881b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:06.719876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-681c813a-80df-495e-be1b-5a3df23b881b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:06.750556 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-681c813a-80df-495e-be1b-5a3df23b881b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1213 microversion: 2.1 time: 0.268549 Jul 25 20:12:06.758621 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 873/1777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:06 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1213 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:06.764506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:06.768849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:06.792487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.792962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.793797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:06.794253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:06.880373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:06.882737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:06.897908 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e4f98d9-efb9-4ba1-83e2-e2e2562fea28 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.925435 Jul 25 20:12:06.925333 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 905/1778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:05 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:06.957103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37449616-3309-449a-a69e-c60fecfafadd tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Action: 'create', calling method: .version_select at 0x7f1969888ca0>, body: {"snapshot": {"volume_id": "cd822ff0-fcc5-457e-9501-67af8b37f903", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-217377993"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:07.170775 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf8dd075-df9c-4c14-a232-99c8bc8fbeb3 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 204 len: 0 microversion: 2.1 time: 0.407558 Jul 25 20:12:07.175351 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 874/1779] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:06 2022] DELETE /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:07.205309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:07.211978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:07.263361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:07.264512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:07.270061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:07.272847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:07.617157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37449616-3309-449a-a69e-c60fecfafadd tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.689889 Jul 25 20:12:07.618033 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 906/1780] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Jul 25 20:12:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:07.875496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-231618e8-8d45-45da-9750-9e47be2edc11 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: .version_select at 0x7f19692d09d0>, body: {"keypair": {"name": "tempest-keypair-1812693343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCBTuvh7FqtXPM82ys2wYFQFyW/5zreACM2OVBdynwsZjXama8AHkWEn2Fs69gNa+8pT7q59zS+zu5zwiGPqBJYcczTS4KHvJv+h5XbI3/PRD2cxWmAgU6rip/wkWJv+g=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:07.930652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:07.948774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61bf564c-e50c-47e4-b454-b9f4b359bc7d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 0.762617 Jul 25 20:12:07.950639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-231618e8-8d45-45da-9750-9e47be2edc11 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:07.956950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 875/1781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:07 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:07.984876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-231618e8-8d45-45da-9750-9e47be2edc11 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:07.988906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:07.990131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:08.023352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.028506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.033220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.035571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.084220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-231618e8-8d45-45da-9750-9e47be2edc11 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.464727 Jul 25 20:12:08.096405 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 907/1782] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:12:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:08.109585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aacb6d51-d20b-4d73-8da2-675bb737e8d0 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196ebba670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:08.154255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:08.197106 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aacb6d51-d20b-4d73-8da2-675bb737e8d0 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 286 microversion: 2.1 time: 0.099122 Jul 25 20:12:08.198032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 908/1783] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:08 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:08.203667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:08.207343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:08.225394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.226266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.231837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.232786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.371154 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1bf85541-6b98-47d7-82e3-071f78764237 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 204 len: 0 microversion: 2.1 time: 0.411719 Jul 25 20:12:08.373898 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 876/1784] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:07 2022] DELETE /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:08.382107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:08.383675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:08.407831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.408835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.412700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.414429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.527919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:08.556138 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a8ff733-8c03-40a7-a815-d2cf1dc28fe6 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1265 microversion: 2.1 time: 0.354593 Jul 25 20:12:08.574957 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 909/1785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:08 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:08.601374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc9e21d3-ae05-4900-8b2b-8f2beb27b40b tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196ebba940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:08.735803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc9e21d3-ae05-4900-8b2b-8f2beb27b40b tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.155063 Jul 25 20:12:08.738163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 910/1786] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Jul 25 20:12:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:08.748358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:08.751139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:08.800548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.802759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:08.804319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:08.808468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:09.455264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:09.470099 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-883a7b72-30a5-47d9-adcb-b3299cf69bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.092987 Jul 25 20:12:09.470650 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 877/1787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:08 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:09.484863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45635be4-bdb1-4752-a160-892b07298dff tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f19698c8940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:09.571684 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45635be4-bdb1-4752-a160-892b07298dff tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 286 microversion: 2.1 time: 0.094882 Jul 25 20:12:09.576768 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 878/1788] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:09 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:09.587556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:09.588811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:09.599968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:09.600931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:09.602700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:09.603524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:11.440744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:11.446542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:11.474047 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf4ae5b3-f5bc-44e9-858e-426c0ff66027 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1474 microversion: 2.1 time: 2.732746 Jul 25 20:12:11.480613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 911/1789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:08 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1474 bytes in 2741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:11.585060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:11.621313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfb5707f-b42f-4d49-832e-f8449218f455 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 2.042641 Jul 25 20:12:11.623129 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 879/1790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:09 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:11.635194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:11.636236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:11.658931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:11.659817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:11.662108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:11.664888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:11.807578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b6eff1d6-6085-4fa7-9458-07114cb16b2b req-d4eb7040-39e9-4abe-bfeb-870188551aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f75746-4d9e-4061-ab74-dd574cd14158", "tag": "4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:11.813958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:11.881471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b6eff1d6-6085-4fa7-9458-07114cb16b2b req-d4eb7040-39e9-4abe-bfeb-870188551aef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:11.898223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b6eff1d6-6085-4fa7-9458-07114cb16b2b req-d4eb7040-39e9-4abe-bfeb-870188551aef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:11.973202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b6eff1d6-6085-4fa7-9458-07114cb16b2b req-d4eb7040-39e9-4abe-bfeb-870188551aef service nova] Creating event network-changed:4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4 for instance 53f75746-4d9e-4061-ab74-dd574cd14158 on n-h1-845775-3 Jul 25 20:12:11.992985 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b6eff1d6-6085-4fa7-9458-07114cb16b2b req-d4eb7040-39e9-4abe-bfeb-870188551aef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.509892 Jul 25 20:12:11.997963 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 912/1791] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:12.018187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:12.019447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:12.038139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:12.038890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:12.040276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:12.040554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:12.069040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:12.100473 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3263c169-9ac9-4041-9399-7b31daf0de2a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1271 microversion: 2.1 time: 0.475638 Jul 25 20:12:12.102425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 880/1792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:11 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1271 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:12.132328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-147ca6ac-1c46-4c5f-9660-b719a6b45253 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f19698c8160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:12.226314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-147ca6ac-1c46-4c5f-9660-b719a6b45253 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 286 microversion: 2.1 time: 0.122025 Jul 25 20:12:12.227698 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 881/1793] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:12 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:12.525471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:12.526370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:12.545751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:12.546582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:12.548823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:12.552433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:13.193476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:13.230714 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1855bd95-d138-4770-a81b-41df590b0d90 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.230342 Jul 25 20:12:13.233051 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 913/1794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:11 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:13.301119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:13.315387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25a2b353-d7e4-4aba-baab-8fd221ec840c tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1474 microversion: 2.1 time: 0.794543 Jul 25 20:12:13.320378 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 882/1795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:12 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1474 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:13.371086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:13.374695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:13.432614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:13.437530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:13.441921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:13.443244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:13.602473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:13.603312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:13.619062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:13.619535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:13.620695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:13.621203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:14.256711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:14.276221 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e169aa8-2056-4123-a2e6-c653824a228c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1271 microversion: 2.1 time: 0.952442 Jul 25 20:12:14.288550 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 883/1796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:13 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1271 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:14.304794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21906951-f479-469a-b743-36e85f29cf5c tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f19698adf70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:14.373111 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21906951-f479-469a-b743-36e85f29cf5c tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 287 microversion: 2.1 time: 0.082540 Jul 25 20:12:14.380748 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 884/1797] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:14 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:14.388133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-87bad41f-410e-44b0-b15a-7eefd956a944 req-cdbc03b7-ea13-4599-8823-e47a394ae9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b27a3f7-0303-403e-aa62-ab70ddd0dc77", "name": "network-vif-deleted", "tag": "25326a4e-6115-4e9e-9806-aa6ad5513dfa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:14.414383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-87bad41f-410e-44b0-b15a-7eefd956a944 req-cdbc03b7-ea13-4599-8823-e47a394ae9dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:14.415916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-87bad41f-410e-44b0-b15a-7eefd956a944 req-cdbc03b7-ea13-4599-8823-e47a394ae9dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:14.432016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-87bad41f-410e-44b0-b15a-7eefd956a944 req-cdbc03b7-ea13-4599-8823-e47a394ae9dd service nova] Creating event network-vif-deleted:25326a4e-6115-4e9e-9806-aa6ad5513dfa for instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 on n-h1-845775-3 Jul 25 20:12:14.440561 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-87bad41f-410e-44b0-b15a-7eefd956a944 req-cdbc03b7-ea13-4599-8823-e47a394ae9dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057906 Jul 25 20:12:14.442174 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 885/1798] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:14.449961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:14.451532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:14.462595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:14.463889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:14.465037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:14.465754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.090430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:15.107893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad0aaf74-1d48-4638-90b9-f13f2acd6e2d tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 1.873117 Jul 25 20:12:15.131928 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 914/1799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:13 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:15.158621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:15.159814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:15.185812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.188323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.193245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.194656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.299791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.305885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.308953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lazy-loading 'fault' on Instance uuid bdc7b0c6-f25a-439d-981e-778d3e193654 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:12:15.401475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:15.416093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:15.429491 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87f037c9-7a73-47a9-88c7-f42cc63399b7 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.984780 Jul 25 20:12:15.440757 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 886/1800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:14 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:15.446674 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3499b411-6299-4b12-bb6c-46a731d91899 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 200 len: 1309 microversion: 2.1 time: 0.308937 Jul 25 20:12:15.460793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b34c7e72-0d81-48fa-b69c-c56b94bd5a8d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f1969ad1f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:15.470667 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 915/1801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:15 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:15.476748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e552de97-e3e2-45ce-be6b-31e83e1167cc req-2818b40c-2e2c-4c0d-b4d4-8d379f8b63ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc7b0c6-f25a-439d-981e-778d3e193654", "name": "network-vif-deleted", "tag": "b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:15.515328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e552de97-e3e2-45ce-be6b-31e83e1167cc req-2818b40c-2e2c-4c0d-b4d4-8d379f8b63ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.547761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e552de97-e3e2-45ce-be6b-31e83e1167cc req-2818b40c-2e2c-4c0d-b4d4-8d379f8b63ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.610638 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e552de97-e3e2-45ce-be6b-31e83e1167cc req-2818b40c-2e2c-4c0d-b4d4-8d379f8b63ba service nova] Creating event network-vif-deleted:b9ae77c1-133c-4dad-91cf-d1a1bcd88cc7 for instance bdc7b0c6-f25a-439d-981e-778d3e193654 on n-h2-845775-3 Jul 25 20:12:15.630942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e552de97-e3e2-45ce-be6b-31e83e1167cc req-2818b40c-2e2c-4c0d-b4d4-8d379f8b63ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156374 Jul 25 20:12:15.634427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 916/1802] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:15.671973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b34c7e72-0d81-48fa-b69c-c56b94bd5a8d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 202 len: 0 microversion: 2.1 time: 0.229219 Jul 25 20:12:15.672967 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 887/1803] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Jul 25 20:12:15 2022] DELETE /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:12:15.677910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:15.679389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:15.701553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9110d0e-8e81-44bd-8fdf-bf3c30c8b113 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f19698e1670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:15.701888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.702995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.705856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:15.708660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:15.928917 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9110d0e-8e81-44bd-8fdf-bf3c30c8b113 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 286 microversion: 2.1 time: 0.249471 Jul 25 20:12:15.930096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 888/1804] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:15 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:12:15.976753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:16.026157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0132d1f7-2a37-4bad-859e-bbbe89d25c6b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1271 microversion: 2.1 time: 0.372407 Jul 25 20:12:16.032354 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 917/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:15 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1271 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:16.136164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:16.154977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:16.160414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:16.197473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.198705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.200427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.201821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.471482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:16.473067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:16.501694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.502800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.504238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.509680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.750261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:16.868975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:16.890425 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-551441f0-a7ab-40bd-a449-1321e7fbd3c6 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 0.756506 Jul 25 20:12:16.891205 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 889/1806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:16 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:16.900831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:16.905186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: bdc7b0c6-f25a-439d-981e-778d3e193654] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:16.923188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.924953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.928567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:16.929821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:16.978997 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 HTTP/1.1 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:16.987224 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. Jul 25 20:12:16.990154 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'bdc7b0c6-f25a-439d-981e-778d3e193654'} Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:16.991746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. Jul 25 20:12:16.997431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.001392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance bdc7b0c6-f25a-439d-981e-778d3e193654 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:17.001392 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-156c039c-3dc9-4a81-9c31-54bc191daca0 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654" status: 404 len: 111 microversion: 2.1 time: 0.096609 Jul 25 20:12:17.001392 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 890/1807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:16 2022] GET /compute/v2.1/servers/bdc7b0c6-f25a-439d-981e-778d3e193654 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:17.001392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-150d7912-a421-4e12-9bbf-afcba8a42d36 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f1969ef1310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.018325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:17.037480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d84032f6-b4ce-4510-8212-fbc76d038941 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.572305 Jul 25 20:12:17.040533 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 918/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:16 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:17.058210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.065472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 3b27a3f7-0303-403e-aa62-ab70ddd0dc77] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:17.093519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.094736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.095814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.103464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.108963 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-150d7912-a421-4e12-9bbf-afcba8a42d36 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 200 len: 286 microversion: 2.1 time: 0.113433 Jul 25 20:12:17.110789 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 891/1809] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:16 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:17.139425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.142514 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. Jul 25 20:12:17.144336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 HTTP/1.1 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:17.148421 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. Jul 25 20:12:17.152296 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3b27a3f7-0303-403e-aa62-ab70ddd0dc77'} Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:17.154545 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. Jul 25 20:12:17.158022 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:17.162633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance 3b27a3f7-0303-403e-aa62-ab70ddd0dc77 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:17.162633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a793370e-d8ba-4649-a72f-62b1d138d575 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77" status: 404 len: 111 microversion: 2.1 time: 0.109179 Jul 25 20:12:17.162633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 919/1810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:17 2022] GET /compute/v2.1/servers/3b27a3f7-0303-403e-aa62-ab70ddd0dc77 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:17.163492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.166114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.166114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.166114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.176083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f09a2a9-9ee8-4b47-8d27-d0233778b158 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.273290 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f09a2a9-9ee8-4b47-8d27-d0233778b158 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/74a5607b-2f43-49e4-8281-c82be72e51b8" status: 204 len: 0 microversion: 2.1 time: 0.108293 Jul 25 20:12:17.276287 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 920/1811] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:12:17 2022] DELETE /compute/v2.1/os-server-groups/74a5607b-2f43-49e4-8281-c82be72e51b8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:17.288349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.289268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:17.310146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.313426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.315362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.321628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.431819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:17.712123 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8cf72561-15a7-4bb6-a8b6-cca2e69b441d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 204 len: 0 microversion: 2.1 time: 0.429158 Jul 25 20:12:17.724418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 921/1812] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:17 2022] DELETE /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:12:17.745852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:17.746467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:17.753379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.754345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.761825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:17.762904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:17.837858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:18.008248 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ccc20f9-3680-4e20-8264-e24065326c00 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 204 len: 0 microversion: 2.1 time: 0.268348 Jul 25 20:12:18.014511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 922/1813] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:17 2022] DELETE /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:12:18.018935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:18.019963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:18.025659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:18.034212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:18.036591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:18.037863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:18.038559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:18.148019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:18.165839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6483528e-39f1-40b5-bfc7-318a620173c7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1313 microversion: 2.1 time: 1.031348 Jul 25 20:12:18.168028 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 892/1814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:17 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1313 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:18.178255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:18.179430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:18.195172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:18.196690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:18.198432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:18.199447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:19.002260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:19.006389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:19.015071 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc937ecb-f89a-4d2e-836d-a0436bd75591 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 200 len: 1474 microversion: 2.1 time: 0.845568 Jul 25 20:12:19.027756 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 893/1815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:18 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 1474 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:19.027756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:19.027756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:19.034308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:19.035198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:19.036381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:19.037021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:19.077894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:19.087264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d825ff92-c367-4bda-9101-a31c8686a024 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 1.074807 Jul 25 20:12:19.100746 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 923/1816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:18 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:19.108069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba2e2930-09c0-477f-8476-f9d595f73719 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196eb71040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:19.147846 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ba2e2930-09c0-477f-8476-f9d595f73719 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] HTTP exception thrown: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba2e2930-09c0-477f-8476-f9d595f73719 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Request method failure captured: Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e HTTP/1.1 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkQZJU64N4LXzI78GV4FNsQ_j0YuSFNIKk5dG94sincHt3_Bmxu9_Hmkkvd0Q3V_J53fE-nn2CCl5UlOijKhdORrZIhXVRbUO7JBAuTQZFBXRMHc5pvEfW89Ma4y44fh0R8rTgjzadwcDP30GGz6_m-2wq3LOoRoCt7jSPfV_8Uq2c Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:19.160067 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}] Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 178e2689b518490993c44e4d72dcc6ad Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: exception: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '88f417f9-7be6-47d1-91da-cf563466607e'} Jul 25 20:12:19.163450 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. (HTTP 404) (Request-ID: req-5c07a29f-a078-4429-abbe-1a1ad8302247) Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.165897 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:19.170451 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 20:12:19.173768 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba2e2930-09c0-477f-8476-f9d595f73719 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Returning 404 to user: Snapshot 88f417f9-7be6-47d1-91da-cf563466607e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:19.177300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba2e2930-09c0-477f-8476-f9d595f73719 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e" status: 404 len: 111 microversion: 2.1 time: 0.060354 Jul 25 20:12:19.179843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 924/1817] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 20:12:19 2022] GET /compute/v2.1/os-snapshots/88f417f9-7be6-47d1-91da-cf563466607e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:19.179843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1945111624", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea7c3422-34fd-4fb8-b7bc-60523dad31bd"}], "security_groups": [{"name": "tempest-securitygroup--622659129"}], "key_name": "tempest-keypair-1812693343", "user_data": "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:19.689407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] validate_networks() for [('ea7c3422-34fd-4fb8-b7bc-60523dad31bd', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:12:19.903643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:19.945012 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-531c73e8-81b4-4222-bdd4-41a10e1d50f1 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.927274 Jul 25 20:12:19.945570 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 894/1818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:19 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:19.952404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68009f7a-2d81-4da9-a64b-555fc6d49bc0 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f1969814550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:20.093372 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68009f7a-2d81-4da9-a64b-555fc6d49bc0 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 202 len: 0 microversion: 2.1 time: 0.146169 Jul 25 20:12:20.095087 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 895/1819] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:12:19 2022] DELETE /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:12:20.110622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:20.118191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:20.163896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:20.164648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:20.165943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:20.166561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:21.433842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:21.458989 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e671b1e5-57bb-42f6-ab62-73b9f396a759 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1313 microversion: 2.1 time: 1.361313 Jul 25 20:12:21.460150 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 896/1820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:20 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1313 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:21.472375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:21.474253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:21.480106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:21.488171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:21.488839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:21.490065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:21.490778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:22.514170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:22.534519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4fcca9c-2a60-4ca3-b8ae-328be02af5c8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 200 len: 1474 microversion: 2.1 time: 1.072133 Jul 25 20:12:22.537589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 897/1821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:21 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 1474 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:22.544964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11f2a553-d754-4ea3-8fab-befd61e2ed79 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196a11c3a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:22.676681 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11f2a553-d754-4ea3-8fab-befd61e2ed79 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 200 len: 344 microversion: 2.1 time: 0.136386 Jul 25 20:12:22.685868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 898/1822] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:22 2022] GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:22.689775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:22.690297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:22.690664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:22.693978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:22.694783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:22.730386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:22.737777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:22.760591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:22.763788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:22.765377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:22.766253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:22.766890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:22.768811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:22.774020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:22.775337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:22.861422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:22.868635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:22.908969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:22.911702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:23.007276 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20505356-85ab-4189-a0ea-54ce2da39593 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.836751 Jul 25 20:12:23.008791 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 925/1823] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:12:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 3840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:12:23.024336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1172157e-c6d6-4f73-97a8-f0fe7200d3d6 req-1c2a1f12-a462-474a-9eb4-b97d02c16fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f75746-4d9e-4061-ab74-dd574cd14158", "name": "network-vif-plugged", "status": "completed", "tag": "4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:23.043599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1172157e-c6d6-4f73-97a8-f0fe7200d3d6 req-1c2a1f12-a462-474a-9eb4-b97d02c16fa7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:23.044400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1172157e-c6d6-4f73-97a8-f0fe7200d3d6 req-1c2a1f12-a462-474a-9eb4-b97d02c16fa7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:23.071244 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1172157e-c6d6-4f73-97a8-f0fe7200d3d6 req-1c2a1f12-a462-474a-9eb4-b97d02c16fa7 service nova] Creating event network-vif-plugged:4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4 for instance 53f75746-4d9e-4061-ab74-dd574cd14158 on n-h1-845775-3 Jul 25 20:12:23.115857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1172157e-c6d6-4f73-97a8-f0fe7200d3d6 req-1c2a1f12-a462-474a-9eb4-b97d02c16fa7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103911 Jul 25 20:12:23.116879 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 926/1824] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:23.142241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:23.150750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:23.174233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:23.177203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:23.178263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:23.179094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:23.942877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:23.967835 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fff79208-4205-442b-9362-b7f27122e375 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.848889 Jul 25 20:12:23.968172 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 927/1825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:23 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:23.975186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:23.975818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:23.994555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:23.995021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:23.995824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:23.996324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:24.231298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:24.252446 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7cbc12d-06d4-46a6-8aac-814def29d219 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 1.553667 Jul 25 20:12:24.267706 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 899/1826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:22 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:24.290431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:24.291468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:24.327362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:24.328356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:24.329745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:24.333920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:24.738411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:24.763317 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b5617ad-94a0-413f-9845-f95fcc7698b4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1243 microversion: 2.1 time: 0.487568 Jul 25 20:12:24.786657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 900/1827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:24 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1243 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:24.804174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:24.804550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:24.822921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:24.823996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:24.826041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:24.827468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:25.205016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:25.209128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:25.248956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a6c5098-7ac1-4adb-a855-c7bbd7edbc7c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1334 microversion: 2.1 time: 1.277490 Jul 25 20:12:25.258335 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 928/1828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:23 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1334 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:25.295377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f6fbe4db-0324-420b-9fbc-208af041b5cb req-90a87e22-9b0d-4938-ab68-36187894c1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "name": "network-vif-unplugged", "status": "completed", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:25.296461 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8140ab93-8ba4-465d-95f2-dee3e32099d8 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 200 len: 1432 microversion: 2.1 time: 0.508034 Jul 25 20:12:25.304301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 901/1829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:24 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 1432 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:25.326620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ca6d608-c218-4153-b667-4b72021893f4 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f1969844670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:25.363610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6fbe4db-0324-420b-9fbc-208af041b5cb req-90a87e22-9b0d-4938-ab68-36187894c1d3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:25.367241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6fbe4db-0324-420b-9fbc-208af041b5cb req-90a87e22-9b0d-4938-ab68-36187894c1d3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:25.413229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f6fbe4db-0324-420b-9fbc-208af041b5cb req-90a87e22-9b0d-4938-ab68-36187894c1d3 service nova] Creating event network-vif-unplugged:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:12:25.438210 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f6fbe4db-0324-420b-9fbc-208af041b5cb req-90a87e22-9b0d-4938-ab68-36187894c1d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175852 Jul 25 20:12:25.443067 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 929/1830] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:25.445037 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5ca6d608-c218-4153-b667-4b72021893f4 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] HTTP exception thrown: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ca6d608-c218-4153-b667-4b72021893f4 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Request method failure captured: Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 HTTP/1.1 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkQZJU64N4LXzI78GV4FNsQ_j0YuSFNIKk5dG94sincHt3_Bmxu9_Hmkkvd0Q3V_J53fE-nn2CCl5UlOijKhdORrZIhXVRbUO7JBAuTQZFBXRMHc5pvEfW89Ma4y44fh0R8rTgjzadwcDP30GGz6_m-2wq3LOoRoCt7jSPfV_8Uq2c Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:25.449192 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}] Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 178e2689b518490993c44e4d72dcc6ad Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'cd822ff0-fcc5-457e-9501-67af8b37f903'} Jul 25 20:12:25.451686 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. (HTTP 404) (Request-ID: req-9f305724-d6b2-43f8-a7c1-309945a0d36d) Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:25.452988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:25.454734 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:12:25.456713 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ca6d608-c218-4153-b667-4b72021893f4 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Returning 404 to user: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:25.458335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ca6d608-c218-4153-b667-4b72021893f4 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 404 len: 109 microversion: 2.1 time: 0.142793 Jul 25 20:12:25.467833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 902/1831] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:25 2022] GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:25.470930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:25.477121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:25.502062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:25.506016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:25.525524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:25.527982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:25.537401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:25.538683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:25.556586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:25.561902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:25.569063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:25.571912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.119512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:28.138870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:28.146099 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9bae7d2b-50d8-47d2-ae0e-99a0e6d53a0b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 2.698722 Jul 25 20:12:28.147528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 930/1832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:25 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:28.167065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92872d62-c66c-421d-8e0f-ff2aca4541a6 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f196eb6d550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.184261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:28.217344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75b1cbe2-35a9-49bd-b51f-f5f5d7efeb59 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1307 microversion: 2.1 time: 2.741043 Jul 25 20:12:28.232764 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 903/1833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:25 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1307 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:28.276503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.278647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:28.312238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-92872d62-c66c-421d-8e0f-ff2aca4541a6 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] HTTP exception thrown: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.314334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92872d62-c66c-421d-8e0f-ff2aca4541a6 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Request method failure captured: Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 HTTP/1.1 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkQZJU64N4LXzI78GV4FNsQ_j0YuSFNIKk5dG94sincHt3_Bmxu9_Hmkkvd0Q3V_J53fE-nn2CCl5UlOijKhdORrZIhXVRbUO7JBAuTQZFBXRMHc5pvEfW89Ma4y44fh0R8rTgjzadwcDP30GGz6_m-2wq3LOoRoCt7jSPfV_8Uq2c Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:28.315089 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}] Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 178e2689b518490993c44e4d72dcc6ad Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: exception: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'cd822ff0-fcc5-457e-9501-67af8b37f903'} Jul 25 20:12:28.321734 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. (HTTP 404) (Request-ID: req-1095e5ea-0af3-496f-88c5-227e16dff95b) Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.323593 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:12:28.326215 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 20:12:28.329938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.333186 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.334820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.335028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92872d62-c66c-421d-8e0f-ff2aca4541a6 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Returning 404 to user: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:28.335220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.335400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92872d62-c66c-421d-8e0f-ff2aca4541a6 tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 404 len: 109 microversion: 2.1 time: 0.167929 Jul 25 20:12:28.335597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.335896 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 931/1834] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:12:28 2022] DELETE /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:28.367203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-36bb7cf2-4b74-4b7c-9dfa-dd8fdb9419cf req-d027bcc2-8005-4f2a-a3c0-64d3c544917a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1ea58-8f94-4b4b-9827-16346eb85ae3", "name": "network-vif-deleted", "tag": "5c9879bc-e873-4d0e-bf3d-5aee2774d7a4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:28.402174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-36bb7cf2-4b74-4b7c-9dfa-dd8fdb9419cf req-d027bcc2-8005-4f2a-a3c0-64d3c544917a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.402869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-36bb7cf2-4b74-4b7c-9dfa-dd8fdb9419cf req-d027bcc2-8005-4f2a-a3c0-64d3c544917a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.427341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-36bb7cf2-4b74-4b7c-9dfa-dd8fdb9419cf req-d027bcc2-8005-4f2a-a3c0-64d3c544917a service nova] Creating event network-vif-deleted:5c9879bc-e873-4d0e-bf3d-5aee2774d7a4 for instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 on n-h2-845775-3 Jul 25 20:12:28.437485 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-36bb7cf2-4b74-4b7c-9dfa-dd8fdb9419cf req-d027bcc2-8005-4f2a-a3c0-64d3c544917a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117066 Jul 25 20:12:28.438753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 932/1835] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:28.450798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.453435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:28.476923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.479842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.481268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.482156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.672827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:28.691334 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f88ae1f-80cb-47c6-b0fd-27abe6bf4eca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1297 microversion: 2.1 time: 0.453911 Jul 25 20:12:28.698964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 904/1836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:28 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1297 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:28.709048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.712088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: 71b1ea58-8f94-4b4b-9827-16346eb85ae3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:28.725223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.726346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.727983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.729104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.784332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 HTTP/1.1 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:28.789294 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. Jul 25 20:12:28.791962 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '71b1ea58-8f94-4b4b-9827-16346eb85ae3'} Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:28.793262 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. Jul 25 20:12:28.795092 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.796905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance 71b1ea58-8f94-4b4b-9827-16346eb85ae3 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:28.796905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01cf4b77-fce4-4315-9c2b-a717e48e8a1d tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3" status: 404 len: 111 microversion: 2.1 time: 0.090338 Jul 25 20:12:28.798871 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 905/1837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:28 2022] GET /compute/v2.1/servers/71b1ea58-8f94-4b4b-9827-16346eb85ae3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:28.814942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e7d944-d21c-44ae-bb16-005770324ef4", "name": "network-vif-deleted", "tag": "f6452a44-0fb1-4e56-9bfb-5062ea8b095f"}, {"name": "network-changed", "server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:28.841653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.842314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.870387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] Creating event network-vif-deleted:f6452a44-0fb1-4e56-9bfb-5062ea8b095f for instance a4e7d944-d21c-44ae-bb16-005770324ef4 on n-h2-845775-3 Jul 25 20:12:28.871507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] Creating event network-changed:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:12:28.890212 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-45d55c63-fe7d-48e6-97c8-72829c9a2787 req-982293f0-cf1d-47d4-98f0-4f075fbf95cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087736 Jul 25 20:12:28.892026 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 906/1838] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:28.900806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19870ff6-9c85-43ab-afb4-771dd8a4081d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Calling method '.version_select at 0x7f19698c3670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.956710 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-19870ff6-9c85-43ab-afb4-771dd8a4081d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] HTTP exception thrown: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19870ff6-9c85-43ab-afb4-771dd8a4081d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Request method failure captured: Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 HTTP/1.1 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkQZJU64N4LXzI78GV4FNsQ_j0YuSFNIKk5dG94sincHt3_Bmxu9_Hmkkvd0Q3V_J53fE-nn2CCl5UlOijKhdORrZIhXVRbUO7JBAuTQZFBXRMHc5pvEfW89Ma4y44fh0R8rTgjzadwcDP30GGz6_m-2wq3LOoRoCt7jSPfV_8Uq2c Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:28.960417 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9feb695f5f2a4646a85fe3eef11da890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9feb695f5f2a4646a85fe3eef11da890"}]}] Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 9feb695f5f2a4646a85fe3eef11da890 Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-595907986 Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 178e2689b518490993c44e4d72dcc6ad Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-595907986-project Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'cd822ff0-fcc5-457e-9501-67af8b37f903'} Jul 25 20:12:28.962444 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. (HTTP 404) (Request-ID: req-7ff42963-6803-4d56-9cd7-0a2baece38df) Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.967471 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:12:28.969171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:12:28.970735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19870ff6-9c85-43ab-afb4-771dd8a4081d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] Returning 404 to user: Volume cd822ff0-fcc5-457e-9501-67af8b37f903 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19870ff6-9c85-43ab-afb4-771dd8a4081d tempest-VolumesSnapshotsTestJSON-595907986 tempest-VolumesSnapshotsTestJSON-595907986-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903" status: 404 len: 109 microversion: 2.1 time: 0.068828 Jul 25 20:12:28.972445 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 907/1839] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:28 2022] GET /compute/v2.1/os-volumes/cd822ff0-fcc5-457e-9501-67af8b37f903 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:28.977291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:28.979233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: a4e7d944-d21c-44ae-bb16-005770324ef4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:28.990297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.991099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:28.992331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:28.992973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.029208 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 HTTP/1.1 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:29.033642 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. Jul 25 20:12:29.036686 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a4e7d944-d21c-44ae-bb16-005770324ef4'} Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:29.038856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. Jul 25 20:12:29.041825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:29.046553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance a4e7d944-d21c-44ae-bb16-005770324ef4 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:29.052381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-631ace32-cd6b-4e7e-bedf-b4fdf9c3ecd2 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4" status: 404 len: 111 microversion: 2.1 time: 0.082735 Jul 25 20:12:29.057805 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 908/1840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:28 2022] GET /compute/v2.1/servers/a4e7d944-d21c-44ae-bb16-005770324ef4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:29.069203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-110086b4-d6b4-49d7-888e-bcc45425ed03 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:29.157714 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-110086b4-d6b4-49d7-888e-bcc45425ed03 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/15be9b85-d7de-41a1-b424-07204f5ec5df" status: 204 len: 0 microversion: 2.1 time: 0.097551 Jul 25 20:12:29.159192 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 909/1841] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:12:29 2022] DELETE /compute/v2.1/os-server-groups/15be9b85-d7de-41a1-b424-07204f5ec5df => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:29.179867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:29.180739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:29.217724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.219192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.220930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.221736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.286496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:29.509625 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-125b1b24-fa49-4860-9ac0-b1cdd2c04e90 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 204 len: 0 microversion: 2.1 time: 0.342101 Jul 25 20:12:29.512999 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 910/1842] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:29 2022] DELETE /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:29.530191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:29.534971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:29.550901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.552243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.554254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.555594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.650996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:29.674763 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12872ff2-047d-4947-9248-3fe3852d2521 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 1.233690 Jul 25 20:12:29.675473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 933/1843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:28 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:29.688536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:29.689181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:29.707385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.711162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:29.712620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:29.715570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:30.564990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:30.583304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0f10663-8960-42f8-b519-3589db71a0cf tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.068160 Jul 25 20:12:30.584437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 911/1844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:29 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:30.589692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:30.595959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:30.612273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:30.612948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:30.614374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:30.617238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:30.814771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:30.876294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ada6266-893e-4f24-b7a3-0a42b2abeecf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1487 microversion: 2.1 time: 1.194309 Jul 25 20:12:30.880391 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 934/1845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:29 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1487 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:30.896476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:30.897836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:30.929799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:30.940062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:30.942638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:30.943438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:31.680382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:31.696316 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfe7a344-dcc7-4363-891b-6135feddac78 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1473 microversion: 2.1 time: 1.110401 Jul 25 20:12:31.706405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 912/1846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:30 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1473 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:31.720864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:31.725033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:31.752547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:31.753398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:31.754956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:31.755672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:31.869887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:31.904024 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-304d3a1a-4d50-40dd-b0e2-ad963270e2f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1364 microversion: 2.1 time: 1.013161 Jul 25 20:12:31.908277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 935/1847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:30 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1364 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:31.929780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-228342175"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:31.935675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:31.964138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:31.964690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:31.965985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:31.967818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:32.561115 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b76fe49a-fafb-4250-9e2e-3c1ffdaaca54 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "POST /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158/action" status: 202 len: 0 microversion: 2.1 time: 0.645056 Jul 25 20:12:32.564753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 936/1848] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:12:31 2022] POST /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:12:32.605473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:32.606582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:32.626268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:32.626852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:32.629781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:32.631014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:32.808675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:32.889319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:33.008248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:33.029638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e06e698-6800-427b-9bcd-db07ce6fac4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 1.321674 Jul 25 20:12:33.030723 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 913/1849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:31 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:33.527909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Calling method '.version_select at 0x7f19699c0940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:33.673311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:12:33.674342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Neutron security group 6420fdb2-df66-499c-b697-746d47c64379 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:12:33.675431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] HTTP exception thrown: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.675431 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Request method failure captured: Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/6420fdb2-df66-499c-b697-746d47c64379 HTTP/1.1 Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkvT507AyHduQBL3yy5aJh6t2RPVXzo2LU16mDYQrcWFpMiZ5B__6UHwF-fGDcUl5uC5f5CSAzedwBPV3WinUV_l8xfolpMz6F_YkABCqbHxIpmekhQVqyIEFi9sk0q9brvKEj1iMdHImgEQ-cJpNVzh606ujyYamcYlwK5cylEvME Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:33.679111 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}] Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ba517281cd734ac08ddd93c70f1c18f4 Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.680831 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '6420fdb2-df66-499c-b697-746d47c64379'} Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:33.682057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:12:33.683490 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.688308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] Jul 25 20:12:33.693290 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:33.698644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Returning 404 to user: Security group 6420fdb2-df66-499c-b697-746d47c64379 does not exist Jul 25 20:12:33.698644 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-8235bc05-264b-4229-be91-b9a07c970944'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:33.698644 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9dfd6a5-323a-493a-b403-9ec6a4d49c97 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6420fdb2-df66-499c-b697-746d47c64379" status: 404 len: 194 microversion: 2.1 time: 0.664216 Jul 25 20:12:33.698644 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 914/1850] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:12:33 2022] DELETE /compute/v2.1/os-security-groups/6420fdb2-df66-499c-b697-746d47c64379 => generated 194 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:33.710822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ae09a70-2541-4379-8422-25db568bb6e1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196a68de50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:33.863686 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ae09a70-2541-4379-8422-25db568bb6e1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e" status: 200 len: 1413 microversion: 2.1 time: 0.162156 Jul 25 20:12:33.872124 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 915/1851] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:33 2022] GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e => generated 1413 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:33.926982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:33.930017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:33.931195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:33.960478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d3090e9-dd7b-4d6c-8087-18e5ddf58b3b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.385307 Jul 25 20:12:33.964172 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 937/1852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:32 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:33.969283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:33.969744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:33.976107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:33.977081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:33.979148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-63e68681-0e55-4138-8dc9-5cdd828228b2 req-5c2b0009-4e27-4a24-a84c-580661f56728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:34.052351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-63e68681-0e55-4138-8dc9-5cdd828228b2 req-5c2b0009-4e27-4a24-a84c-580661f56728 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.055277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-63e68681-0e55-4138-8dc9-5cdd828228b2 req-5c2b0009-4e27-4a24-a84c-580661f56728 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.058378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.059487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.060291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lazy-loading 'fault' on Instance uuid d7621d37-160c-4885-8f49-abe92624f69a {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:12:34.086521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-63e68681-0e55-4138-8dc9-5cdd828228b2 req-5c2b0009-4e27-4a24-a84c-580661f56728 service nova] Creating event network-changed:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:12:34.121573 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-63e68681-0e55-4138-8dc9-5cdd828228b2 req-5c2b0009-4e27-4a24-a84c-580661f56728 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155662 Jul 25 20:12:34.122214 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 938/1853] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:34.134729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:34.135632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:34.164155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.164514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.165316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.170425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.264436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b1d24b7c6b4b858546831e1b5b0508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2718565d4b48ab8235a338f7282313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:34.279314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5068159-93fa-406e-80f2-d848e138ece1 tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 200 len: 1307 microversion: 2.1 time: 0.402902 Jul 25 20:12:34.280644 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 916/1854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:33 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:34.300159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b5dd620b-1ecc-4193-b27a-a349cdb6ebcb req-8fabf6af-b55a-4d55-bfe5-5dbaa3e50d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "tag": "b436f454-000b-467a-b0dd-717437df22bd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:34.338188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b5dd620b-1ecc-4193-b27a-a349cdb6ebcb req-8fabf6af-b55a-4d55-bfe5-5dbaa3e50d3c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.339837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b5dd620b-1ecc-4193-b27a-a349cdb6ebcb req-8fabf6af-b55a-4d55-bfe5-5dbaa3e50d3c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.389263 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b5dd620b-1ecc-4193-b27a-a349cdb6ebcb req-8fabf6af-b55a-4d55-bfe5-5dbaa3e50d3c service nova] Creating event network-changed:b436f454-000b-467a-b0dd-717437df22bd for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:34.405368 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b5dd620b-1ecc-4193-b27a-a349cdb6ebcb req-8fabf6af-b55a-4d55-bfe5-5dbaa3e50d3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123028 Jul 25 20:12:34.410344 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 917/1855] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:34.425987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-873bd978-1670-483a-b4d0-b7638c510408 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008296 Jul 25 20:12:34.426664 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 918/1856] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Jul 25 20:12:34 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 20:12:34.444961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-220486c6-349c-4791-98f4-ea0b3bd7b4a4 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19698c84c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:34.567950 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-220486c6-349c-4791-98f4-ea0b3bd7b4a4 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e" status: 200 len: 1413 microversion: 2.1 time: 0.139910 Jul 25 20:12:34.568633 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 919/1857] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:34 2022] GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:34.599031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:34.599814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:34.630902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.631355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.632262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:34.632718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:34.649886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:34.903112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:34.922556 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e273a5f6-2e8f-4a62-9c48-5861da153998 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1364 microversion: 2.1 time: 0.799036 Jul 25 20:12:34.923537 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 939/1858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:34 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1364 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:34.928414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1900e17e-bb78-4ee2-a64e-0f0852727fd6 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Calling method '.version_select at 0x7f1969280700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:35.419933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:35.435462 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4ac86c5-3353-4f00-a48f-f7ba0d6df0a2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.852798 Jul 25 20:12:35.436438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 920/1859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:34 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:35.464597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88c6ba99-6ddd-4737-9252-08b2aec8b9de tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969530a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:35.728705 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88c6ba99-6ddd-4737-9252-08b2aec8b9de tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e" status: 204 len: 0 microversion: 2.1 time: 0.273255 Jul 25 20:12:35.729312 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 921/1860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:35 2022] DELETE /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:35.874119 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1900e17e-bb78-4ee2-a64e-0f0852727fd6 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.949249 Jul 25 20:12:35.875299 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 940/1861] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:12:34 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:35.882726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:35.885569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:35.903744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:35.907355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-dd6f79ce-ed47-49df-853b-c8492476a7a1 req-d9dbd312-7871-43ce-9149-d4e8a9897681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "name": "network-vif-unplugged", "status": "completed", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:35.908279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:35.909299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:35.909873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:35.930426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd6f79ce-ed47-49df-853b-c8492476a7a1 req-d9dbd312-7871-43ce-9149-d4e8a9897681 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:35.931000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd6f79ce-ed47-49df-853b-c8492476a7a1 req-d9dbd312-7871-43ce-9149-d4e8a9897681 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:35.967134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dd6f79ce-ed47-49df-853b-c8492476a7a1 req-d9dbd312-7871-43ce-9149-d4e8a9897681 service nova] Creating event network-vif-unplugged:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:12:35.977106 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-dd6f79ce-ed47-49df-853b-c8492476a7a1 req-d9dbd312-7871-43ce-9149-d4e8a9897681 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.246105 Jul 25 20:12:35.977921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 922/1862] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:36.000733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:36.001572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] [instance: d7621d37-160c-4885-8f49-abe92624f69a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:36.018614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:36.019082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:36.023082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:36.023811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:36.063049 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] HTTP exception thrown: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Request method failure captured: Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a HTTP/1.1 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vgPk1vzQE-EKTJuNBtEX6jCwcEdZIRpTQ8WzxZP_cBhd5DIK8d38yLGbKpmxe_M9fIODTZR3l-j7iUYDKqUtZyaqO6u_shw17PL1Zdpe859t2mWWMiqx19kqXtheahc64cAk7LtKBg7AAwDMO6-ja6rG5ggdWCfNCE2ghlqkHI-xKM Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:36.083675 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce2718565d4b48ab8235a338f7282313"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce2718565d4b48ab8235a338f7282313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce2718565d4b48ab8235a338f7282313"}]}] Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ce2718565d4b48ab8235a338f7282313 Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-353054377 Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 06b1d24b7c6b4b858546831e1b5b0508 Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersOnMultiNodesTest-353054377-project Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. Jul 25 20:12:36.086342 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd7621d37-160c-4885-8f49-abe92624f69a'} Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:36.087284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. Jul 25 20:12:36.091722 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.094894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] Returning 404 to user: Instance d7621d37-160c-4885-8f49-abe92624f69a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:36.095959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41c70ed4-eae7-4c44-967c-91d6f449bb0a tempest-ServersOnMultiNodesTest-353054377 tempest-ServersOnMultiNodesTest-353054377-project] 10.222.0.48 "GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a" status: 404 len: 111 microversion: 2.1 time: 0.114946 Jul 25 20:12:36.106642 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 923/1863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:35 2022] GET /compute/v2.1/servers/d7621d37-160c-4885-8f49-abe92624f69a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:36.125107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52eee374-5888-4189-92ab-5739efc3fc3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969bb1670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:36.174957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-52eee374-5888-4189-92ab-5739efc3fc3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Image not found. Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52eee374-5888-4189-92ab-5739efc3fc3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e HTTP/1.1 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:36.180419 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c2524f39-291f-4edf-9e7a-57c7ef80673e'} Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:36.182879 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c2524f39-291f-4edf-9e7a-57c7ef80673e Jul 25 20:12:36.184948 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:36.187374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2524f39-291f-4edf-9e7a-57c7ef80673e could not be found. Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:36.191241 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:12:36.193817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.198024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52eee374-5888-4189-92ab-5739efc3fc3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:36.206162 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52eee374-5888-4189-92ab-5739efc3fc3b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e" status: 404 len: 62 microversion: 2.1 time: 0.097809 Jul 25 20:12:36.217517 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 924/1864] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:36 2022] GET /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:12:36.247816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Calling method '.version_select at 0x7f1969530b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:36.766661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:36.783265 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c6b4ace-17cf-42e4-b879-fb0cfedb9d77 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.905848 Jul 25 20:12:36.802106 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 941/1865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:35 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:36.808332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:36.809336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:36.817951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:36.819222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:36.822484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:36.823413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:36.968712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:12:36.969457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 25 20:12:36.969457 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Request method failure captured: Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/1c09e4c6-ecbf-4989-87d1-a1c53ec0eb0e HTTP/1.1 Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkvT507AyHduQBL3yy5aJh6t2RPVXzo2LU16mDYQrcWFpMiZ5B__6UHwF-fGDcUl5uC5f5CSAzedwBPV3WinUV_l8xfolpMz6F_YkABCqbHxIpmekhQVqyIEFi9sk0q9brvKEj1iMdHImgEQ-cJpNVzh606ujyYamcYlwK5cylEvME Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:36.971351 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}] Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ba517281cd734ac08ddd93c70f1c18f4 Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: exception: Insufficient rights for removing default security group. Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.973049 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1c09e4c6-ecbf-4989-87d1-a1c53ec0eb0e'} Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:36.973992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 25 20:12:36.975419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:36.980969 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-470429aa-8b6d-42be-81a1-d694c02874db'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aab02e93-6a10-4115-92af-f2bec2729f3b tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1c09e4c6-ecbf-4989-87d1-a1c53ec0eb0e" status: 400 len: 182 microversion: 2.1 time: 0.753178 Jul 25 20:12:36.988296 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 925/1866] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:12:36 2022] DELETE /compute/v2.1/os-security-groups/1c09e4c6-ecbf-4989-87d1-a1c53ec0eb0e => generated 182 bytes in 754 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:12:36.994684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:36.994684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:36.997832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:36.998308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:36.999203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:37.000130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:37.239229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:37.292972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c2ca95d-e21a-4aa4-bcfc-6608bbac4a65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1364 microversion: 2.1 time: 0.485502 Jul 25 20:12:37.298445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 942/1867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:36 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1364 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:37.374555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:37.377250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:37.414279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:37.414695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:37.415505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:37.415948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:37.694715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:37.711280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46fc9855-6b4f-4dec-a14c-4b6e2313c55a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1487 microversion: 2.1 time: 0.728572 Jul 25 20:12:37.711280 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 926/1868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:36 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1487 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:37.738003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4a76e68-7a78-4fe1-a888-4ffa07e5558e tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f1969ad1f70>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:37.906164 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d4a76e68-7a78-4fe1-a888-4ffa07e5558e tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c7dd4858-7448-4d42-a37d-bc72a9ff311e" status: 200 len: 351 microversion: 2.1 time: 0.194556 Jul 25 20:12:37.906986 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 927/1869] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:37 2022] GET /compute/v2.1/os-volumes/c7dd4858-7448-4d42-a37d-bc72a9ff311e => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:38.355922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:38.368190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0d8a1795-bad1-4d23-9a6d-86ffdc23a836 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 1.020734 Jul 25 20:12:38.369017 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 943/1870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:37 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:38.386750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Calling method '.version_select at 0x7f1969c31820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:38.528447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:12:38.529190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Neutron security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:12:38.529932 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] HTTP exception thrown: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.529932 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Request method failure captured: Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-security-groups/43f9bffe-c13a-4cad-bc87-5aa83bc88dab HTTP/1.1 Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkvT507AyHduQBL3yy5aJh6t2RPVXzo2LU16mDYQrcWFpMiZ5B__6UHwF-fGDcUl5uC5f5CSAzedwBPV3WinUV_l8xfolpMz6F_YkABCqbHxIpmekhQVqyIEFi9sk0q9brvKEj1iMdHImgEQ-cJpNVzh606ujyYamcYlwK5cylEvME Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:38.532887 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}] Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ba517281cd734ac08ddd93c70f1c18f4 Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.534719 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '43f9bffe-c13a-4cad-bc87-5aa83bc88dab'} Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:38.536532 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:12:38.538250 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.539958 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] Jul 25 20:12:38.541933 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:38.545539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Returning 404 to user: Security group 43f9bffe-c13a-4cad-bc87-5aa83bc88dab does not exist Jul 25 20:12:38.545539 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-5e54c718-54bf-4b9d-846b-9a8ae15bea8a'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:38.545539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb0e567e-a166-4072-a9bc-7e4e351fc262 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/43f9bffe-c13a-4cad-bc87-5aa83bc88dab" status: 404 len: 194 microversion: 2.1 time: 0.171140 Jul 25 20:12:38.546695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 944/1871] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:12:38 2022] GET /compute/v2.1/os-security-groups/43f9bffe-c13a-4cad-bc87-5aa83bc88dab => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:38.556637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9bfa7af4-523d-4f79-9fbb-ec7dee00ec8d req-f26f5f20-2f32-4bfa-ab2b-51acea6950ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "tag": "772df191-de7f-4858-a731-c1384f136652"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:38.569929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9bfa7af4-523d-4f79-9fbb-ec7dee00ec8d req-f26f5f20-2f32-4bfa-ab2b-51acea6950ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.570607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9bfa7af4-523d-4f79-9fbb-ec7dee00ec8d req-f26f5f20-2f32-4bfa-ab2b-51acea6950ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.584078 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9bfa7af4-523d-4f79-9fbb-ec7dee00ec8d req-f26f5f20-2f32-4bfa-ab2b-51acea6950ba service nova] Creating event network-changed:772df191-de7f-4858-a731-c1384f136652 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:38.590366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9bfa7af4-523d-4f79-9fbb-ec7dee00ec8d req-f26f5f20-2f32-4bfa-ab2b-51acea6950ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042126 Jul 25 20:12:38.594952 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 945/1872] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:38.631875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:38.635203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:38.669437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.686686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.688088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.695784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.784643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:38.803359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7621d37-160c-4885-8f49-abe92624f69a", "name": "network-vif-deleted", "tag": "3f8c6ea8-c0dd-4216-85ce-f51302d56122"}, {"server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "name": "network-vif-unplugged", "status": "completed", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:38.826240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.830394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.865349 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] Creating event network-vif-deleted:3f8c6ea8-c0dd-4216-85ce-f51302d56122 for instance d7621d37-160c-4885-8f49-abe92624f69a on n-h1-845775-3 Jul 25 20:12:38.865862 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] Creating event network-vif-unplugged:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h2-845775-3 Jul 25 20:12:38.889768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-af974052-f32e-426b-b51d-72fa32fd97b2 req-f4e1dc22-42af-410e-b41a-7c36a656b185 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.980915 Jul 25 20:12:38.894121 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 928/1873] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:38.911920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:38.916192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:38.934431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.935183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.936660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:38.937674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:38.969592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:38.981063 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0d789be-de1b-4298-bd8c-a2342d350d7f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 204 len: 0 microversion: 2.1 time: 0.364104 Jul 25 20:12:38.981767 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 946/1874] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:38 2022] DELETE /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:38.992341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:38.993061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:39.012518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:39.012999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:39.018211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:39.019003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:39.640586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:39.651361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b5c7c06d-5005-4be0-ba4a-9ae05e87ded6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 0.754359 Jul 25 20:12:39.655981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 929/1875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:38 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:39.671090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Action: 'update', calling method: .version_select at 0x7f1969533550>, body: {"security_group": {"name": "tempest-sg-227604636", "description": "tempest-description-1610451410"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:39.679967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:39.721839 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59ee7ff9-de7e-4f87-8d3f-06fb7330c85d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1364 microversion: 2.1 time: 0.730652 Jul 25 20:12:39.738117 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 947/1876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:38 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1364 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:39.764538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc552a54-f78e-4246-9bdb-d78798e5041a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f1969a96e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:39.866475 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fc552a54-f78e-4246-9bdb-d78798e5041a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Image not found. Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc552a54-f78e-4246-9bdb-d78798e5041a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e HTTP/1.1 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:39.872313 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c2524f39-291f-4edf-9e7a-57c7ef80673e'} Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:39.875835 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c2524f39-291f-4edf-9e7a-57c7ef80673e to delete Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.879009 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2524f39-291f-4edf-9e7a-57c7ef80673e could not be found. Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:39.885166 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:12:39.891730 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.895565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc552a54-f78e-4246-9bdb-d78798e5041a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:39.900355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc552a54-f78e-4246-9bdb-d78798e5041a tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e" status: 404 len: 62 microversion: 2.1 time: 0.168483 Jul 25 20:12:39.904809 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 948/1877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:39 2022] DELETE /compute/v2.1/images/c2524f39-291f-4edf-9e7a-57c7ef80673e => generated 62 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:12:39.927916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:39.929534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:39.973654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:12:39.974433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Neutron security group a132ca6b-0b89-4762-94f7-e3f5f2697330 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:12:39.974975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] HTTP exception thrown: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:39.974975 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Request method failure captured: Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/os-security-groups/a132ca6b-0b89-4762-94f7-e3f5f2697330 HTTP/1.1 Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 101 Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkvT507AyHduQBL3yy5aJh6t2RPVXzo2LU16mDYQrcWFpMiZ5B__6UHwF-fGDcUl5uC5f5CSAzedwBPV3WinUV_l8xfolpMz6F_YkABCqbHxIpmekhQVqyIEFi9sk0q9brvKEj1iMdHImgEQ-cJpNVzh606ujyYamcYlwK5cylEvME Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:39.977723 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3e3db34532c54b6aa65b3ffa1cf59f7e"}]}] Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 3e3db34532c54b6aa65b3ffa1cf59f7e Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953 Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ba517281cd734ac08ddd93c70f1c18f4 Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1756630953-project Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: {"security_group": {"name": "tempest-sg-227604636", "description": "tempest-description-1610451410"}} Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:39.982175 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a132ca6b-0b89-4762-94f7-e3f5f2697330', 'body': {'security_group': {'name': 'tempest-sg-227604636', 'description': 'tempest-description-1610451410'}}} Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:12:39.985955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:12:39.990386 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:39.993439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] Returning 404 to user: Security group a132ca6b-0b89-4762-94f7-e3f5f2697330 does not exist Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-964ae1b6-58b5-4ce0-a599-fced248c90fe'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:40.001576 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2b84d50b-3c59-4632-a89a-c5cd59b78285 tempest-SecurityGroupsNegativeTestJSON-1756630953 tempest-SecurityGroupsNegativeTestJSON-1756630953-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/a132ca6b-0b89-4762-94f7-e3f5f2697330" status: 404 len: 194 microversion: 2.1 time: 0.314492 Jul 25 20:12:40.004751 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 930/1878] 10.222.0.48 () {60 vars in 1290 bytes} [Mon Jul 25 20:12:39 2022] PUT /compute/v2.1/os-security-groups/a132ca6b-0b89-4762-94f7-e3f5f2697330 => generated 194 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:40.004751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:40.004751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:40.006643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.006643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.014754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.016104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.039332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.039799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.040635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.041512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.121057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:40.263946 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Instance is already in deleting state, ignoring this request Jul 25 20:12:40.264848 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-829d0532-3cd1-449c-90d8-2649ab94ade9 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 204 len: 0 microversion: 2.1 time: 0.282724 Jul 25 20:12:40.265707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 931/1879] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:39 2022] DELETE /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:40.271783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1b45ed75-b301-437f-94cc-42648ba726e6 req-9e62c32a-7970-425e-a6e9-9bf7873f19b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-plugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:40.300893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b45ed75-b301-437f-94cc-42648ba726e6 req-9e62c32a-7970-425e-a6e9-9bf7873f19b6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.302175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b45ed75-b301-437f-94cc-42648ba726e6 req-9e62c32a-7970-425e-a6e9-9bf7873f19b6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.339046 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1b45ed75-b301-437f-94cc-42648ba726e6 req-9e62c32a-7970-425e-a6e9-9bf7873f19b6 service nova] Creating event network-vif-plugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:12:40.349472 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1b45ed75-b301-437f-94cc-42648ba726e6 req-9e62c32a-7970-425e-a6e9-9bf7873f19b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082005 Jul 25 20:12:40.353493 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 932/1880] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:40.370678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:40.371676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:40.388105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.396667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.397976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.403711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.689102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:40.724196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92ad01f4-fbb4-4af6-96ef-c36b04c6ea24 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.811877 Jul 25 20:12:40.731012 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 949/1881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:39 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:40.756420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:40.761032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:40.795683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.798054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.801562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:40.803890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:40.897025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:41.749548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:41.787413 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3699798e-ee80-4abd-8c69-63ba9a907292 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1493 microversion: 2.1 time: 1.432215 Jul 25 20:12:41.800086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 933/1882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:40 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1493 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:41.801282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:41.801282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:41.815578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:41.816955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:41.818126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:41.818581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:41.826151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:41.839588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd8bd263-bc28-4a38-8ce2-33b829954bc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1391 microversion: 2.1 time: 1.105468 Jul 25 20:12:41.841162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 950/1883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:40 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1391 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:41.867530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-05d08206-41a4-4bd8-b7d7-49ab85b6f3b4 req-88b35642-f1de-469d-87f3-82a9e225ef3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "tag": "56347ae9-a921-4008-abfe-e3172d7a6ef1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:41.886541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-05d08206-41a4-4bd8-b7d7-49ab85b6f3b4 req-88b35642-f1de-469d-87f3-82a9e225ef3f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:41.887622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-05d08206-41a4-4bd8-b7d7-49ab85b6f3b4 req-88b35642-f1de-469d-87f3-82a9e225ef3f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:41.912553 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-05d08206-41a4-4bd8-b7d7-49ab85b6f3b4 req-88b35642-f1de-469d-87f3-82a9e225ef3f service nova] Creating event network-changed:56347ae9-a921-4008-abfe-e3172d7a6ef1 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:41.921288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-05d08206-41a4-4bd8-b7d7-49ab85b6f3b4 req-88b35642-f1de-469d-87f3-82a9e225ef3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059168 Jul 25 20:12:41.922461 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 951/1884] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:41.930349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:41.931896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:41.942750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:41.943933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:41.945156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:41.945857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:42.144270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:42.164185 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-354607f6-3ab7-42af-8777-75d414fe2368 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1364 microversion: 2.1 time: 0.368619 Jul 25 20:12:42.164893 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 934/1885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:41 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:42.174907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db266848-0216-4ae7-b09a-0ee6125faef7 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f19698c8940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:42.281454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:42.295149 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-936e90b2-73e9-49bd-8a96-b85a080ba756 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.370764 Jul 25 20:12:42.296178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 952/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:41 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:42.320109 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db266848-0216-4ae7-b09a-0ee6125faef7 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/49529249-e328-4cf1-b7a1-e3a4b7852aa8" status: 200 len: 350 microversion: 2.1 time: 0.152488 Jul 25 20:12:42.321168 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 935/1887] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:42 2022] GET /compute/v2.1/os-volumes/49529249-e328-4cf1-b7a1-e3a4b7852aa8 => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:42.815780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:42.853586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:42.869392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:42.870223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:42.883572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:42.884993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:42.887916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:42.889435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:42.894568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:42.895135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:42.897416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:42.900259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.254497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:43.266044 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85f20e81-9f8d-4756-8c90-c950d4fa9f58 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1381 microversion: 2.1 time: 0.404350 Jul 25 20:12:43.266675 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 936/1888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:42 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1381 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:43.302856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:43.307639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:43.323817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e02ce4bb4645e2a92ba0a5eed8ba0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa09b4e706904790a2a127f3d15e11ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:43.335750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:43.336710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.337731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:43.340989 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-78640530-3875-4ad6-9421-db90ab83f5ba tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 200 len: 1493 microversion: 2.1 time: 0.529174 Jul 25 20:12:43.344182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.349089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 953/1889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:42 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 1493 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:43.362296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bdc1a6a-effd-4fa0-a149-f683313f09ae tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '.version_select at 0x7f196ead0940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:43.370558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc1a6a-effd-4fa0-a149-f683313f09ae tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:43.372258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc1a6a-effd-4fa0-a149-f683313f09ae tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.392956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bdc1a6a-effd-4fa0-a149-f683313f09ae tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.041358 Jul 25 20:12:43.411501 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 954/1890] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:12:43 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:43.428449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:43.433116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:43.450735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:43.452775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.453818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:43.454440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:43.958790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:43.975239 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-491f85fd-ec18-480a-ab26-7693531b2ea1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1552 microversion: 2.1 time: 0.685516 Jul 25 20:12:43.984536 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 937/1891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:43 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1552 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:44.045753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:44.059008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d99f80c-c1aa-47d0-bbda-9f297a06fb4e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.640851 Jul 25 20:12:44.063029 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 955/1892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:43 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:44.071414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:44.072060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:44.084451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.084929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.085935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.086996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.236380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-507198606", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:44.408679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:12:44.416225 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-379453b9-dc0b-4e9a-872d-eef2f3d920f8 tempest-LiveMigrationTest-1976979595 tempest-LiveMigrationTest-1976979595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1532 microversion: 2.1 time: 0.351850 Jul 25 20:12:44.419578 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 956/1893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:44 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1532 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:44.433656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7695c4d9-cac4-4fcb-8816-38e6b79ad2d9 req-5e150690-464e-4ffb-ae22-0b741b94e445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f75746-4d9e-4061-ab74-dd574cd14158", "name": "network-vif-deleted", "tag": "4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:44.459440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7695c4d9-cac4-4fcb-8816-38e6b79ad2d9 req-5e150690-464e-4ffb-ae22-0b741b94e445 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.464787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7695c4d9-cac4-4fcb-8816-38e6b79ad2d9 req-5e150690-464e-4ffb-ae22-0b741b94e445 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.502532 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7695c4d9-cac4-4fcb-8816-38e6b79ad2d9 req-5e150690-464e-4ffb-ae22-0b741b94e445 service nova] Creating event network-vif-deleted:4f315e85-d6d0-48e0-9ce3-eaa0a865c0b4 for instance 53f75746-4d9e-4061-ab74-dd574cd14158 on n-h1-845775-3 Jul 25 20:12:44.519941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7695c4d9-cac4-4fcb-8816-38e6b79ad2d9 req-5e150690-464e-4ffb-ae22-0b741b94e445 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093841 Jul 25 20:12:44.521117 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 957/1894] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:44.539110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:44.540783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:44.556841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.561141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.562365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.562987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.762597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5baf2e42-e1c2-482b-bd19-35967ddf25d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235165 Jul 25 20:12:44.763223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 958/1895] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:12:44 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:44.774728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:44.775362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 53f75746-4d9e-4061-ab74-dd574cd14158] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:44.782495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.783553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.784756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.785200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.802220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 HTTP/1.1 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:44.803912 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '53f75746-4d9e-4061-ab74-dd574cd14158'} Jul 25 20:12:44.806037 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:44.807239 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. Jul 25 20:12:44.808959 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:44.810813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 53f75746-4d9e-4061-ab74-dd574cd14158 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:44.810813 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-11640c54-0b32-4ece-9ace-909cb0c0074b tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158" status: 404 len: 111 microversion: 2.1 time: 0.041402 Jul 25 20:12:44.810813 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 959/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:44 2022] GET /compute/v2.1/servers/53f75746-4d9e-4061-ab74-dd574cd14158 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:44.815752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:44.816296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:44.822822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.823198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.823983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.824459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.862981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:12:44.942613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:44.943357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:44.944073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:44.944660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:44.945236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:44.962074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.962817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:44.966482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:44.966945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:45.014598 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e577d887-8f6e-4240-bd2d-3d3ee1b76934 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 204 len: 0 microversion: 2.1 time: 0.203417 Jul 25 20:12:45.015510 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 960/1897] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:44 2022] DELETE /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:12:45.032807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de7052b5-96a1-468e-a79e-b150266a03f2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb32dc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.040852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Getting quotas for project 0c84f0a7d4bd49cbb32d19bc4c2d19b2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:45.055815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Getting quotas for user 1588f90fd6444050bf26cd0b07eb1f26 and project 0c84f0a7d4bd49cbb32d19bc4c2d19b2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:45.084216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:45.087150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:45.097818 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de7052b5-96a1-468e-a79e-b150266a03f2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def" status: 200 len: 661 microversion: 2.1 time: 0.078506 Jul 25 20:12:45.099937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 961/1898] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:45.113074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-863c51b7-08c7-4d95-9bf7-a9b2dee260d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196ead0790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.195417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae27dead-6029-49e0-a350-77a698d153a4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207455 Jul 25 20:12:45.206578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 938/1899] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:12:45.214260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.214912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:45.215232 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-863c51b7-08c7-4d95-9bf7-a9b2dee260d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Image not found. Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-863c51b7-08c7-4d95-9bf7-a9b2dee260d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 HTTP/1.1 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:12:45.219964 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3edac783-7791-474e-90de-cc745affe374'} Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:45.221972 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3edac783-7791-474e-90de-cc745affe374 to delete Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.223217 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3edac783-7791-474e-90de-cc745affe374 could not be found. Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:45.225921 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:12:45.227833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-863c51b7-08c7-4d95-9bf7-a9b2dee260d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:45.229002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:45.229002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:45.229002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:45.229002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:45.230696 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-863c51b7-08c7-4d95-9bf7-a9b2dee260d0 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374" status: 404 len: 62 microversion: 2.1 time: 0.127333 Jul 25 20:12:45.230696 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 962/1900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:45 2022] DELETE /compute/v2.1/images/3edac783-7791-474e-90de-cc745affe374 => generated 62 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:12:45.239692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f4661b4-6fea-413f-8ed4-c3b86248a173 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f19692d01f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.355754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f4661b4-6fea-413f-8ed4-c3b86248a173 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a33af54a-1d4a-47e4-b6e8-c3f99bcb3c7f" status: 200 len: 350 microversion: 2.1 time: 0.123188 Jul 25 20:12:45.356414 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 963/1901] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/os-volumes/a33af54a-1d4a-47e4-b6e8-c3f99bcb3c7f => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:45.372906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.374114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:45.394381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:45.395665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:45.397196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:45.397652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:45.644475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:45.664908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfd886ae-4c87-4a7d-b133-2227d21a900c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1387 microversion: 2.1 time: 0.456226 Jul 25 20:12:45.665523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 939/1902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1387 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:45.672433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b36e179-c3c3-4013-a6e1-b5bd907a6bf2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f19694c7b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.795599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b36e179-c3c3-4013-a6e1-b5bd907a6bf2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def" status: 200 len: 661 microversion: 2.1 time: 0.128510 Jul 25 20:12:45.804879 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 940/1903] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def => generated 661 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:45.804879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81f69bed-c34a-43a9-a342-23ade01ae82e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:45.804879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81f69bed-c34a-43a9-a342-23ade01ae82e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:45.957080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81f69bed-c34a-43a9-a342-23ade01ae82e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:45.971017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81f69bed-c34a-43a9-a342-23ade01ae82e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1218 microversion: 2.1 time: 0.173035 Jul 25 20:12:45.973605 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 941/1904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:45.980003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:46.000722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.002403 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cdfc0ca3-7b0a-4bd1-9904-0d7e38e5a2db tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.634774 Jul 25 20:12:46.003425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.008098 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 964/1905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:45 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:46.026360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-212bba8b-1ef2-4ee5-adf9-4ff30d1b78f3 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f19692d0310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.032966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.036340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.037345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.040737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.101658 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f HTTP/1.1 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.110923 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.114149 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '16f865fb-665a-4252-9093-d8116d13512f'} Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.115097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.117100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.124693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.127189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e75d7f1-9bd8-410f-9bf5-9f5d5ecfc85f tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 404 len: 111 microversion: 2.1 time: 0.152230 Jul 25 20:12:46.134116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 942/1906] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:45 2022] DELETE /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:46.150557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.151737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 16f865fb-665a-4252-9093-d8116d13512f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.179270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.180225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.181355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.184411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.215914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f HTTP/1.1 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.218046 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '16f865fb-665a-4252-9093-d8116d13512f'} Jul 25 20:12:46.219683 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.220796 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. Jul 25 20:12:46.222230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.230738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 16f865fb-665a-4252-9093-d8116d13512f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.232594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25df1ae9-5123-46ab-b2b2-ba6332a826b1 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f" status: 404 len: 111 microversion: 2.1 time: 0.094001 Jul 25 20:12:46.234366 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 943/1907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/servers/16f865fb-665a-4252-9093-d8116d13512f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:46.248144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-212bba8b-1ef2-4ee5-adf9-4ff30d1b78f3 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.238340 Jul 25 20:12:46.249003 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 965/1908] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:46.263909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f9b038-8505-42fa-8912-2d3cab7ea699 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f196987d4c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.271095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5d684fc8-22a3-40ca-ae79-c9a2f6ae9f9e tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f19692bd0d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.316286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-75f9b038-8505-42fa-8912-2d3cab7ea699 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Image not found. Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f9b038-8505-42fa-8912-2d3cab7ea699 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 HTTP/1.1 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.319088 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1ab2faf6-1347-40b8-9668-b5629aa027c7'} Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.320748 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1ab2faf6-1347-40b8-9668-b5629aa027c7 to delete Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.321802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ab2faf6-1347-40b8-9668-b5629aa027c7 could not be found. Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.325709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:12:46.327430 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.339107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f9b038-8505-42fa-8912-2d3cab7ea699 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.340020 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75f9b038-8505-42fa-8912-2d3cab7ea699 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7" status: 404 len: 62 microversion: 2.1 time: 0.085934 Jul 25 20:12:46.344206 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 944/1909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:46 2022] DELETE /compute/v2.1/images/1ab2faf6-1347-40b8-9668-b5629aa027c7 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:12:46.365781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.367303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.390816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.391290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.392132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.397414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.438415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e HTTP/1.1 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.443175 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.445398 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '819316d7-7a6c-464d-9d57-c9d1dedcc64e'} Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.446352 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.448057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.450081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.450081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94f3d326-0a11-42c8-b94a-74eaae0ce161 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 404 len: 111 microversion: 2.1 time: 0.100523 Jul 25 20:12:46.450291 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 945/1910] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:46 2022] DELETE /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:46.459504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.461019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 819316d7-7a6c-464d-9d57-c9d1dedcc64e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.470668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.471477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.474137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.474779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.482510 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5d684fc8-22a3-40ca-ae79-c9a2f6ae9f9e tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.215610 Jul 25 20:12:46.483666 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 966/1911] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:46.500409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5c20402-812d-4087-9528-46e8e1e21502 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f196ebb6c10>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.517600 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e HTTP/1.1 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.532316 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '819316d7-7a6c-464d-9d57-c9d1dedcc64e'} Jul 25 20:12:46.535065 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.536642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. Jul 25 20:12:46.539440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.547176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 819316d7-7a6c-464d-9d57-c9d1dedcc64e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.554149 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c05c6058-27be-47ba-b9ce-6b700cfcf2bf tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e" status: 404 len: 111 microversion: 2.1 time: 0.101909 Jul 25 20:12:46.556748 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 946/1912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/servers/819316d7-7a6c-464d-9d57-c9d1dedcc64e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:46.584966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b6409ad-7f14-46a3-8b31-839660a9f4ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '.version_select at 0x7f19699c0af0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.633074 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7b6409ad-7f14-46a3-8b31-839660a9f4ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Image not found. Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b6409ad-7f14-46a3-8b31-839660a9f4ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 HTTP/1.1 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.636939 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8b324945-6ee8-4731-9c96-240696d882d0'} Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.638846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b324945-6ee8-4731-9c96-240696d882d0 to delete Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.640077 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b324945-6ee8-4731-9c96-240696d882d0 could not be found. Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.645836 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b6409ad-7f14-46a3-8b31-839660a9f4ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b6409ad-7f14-46a3-8b31-839660a9f4ae tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0" status: 404 len: 62 microversion: 2.1 time: 0.074865 Jul 25 20:12:46.651984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 947/1913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:46 2022] DELETE /compute/v2.1/images/8b324945-6ee8-4731-9c96-240696d882d0 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:12:46.659827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.661463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.673748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:46.684669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.685243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.694415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.694926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.724948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5c20402-812d-4087-9528-46e8e1e21502 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.226797 Jul 25 20:12:46.733663 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 967/1914] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:46.733663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:46.733663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:46.753654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.755766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.764119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:46.764861 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:46.768890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b HTTP/1.1 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:46.769185 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:46.773035 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '808c68ad-c3ba-4664-96e6-c7adc355b17b'} Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:46.774870 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:46.779803 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:46.785096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:46.792083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4971c33-912a-40b4-982f-32595015a496 tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 404 len: 111 microversion: 2.1 time: 0.143852 Jul 25 20:12:46.802405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 948/1915] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:12:46 2022] DELETE /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:46.829846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b00585a2-2e2e-4c56-87c7-d560882c2a65 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f1969b7e5e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.017285 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b00585a2-2e2e-4c56-87c7-d560882c2a65 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212252 Jul 25 20:12:47.020818 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 949/1916] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:47.030829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.035575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] [instance: 808c68ad-c3ba-4664-96e6-c7adc355b17b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:47.058910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.059926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.061525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.063181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.101014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] HTTP exception thrown: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Request method failure captured: Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b HTTP/1.1 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vfxz0xbRKXvQBW2mLjeicOiOL3uZY3M4iPC5PQ-eC_Qi-gHXiT82Gb1OjlVNEW6sem8hc8iiARPnFUJVbls4LqAL_qywTFzpYxe72f4DDttZnJZzQV4LR-bKsJYUIHfjqZa1d-KtRLp6vU4ItmmIBVouhFmBEcFu0advhuzVb-Xqw0 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:12:47.102648 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aa09b4e706904790a2a127f3d15e11ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aa09b4e706904790a2a127f3d15e11ac"}]}] Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: aa09b4e706904790a2a127f3d15e11ac Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesTestJSON-1251940469 Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a5e02ce4bb4645e2a92ba0a5eed8ba0d Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesTestJSON-1251940469-project Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '808c68ad-c3ba-4664-96e6-c7adc355b17b'} Jul 25 20:12:47.104221 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:12:47.105155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. Jul 25 20:12:47.106588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:12:47.107900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] Returning 404 to user: Instance 808c68ad-c3ba-4664-96e6-c7adc355b17b could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:12:47.107900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f28adf3-b11e-46b6-a637-a72fe62dd4db tempest-ImagesTestJSON-1251940469 tempest-ImagesTestJSON-1251940469-project] 10.222.0.48 "GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b" status: 404 len: 111 microversion: 2.1 time: 0.082061 Jul 25 20:12:47.110921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 950/1917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/servers/808c68ad-c3ba-4664-96e6-c7adc355b17b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:12:47.116576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.117213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:47.149017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.149780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.151090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.151712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.518536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:47.546442 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60cb57b1-9bee-49b9-9365-ae7b77508705 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1288 microversion: 2.1 time: 0.431142 Jul 25 20:12:47.564282 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 951/1918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1288 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:47.570321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.571434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:47.578989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.579722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.580870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:47.581678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:47.629250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:47.642275 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1fe58066-1f6e-4f2c-b1fc-ab55aefee28b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1387 microversion: 2.1 time: 0.914386 Jul 25 20:12:47.658163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 968/1919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:46 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1387 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:47.685409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91b3589f-e739-40e7-8897-7853a858bec7 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f196eb713a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.813460 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91b3589f-e739-40e7-8897-7853a858bec7 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.143163 Jul 25 20:12:47.814476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 969/1920] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:47.820236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c671c25-d830-4116-b12d-651655d2b374 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb5dd30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:47.889043 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c671c25-d830-4116-b12d-651655d2b374 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df" status: 200 len: 660 microversion: 2.1 time: 0.073304 Jul 25 20:12:47.890830 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 970/1921] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df => generated 660 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:47.907142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8cd6888f-24af-41ac-8bfe-d56dd886cc0a tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f196eb32550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.141639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8cd6888f-24af-41ac-8bfe-d56dd886cc0a tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.248820 Jul 25 20:12:48.142574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 971/1922] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:48.163964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54e99b7a-4380-4d86-b192-8db8a42ba307 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ebba310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.186325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:48.199361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fb8f3fd-2eeb-4715-8b2b-61139ef43ceb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.633508 Jul 25 20:12:48.208617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 952/1923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:47 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:48.235063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e6cce3e2-1a35-4377-8a6c-bfa32bb58ad6 req-06cf23e1-83e5-42e5-89fa-0cfd9e7009b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483f7b8c-bc4b-4d97-8176-dfa0e2f21801", "name": "network-vif-deleted", "tag": "d6c91681-6324-4504-86b5-5fe6b4574580"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:48.256296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54e99b7a-4380-4d86-b192-8db8a42ba307 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df" status: 200 len: 660 microversion: 2.1 time: 0.110193 Jul 25 20:12:48.258643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e6cce3e2-1a35-4377-8a6c-bfa32bb58ad6 req-06cf23e1-83e5-42e5-89fa-0cfd9e7009b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.259548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e6cce3e2-1a35-4377-8a6c-bfa32bb58ad6 req-06cf23e1-83e5-42e5-89fa-0cfd9e7009b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:48.264212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 972/1924] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:48 2022] GET /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df => generated 660 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:48.275602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61482c83-bd50-4a02-b42a-e4c3e44dece3 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f196eb5df70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.313078 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e6cce3e2-1a35-4377-8a6c-bfa32bb58ad6 req-06cf23e1-83e5-42e5-89fa-0cfd9e7009b7 service nova] Creating event network-vif-deleted:d6c91681-6324-4504-86b5-5fe6b4574580 for instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 on n-h1-845775-3 Jul 25 20:12:48.346194 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e6cce3e2-1a35-4377-8a6c-bfa32bb58ad6 req-06cf23e1-83e5-42e5-89fa-0cfd9e7009b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128486 Jul 25 20:12:48.346964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 953/1925] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:48.462661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-27350440-cc4e-4566-9e3a-9c63471f8086 req-d4f38c45-cf5f-406f-9f5c-36030b267007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:48.487402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-27350440-cc4e-4566-9e3a-9c63471f8086 req-d4f38c45-cf5f-406f-9f5c-36030b267007 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.488063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-27350440-cc4e-4566-9e3a-9c63471f8086 req-d4f38c45-cf5f-406f-9f5c-36030b267007 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:48.496541 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61482c83-bd50-4a02-b42a-e4c3e44dece3 tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.229463 Jul 25 20:12:48.497624 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 973/1926] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Jul 25 20:12:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:48.526832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d91c0eee-33f3-4bbf-8fcd-f40be652406f tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] Calling method '.version_select at 0x7f196ebba280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.553017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-27350440-cc4e-4566-9e3a-9c63471f8086 req-d4f38c45-cf5f-406f-9f5c-36030b267007 service nova] Creating event network-changed:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:12:48.572796 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-27350440-cc4e-4566-9e3a-9c63471f8086 req-d4f38c45-cf5f-406f-9f5c-36030b267007 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114366 Jul 25 20:12:48.582182 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 954/1927] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:48.595791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.600546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:48.622792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.623676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:48.627104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.627568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:48.637891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:48.755721 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d91c0eee-33f3-4bbf-8fcd-f40be652406f tempest-VolumesTestJSON-775205631 tempest-VolumesTestJSON-775205631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.239684 Jul 25 20:12:48.770778 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 974/1928] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:12:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:48.777937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:48.780778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:48.783575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:48.796536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71aaf4cf-ca13-4a3f-9c58-48795f31ae38 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1276 microversion: 2.1 time: 0.212629 Jul 25 20:12:48.798051 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 955/1929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:48 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:48.802111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.802805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:48.803760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:48.804292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:49.231271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:49.231899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:49.258804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:49.259272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:49.260106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:49.260560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:49.631782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:49.649320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3bf3a68-89f0-4074-b35e-5761f97a991f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1345 microversion: 2.1 time: 0.874073 Jul 25 20:12:49.653542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 975/1930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:48 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1345 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:49.833676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:49.835662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:49.873281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:49.873909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:49.874841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:49.876162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:50.396370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:50.410275 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3444005-ca0e-4df4-a61d-f01b310cd6e4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1276 microversion: 2.1 time: 0.582511 Jul 25 20:12:50.448068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 976/1931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:49 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1276 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:50.456484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85c3a82a-bb8e-4d4f-9fae-1c59aba25882 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ead7790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:50.540544 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-85c3a82a-bb8e-4d4f-9fae-1c59aba25882 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1" status: 200 len: 662 microversion: 2.1 time: 0.099181 Jul 25 20:12:50.549581 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 977/1932] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:50 2022] GET /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:50.549972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:50.559054 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8f6a4ec-4807-4d9a-8189-601f31287b19 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 1.332621 Jul 25 20:12:50.572092 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 956/1933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:49 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:50.572387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12a864c1-5bf9-4649-aa03-80388591536a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ead0c10>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:50.652726 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12a864c1-5bf9-4649-aa03-80388591536a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1" status: 200 len: 662 microversion: 2.1 time: 0.095471 Jul 25 20:12:50.653336 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 978/1934] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:12:50 2022] GET /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:50.686681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:50.690038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:50.716603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:50.717129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:50.718223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:50.718770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:50.973776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-192897966", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:51.052411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:51.069535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:12:51.079365 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-66b384ad-088a-4453-9afe-60c2da3d493a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1183 microversion: 2.1 time: 0.407028 Jul 25 20:12:51.093994 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 957/1935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:50 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:51.467184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:51.467870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:51.487190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:51.491883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:51.493678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:51.499124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:51.741382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:51.789132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57207452-8cf9-4f55-8470-ad7fa3b11a14 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1276 microversion: 2.1 time: 0.327477 Jul 25 20:12:51.807048 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 958/1936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:51 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1276 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:12:51.818045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:51.818983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:51.835356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:51.836211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:51.837521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:51.838781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.523059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:52.529259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:52.530243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:52.532983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:52.534315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:52.563366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.564253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.565678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.566998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.604351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Getting quotas for project 0f1308036b7a477dbd8d67e93e50bbc9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:52.614532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Getting quotas for user 1c5102a00ef64e38a10d89ecb06d643e and project 0f1308036b7a477dbd8d67e93e50bbc9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:52.633954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:52.637062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:52.666511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:52.691038 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e91b671-b6ae-44cf-b1cb-6df39b67584e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.882212 Jul 25 20:12:52.700212 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 959/1937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:51 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:52.714555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:52.725409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:52.743572 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf006df4-e1ef-459d-92f4-fea403df760c tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774706 Jul 25 20:12:52.753054 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 979/1938] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:12:52.763933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.768975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.774425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.782189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.827152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:52.828351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:52.854920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.855869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:52.856947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:52.857528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:53.126955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:53.152953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f79b9704-caa1-42cf-a341-52a819b9eaf4 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1276 microversion: 2.1 time: 0.332622 Jul 25 20:12:53.174027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 980/1939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:52 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1276 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:53.197028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1252103131", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:53.339698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:12:53.369554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:53.387977 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac042298-5e0b-4e50-b53f-cd39569506e0 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1183 microversion: 2.1 time: 0.686208 Jul 25 20:12:53.397122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 960/1940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:52 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1183 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:53.745375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:53.746005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:53.768375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:53.769091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:53.769950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:53.770729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.000319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:55.601775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:12:55.602333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:12:55.602672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:12:55.603088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:12:55.603510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:12:55.620614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.621081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.621907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.622357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.678655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Getting quotas for project 0f1308036b7a477dbd8d67e93e50bbc9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:12:55.699930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Getting quotas for user 1c5102a00ef64e38a10d89ecb06d643e and project 0f1308036b7a477dbd8d67e93e50bbc9. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:12:55.722323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:12:55.730965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:12:55.831621 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19625782-69b0-4bc8-9ad5-a244ba429210 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.653686 Jul 25 20:12:55.834165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 981/1941] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:12:55.841890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:55.842773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:55.854731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.855517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.856935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.857558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.899899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:55.935833 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-edf5c5a1-3957-4938-9171-fdb3e4d9f92b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 2.190605 Jul 25 20:12:55.938521 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 961/1942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:53 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:12:55.947547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:55.950028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:55.967242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:55.973087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.977908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:55.983725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:55.989033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:56.383017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:56.419053 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03b5bca1-6b9f-41ed-9ad9-4e2a3fbb7ded tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1183 microversion: 2.1 time: 0.475563 Jul 25 20:12:56.420148 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 962/1943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:55 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1183 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:56.429830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e422550c-12e7-4ded-ae5c-9410a18a54e8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:56.450551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e422550c-12e7-4ded-ae5c-9410a18a54e8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:56.705171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e422550c-12e7-4ded-ae5c-9410a18a54e8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:56.717590 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e422550c-12e7-4ded-ae5c-9410a18a54e8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1218 microversion: 2.1 time: 0.296160 Jul 25 20:12:56.737270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 963/1944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:56 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1218 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:56.749324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2d00cbf4-45ec-41a8-a399-3501349226bd req-af61591a-5e73-4c85-8cbc-9a20066f01b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-plugged", "status": "completed", "tag": "56347ae9-a921-4008-abfe-e3172d7a6ef1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:56.774256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2d00cbf4-45ec-41a8-a399-3501349226bd req-af61591a-5e73-4c85-8cbc-9a20066f01b9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:56.777869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2d00cbf4-45ec-41a8-a399-3501349226bd req-af61591a-5e73-4c85-8cbc-9a20066f01b9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:56.796009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:56.804643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aed38d2b-dfea-48a7-bca4-9c3e004563d7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.969076 Jul 25 20:12:56.805252 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 982/1945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:55 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:56.810387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2d00cbf4-45ec-41a8-a399-3501349226bd req-af61591a-5e73-4c85-8cbc-9a20066f01b9 service nova] Creating event network-vif-plugged:56347ae9-a921-4008-abfe-e3172d7a6ef1 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:56.821891 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2d00cbf4-45ec-41a8-a399-3501349226bd req-af61591a-5e73-4c85-8cbc-9a20066f01b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083048 Jul 25 20:12:56.824897 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 964/1946] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:56.963992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:56.964647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:56.978030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:56.978473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:56.979492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:56.980160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.442356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:57.443751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:57.468468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.469323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.471968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.472660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.682539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:57.689074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:12:57.704652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:57.731137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d4d1eaa-99f6-4f08-a00c-b3853e600156 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.771320 Jul 25 20:12:57.731843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 983/1947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:56 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:57.736525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b7099ff-d461-4b66-a828-5bcb7e3ebbc5 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1183 microversion: 2.1 time: 0.296057 Jul 25 20:12:57.740416 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 965/1948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:57 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:57.749746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:57.750370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:57.772730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.783367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.788567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.792124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.852519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:57.854161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:57.883084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.890854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:57.895051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:57.896327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:58.807743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:58.827477 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de3eec93-9bea-4bc5-ab85-477c8e3f2be9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1270 microversion: 2.1 time: 1.076434 Jul 25 20:12:58.842714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 984/1949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:57 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1270 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:58.851832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:58.854022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:58.871061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:58.871521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:58.872361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:58.874597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.556165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:59.568536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9773041-87be-4d0e-9ce3-aed4f439b2b9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 1.721099 Jul 25 20:12:59.589592 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 966/1950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:57 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:59.597645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:59.598514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:59.606200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:59.606847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.607857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:59.608538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.720284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:59.733846 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7fec268-560b-4399-bae0-c9904584e8d5 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 0.886153 Jul 25 20:12:59.734948 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 985/1951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:58 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:12:59.748376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-plugged", "status": "completed", "tag": "772df191-de7f-4858-a731-c1384f136652"}, {"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-plugged", "status": "completed", "tag": "b436f454-000b-467a-b0dd-717437df22bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:12:59.760528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:59.761441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.790814 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] Creating event network-vif-plugged:772df191-de7f-4858-a731-c1384f136652 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:59.792351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] Creating event network-vif-plugged:b436f454-000b-467a-b0dd-717437df22bd for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:12:59.814784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2d77bb7d-658b-4261-a72d-eeeff5ecc0a8 req-c593f44c-8be6-4a88-8b2a-cb2ab3c0c09f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078363 Jul 25 20:12:59.824423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 986/1952] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:12:59.851006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:12:59.851714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:12:59.868164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:59.882114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.885465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:12:59.887314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:12:59.893123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:12:59.901557 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48a835f6-2796-4ec4-94fe-3708459556d6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 200 len: 1183 microversion: 2.1 time: 0.308310 Jul 25 20:12:59.909460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 967/1953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:59 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 1183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:00.228397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:00.250898 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-958055f5-362c-4325-96c0-244d83f87e15 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1276 microversion: 2.1 time: 0.400933 Jul 25 20:13:00.256090 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 987/1954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:12:59 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1276 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:00.586621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d85c0c19-6c3a-41a8-a6e8-1bad618dc6dd req-8a8b1f4f-71a4-4efa-8405-4c17fb91f30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50528281-7811-4a63-b92e-7a1b2647a757", "tag": "7864bfc9-df39-46a3-a6dd-5a1773b076cd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:00.593443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:00.598637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:00.631533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.632424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.633982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.638276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.644256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d85c0c19-6c3a-41a8-a6e8-1bad618dc6dd req-8a8b1f4f-71a4-4efa-8405-4c17fb91f30c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.649883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d85c0c19-6c3a-41a8-a6e8-1bad618dc6dd req-8a8b1f4f-71a4-4efa-8405-4c17fb91f30c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.694173 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d85c0c19-6c3a-41a8-a6e8-1bad618dc6dd req-8a8b1f4f-71a4-4efa-8405-4c17fb91f30c service nova] Creating event network-changed:7864bfc9-df39-46a3-a6dd-5a1773b076cd for instance 50528281-7811-4a63-b92e-7a1b2647a757 on n-h1-845775-3 Jul 25 20:13:00.733275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d85c0c19-6c3a-41a8-a6e8-1bad618dc6dd req-8a8b1f4f-71a4-4efa-8405-4c17fb91f30c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150427 Jul 25 20:13:00.758308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 968/1955] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:00.779502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:00.785010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:00.806946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.810179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:00.814928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:00.815670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.404956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:01.421619 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e058643b-d2e1-4da3-bfdb-79b6b0603afc tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.828323 Jul 25 20:13:01.426116 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 988/1956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:00 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:01.444114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:01.446818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: 483f7b8c-bc4b-4d97-8176-dfa0e2f21801] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:01.474400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.475392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.478387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.479499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.528152 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] HTTP exception thrown: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Request method failure captured: Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 HTTP/1.1 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vc3fQVtHUmzOeDSDRZ6HMFtrnSEVvOsaWTcRLMqdvK3yVW5vYE5TEzbBbPMaNDeZuZz5zePxzbUqdRpNnR83a2Q-eTqkdJEcwws4J9yE9KtBwxiNOP8kdJMqZtIB-qu7b7EJVMFgpBsmdYDX_u6zOAshXwkHAb_Mpa-IXDweHR2_SU Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:13:01.530528 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b920e56f4052452a8f53673b16d2c370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}] Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveMigrationTest-68048607 Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1d0f300b7de441108c3efcee70e8f920 Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. Jul 25 20:13:01.533545 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '483f7b8c-bc4b-4d97-8176-dfa0e2f21801'} Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:01.535160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. Jul 25 20:13:01.537352 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:01.540729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Returning 404 to user: Instance 483f7b8c-bc4b-4d97-8176-dfa0e2f21801 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:01.540729 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da970b90-5a8d-4f02-9ab5-58095bd6333f tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801" status: 404 len: 111 microversion: 2.1 time: 0.104095 Jul 25 20:13:01.540729 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 989/1957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:01 2022] GET /compute/v2.1/servers/483f7b8c-bc4b-4d97-8176-dfa0e2f21801 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:13:01.552224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e10f9be1-a43a-4ca6-bc6a-4ba7f405aa52 req-07c0ebf9-d266-436a-92f2-8a8cb43c0fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:01.580163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e10f9be1-a43a-4ca6-bc6a-4ba7f405aa52 req-07c0ebf9-d266-436a-92f2-8a8cb43c0fdd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.580545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e10f9be1-a43a-4ca6-bc6a-4ba7f405aa52 req-07c0ebf9-d266-436a-92f2-8a8cb43c0fdd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.607008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e10f9be1-a43a-4ca6-bc6a-4ba7f405aa52 req-07c0ebf9-d266-436a-92f2-8a8cb43c0fdd service nova] Creating event network-changed:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:13:01.623944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e10f9be1-a43a-4ca6-bc6a-4ba7f405aa52 req-07c0ebf9-d266-436a-92f2-8a8cb43c0fdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083328 Jul 25 20:13:01.625162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 990/1958] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:01.637153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:01.638125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:01.661393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.663642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.667817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:01.668583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:01.968405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:01.986294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9963cbda-4551-4e73-bec7-d34fb0b13355 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1276 microversion: 2.1 time: 0.341160 Jul 25 20:13:01.987164 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 991/1959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:01 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1276 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:02.459400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:02.459962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:02.471255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:02.471917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:02.473753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:02.474465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:03.722515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:03.746729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d0d2a41-c00e-4e16-a76c-82678ea92b9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1355 microversion: 2.1 time: 2.986179 Jul 25 20:13:03.748701 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 969/1960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:00 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1355 bytes in 2989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:03.757043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:03.757937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:03.766189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:03.780781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:03.784339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:03.788892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:04.975487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:05.017389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b5d14e1-2478-4a81-a34f-619ec6dfe9bd tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 2.559886 Jul 25 20:13:05.021528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 992/1961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:02 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:05.049821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:05.052282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:05.081635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:05.084071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:05.088330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:05.088801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:05.654764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:05.709353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:05.792328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:05.839521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10880cd1-1eef-4750-9297-b8b9439788dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 2.088892 Jul 25 20:13:05.840334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 970/1962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:03 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:06.038148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:06.048523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.052160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.058571 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8d5610c-5057-42b2-b0c6-e6d1c8c0a1f4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1805 microversion: 2.1 time: 1.034853 Jul 25 20:13:06.063033 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 993/1963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:05 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1805 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:06.074655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.077181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.079824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.080960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.088326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.089301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.100919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:06.122387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.125343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.128328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.132400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.192850 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f9816ac-91da-4622-b919-0310e971be56 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021/ips" status: 200 len: 218 microversion: 2.1 time: 0.111137 Jul 25 20:13:06.194160 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 994/1964] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:13:06 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021/ips => generated 218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:13:06.211415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.212709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.226846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.232893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.233980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.240864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.290373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:13:06.496195 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54fe4137-7dc4-4a0a-9a98-f918f56d6f7a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 204 len: 0 microversion: 2.1 time: 0.289980 Jul 25 20:13:06.501399 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 995/1965] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:13:06 2022] DELETE /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:13:06.518471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.520170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.551101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.551453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.552297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.552744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.646725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:06.656024 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c38782bd-cd6c-43ad-a8fd-4a08b227b7c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.615811 Jul 25 20:13:06.677481 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 971/1966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:06 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:06.690791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-178ea65b-d74c-44c2-8894-a9fde9ebd1df req-04b9415c-0a4e-4428-afa4-8c4e92705f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab1754d-5d46-4ace-bc70-b6c00bf08b99", "tag": "707a75e3-3d04-4fab-b129-8ae3088e09f1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:06.721610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:06.724714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-178ea65b-d74c-44c2-8894-a9fde9ebd1df req-04b9415c-0a4e-4428-afa4-8c4e92705f10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.730136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-178ea65b-d74c-44c2-8894-a9fde9ebd1df req-04b9415c-0a4e-4428-afa4-8c4e92705f10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.749209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-178ea65b-d74c-44c2-8894-a9fde9ebd1df req-04b9415c-0a4e-4428-afa4-8c4e92705f10 service nova] Creating event network-changed:707a75e3-3d04-4fab-b129-8ae3088e09f1 for instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 on n-h1-845775-3 Jul 25 20:13:06.756205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-178ea65b-d74c-44c2-8894-a9fde9ebd1df req-04b9415c-0a4e-4428-afa4-8c4e92705f10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077247 Jul 25 20:13:06.765989 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 972/1967] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:06.862264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:06.864731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:06.879782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.880455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:06.886521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:06.887312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:07.437347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:07.452017 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92e43153-f32b-4e6e-9802-eceeba1da942 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1811 microversion: 2.1 time: 0.944560 Jul 25 20:13:07.465373 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 996/1968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:06 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1811 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:07.687363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:07.688799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:07.722092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:07.725805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:07.732737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:07.734982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:07.754932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:07.768972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2defb090-082c-4bc7-831e-f903e18ea3c0 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.910734 Jul 25 20:13:07.781441 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 973/1969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:06 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:08.482966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:08.484499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:08.498950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.499741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:08.500766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.503319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:08.549997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:08.561862 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2ea5c24-d615-4564-be50-ff3c35a83665 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.879604 Jul 25 20:13:08.564394 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 997/1970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:07 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:08.802691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:08.803571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:08.829135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.830579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:08.831402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:08.833988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.163469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:09.170994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:09.200297 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-920dada1-5531-43ce-942b-9998b07856d1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1811 microversion: 2.1 time: 0.721234 Jul 25 20:13:09.208863 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 974/1971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:08 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1811 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:09.387696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:09.400143 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6dcad34e-2c0c-4b86-b8f0-63064aabab41 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.601897 Jul 25 20:13:09.406696 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 998/1972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:08 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:09.593532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b2a2dec4-566f-4fb1-8f7b-3a890435bcc8 req-03094836-c1c5-4f9d-b968-14ea5bad3855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-plugged", "status": "completed", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:09.600801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:09.609351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:09.658279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b2a2dec4-566f-4fb1-8f7b-3a890435bcc8 req-03094836-c1c5-4f9d-b968-14ea5bad3855 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.658680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.659413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.660994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.661609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b2a2dec4-566f-4fb1-8f7b-3a890435bcc8 req-03094836-c1c5-4f9d-b968-14ea5bad3855 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.666284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.696334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b2a2dec4-566f-4fb1-8f7b-3a890435bcc8 req-03094836-c1c5-4f9d-b968-14ea5bad3855 service nova] Creating event network-vif-plugged:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:13:09.705021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b2a2dec4-566f-4fb1-8f7b-3a890435bcc8 req-03094836-c1c5-4f9d-b968-14ea5bad3855 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117709 Jul 25 20:13:09.710445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 999/1973] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:09.833294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:09.834297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:09.878548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.879318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:09.905164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:09.905988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:10.040784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:13:10.160092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:10.298140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-894fe463-460c-445e-87c5-0d20e3579478 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 204 len: 0 microversion: 2.1 time: 0.477327 Jul 25 20:13:10.305072 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1000/1974] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:13:09 2022] DELETE /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:13:10.324272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:10.325608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:10.341413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:10.342866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:10.348673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:10.353040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:11.191852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:11.209720 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c3f9a4fc-0ab0-469b-a522-f51740a35674 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 1.627692 Jul 25 20:13:11.229655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 975/1975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:09 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:11.238696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:11.245654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:11.268648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:11.270880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:11.277926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:11.278852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:11.982287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:12.026434 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0e5e68b-c3b6-41e4-8ceb-cd0c1377fc69 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1790 microversion: 2.1 time: 1.712092 Jul 25 20:13:12.028845 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1001/1976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:10 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1790 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:12.046248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:12.055849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:12.072261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.072895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.076656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.077144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.577910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:12.600012 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96f4f3d6-fa4b-4c56-9df0-e50d2291723c tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1668 microversion: 2.1 time: 1.363658 Jul 25 20:13:12.600753 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 976/1977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:11 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1668 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:12.632097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-967949cd-caff-421c-8421-66bbe9ae65db req-f67ba531-9320-4de8-b58d-c65e0a781af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-deleted", "tag": "b436f454-000b-467a-b0dd-717437df22bd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:12.685888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-967949cd-caff-421c-8421-66bbe9ae65db req-f67ba531-9320-4de8-b58d-c65e0a781af3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.686341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-967949cd-caff-421c-8421-66bbe9ae65db req-f67ba531-9320-4de8-b58d-c65e0a781af3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.718569 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-967949cd-caff-421c-8421-66bbe9ae65db req-f67ba531-9320-4de8-b58d-c65e0a781af3 service nova] Creating event network-vif-deleted:b436f454-000b-467a-b0dd-717437df22bd for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:13:12.730472 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-967949cd-caff-421c-8421-66bbe9ae65db req-f67ba531-9320-4de8-b58d-c65e0a781af3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108613 Jul 25 20:13:12.731328 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 977/1978] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:12.760598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-unplugged", "status": "completed", "tag": "56347ae9-a921-4008-abfe-e3172d7a6ef1"}, {"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-unplugged", "status": "completed", "tag": "772df191-de7f-4858-a731-c1384f136652"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:12.804244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.805304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.834189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] Creating event network-vif-unplugged:56347ae9-a921-4008-abfe-e3172d7a6ef1 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:13:12.834970 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] Creating event network-vif-unplugged:772df191-de7f-4858-a731-c1384f136652 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:13:12.845423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ac79df15-352d-460d-8274-1f53cd817e15 req-754eac90-3b25-4cf5-bdcf-e0488c4a1dce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.110737 Jul 25 20:13:12.846961 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 978/1979] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:12.855817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:12.856990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:12.877403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.878377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:12.879902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:12.880544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.072928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:13.125322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f21a383-cdb2-48ac-91c4-bc08cac86bd3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 1.095130 Jul 25 20:13:13.130868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1002/1980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:12 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:13.150985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:13.152026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:13.163295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.164237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.165423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.166340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.501495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:13.510299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12b68182-0aa1-459b-9afc-d86ebb7f1cf5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.660710 Jul 25 20:13:13.522144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 979/1981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:12 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:13.533193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:13.547197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9eaeb0a6-5a54-4b8c-9fed-0a82f6e01cf2 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1675 microversion: 2.1 time: 0.401097 Jul 25 20:13:13.549833 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1003/1982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:13 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1675 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:13.627225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:13.627887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:13.639040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.639810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:13.645247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:13.645980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.154422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:14.155510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:14.177377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.177840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.186149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.188097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.403364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:14.421638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-352b1851-5b0f-4717-8694-3a2972638d4e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1668 microversion: 2.1 time: 0.797785 Jul 25 20:13:14.443921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 980/1983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:13 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1668 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:14.546344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:14.547914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:14.561826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.571028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.575146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.575883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.850483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:14.869690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd88a25d-5c16-401f-b67b-90e134945d46 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.720694 Jul 25 20:13:14.871561 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1004/1984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:14 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:14.882819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:14.882819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:14.892727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.893248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:14.894654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:14.895835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.395794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:15.406444 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c4b446d4-87d2-4455-b044-d19960cac1cb tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.866359 Jul 25 20:13:15.412491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 981/1985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:14 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:15.425876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6701806d-71e3-4460-b799-8427eb93874c req-70fcde97-7221-43d3-846e-f06654cf2cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-deleted", "tag": "772df191-de7f-4858-a731-c1384f136652"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:15.450530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6701806d-71e3-4460-b799-8427eb93874c req-70fcde97-7221-43d3-846e-f06654cf2cd7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.453290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6701806d-71e3-4460-b799-8427eb93874c req-70fcde97-7221-43d3-846e-f06654cf2cd7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.468257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6701806d-71e3-4460-b799-8427eb93874c req-70fcde97-7221-43d3-846e-f06654cf2cd7 service nova] Creating event network-vif-deleted:772df191-de7f-4858-a731-c1384f136652 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:13:15.486881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6701806d-71e3-4460-b799-8427eb93874c req-70fcde97-7221-43d3-846e-f06654cf2cd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072500 Jul 25 20:13:15.487735 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 982/1986] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:15.494949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e3953cd5-9edf-492d-bee7-ac2ae9071e4f req-838943d7-a3f4-4bae-8394-3c8172eb1eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50528281-7811-4a63-b92e-7a1b2647a757", "name": "network-vif-plugged", "status": "completed", "tag": "7864bfc9-df39-46a3-a6dd-5a1773b076cd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:15.516216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e3953cd5-9edf-492d-bee7-ac2ae9071e4f req-838943d7-a3f4-4bae-8394-3c8172eb1eda service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.518039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e3953cd5-9edf-492d-bee7-ac2ae9071e4f req-838943d7-a3f4-4bae-8394-3c8172eb1eda service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.553727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e3953cd5-9edf-492d-bee7-ac2ae9071e4f req-838943d7-a3f4-4bae-8394-3c8172eb1eda service nova] Creating event network-vif-plugged:7864bfc9-df39-46a3-a6dd-5a1773b076cd for instance 50528281-7811-4a63-b92e-7a1b2647a757 on n-h1-845775-3 Jul 25 20:13:15.576335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e3953cd5-9edf-492d-bee7-ac2ae9071e4f req-838943d7-a3f4-4bae-8394-3c8172eb1eda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086215 Jul 25 20:13:15.579401 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 983/1987] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:15.584019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:15.618409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bc8c7dd3-9bbc-4767-92c9-3d3f4192fef1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1654 microversion: 2.1 time: 0.741344 Jul 25 20:13:15.637709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:15.639004 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1005/1988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:14 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1654 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:15.640319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:15.652424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.653248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.663408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.663910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.676696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0ee9ae1a-2fc7-4197-9c23-34b3173b5ced req-9277a476-390c-4873-a6cf-e08596c29206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae29a5e1-d80c-45f5-b11f-514b6cf29926", "name": "network-vif-deleted", "tag": "b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:15.726869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0ee9ae1a-2fc7-4197-9c23-34b3173b5ced req-9277a476-390c-4873-a6cf-e08596c29206 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.729719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0ee9ae1a-2fc7-4197-9c23-34b3173b5ced req-9277a476-390c-4873-a6cf-e08596c29206 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.755288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0ee9ae1a-2fc7-4197-9c23-34b3173b5ced req-9277a476-390c-4873-a6cf-e08596c29206 service nova] Creating event network-vif-deleted:b6f7ee29-324a-4c4c-82e9-feaf6c8e1ca9 for instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 on n-h2-845775-3 Jul 25 20:13:15.778639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0ee9ae1a-2fc7-4197-9c23-34b3173b5ced req-9277a476-390c-4873-a6cf-e08596c29206 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106405 Jul 25 20:13:15.781241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1006/1989] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:15.901454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:15.902378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:15.920141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.921301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:15.922571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:15.923237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.045688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:16.076286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01cbdec0-f9bc-45b7-8b94-12882ac3259d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 200 len: 1600 microversion: 2.1 time: 0.482344 Jul 25 20:13:16.079035 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 984/1990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:15 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 1600 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:16.271351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:16.282619 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2bc7eccb-2521-4872-8706-0c04dac52647 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.388529 Jul 25 20:13:16.296118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1007/1991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:15 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:16.443669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:16.444958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:16.458662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:16.459974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.461596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:16.462351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.649581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:16.650938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:16.665024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:16.665652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.666753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:16.668550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.764716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:16.764943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:16.765588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:16.766198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lazy-loading 'fault' on Instance uuid 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:13:16.781348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-428fd05a-d2da-4ca8-93a7-57f0080ae1db tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.343527 Jul 25 20:13:16.785716 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 985/1992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:16 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:16.854885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:16.868402 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c25f7ac2-2b98-40b1-86f7-27088b5d9581 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 200 len: 1303 microversion: 2.1 time: 0.224132 Jul 25 20:13:16.869551 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1008/1993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:16 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:17.103037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:17.104473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: ae29a5e1-d80c-45f5-b11f-514b6cf29926] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:17.123215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=76 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:17.128719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.129641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.130778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.132520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.156592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] HTTP exception thrown: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Request method failure captured: Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 HTTP/1.1 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vc3fQVtHUmzOeDSDRZ6HMFtrnSEVvOsaWTcRLMqdvK3yVW5vYE5TEzbBbPMaNDeZuZz5zePxzbUqdRpNnR83a2Q-eTqkdJEcwws4J9yE9KtBwxiNOP8kdJMqZtIB-qu7b7EJVMFgpBsmdYDX_u6zOAshXwkHAb_Mpa-IXDweHR2_SU Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:13:17.163636 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b920e56f4052452a8f53673b16d2c370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}] Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveMigrationTest-68048607 Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 1d0f300b7de441108c3efcee70e8f920 Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. Jul 25 20:13:17.165806 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ae29a5e1-d80c-45f5-b11f-514b6cf29926'} Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:17.166745 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. Jul 25 20:13:17.168084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.172474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Returning 404 to user: Instance ae29a5e1-d80c-45f5-b11f-514b6cf29926 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:17.174432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5fb539e1-ea6f-409a-9136-72a2c1dcd43b tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926" status: 404 len: 111 microversion: 2.1 time: 0.078511 Jul 25 20:13:17.176235 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 986/1994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:17 2022] GET /compute/v2.1/servers/ae29a5e1-d80c-45f5-b11f-514b6cf29926 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:13:17.188491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed0389e4-deec-4b85-b4eb-c493a9e03219 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '.version_select at 0x7f196eaa5e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:17.233492 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed0389e4-deec-4b85-b4eb-c493a9e03219 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217502462" status: 202 len: 0 microversion: 2.1 time: 0.052771 Jul 25 20:13:17.234130 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1009/1995] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217502462 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:13:17.306178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:17.306844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:17.322374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.323068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.324211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.324900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.534102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ca7714e4-94d8-45ae-bad4-17a4e2cb0c6e req-1a91263d-71fa-40f9-9c65-c84e8f304bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b59dc5-ee2b-470f-aa3e-6eb4162c3021", "name": "network-vif-deleted", "tag": "56347ae9-a921-4008-abfe-e3172d7a6ef1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:17.554531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca7714e4-94d8-45ae-bad4-17a4e2cb0c6e req-1a91263d-71fa-40f9-9c65-c84e8f304bc2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.554855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca7714e4-94d8-45ae-bad4-17a4e2cb0c6e req-1a91263d-71fa-40f9-9c65-c84e8f304bc2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.583341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ca7714e4-94d8-45ae-bad4-17a4e2cb0c6e req-1a91263d-71fa-40f9-9c65-c84e8f304bc2 service nova] Creating event network-vif-deleted:56347ae9-a921-4008-abfe-e3172d7a6ef1 for instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 on n-h1-845775-3 Jul 25 20:13:17.598175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ca7714e4-94d8-45ae-bad4-17a4e2cb0c6e req-1a91263d-71fa-40f9-9c65-c84e8f304bc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068053 Jul 25 20:13:17.599057 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1010/1996] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:17.763969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:17.776636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dec5e9c-1a1a-4285-ae55-7e7638f09dcb tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.475554 Jul 25 20:13:17.780056 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 987/1997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:17 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:17.819392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:17.821140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:17.822160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2c1c38b5-e5c8-43c9-abcd-025e646bbf10 req-a7c06196-b61d-4578-9dd4-253bc8d41920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1754d-5d46-4ace-bc70-b6c00bf08b99", "name": "network-vif-plugged", "status": "completed", "tag": "707a75e3-3d04-4fab-b129-8ae3088e09f1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:17.837265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.846278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.846946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2c1c38b5-e5c8-43c9-abcd-025e646bbf10 req-a7c06196-b61d-4578-9dd4-253bc8d41920 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.847442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2c1c38b5-e5c8-43c9-abcd-025e646bbf10 req-a7c06196-b61d-4578-9dd4-253bc8d41920 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.848990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.854238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.874570 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2c1c38b5-e5c8-43c9-abcd-025e646bbf10 req-a7c06196-b61d-4578-9dd4-253bc8d41920 service nova] Creating event network-vif-plugged:707a75e3-3d04-4fab-b129-8ae3088e09f1 for instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 on n-h1-845775-3 Jul 25 20:13:17.882319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2c1c38b5-e5c8-43c9-abcd-025e646bbf10 req-a7c06196-b61d-4578-9dd4-253bc8d41920 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064082 Jul 25 20:13:17.883274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 988/1998] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:13:17.916181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:17.917113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:17.945178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.945705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.946643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:17.947159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:17.986352 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 HTTP/1.1 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:13:17.989349 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:13:17.990655 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '25b59dc5-ee2b-470f-aa3e-6eb4162c3021'} Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:17.994699 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:13:17.996183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:17.997350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:17.997350 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c0eeca8-a38f-4a58-9f96-c525121623b7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 404 len: 111 microversion: 2.1 time: 0.083090 Jul 25 20:13:18.004520 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 989/1999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:17 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:13:18.379627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:18.388235 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79fa7aa2-4a79-432d-82e1-c5ccbb642bd6 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1318 microversion: 2.1 time: 0.575098 Jul 25 20:13:18.402475 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1011/2000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:17 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:18.807054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:18.807748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:18.823847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:18.833373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:18.834229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:18.834671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:19.411774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:19.416251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:19.441594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:19.446361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:19.447089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:19.448405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:19.455146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae308bc0-12a0-4554-a3eb-05b0c54ae377 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1318 microversion: 2.1 time: 0.651850 Jul 25 20:13:19.457306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 990/2001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:18 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:19.458564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:20.122997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:20.158777 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f6071b2a-ca67-48d3-8c0b-b94280794caa tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1468 microversion: 2.1 time: 0.753307 Jul 25 20:13:20.159389 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1012/2002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:19 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1468 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:20.479395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:20.480355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:20.497393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:20.502520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:20.503642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:20.506222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:20.937990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1677242767", "block_migration": true, "disk_over_commit": false}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:20.942647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:20.980877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:20.983145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:20.985902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:20.986533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.056972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lazy-loading 'flavor' on Instance uuid 50528281-7811-4a63-b92e-7a1b2647a757 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:13:21.086316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Going to try to live migrate instance to tempest-host-1677242767 {{(pid=119723) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:13:21.114915 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] HTTP exception thrown: Compute host tempest-host-1677242767 could not be found. Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Request method failure captured: Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757/action HTTP/1.1 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 107 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vk6ikOofBVSo9z3OPfQXNFTtwLO_q9-q1_Pwmxf4klXI01RPAEFUVoQvSwY-19Qai8fJOGAxG12zfNpSqi7fj_4NB2X7nl9jtRGsNO9MSc9Vuz2f9yAwSx_ZOFdKPE9XHYHoxz0xvvYoWCcUkyaw_c9GBOqZ5LaXEzqWCr44wMdhgI Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6badc3429c214b358226e838f68b2d26 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:13:21.127468 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6badc3429c214b358226e838f68b2d26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6badc3429c214b358226e838f68b2d26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6badc3429c214b358226e838f68b2d26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6badc3429c214b358226e838f68b2d26"}]}] Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6badc3429c214b358226e838f68b2d26 Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveMigrationNegativeTest-310040334-project-admin Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9e3405ca546f455d91ba25cea86dc50b Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveMigrationNegativeTest-310040334-project-admin Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: {"os-migrateLive": {"host": "tempest-host-1677242767", "block_migration": true, "disk_over_commit": false}} Jul 25 20:13:21.129310 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: exception: Compute host tempest-host-1677242767 could not be found. Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '50528281-7811-4a63-b92e-7a1b2647a757', 'body': {'os-migrateLive': {'host': 'tempest-host-1677242767', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:13:21.130062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1677242767 could not be found. Jul 25 20:13:21.131011 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1677242767 could not be found. Jul 25 20:13:21.132510 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1677242767 could not be found. Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Returning 400 to user: Compute host tempest-host-1677242767 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:21.133562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1bf16f29-8d10-4486-947a-bef91b899cab tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757/action" status: 400 len: 100 microversion: 2.1 time: 0.950741 Jul 25 20:13:21.136940 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 991/2003] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Jul 25 20:13:20 2022] POST /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757/action => generated 100 bytes in 956 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:13:21.160283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:21.161094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:21.180385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.181567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.185076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.187763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.315264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:13:21.500281 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9c5ed45-d477-4226-848d-87fd85eb8a7a tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 204 len: 0 microversion: 2.1 time: 0.359801 Jul 25 20:13:21.501588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 992/2004] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:13:21 2022] DELETE /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:13:21.512522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:21.515092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:21.533798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.535624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.538305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.539026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.688795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:21.711001 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c44a9ca7-7646-430f-8406-93ba126a9769 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1468 microversion: 2.1 time: 1.232854 Jul 25 20:13:21.713395 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1013/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:20 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1468 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:21.741799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:21.744117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:21.788265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.790878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:21.817458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:21.818394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:22.471134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:22.483930 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e264a750-165c-4a5e-a69e-8c2b44e4ea71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1468 microversion: 2.1 time: 0.980796 Jul 25 20:13:22.485332 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 993/2006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:21 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1468 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:22.491308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:22.492297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:22.499111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:22.499873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:22.500902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:22.501574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:22.507455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:22.619784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:22.647014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4a81b23-641c-4abe-9815-97b08aaa9bc3 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1484 microversion: 2.1 time: 0.932215 Jul 25 20:13:22.647795 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1014/2007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:21 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1484 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:22.757756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1507428871", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:22.884349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:13:22.943666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:22.958081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9576f3a7-46f2-4652-8a9e-9327bdfaa3ca tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1467 microversion: 2.1 time: 0.471064 Jul 25 20:13:22.958862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 994/2008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:22 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:22.981830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-794677166"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:22.986684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:23.012535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.013307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:23.014664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.017947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:23.349490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:13:23.351234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:13:23.352834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:13:23.353597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:13:23.354434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:13:23.373137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.373872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:23.374936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.375521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:23.414249 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b378f5e9-b2c1-43e4-81b6-7f21a8525104 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "POST /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc/action" status: 202 len: 0 microversion: 2.1 time: 0.435701 Jul 25 20:13:23.416114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Getting quotas for project 0c84f0a7d4bd49cbb32d19bc4c2d19b2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:13:23.416681 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 995/2009] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:13:22 2022] POST /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 20:13:23.432968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Getting quotas for user 1588f90fd6444050bf26cd0b07eb1f26 and project 0c84f0a7d4bd49cbb32d19bc4c2d19b2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:13:23.436876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d64b188-b4a4-4880-864e-333300ec265a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f19694a7280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:23.497823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:13:23.501978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:13:23.516014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d64b188-b4a4-4880-864e-333300ec265a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.086635 Jul 25 20:13:23.517510 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 996/2010] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:23 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:23.579468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6791315-8f91-4e1f-9991-db5520723b3a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825090 Jul 25 20:13:23.580731 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1015/2011] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:13:23.591966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11cf68bc-ac37-42e9-b523-feb9ccc2db25 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:23.592984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11cf68bc-ac37-42e9-b523-feb9ccc2db25 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:23.686946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:23.696078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:23.703258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11cf68bc-ac37-42e9-b523-feb9ccc2db25 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:23.716000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11cf68bc-ac37-42e9-b523-feb9ccc2db25 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1219 microversion: 2.1 time: 0.127604 Jul 25 20:13:23.717252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 997/2012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:23 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:23.720182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.720633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:23.721437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:23.721913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:24.119896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:24.132187 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad382376-294f-44bd-98ae-070335b6f92d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1484 microversion: 2.1 time: 0.452468 Jul 25 20:13:24.136648 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1016/2013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:23 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1484 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:24.549236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbe49fad-8eb9-4e10-a186-892d7af62572 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb57280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:24.709217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbe49fad-8eb9-4e10-a186-892d7af62572 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.167500 Jul 25 20:13:24.716740 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 998/2014] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:24 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:24.743786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:24.747338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:24.798611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:24.800196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:24.809536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:24.810649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:25.170703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:25.171919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:25.184740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:25.187170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:25.190141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:25.204415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:25.523209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:25.536667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d1d70ec-0ea5-4970-8b5c-f18ecb09ea74 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1223 microversion: 2.1 time: 0.798155 Jul 25 20:13:25.544294 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1017/2015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:24 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1223 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:25.548626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:25.568875 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18a8f12d-c849-4c50-a326-4e8c90044e0e tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1442 microversion: 2.1 time: 0.402655 Jul 25 20:13:25.594701 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 999/2016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:25 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1442 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:25.751243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a7ff2e8-fad5-472b-8fce-f51c0246ed97 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eae4f70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:25.879361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-377ef91d-5ed5-42d7-9299-b71a45165b53 req-6d1f6e43-53bd-4b73-9368-326acf0e3ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c574d5-8512-4c01-85f3-013f9050d763", "name": "network-vif-deleted", "tag": "92810ae3-f142-4457-8473-eea7b8998454"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:25.899612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a7ff2e8-fad5-472b-8fce-f51c0246ed97 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.161573 Jul 25 20:13:25.904682 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1018/2017] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:25 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:25.911991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-377ef91d-5ed5-42d7-9299-b71a45165b53 req-6d1f6e43-53bd-4b73-9368-326acf0e3ee8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:25.912685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-377ef91d-5ed5-42d7-9299-b71a45165b53 req-6d1f6e43-53bd-4b73-9368-326acf0e3ee8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:25.972344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-377ef91d-5ed5-42d7-9299-b71a45165b53 req-6d1f6e43-53bd-4b73-9368-326acf0e3ee8 service nova] Creating event network-vif-deleted:92810ae3-f142-4457-8473-eea7b8998454 for instance d2c574d5-8512-4c01-85f3-013f9050d763 on n-h2-845775-3 Jul 25 20:13:26.001734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-377ef91d-5ed5-42d7-9299-b71a45165b53 req-6d1f6e43-53bd-4b73-9368-326acf0e3ee8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145582 Jul 25 20:13:26.006221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1000/2018] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:26.568153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:26.569065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:26.596679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:26.599738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:26.618772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:26.619932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:26.623583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:26.625909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:26.631043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:26.631896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:26.640439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:26.652918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:26.774709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:26.775578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:26.777077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lazy-loading 'fault' on Instance uuid d2c574d5-8512-4c01-85f3-013f9050d763 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:13:26.930158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:26.958341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44e9aca5-3da7-4bfd-a31a-fc931c62fa8d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1277 microversion: 2.1 time: 0.393679 Jul 25 20:13:26.960466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1019/2019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:26 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1277 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:26.967502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9c8ea51-6f35-4461-a299-375eedc599ec tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaade50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:26.983026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:27.015605 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88e2175f-47bb-40b3-91d4-8471077e2400 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 200 len: 1300 microversion: 2.1 time: 0.420652 Jul 25 20:13:27.019508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1001/2020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:26 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 1300 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:27.083406 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9c8ea51-6f35-4461-a299-375eedc599ec tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.119101 Jul 25 20:13:27.084486 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1020/2021] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:26 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:27.987122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:27.989140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:28.006425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.007052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.010232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.012242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.057157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:28.057959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: d2c574d5-8512-4c01-85f3-013f9050d763] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:28.086619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.093452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.099933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.101486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.166970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] HTTP exception thrown: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Request method failure captured: Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 HTTP/1.1 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vc3fQVtHUmzOeDSDRZ6HMFtrnSEVvOsaWTcRLMqdvK3yVW5vYE5TEzbBbPMaNDeZuZz5zePxzbUqdRpNnR83a2Q-eTqkdJEcwws4J9yE9KtBwxiNOP8kdJMqZtIB-qu7b7EJVMFgpBsmdYDX_u6zOAshXwkHAb_Mpa-IXDweHR2_SU Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:13:28.168723 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b920e56f4052452a8f53673b16d2c370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}] Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveMigrationTest-68048607 Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1d0f300b7de441108c3efcee70e8f920 Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. Jul 25 20:13:28.171056 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd2c574d5-8512-4c01-85f3-013f9050d763'} Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:28.172711 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. Jul 25 20:13:28.174747 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:13:28.177333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Returning 404 to user: Instance d2c574d5-8512-4c01-85f3-013f9050d763 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:28.177483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f42b07df-42f5-4dd8-8907-1432a023450d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763" status: 404 len: 111 microversion: 2.1 time: 0.135130 Jul 25 20:13:28.181348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1021/2022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:28 2022] GET /compute/v2.1/servers/d2c574d5-8512-4c01-85f3-013f9050d763 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:13:28.189301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7ef459e-ab6c-401d-97c5-e9768c58531a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea50a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:28.310192 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7ef459e-ab6c-401d-97c5-e9768c58531a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.129839 Jul 25 20:13:28.311102 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1022/2023] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:28 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:28.334932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:28.335599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:28.366428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.373905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.376981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.379007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.401823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:28.496750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:13:28.813840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc4f5b01-e0e7-4acc-86c2-80c2ae366bd6 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 204 len: 0 microversion: 2.1 time: 0.489584 Jul 25 20:13:28.814725 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1023/2024] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:13:28 2022] DELETE /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:13:28.839092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:28.839976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:28.851358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:28.856995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.859857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.861031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:28.861535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:28.883718 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b27fea6-8e62-4878-9d39-78440e8f4b8e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.901461 Jul 25 20:13:28.888994 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1002/2025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:27 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:29.346561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b5a3f38-0178-469f-8d89-76eeedd576b9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eacd670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:29.518315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:29.522732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b5a3f38-0178-469f-8d89-76eeedd576b9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.200107 Jul 25 20:13:29.523406 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1003/2026] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:29 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:29.554122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f73bf706-59f2-45e9-bda0-7a6e78fc2e3d tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1499 microversion: 2.1 time: 0.732248 Jul 25 20:13:29.557044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1024/2027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:28 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1499 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:29.933704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:29.934559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:29.955401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:29.957123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:29.959069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:29.959643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:30.577818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c87a762d-f010-436f-88e1-9f741ffe67db tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196972a940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:30.690365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:30.737435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2349406-e341-49a0-b9a5-f68dcad7de49 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.810924 Jul 25 20:13:30.745332 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1004/2028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:29 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:30.754562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c87a762d-f010-436f-88e1-9f741ffe67db tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.219775 Jul 25 20:13:30.763049 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1025/2029] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:30 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:30.775851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:30.789743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:30.829349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:30.832531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:30.837571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:30.841443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:31.619005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:31.635802 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6fe1e8ca-401c-4c94-9b3e-12a02bf6f4eb tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1499 microversion: 2.1 time: 0.885174 Jul 25 20:13:31.637354 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1005/2030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:30 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1499 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:31.649233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:31.652172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:31.667149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:31.667609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:31.672255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:31.672747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:31.889899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1372498960", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "1dc75bc8-6a1d-4286-815a-04492dd5f726"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:32.051715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] validate_networks() for [('1dc75bc8-6a1d-4286-815a-04492dd5f726', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:13:32.720510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:32.757335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0e6b1fc-4cb6-498e-90e1-75134b9b74ca tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.116392 Jul 25 20:13:32.764505 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1006/2031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:31 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:32.775197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-426257d4-8ffb-420c-a948-7c8788215aa2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eae5e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:32.908163 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-426257d4-8ffb-420c-a948-7c8788215aa2 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.141842 Jul 25 20:13:32.911807 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1007/2032] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:32 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:32.933166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:32.937536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:32.964356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:32.973177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:32.974984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:32.976026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:33.399167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:33.472875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:33.714816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:34.331859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:34.408705 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80a7b66f-e70f-42c1-9068-c6d17e7a0c71 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 1.495373 Jul 25 20:13:34.412364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1008/2033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:32 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:34.439508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:34.443665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:34.470650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:34.471418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:34.477503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:34.478939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:34.622652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:34.623685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:34.624608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lazy-loading 'fault' on Instance uuid de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:13:34.888399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0f300b7de441108c3efcee70e8f920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b920e56f4052452a8f53673b16d2c370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:34.903981 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08ffe1c5-1bc3-4690-97c0-8e28b2dda395 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 200 len: 1300 microversion: 2.1 time: 0.489984 Jul 25 20:13:34.910297 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1009/2034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:34 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 1300 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:34.959513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:34.965760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:35.014008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:35.014480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:35.015434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:35.029785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:35.744540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:13:35.745034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:13:35.745587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:13:35.745905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:13:35.746550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:13:35.807714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:35.809195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:35.816421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:35.832920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:35.910076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:13:35.938956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for user 7d3883ad9f7744b5890c8847a4376a94 and project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:13:35.943572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:35.975092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:13:35.979245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:13:36.063820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:36.073078 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-beca0bfd-3ee0-43af-bf27-f62110af11e3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.624837 Jul 25 20:13:36.082249 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1026/2035] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:13:36.095464 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3fe2670-4b8e-4424-8632-4b76f082246c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.179932 Jul 25 20:13:36.099143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e4c537d8-934a-473d-888a-f28e64bb94ac req-f76ace02-af71-473d-9aac-ccfbcb9f9559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-plugged", "status": "completed", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:36.099640 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1010/2036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:34 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:36.126403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-812bbd30-c724-41e4-8e74-0a1224cd02b0 req-712c0e79-9153-46c1-9405-c90232ad7e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de1dfe82-56a6-4f30-b2f5-e40f69d3cba5", "name": "network-vif-deleted", "tag": "2dd8b8db-d9cb-48c4-9b69-d38b9d39629c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:36.151334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e4c537d8-934a-473d-888a-f28e64bb94ac req-f76ace02-af71-473d-9aac-ccfbcb9f9559 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.153290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e4c537d8-934a-473d-888a-f28e64bb94ac req-f76ace02-af71-473d-9aac-ccfbcb9f9559 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.153886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-812bbd30-c724-41e4-8e74-0a1224cd02b0 req-712c0e79-9153-46c1-9405-c90232ad7e1b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.159335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-812bbd30-c724-41e4-8e74-0a1224cd02b0 req-712c0e79-9153-46c1-9405-c90232ad7e1b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.188020 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-812bbd30-c724-41e4-8e74-0a1224cd02b0 req-712c0e79-9153-46c1-9405-c90232ad7e1b service nova] Creating event network-vif-deleted:2dd8b8db-d9cb-48c4-9b69-d38b9d39629c for instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 on n-h2-845775-3 Jul 25 20:13:36.203267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e4c537d8-934a-473d-888a-f28e64bb94ac req-f76ace02-af71-473d-9aac-ccfbcb9f9559 service nova] Creating event network-vif-plugged:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:13:36.204641 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-812bbd30-c724-41e4-8e74-0a1224cd02b0 req-712c0e79-9153-46c1-9405-c90232ad7e1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103484 Jul 25 20:13:36.206195 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1011/2037] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:36.218941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e4c537d8-934a-473d-888a-f28e64bb94ac req-f76ace02-af71-473d-9aac-ccfbcb9f9559 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134508 Jul 25 20:13:36.223435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81c6c62e-1aef-4549-b8ca-7e9efb58cfe1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eacd550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:36.227874 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1027/2038] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:36.240678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:36.243464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:36.265530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.266150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.267089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.267903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.351568 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81c6c62e-1aef-4549-b8ca-7e9efb58cfe1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.143273 Jul 25 20:13:36.354687 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1012/2039] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:36 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:36.362534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:36.368765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] [instance: de1dfe82-56a6-4f30-b2f5-e40f69d3cba5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:36.386002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.387796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.391193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.391831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.438536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] HTTP exception thrown: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Request method failure captured: Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 HTTP/1.1 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vc3fQVtHUmzOeDSDRZ6HMFtrnSEVvOsaWTcRLMqdvK3yVW5vYE5TEzbBbPMaNDeZuZz5zePxzbUqdRpNnR83a2Q-eTqkdJEcwws4J9yE9KtBwxiNOP8kdJMqZtIB-qu7b7EJVMFgpBsmdYDX_u6zOAshXwkHAb_Mpa-IXDweHR2_SU Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:13:36.440942 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b920e56f4052452a8f53673b16d2c370"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b920e56f4052452a8f53673b16d2c370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b920e56f4052452a8f53673b16d2c370"}]}] Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveMigrationTest-68048607 Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: b920e56f4052452a8f53673b16d2c370 Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveMigrationTest-68048607 Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 1d0f300b7de441108c3efcee70e8f920 Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveMigrationTest-68048607-project Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. Jul 25 20:13:36.442237 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'de1dfe82-56a6-4f30-b2f5-e40f69d3cba5'} Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:13:36.442992 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. Jul 25 20:13:36.444053 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:13:36.444978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] Returning 404 to user: Instance de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:13:36.445045 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35c7256f-89c7-47c3-b0be-a4b88636f690 tempest-LiveMigrationTest-68048607 tempest-LiveMigrationTest-68048607-project] 10.222.0.48 "GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5" status: 404 len: 111 microversion: 2.1 time: 0.089243 Jul 25 20:13:36.445563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1013/2040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:36 2022] GET /compute/v2.1/servers/de1dfe82-56a6-4f30-b2f5-e40f69d3cba5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:13:36.474901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-274c9a9a-eba1-4a76-8c2d-af552a290bd6 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:36.480085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-274c9a9a-eba1-4a76-8c2d-af552a290bd6 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:36.860987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-274c9a9a-eba1-4a76-8c2d-af552a290bd6 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:36.873334 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-274c9a9a-eba1-4a76-8c2d-af552a290bd6 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1225 microversion: 2.1 time: 0.419248 Jul 25 20:13:36.892802 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1014/2041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:36 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1225 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:36.916931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:36.917682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:36.935932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.936856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:36.938358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:36.938963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:37.290751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:37.305337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0af5a118-d857-486e-9b4d-0ec7d01cc6e2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 1.075308 Jul 25 20:13:37.308449 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1028/2042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:36 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:37.372291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ce3cc5e-1e87-468d-b641-2a6c4e68d8dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea8f700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:37.477550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ce3cc5e-1e87-468d-b641-2a6c4e68d8dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.111946 Jul 25 20:13:37.489502 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1029/2043] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:37 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:37.684612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:37.700988 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84a9e523-315e-4473-8e74-c1017c6ef38b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.806211 Jul 25 20:13:37.703999 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1015/2044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:36 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:37.733845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-400220525"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:37.738928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:37.751615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:37.753439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:37.755657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:37.756828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:37.901739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:37.904130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:37.963959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:37.964694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:37.968741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:37.970098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:38.271180 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b30945a-dccf-457f-b84b-3b0cfbc0f40d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.538091 Jul 25 20:13:38.277564 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1030/2045] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:13:37 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 20:13:38.307806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-fbc10ed6-3aa5-4ca7-a9ce-34e1baac7a2b req-649ac854-fa7d-44c7-84ae-2f73ace0926d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed6449b-f0e2-4de1-b75e-0f313dea121e", "tag": "0df73111-21fd-408f-b83b-5961e5bd19df"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:38.368524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fbc10ed6-3aa5-4ca7-a9ce-34e1baac7a2b req-649ac854-fa7d-44c7-84ae-2f73ace0926d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:38.369327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fbc10ed6-3aa5-4ca7-a9ce-34e1baac7a2b req-649ac854-fa7d-44c7-84ae-2f73ace0926d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:38.396933 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-fbc10ed6-3aa5-4ca7-a9ce-34e1baac7a2b req-649ac854-fa7d-44c7-84ae-2f73ace0926d service nova] Creating event network-changed:0df73111-21fd-408f-b83b-5961e5bd19df for instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e on n-h1-845775-3 Jul 25 20:13:38.416467 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-fbc10ed6-3aa5-4ca7-a9ce-34e1baac7a2b req-649ac854-fa7d-44c7-84ae-2f73ace0926d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126473 Jul 25 20:13:38.422522 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1031/2046] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:38.433140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:38.443986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:38.444775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:38.461044 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b80b5ecd-a1b4-4acb-bf99-05dbb93f54f2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1277 microversion: 2.1 time: 0.568961 Jul 25 20:13:38.467665 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1016/2047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:37 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1277 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:38.485706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:38.486094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:38.486910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:38.487682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:38.505845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d003671-f9ce-471f-892e-13c11bc3fa30 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f1969530e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:38.670472 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d003671-f9ce-471f-892e-13c11bc3fa30 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.170014 Jul 25 20:13:38.672086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1017/2048] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:38 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:39.395363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-896576223", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b4895b10-4539-47b9-b55b-7b2a376218dd"}, {"uuid": "f072554c-8f26-495c-8769-8f8be7b6b580"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:39.422575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:39.457065 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a04d4716-0907-4a10-83ce-dd7522284df7 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 1.026388 Jul 25 20:13:39.477344 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1032/2049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:38 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:39.531806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:39.533786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:39.555828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:39.563355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:39.565385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:39.566594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:39.635404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] validate_networks() for [('b4895b10-4539-47b9-b55b-7b2a376218dd', None, None, None, None, None), ('f072554c-8f26-495c-8769-8f8be7b6b580', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:13:40.230684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:40.247011 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9194368f-44fa-4a01-b9f3-ac298daf8394 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1283 microversion: 2.1 time: 0.749881 Jul 25 20:13:40.248658 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1033/2050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:39 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1283 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:40.257125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5933c47-8a67-4fb9-9cf8-96fbed42ae9f tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f1969280550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:40.376238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5933c47-8a67-4fb9-9cf8-96fbed42ae9f tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.126004 Jul 25 20:13:40.381523 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1034/2051] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:40 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:40.490532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:40.491467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:40.524682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:40.539710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:40.541420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:40.542216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:42.225246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:13:42.226054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:13:42.226943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:13:42.227826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:13:42.228754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:13:42.278907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:42.279599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:42.280581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:42.281153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:42.290598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:42.309303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4081d511-f2ec-4db6-9a7a-2e961fe97ad9 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 1.820179 Jul 25 20:13:42.332149 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1035/2052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:40 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:42.359716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:42.364249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:42.379199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Getting quotas for project cb643c0372d04a3495e515c2a76a3697. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:13:42.393308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Getting quotas for user 23377768dc934265bf4eb9550084d731 and project cb643c0372d04a3495e515c2a76a3697. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:13:42.395580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:42.401504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:42.404371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:42.410145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:42.414887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:13:42.422539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:13:42.535473 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-67995599-1f56-4f06-9393-8a259616013a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.145717 Jul 25 20:13:42.538868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1018/2053] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:13:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:13:42.584161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bed9811-d36e-4297-96cd-a8f43ca90ba6 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eae55e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:42.726177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:42.796877 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62ea383d-122e-480d-a900-c3ece3cfa60a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1283 microversion: 2.1 time: 0.457335 Jul 25 20:13:42.798180 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1036/2054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:42 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1283 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:42.818328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd668786-b744-4a61-9ff4-3a88eda402fb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:42.825675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd668786-b744-4a61-9ff4-3a88eda402fb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:42.894469 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bed9811-d36e-4297-96cd-a8f43ca90ba6 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.351543 Jul 25 20:13:42.895328 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1019/2055] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:42 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:43.015464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd668786-b744-4a61-9ff4-3a88eda402fb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:43.037434 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd668786-b744-4a61-9ff4-3a88eda402fb tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1212 microversion: 2.1 time: 0.233731 Jul 25 20:13:43.053511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1037/2056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:42 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:43.339488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:43.340138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:43.372336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:43.376549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:43.380742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:43.381595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:43.441973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:43.822396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:43.822995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:43.894005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:43.903027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:43.914484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:43.919802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:43.969637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:43.994787 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f583047-22ea-41e2-8486-b7ce65a7a6c5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.654949 Jul 25 20:13:44.013915 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1020/2057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:43 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:44.063600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9250a994-78b9-41b5-879d-b0f5ab7f72fc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ead51f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:44.270228 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9250a994-78b9-41b5-879d-b0f5ab7f72fc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1452 microversion: 2.1 time: 0.249751 Jul 25 20:13:44.276430 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1021/2058] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:44 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1452 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:44.298957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b9809d6b-382f-4cd5-b9f0-d93a9d442e71 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:44.300955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b9809d6b-382f-4cd5-b9f0-d93a9d442e71 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:44.301375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:44.314975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31c08215-56ec-46b7-acd6-672151a2d8df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1283 microversion: 2.1 time: 0.498368 Jul 25 20:13:44.325266 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1038/2059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:43 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1283 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:44.543551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b9809d6b-382f-4cd5-b9f0-d93a9d442e71 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:44.587047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b9809d6b-382f-4cd5-b9f0-d93a9d442e71 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1212 microversion: 2.1 time: 0.303802 Jul 25 20:13:44.590137 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1022/2060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:44 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1212 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:45.017255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:45.018919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:45.040640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:45.041962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:45.044941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:45.045733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:45.308356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba3defd7-6c38-44bc-a2b9-1ffd6bb14a73 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaf0700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:45.613985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:45.629564 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c75ddbf-2a7d-4b81-a18b-e14d3417120e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.615099 Jul 25 20:13:45.630187 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1039/2061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:45 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:45.693768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:45.695050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:45.717780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:45.719473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:45.722604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:45.723632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:45.870671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:46.038928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:46.053830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-83003d87-92b8-442a-8bf0-aa2c591676ca tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1283 microversion: 2.1 time: 0.417772 Jul 25 20:13:46.058994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1040/2062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:45 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1283 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:46.074067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:46.075691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:46.104372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:46.107368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:46.109526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:46.112342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:46.299367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:46.330332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9229da12-d68b-4ea3-aa6e-fb1a3a1a3fcf tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1272 microversion: 2.1 time: 0.268228 Jul 25 20:13:46.357096 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1041/2063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:46 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:46.661875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:46.662911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:46.687544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:46.688008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:46.688897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:46.689348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:47.169668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:47.189457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:47.203597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6db4899b-5d68-492a-9953-24712600dad1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.540714 Jul 25 20:13:47.221480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1042/2064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:46 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:47.230336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:47.237241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:47.258290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:47.259446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:47.260984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:47.261967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:47.850100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:47.885168 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c374e97-2660-4d36-8c22-8e68ab35e1df tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.655190 Jul 25 20:13:47.896149 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1043/2065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:47 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:47.912389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:47.913758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:47.943369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:47.952344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:47.958996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:47.959777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:48.181917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:48.206955 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37529f81-3af9-46b5-9512-7ebe32116208 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1270 microversion: 2.1 time: 0.317556 Jul 25 20:13:48.211535 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1044/2066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:47 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1270 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:48.243031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:48.248643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:48.290035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:48.301582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:48.309856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:48.311231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:48.929942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:48.949462 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-290ef598-9020-4a1c-a971-47214590e6e5 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.713103 Jul 25 20:13:48.950499 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1045/2067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:48 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:48.959208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:48.970308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:48.997009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:48.997465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:48.998258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:48.998695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:49.836860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:49.867836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1d192624-1448-4cf1-a8dc-da14aff72c53 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.913245 Jul 25 20:13:49.879194 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1046/2068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:48 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:49.928470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:49.943292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:49.984375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:49.989080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:49.994313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:50.003271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:50.371185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:50.458710 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f190469-9c57-4f7c-bd13-c269e04008fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1270 microversion: 2.1 time: 0.559061 Jul 25 20:13:50.464236 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1047/2069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:49 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1270 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:50.502471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:50.503945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:50.531242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:50.535640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:50.541627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:50.542387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:50.987073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:51.017491 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d924a128-a80c-425f-ae10-be5f89107d45 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.545087 Jul 25 20:13:51.022032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1048/2070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:50 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:51.065687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:51.066489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:51.093475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:51.096527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:51.098122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:51.103899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:51.729523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:51.769369 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23dbd072-5607-40ba-a406-12e9130b4e50 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.730797 Jul 25 20:13:51.770315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1049/2071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:51 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:51.808027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:51.812718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:51.845106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:51.848870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:51.852712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:51.853728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:52.214355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:52.225991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab18d52c-943b-49f1-9c14-b7e996142251 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1270 microversion: 2.1 time: 0.448674 Jul 25 20:13:52.226925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1050/2072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:51 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1270 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:52.236131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:52.237074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:52.262187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:52.263705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:52.267638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:52.269922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:52.320455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:52.564415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:52.579694 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60d00dc9-5970-4655-b14e-af6b9fd97247 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.351396 Jul 25 20:13:52.591033 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1051/2073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:52 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:52.810482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:52.811465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:52.834106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:52.841471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:52.841834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:52.855392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:53.022992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:53.433026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:53.479985 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9afd067-bf8b-4241-b6f6-ba88cd556ad5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.676759 Jul 25 20:13:53.490083 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1052/2074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:52 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:53.527463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:53.530603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:53.569977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:53.577309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:53.580028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:53.583172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:53.975296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:54.109626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:54.124947 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74d9ffed-cd6e-47cf-98ef-2073c94021d7 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1312 microversion: 2.1 time: 0.632648 Jul 25 20:13:54.125629 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1053/2075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:53 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1312 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:54.140973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5e62295d-1b2b-4570-9afb-c4338fbf11be req-2cc8ca84-f434-4fb9-aea9-88a54bf3eb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed6449b-f0e2-4de1-b75e-0f313dea121e", "name": "network-vif-plugged", "status": "completed", "tag": "0df73111-21fd-408f-b83b-5961e5bd19df"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:54.173824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5e62295d-1b2b-4570-9afb-c4338fbf11be req-2cc8ca84-f434-4fb9-aea9-88a54bf3eb6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:54.174978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5e62295d-1b2b-4570-9afb-c4338fbf11be req-2cc8ca84-f434-4fb9-aea9-88a54bf3eb6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:54.221711 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5e62295d-1b2b-4570-9afb-c4338fbf11be req-2cc8ca84-f434-4fb9-aea9-88a54bf3eb6d service nova] Creating event network-vif-plugged:0df73111-21fd-408f-b83b-5961e5bd19df for instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e on n-h1-845775-3 Jul 25 20:13:54.245917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5e62295d-1b2b-4570-9afb-c4338fbf11be req-2cc8ca84-f434-4fb9-aea9-88a54bf3eb6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116859 Jul 25 20:13:54.248352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1054/2076] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:54.268360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:54.269301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:54.278872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:54.280886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:54.281957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:54.282738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:54.372453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:54.586438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:55.088737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:55.099615 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf48f140-3c27-4660-8c8a-1c844a61857e tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.845690 Jul 25 20:13:55.121609 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1055/2077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:54 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:55.145571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:55.147914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:55.173277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:55.185962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:55.187292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:55.192986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:55.463515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:55.472932 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6203ab2a-a5b6-468c-b559-8236e194222d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.348794 Jul 25 20:13:55.487560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1056/2078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:55 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:55.492732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:55.493525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:55.504206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:55.504956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:55.508966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:55.509460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:55.961640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:55.979504 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c26b6d4c-1ea9-43de-9737-2b4180e6dbad tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1312 microversion: 2.1 time: 0.503805 Jul 25 20:13:55.997944 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1057/2079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:55 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1312 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:56.142835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:56.145108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:56.179302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:56.208863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:56.215568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:56.219265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:56.609022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:56.626918 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-221b2cbb-caab-4cfe-acd4-7c1af703b41a tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1319 microversion: 2.1 time: 0.494440 Jul 25 20:13:56.630084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1058/2080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:56 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:13:56.641647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ee8a28d5-1863-415f-b9b9-901ff657972d req-f9b0cde1-337b-4e54-8236-ffcc64396618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-plugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:13:56.663346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ee8a28d5-1863-415f-b9b9-901ff657972d req-f9b0cde1-337b-4e54-8236-ffcc64396618 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:56.664558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ee8a28d5-1863-415f-b9b9-901ff657972d req-f9b0cde1-337b-4e54-8236-ffcc64396618 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:56.703471 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ee8a28d5-1863-415f-b9b9-901ff657972d req-f9b0cde1-337b-4e54-8236-ffcc64396618 service nova] Creating event network-vif-plugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:13:56.736240 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ee8a28d5-1863-415f-b9b9-901ff657972d req-f9b0cde1-337b-4e54-8236-ffcc64396618 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104142 Jul 25 20:13:56.738444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1059/2081] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:13:56.750710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:56.754100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:56.777910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:56.777910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:56.777910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:56.778256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:57.188423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:57.193764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:13:57.202305 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-375c411c-9933-460e-8e0d-af38e045db14 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.459877 Jul 25 20:13:57.204380 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1060/2082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:56 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:57.219858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:57.226745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:57.274434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:57.274963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:57.278611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:57.287345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:58.078097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:13:58.096159 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-091f7081-03fc-4965-b6ca-4dbdba45a6fe tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1312 microversion: 2.1 time: 0.888368 Jul 25 20:13:58.096966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1061/2083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:57 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1312 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:13:58.107219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:13:58.119039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:13:58.148991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:58.156856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:13:58.159721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:13:58.164723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:00.376771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:00.391888 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-211ec3fa-a38f-4099-84fd-9fc2310bb095 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1468 microversion: 2.1 time: 2.290841 Jul 25 20:14:00.397005 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1062/2084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:13:58 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1468 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:00.414929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:00.419184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:00.445833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:00.446317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:00.450129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:00.453454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:01.991664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:02.010566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69834805-352a-4aa4-8ad7-73e883839731 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 1.609947 Jul 25 20:14:02.011178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1063/2085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:00 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:02.025495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:02.026853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:02.057376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:02.057836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:02.058653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:02.059114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:02.545951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:02.571022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3827dc9c-2ce8-45fc-9eba-61b8dd1afb7e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.546435 Jul 25 20:14:02.588081 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1064/2086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:02 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:02.588081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-920abd37-092e-4b68-9f68-5035a43d0f4e req-049532db-c62e-4e17-9b05-05c9895b74d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779a51de-08d4-4639-b4fd-61e3db2d6ecc", "tag": "fe2a2b27-f50a-4260-88b0-9a43b958e985"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:02.627879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-920abd37-092e-4b68-9f68-5035a43d0f4e req-049532db-c62e-4e17-9b05-05c9895b74d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:02.645093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-920abd37-092e-4b68-9f68-5035a43d0f4e req-049532db-c62e-4e17-9b05-05c9895b74d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:02.694915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-920abd37-092e-4b68-9f68-5035a43d0f4e req-049532db-c62e-4e17-9b05-05c9895b74d2 service nova] Creating event network-changed:fe2a2b27-f50a-4260-88b0-9a43b958e985 for instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc on n-h2-845775-3 Jul 25 20:14:02.725060 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-920abd37-092e-4b68-9f68-5035a43d0f4e req-049532db-c62e-4e17-9b05-05c9895b74d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150818 Jul 25 20:14:02.726454 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1065/2087] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:02.757750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:02.758922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:02.815335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba3defd7-6c38-44bc-a2b9-1ffd6bb14a73 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1461 microversion: 2.1 time: 17.525754 Jul 25 20:14:02.826654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:02.827174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:02.827983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:02.828452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:02.832543 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1023/2088] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:13:45 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1461 bytes in 17544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:02.839309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54dfd193-a064-4f67-9742-fd32965da3c4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea8bdc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:02.879352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lazy-loading 'flavor' on Instance uuid 6ed6449b-f0e2-4de1-b75e-0f313dea121e {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:14:03.087507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54dfd193-a064-4f67-9742-fd32965da3c4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 200 len: 1461 microversion: 2.1 time: 0.253377 Jul 25 20:14:03.100085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1024/2089] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:02 2022] GET /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 1461 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:03.123266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:03.167584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:03.189533 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c4795ae-d563-48ae-a8ee-d5186f69bfff tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e/action" status: 202 len: 0 microversion: 2.1 time: 0.445693 Jul 25 20:14:03.196659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1066/2090] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:02 2022] POST /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:14:03.212772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:03.214214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:03.224350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:03.229248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:03.232825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:03.236166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:03.257556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:03.258520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:03.263451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:03.264325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:03.952064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:03.972915 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b951471a-d9cb-4662-ae6c-1ad34adc9fb3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.871778 Jul 25 20:14:03.976579 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1025/2091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:03 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:03.997888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:04.000000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:04.007519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.008237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:04.017224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.018709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:04.567263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:04.582782 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-459027bf-9ae9-4008-922d-ec095c821a43 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1480 microversion: 2.1 time: 1.383450 Jul 25 20:14:04.603937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1067/2092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:03 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1480 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:04.610688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:04.611946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:04.645708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.647990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:04.651435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.667059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:04.789180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:04.804451 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e94f4295-4ad3-4f23-85da-151222ebcfa0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1459 microversion: 2.1 time: 0.823894 Jul 25 20:14:04.813078 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1026/2093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:03 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1459 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:04.867909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:04.868575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:04.912754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.913218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:04.914021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:04.914465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:05.452915 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34f42dee-bb12-40c8-b6f0-fe3eb4b70979 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1610 microversion: 2.1 time: 0.615148 Jul 25 20:14:05.456787 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1027/2094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:04 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1610 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:05.471808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-99a5bd80-0bf1-4d3e-afef-87040273f323 req-e5e467be-8c22-45a7-bb6e-e1e454fc4ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "tag": "7a0aaba6-88bf-4161-8ae7-b8408bede917"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:05.539644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99a5bd80-0bf1-4d3e-afef-87040273f323 req-e5e467be-8c22-45a7-bb6e-e1e454fc4ffe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:05.541382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99a5bd80-0bf1-4d3e-afef-87040273f323 req-e5e467be-8c22-45a7-bb6e-e1e454fc4ffe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:05.614102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-99a5bd80-0bf1-4d3e-afef-87040273f323 req-e5e467be-8c22-45a7-bb6e-e1e454fc4ffe service nova] Creating event network-changed:7a0aaba6-88bf-4161-8ae7-b8408bede917 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:14:05.640282 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-99a5bd80-0bf1-4d3e-afef-87040273f323 req-e5e467be-8c22-45a7-bb6e-e1e454fc4ffe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176791 Jul 25 20:14:05.645334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1028/2095] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:05.677602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:05.682483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:05.734559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:05.738283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:05.740447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:05.746887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:06.772555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:06.789435 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bad206a-3216-46a1-8234-7284341d88a0 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 2.183872 Jul 25 20:14:06.800107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1068/2096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:04 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:06.805237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:06.818338 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:14:06.818338 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:14:06.819762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:06.820268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:06.821090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:06.821542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:06.887659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:06.911572 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c91f126-f566-4eb6-9e3a-5534a7724d99 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.112350 Jul 25 20:14:06.912337 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1069/2097] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:14:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:06.935314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:06.945678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:06.954975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:06.956114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:06.958286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:06.962097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.063392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:07.090381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5fec983-f274-4dde-8777-03f7b8612aad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 1.439311 Jul 25 20:14:07.102069 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1029/2098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:05 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:07.119546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845775-3", "block_migration": true, "disk_over_commit": false}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:07.128692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:07.160674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.161220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.161919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.162384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.270137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Lazy-loading 'flavor' on Instance uuid 6ed6449b-f0e2-4de1-b75e-0f313dea121e {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:14:07.311830 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e while it is in vm_state suspended Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Request method failure captured: Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e/action HTTP/1.1 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 97 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vk6ikOofBVSo9z3OPfQXNFTtwLO_q9-q1_Pwmxf4klXI01RPAEFUVoQvSwY-19Qai8fJOGAxG12zfNpSqi7fj_4NB2X7nl9jtRGsNO9MSc9Vuz2f9yAwSx_ZOFdKPE9XHYHoxz0xvvYoWCcUkyaw_c9GBOqZ5LaXEzqWCr44wMdhgI Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6badc3429c214b358226e838f68b2d26 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:14:07.318009 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6badc3429c214b358226e838f68b2d26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6badc3429c214b358226e838f68b2d26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6badc3429c214b358226e838f68b2d26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6badc3429c214b358226e838f68b2d26"}]}] Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6badc3429c214b358226e838f68b2d26 Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-310040334 Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveMigrationNegativeTest-310040334-project-admin Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9e3405ca546f455d91ba25cea86dc50b Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveMigrationNegativeTest-310040334-project-admin Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: {"os-migrateLive": {"host": "n-h2-845775-3", "block_migration": true, "disk_over_commit": false}} Jul 25 20:14:07.320669 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'os-migrateLive' instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e while it is in vm_state suspended Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '6ed6449b-f0e2-4de1-b75e-0f313dea121e', 'body': {'os-migrateLive': {'host': 'n-h2-845775-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 20:14:07.322164 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:07.323706 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e while it is in vm_state suspended Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e while it is in vm_state suspended Jul 25 20:14:07.324891 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:07.341189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e while it is in vm_state suspended {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:07.344277 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41a7d28f-a624-4c85-a308-ee2828f7ea61 tempest-LiveMigrationNegativeTest-310040334 tempest-LiveMigrationNegativeTest-310040334-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e/action" status: 409 len: 155 microversion: 2.1 time: 0.238290 Jul 25 20:14:07.345565 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1030/2099] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:07 2022] POST /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e/action => generated 155 bytes in 240 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:14:07.384451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:07.386766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:07.408225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.411131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.415117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.415802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.530640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:14:07.535597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:07.563385 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23ddffb7-b0f2-4713-96c9-4b49a901ecea tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1467 microversion: 2.1 time: 0.639078 Jul 25 20:14:07.573243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1070/2100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:06 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1467 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:07.595160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1862978607"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:07.599476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:07.628007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.634389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.635730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.636671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.817949 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb504e06-db9f-4de5-9eb1-ee841c1bb018 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 204 len: 0 microversion: 2.1 time: 0.450658 Jul 25 20:14:07.819819 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1031/2101] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:14:07 2022] DELETE /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:14:07.829153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:07.834327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:07.843882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.844275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:07.844980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:07.845424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:08.492352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:08.507853 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f915bf2-c350-45c1-8a5f-6f5e10579fc4 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.684553 Jul 25 20:14:08.528710 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1032/2102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:07 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:08.534240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:08.535199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:08.545872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:08.547061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:08.548702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:08.549964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:09.109772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:09.123817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-49aa69da-4516-4778-bfda-643996080bc2 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1465 microversion: 2.1 time: 0.591466 Jul 25 20:14:09.141138 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1033/2103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:08 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1465 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:09.169667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-643bf048-cff2-4ece-a99b-2fcfcd653545 req-7357d891-28cb-406f-a1da-0a7399ff5d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-unplugged", "status": "completed", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:09.206868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-643bf048-cff2-4ece-a99b-2fcfcd653545 req-7357d891-28cb-406f-a1da-0a7399ff5d66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:09.207684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-643bf048-cff2-4ece-a99b-2fcfcd653545 req-7357d891-28cb-406f-a1da-0a7399ff5d66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:09.266757 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-643bf048-cff2-4ece-a99b-2fcfcd653545 req-7357d891-28cb-406f-a1da-0a7399ff5d66 service nova] Creating event network-vif-unplugged:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:14:09.289754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-643bf048-cff2-4ece-a99b-2fcfcd653545 req-7357d891-28cb-406f-a1da-0a7399ff5d66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143531 Jul 25 20:14:09.290925 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1034/2104] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:09.325541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:09.326873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:09.360924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:09.362830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:09.366783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:09.379685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:10.946142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:10.989886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48df17ce-b7fb-4ba8-a4fd-8389aaa25b01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 1.693448 Jul 25 20:14:10.994413 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1035/2105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:09 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:11.012185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1b72deb1-71db-470c-9850-301d11213be1 req-cfb1b9da-4788-4932-863d-7d10e01309c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "tag": "edfacf52-0291-4395-98af-4d6ec0eac908"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:11.077672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b72deb1-71db-470c-9850-301d11213be1 req-cfb1b9da-4788-4932-863d-7d10e01309c5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:11.080962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b72deb1-71db-470c-9850-301d11213be1 req-cfb1b9da-4788-4932-863d-7d10e01309c5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:11.138282 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1b72deb1-71db-470c-9850-301d11213be1 req-cfb1b9da-4788-4932-863d-7d10e01309c5 service nova] Creating event network-changed:edfacf52-0291-4395-98af-4d6ec0eac908 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:14:11.151357 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1b72deb1-71db-470c-9850-301d11213be1 req-cfb1b9da-4788-4932-863d-7d10e01309c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151860 Jul 25 20:14:11.160708 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1036/2106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:11.171956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:11.175170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:11.188753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:11.189988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:11.192491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:11.193679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:12.217213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:12.242294 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-510b8883-72f9-4e74-8b01-774be0926b73 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 1.079181 Jul 25 20:14:12.243608 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1037/2107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:11 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:12.261618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:12.263238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:12.275307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:12.282814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:12.284557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:12.285234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:12.776380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:12.805567 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d4d6582-b39b-4e74-bfa9-cd9f4757d57d tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 200 len: 1465 microversion: 2.1 time: 0.560105 Jul 25 20:14:12.809755 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1038/2108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:12 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 1465 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:12.815226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-93e8011f-a080-4095-9713-fb3ee58910c6 req-b15d7a5a-65d0-43f3-a98a-ea97af2c296c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779a51de-08d4-4639-b4fd-61e3db2d6ecc", "name": "network-vif-plugged", "status": "completed", "tag": "fe2a2b27-f50a-4260-88b0-9a43b958e985"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:12.845481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-93e8011f-a080-4095-9713-fb3ee58910c6 req-b15d7a5a-65d0-43f3-a98a-ea97af2c296c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:12.848231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-93e8011f-a080-4095-9713-fb3ee58910c6 req-b15d7a5a-65d0-43f3-a98a-ea97af2c296c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:12.874702 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-93e8011f-a080-4095-9713-fb3ee58910c6 req-b15d7a5a-65d0-43f3-a98a-ea97af2c296c service nova] Creating event network-vif-plugged:fe2a2b27-f50a-4260-88b0-9a43b958e985 for instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc on n-h2-845775-3 Jul 25 20:14:12.886083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-93e8011f-a080-4095-9713-fb3ee58910c6 req-b15d7a5a-65d0-43f3-a98a-ea97af2c296c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074393 Jul 25 20:14:12.898621 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1039/2109] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:12.905062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:12.918213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:12.960763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:12.961911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:12.963064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:12.963775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:13.760658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:13.784871 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9da5508-a9fb-468f-9942-28b926120dd3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.880025 Jul 25 20:14:13.785567 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1040/2110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:12 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:13.813523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:13.822383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:13.850896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:13.853150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:13.861163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:13.863833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.297066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:14.321612 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a83a573a-94f6-4740-867c-6bdded8e5723 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.525623 Jul 25 20:14:14.359792 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1041/2111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:13 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:14.374707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-52d2037a-1017-4811-a21d-e73d7c8adc99 req-8f3dbf6c-9b3c-43ee-be99-15c7dd3c47f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed6449b-f0e2-4de1-b75e-0f313dea121e", "name": "network-vif-deleted", "tag": "0df73111-21fd-408f-b83b-5961e5bd19df"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:14.416216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-52d2037a-1017-4811-a21d-e73d7c8adc99 req-8f3dbf6c-9b3c-43ee-be99-15c7dd3c47f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:14.417432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-52d2037a-1017-4811-a21d-e73d7c8adc99 req-8f3dbf6c-9b3c-43ee-be99-15c7dd3c47f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.434943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-52d2037a-1017-4811-a21d-e73d7c8adc99 req-8f3dbf6c-9b3c-43ee-be99-15c7dd3c47f2 service nova] Creating event network-vif-deleted:0df73111-21fd-408f-b83b-5961e5bd19df for instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e on n-h1-845775-3 Jul 25 20:14:14.451583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-52d2037a-1017-4811-a21d-e73d7c8adc99 req-8f3dbf6c-9b3c-43ee-be99-15c7dd3c47f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090044 Jul 25 20:14:14.452425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1042/2112] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:14.467832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:14.468623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 6ed6449b-f0e2-4de1-b75e-0f313dea121e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:14.489266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:14.489999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.491709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:14.492634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.506775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:14.538104 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] HTTP exception thrown: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Request method failure captured: Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e HTTP/1.1 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vk5sVgWFTPwGXPuDfuRluBKHLh_V1OFVrB6MVQMYv3Hh1xTKWF-mDKOYUAxl4WGtyQgv9kPCRXBAHLoLFNKQULa5aLwpVlKO6kaCNvOoD9OmffVQqN5BukheJQvCImiEChDRxQgyGVbTmt6WeIWEztMZd3niycrK1vU0YkWiHk4dNo Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0c84f0a7d4bd49cbb32d19bc4c2d19b2 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:14:14.547745 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}] Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0c84f0a7d4bd49cbb32d19bc4c2d19b2 Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-LiveMigrationNegativeTest-1439811231-project Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 1588f90fd6444050bf26cd0b07eb1f26 Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-LiveMigrationNegativeTest-1439811231-project Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. Jul 25 20:14:14.551304 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '6ed6449b-f0e2-4de1-b75e-0f313dea121e'} Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:14.553035 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. Jul 25 20:14:14.554519 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:14.568393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Returning 404 to user: Instance 6ed6449b-f0e2-4de1-b75e-0f313dea121e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:14.569967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22b436c5-1b89-43b6-9381-3c2b8beee559 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e" status: 404 len: 111 microversion: 2.1 time: 0.112996 Jul 25 20:14:14.584494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1043/2113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:14 2022] GET /compute/v2.1/servers/6ed6449b-f0e2-4de1-b75e-0f313dea121e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:14:14.595144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:14.621806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:14.640774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:14.641542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.651792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:14.653107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:14.769634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:14:15.058948 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fde281df-a0b7-457d-ad17-c4d2a67dc937 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "DELETE /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 204 len: 0 microversion: 2.1 time: 0.474582 Jul 25 20:14:15.059528 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1044/2114] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:14:14 2022] DELETE /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:14:15.068993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:15.070723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:15.084241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:15.084710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:15.085519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:15.085962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:15.559623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:15.607576 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98b6ee45-6867-42c4-bedb-bbd1475acb54 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1325 microversion: 2.1 time: 0.533087 Jul 25 20:14:15.638878 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1045/2115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:15 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:15.663057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:15.666635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:15.699355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:15.702377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:15.704028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:15.707358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:16.093671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:16.131038 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37f7cba8-9a6c-42ba-a1a9-927b898427e1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1474 microversion: 2.1 time: 0.487127 Jul 25 20:14:16.134765 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1046/2116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:15 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1474 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:16.151071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:16.155654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:16.180223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:16.180883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:16.183437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:16.186111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:16.655473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:16.686271 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6daeb0a9-9a47-4f16-b45f-fc195f9c100b tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.548534 Jul 25 20:14:16.688154 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1047/2117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:16 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:16.697135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:16.698517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:16.726602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:16.727349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:16.728246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:16.729195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:16.851025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:17.628426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=7 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:17.784939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:17.827783 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c972510c-d8c9-4d09-b85b-8dda12fb804a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 1.132731 Jul 25 20:14:17.830646 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a9af4d96-f97d-4034-b1ab-d748c446c888 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "POST /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99/action" status: 202 len: 0 microversion: 2.1 time: 10.240505 Jul 25 20:14:17.837254 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1071/2118] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:07 2022] POST /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99/action => generated 0 bytes in 10248 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 25 20:14:17.845113 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1048/2119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:16 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:17.871969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:17.874873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:17.875862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:17.879346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:17.904583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:17.907530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:17.914348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:17.915737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:17.916313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:17.916980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:17.918600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:17.921786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:18.661080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:18.693682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5c01dac-88c4-4ea1-9ef5-21b2e66c4393 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.843309 Jul 25 20:14:18.699870 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1049/2120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:17 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:18.717371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1588f90fd6444050bf26cd0b07eb1f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c84f0a7d4bd49cbb32d19bc4c2d19b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:18.739081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:18.739739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:18.746953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-547db888-cb0a-4b0b-9845-79aab73e7df1 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 200 len: 1474 microversion: 2.1 time: 0.907037 Jul 25 20:14:18.749341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:18.749538 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1072/2121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:17 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 1474 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:18.750398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:18.751775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:18.753169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:18.763871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-595cd69a-f129-47b2-9d65-37d0194d4fb9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaa59d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:18.867010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-595cd69a-f129-47b2-9d65-37d0194d4fb9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1453 microversion: 2.1 time: 0.114692 Jul 25 20:14:18.867815 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1073/2122] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:18 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:18.882669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:18.888172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:18.904437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:18.907683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:18.910084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:18.912005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.535817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:19.558831 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ebd61bf-311f-4845-b0cd-949fdc004d9c tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.855985 Jul 25 20:14:19.561138 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1050/2123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:18 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:19.574097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ca1e97f8-56e3-41a8-9e87-7f7524a9d531 req-0e37932b-e7e8-4f2b-b088-ce3498f081ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50528281-7811-4a63-b92e-7a1b2647a757", "name": "network-vif-deleted", "tag": "7864bfc9-df39-46a3-a6dd-5a1773b076cd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:19.600803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ca1e97f8-56e3-41a8-9e87-7f7524a9d531 req-0e37932b-e7e8-4f2b-b088-ce3498f081ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.601579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ca1e97f8-56e3-41a8-9e87-7f7524a9d531 req-0e37932b-e7e8-4f2b-b088-ce3498f081ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.639662 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ca1e97f8-56e3-41a8-9e87-7f7524a9d531 req-0e37932b-e7e8-4f2b-b088-ce3498f081ab service nova] Creating event network-vif-deleted:7864bfc9-df39-46a3-a6dd-5a1773b076cd for instance 50528281-7811-4a63-b92e-7a1b2647a757 on n-h1-845775-3 Jul 25 20:14:19.652673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ca1e97f8-56e3-41a8-9e87-7f7524a9d531 req-0e37932b-e7e8-4f2b-b088-ce3498f081ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089204 Jul 25 20:14:19.653439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1051/2124] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:19.680983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:19.721972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-490d1927-99ad-485d-93d7-7b6f681b83be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.846832 Jul 25 20:14:19.724319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1074/2125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:18 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:19.739031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:19.739865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:19.758294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5cf231d7-fa4a-41f5-80a9-b34a7c7c8bd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-850331732", "metadata": {"": ""}}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5cf231d7-fa4a-41f5-80a9-b34a7c7c8bd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action HTTP/1.1 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 106 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:14:19.784263 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-850331732", "metadata": {"": ""}}} Jul 25 20:14:19.786994 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-850331732', 'metadata': {'': ''}}}} Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'': ''} Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:19.788449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.791157 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:19.794274 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.794998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.794998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.794998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.794998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.797473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5cf231d7-fa4a-41f5-80a9-b34a7c7c8bd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:19.805298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5cf231d7-fa4a-41f5-80a9-b34a7c7c8bd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action" status: 400 len: 170 microversion: 2.1 time: 0.056613 Jul 25 20:14:19.806656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1075/2126] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Jul 25 20:14:19 2022] POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action => generated 170 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:14:19.837003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:19.840854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] [instance: 50528281-7811-4a63-b92e-7a1b2647a757] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:19.859029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.859998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.862847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.863371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.890990 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] HTTP exception thrown: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Request method failure captured: Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 HTTP/1.1 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vk5sVgWFTPwGXPuDfuRluBKHLh_V1OFVrB6MVQMYv3Hh1xTKWF-mDKOYUAxl4WGtyQgv9kPCRXBAHLoLFNKQULa5aLwpVlKO6kaCNvOoD9OmffVQqN5BukheJQvCImiEChDRxQgyGVbTmt6WeIWEztMZd3niycrK1vU0YkWiHk4dNo Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0c84f0a7d4bd49cbb32d19bc4c2d19b2 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:14:19.896985 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c84f0a7d4bd49cbb32d19bc4c2d19b2"}]}] Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0c84f0a7d4bd49cbb32d19bc4c2d19b2 Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1439811231 Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-LiveMigrationNegativeTest-1439811231-project Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1588f90fd6444050bf26cd0b07eb1f26 Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-LiveMigrationNegativeTest-1439811231-project Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. Jul 25 20:14:19.899644 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '50528281-7811-4a63-b92e-7a1b2647a757'} Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:19.901305 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. Jul 25 20:14:19.903320 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:19.906485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] Returning 404 to user: Instance 50528281-7811-4a63-b92e-7a1b2647a757 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:19.909041 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea7a9b5b-0743-4ca8-9c62-576472fc54c0 tempest-LiveMigrationNegativeTest-1439811231 tempest-LiveMigrationNegativeTest-1439811231-project] 10.222.0.48 "GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757" status: 404 len: 111 microversion: 2.1 time: 0.095422 Jul 25 20:14:19.910589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1076/2127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:19 2022] GET /compute/v2.1/servers/50528281-7811-4a63-b92e-7a1b2647a757 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:14:19.922526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:19.924209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:19.935914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.936931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:19.938626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:19.939940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:20.383774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:20.397758 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0723eda3-8b68-43dc-9624-261aa68f6439 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.665556 Jul 25 20:14:20.398995 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1052/2128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:19 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:20.410317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:20.415104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52b43ee3-7b6a-4bc1-a2a6-23dcc5f6e1dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaf0550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:20.434031 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aae3e74f-a98a-4b34-a212-e1dccddbde5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.521670 Jul 25 20:14:20.435398 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1077/2129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:19 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:20.451416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1345057656"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:20.460722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:20.479161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:20.480610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:20.487540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:20.488344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:20.507547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52b43ee3-7b6a-4bc1-a2a6-23dcc5f6e1dc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1453 microversion: 2.1 time: 0.106934 Jul 25 20:14:20.517407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1053/2130] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:20 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:20.526572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:20.528230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:20.529494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:20.555239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:20.555976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:20.559024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:20.561322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:20.985628 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab0d763e-d28c-4af5-8da7-6633d1ebb7c9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.542695 Jul 25 20:14:20.988599 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1078/2131] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:20 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 25 20:14:21.001660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:21.004409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:21.004746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:21.026018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-990ef829-90b8-4778-9eb2-ddd6227c452b tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.513478 Jul 25 20:14:21.030717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:21.035938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:21.036406 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1054/2132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:20 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:21.037432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:21.039787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:21.080211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eba6ed16-141c-4942-ac64-378cdc1984c2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-797807137", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eba6ed16-141c-4942-ac64-378cdc1984c2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action HTTP/1.1 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 618 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:14:21.093109 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:21.095418 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:14:21.097268 n-d-845775-3 devstack@n-api.service[119723]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-797807137", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 25 20:14:21.097268 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:14:21.097268 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-797807137', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 25 20:14:21.097624 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:21.099177 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.101270 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:14:21.105097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:14:21.122625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eba6ed16-141c-4942-ac64-378cdc1984c2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:21.123614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eba6ed16-141c-4942-ac64-378cdc1984c2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action" status: 400 len: 938 microversion: 2.1 time: 0.048674 Jul 25 20:14:21.133959 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1055/2133] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Jul 25 20:14:21 2022] POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action => generated 938 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:14:21.147508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:21.152841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:21.172819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:21.173296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:21.174686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:21.175136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:21.666234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:21.706797 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a012ba5-0ca8-40cf-8f44-5b917b9ea396 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.713416 Jul 25 20:14:21.711560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1079/2134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:20 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:21.743351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ce02fe6c-ce6e-4e39-b4d2-fc440ca06415 req-21cfb3f7-fc0e-46ec-b63e-b78867997228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "name": "network-vif-plugged", "status": "completed", "tag": "edfacf52-0291-4395-98af-4d6ec0eac908"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:21.778852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ce02fe6c-ce6e-4e39-b4d2-fc440ca06415 req-21cfb3f7-fc0e-46ec-b63e-b78867997228 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:21.780830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ce02fe6c-ce6e-4e39-b4d2-fc440ca06415 req-21cfb3f7-fc0e-46ec-b63e-b78867997228 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:21.847737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ce02fe6c-ce6e-4e39-b4d2-fc440ca06415 req-21cfb3f7-fc0e-46ec-b63e-b78867997228 service nova] Creating event network-vif-plugged:edfacf52-0291-4395-98af-4d6ec0eac908 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:14:21.879591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ce02fe6c-ce6e-4e39-b4d2-fc440ca06415 req-21cfb3f7-fc0e-46ec-b63e-b78867997228 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165293 Jul 25 20:14:21.885670 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1080/2135] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:21.906285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d074e3ae-a08e-4d26-892d-925bdd0fe0ad tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea78550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:22.264015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d074e3ae-a08e-4d26-892d-925bdd0fe0ad tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1453 microversion: 2.1 time: 0.370421 Jul 25 20:14:22.265059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1081/2136] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:21 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1453 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:22.287009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:22.362721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-adb06f50-169b-4d8a-8917-6435c84035ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 1.220878 Jul 25 20:14:22.369470 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1056/2137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:21 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:22.413511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:22.414633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:22.426522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:22.427598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:22.428906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:22.429606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:22.754805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:22.758421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:22.795446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:22.796568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:22.805048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:22.807708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:22.950484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:22.994850 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c09d549-809e-409e-b4a6-f4142f81c5ae tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.578398 Jul 25 20:14:22.998822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1082/2138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:22 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:23.038878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd453838-1bc7-4acc-91fd-dead947774fa tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd453838-1bc7-4acc-91fd-dead947774fa tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action HTTP/1.1 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 285 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:14:23.059571 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:14:23.061928 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:14:23.063230 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:14:23.064904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:14:23.067314 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:14:23.068915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:14:23.068915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:23.085732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd453838-1bc7-4acc-91fd-dead947774fa tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:23.104171 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd453838-1bc7-4acc-91fd-dead947774fa tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action" status: 400 len: 619 microversion: 2.1 time: 0.061363 Jul 25 20:14:23.109263 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1083/2139] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Jul 25 20:14:23 2022] POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action => generated 619 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:14:23.149464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:23.153482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:23.257198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:23.263413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:23.275281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:23.288018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:23.426272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:23.461741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a18d667-c2ec-4be3-b3f1-58927959142f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1333 microversion: 2.1 time: 0.706122 Jul 25 20:14:23.462831 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1057/2140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:22 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1333 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:14:23.500077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe90db52-c989-41b5-8d6c-5448bbe4a782 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb579d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:23.751562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:23.774303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1688bf51-5088-4299-ad18-efcf7b325717 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.661362 Jul 25 20:14:23.776126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1084/2141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:23 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:23.816994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:23.821082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:23.829170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:23.830254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:23.831840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:23.832596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:24.082141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:24.103404 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68624c5e-dc90-4845-bf54-3ae79af50b52 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 0.293035 Jul 25 20:14:24.105556 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1085/2142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:23 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:14:24.115928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "name": "network-vif-plugged", "status": "completed", "tag": "7a0aaba6-88bf-4161-8ae7-b8408bede917"}, {"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:24.138518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:24.139342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:24.169865 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] Creating event network-vif-plugged:7a0aaba6-88bf-4161-8ae7-b8408bede917 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:14:24.170768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] Creating event network-vif-unplugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:14:24.183096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d5810d9b-fbdd-46c6-ac5a-ee94fe25460e req-8e3b4ccf-2812-43ff-a156-7e761ff29ceb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.074421 Jul 25 20:14:24.184111 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1086/2143] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:24.197708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1620548388"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:24.205483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:24.220063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:24.221308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:24.223109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:24.224422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:32.637907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe90db52-c989-41b5-8d6c-5448bbe4a782 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1453 microversion: 2.1 time: 9.158743 Jul 25 20:14:32.638767 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1058/2144] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:23 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1453 bytes in 9175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:32.654095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:32.655205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:32.668683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:32.671956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:32.672821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:32.678371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:32.679238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:33.044199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-583fb3e7-8ffe-4929-b319-b58f83c20ffc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action" status: 202 len: 0 microversion: 2.1 time: 8.836614 Jul 25 20:14:33.052659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1087/2145] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:24 2022] POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action => generated 0 bytes in 8868 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:14:33.074608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-895bbfdb-4edb-4c22-b2b2-9c9b599d494e req-5dfa417c-c45e-408b-8ffe-c6e622afb594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1754d-5d46-4ace-bc70-b6c00bf08b99", "name": "network-vif-plugged", "status": "completed", "tag": "707a75e3-3d04-4fab-b129-8ae3088e09f1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:33.115878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-895bbfdb-4edb-4c22-b2b2-9c9b599d494e req-5dfa417c-c45e-408b-8ffe-c6e622afb594 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:33.117045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-895bbfdb-4edb-4c22-b2b2-9c9b599d494e req-5dfa417c-c45e-408b-8ffe-c6e622afb594 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:33.142052 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-895bbfdb-4edb-4c22-b2b2-9c9b599d494e req-5dfa417c-c45e-408b-8ffe-c6e622afb594 service nova] Creating event network-vif-plugged:707a75e3-3d04-4fab-b129-8ae3088e09f1 for instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 on n-h1-845775-3 Jul 25 20:14:33.164242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-895bbfdb-4edb-4c22-b2b2-9c9b599d494e req-5dfa417c-c45e-408b-8ffe-c6e622afb594 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109213 Jul 25 20:14:33.165356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1088/2146] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:33.211362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23377768dc934265bf4eb9550084d731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb643c0372d04a3495e515c2a76a3697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:33.235399 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ce7ed725-c886-4136-a1dd-5dd271d2fcc1 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 200 len: 1669 microversion: 2.1 time: 0.594475 Jul 25 20:14:33.238250 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1059/2147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:32 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 1669 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:33.866529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1802997145", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:33.871862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2fa1b6a-2e3a-45e0-9f9b-1475202bedea tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] Calling method '.version_select at 0x7f196ebba550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:35.475859 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2fa1b6a-2e3a-45e0-9f9b-1475202bedea tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 6716 microversion: 2.1 time: 2.308446 Jul 25 20:14:35.481495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1089/2148] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:14:33 2022] GET /compute/v2.1/os-networks => generated 6716 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:35.486997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1269088383"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:35.499697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:35.529455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:35.534668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:35.536091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:35.536747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:35.682839 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Cannot 'createImage' instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc while it is in task_state image_pending_upload Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action HTTP/1.1 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 85 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:14:35.688412 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1269088383"}} Jul 25 20:14:35.690276 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'createImage' instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc while it is in task_state image_pending_upload Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1269088383'}}} Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc in task_state image_pending_upload. Cannot snapshot while the instance is in this state. Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:35.691011 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc while it is in task_state image_pending_upload Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc while it is in task_state image_pending_upload Jul 25 20:14:35.694065 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:35.697556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 409 to user: Cannot 'createImage' instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc while it is in task_state image_pending_upload {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:35.698732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33487c55-6d51-4db0-9631-5d76e8759b59 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action" status: 409 len: 165 microversion: 2.1 time: 0.216184 Jul 25 20:14:35.699405 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1090/2149] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:35 2022] POST /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc/action => generated 165 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:14:35.734941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:35.737006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:35.770664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:35.778879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:35.781883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:35.782616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:35.929435 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-db62aa7e-487b-4e6b-b568-9c80335e7837 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc/ips" status: 200 len: 180 microversion: 2.1 time: 0.228288 Jul 25 20:14:35.931217 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1091/2150] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:14:35 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc/ips => generated 180 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:35.956298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81bed2cd-7d50-4ddb-8857-245f7eb23595 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ebb6700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:43.219937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:43.900906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:45.743872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=30 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:45.909829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:47.404739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:14:47.449526 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81bed2cd-7d50-4ddb-8857-245f7eb23595 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1462 microversion: 2.1 time: 11.515753 Jul 25 20:14:47.456481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1092/2151] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:35 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1462 bytes in 11524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:47.476009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0ebd7a23-cb79-4464-b6e9-27c9fc276af0 req-cf680ec8-5f24-495f-a18b-215637e965ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-plugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:47.504663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0ebd7a23-cb79-4464-b6e9-27c9fc276af0 req-cf680ec8-5f24-495f-a18b-215637e965ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:47.505643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0ebd7a23-cb79-4464-b6e9-27c9fc276af0 req-cf680ec8-5f24-495f-a18b-215637e965ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:47.521116 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0ebd7a23-cb79-4464-b6e9-27c9fc276af0 req-cf680ec8-5f24-495f-a18b-215637e965ce service nova] Creating event network-vif-plugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:14:47.539690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0ebd7a23-cb79-4464-b6e9-27c9fc276af0 req-cf680ec8-5f24-495f-a18b-215637e965ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080866 Jul 25 20:14:47.550653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1093/2152] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:47.564374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2362678-d857-4152-95ce-38ecd32b7192 tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] Calling method '.version_select at 0x7f196eaad700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:47.960516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:14:47.961586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:14:47.963441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:14:47.964536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:14:47.967220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:14:48.012182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2362678-d857-4152-95ce-38ecd32b7192 tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks/72fbcb55-45db-4218-9d9d-4b0d790cebc6" status: 200 len: 652 microversion: 2.1 time: 0.459249 Jul 25 20:14:48.013432 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1094/2153] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:14:47 2022] GET /compute/v2.1/os-networks/72fbcb55-45db-4218-9d9d-4b0d790cebc6 => generated 652 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:48.021997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:48.023946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c83fa7db-e52e-4a6a-b7d2-b5da6a3f9d5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f196eb71a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:48.025125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:48.028555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:48.030386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:48.116234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:14:48.138573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:14:48.209032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:14:48.218450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:14:48.358072 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc75fe24-6192-4879-9fcb-8c854c0ac111 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.116614 Jul 25 20:14:48.372733 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1060/2154] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 15132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:14:48.386159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:48.388874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:48.407136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:48.410862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:48.415162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:48.416664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:48.486175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:14:48.670640 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-72803949-e641-4088-933d-7f8fc59ec4e9 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 204 len: 0 microversion: 2.1 time: 0.294077 Jul 25 20:14:48.672419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1061/2155] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:14:48 2022] DELETE /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:14:48.683415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04dc453e-6f86-4782-9f07-b2dfeaaa8de8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eadee50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:56.795575 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c83fa7db-e52e-4a6a-b7d2-b5da6a3f9d5e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/images/429cd209-555c-4884-91ef-791f47d124fa" status: 204 len: 0 microversion: 2.1 time: 8.780433 Jul 25 20:14:56.801295 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1095/2156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:48 2022] DELETE /compute/v2.1/images/429cd209-555c-4884-91ef-791f47d124fa => generated 0 bytes in 8783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:14:56.806155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-38c4fd26-3683-4123-88e3-14efd7aac6f8 tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] Calling method '.version_select at 0x7f196eaadca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:57.184306 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-38c4fd26-3683-4123-88e3-14efd7aac6f8 tempest-NetworksTest-1605596230 tempest-NetworksTest-1605596230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 6716 microversion: 2.1 time: 0.381672 Jul 25 20:14:57.184985 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1096/2157] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:14:56 2022] GET /compute/v2.1/os-networks => generated 6716 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:57.203074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:57.207294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:57.220861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.221905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.223084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.224855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.640435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:57.659471 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54018b5c-67ae-49a1-95ef-0e6cefed480d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1313 microversion: 2.1 time: 0.469068 Jul 25 20:14:57.660150 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1097/2158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:57 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:57.669796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:57.670423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:57.694090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.695230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.696880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.698045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.731252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc HTTP/1.1 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:14:57.734806 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:14:57.737420 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c5a3012b-c8be-45c9-89b8-3be7cf3225dc'} Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:14:57.740261 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:14:57.743643 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:14:57.748168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:14:57.755061 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c1c0459-5c42-4500-861d-99c1db128b16 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 404 len: 111 microversion: 2.1 time: 0.084120 Jul 25 20:14:57.756935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1098/2159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:57 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:14:57.764707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3c7b967a-86be-4936-8ee4-b16080e8c177 req-37b45178-d379-4744-a7b3-b6b7a79ca4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779a51de-08d4-4639-b4fd-61e3db2d6ecc", "name": "network-vif-plugged", "status": "completed", "tag": "fe2a2b27-f50a-4260-88b0-9a43b958e985"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:57.781070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3c7b967a-86be-4936-8ee4-b16080e8c177 req-37b45178-d379-4744-a7b3-b6b7a79ca4c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.782000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3c7b967a-86be-4936-8ee4-b16080e8c177 req-37b45178-d379-4744-a7b3-b6b7a79ca4c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.796190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3c7b967a-86be-4936-8ee4-b16080e8c177 req-37b45178-d379-4744-a7b3-b6b7a79ca4c8 service nova] Creating event network-vif-plugged:fe2a2b27-f50a-4260-88b0-9a43b958e985 for instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc on n-h2-845775-3 Jul 25 20:14:57.804768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3c7b967a-86be-4936-8ee4-b16080e8c177 req-37b45178-d379-4744-a7b3-b6b7a79ca4c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044040 Jul 25 20:14:57.806140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1099/2160] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:57.813490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6f5ec436-a654-49fe-9124-b73983927ae7 req-de88a984-c147-44f3-bfab-b0eb3b910fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "name": "network-vif-deleted", "tag": "edfacf52-0291-4395-98af-4d6ec0eac908"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:57.830439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6f5ec436-a654-49fe-9124-b73983927ae7 req-de88a984-c147-44f3-bfab-b0eb3b910fba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.831235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6f5ec436-a654-49fe-9124-b73983927ae7 req-de88a984-c147-44f3-bfab-b0eb3b910fba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.842751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04dc453e-6f86-4782-9f07-b2dfeaaa8de8 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 200 len: 1462 microversion: 2.1 time: 9.167165 Jul 25 20:14:57.843360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1062/2161] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:14:48 2022] GET /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 1462 bytes in 9170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:57.846935 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6f5ec436-a654-49fe-9124-b73983927ae7 req-de88a984-c147-44f3-bfab-b0eb3b910fba service nova] Creating event network-vif-deleted:edfacf52-0291-4395-98af-4d6ec0eac908 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:14:57.851121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6019c9ea-ad97-416c-95f4-cbc803bac960 req-ced73a07-1c98-4b4d-bab1-570f1b87fc07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:57.855842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6f5ec436-a654-49fe-9124-b73983927ae7 req-de88a984-c147-44f3-bfab-b0eb3b910fba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046514 Jul 25 20:14:57.857908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1100/2162] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:57.872321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:57.873437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:57.878894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6019c9ea-ad97-416c-95f4-cbc803bac960 req-ced73a07-1c98-4b4d-bab1-570f1b87fc07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.879358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6019c9ea-ad97-416c-95f4-cbc803bac960 req-ced73a07-1c98-4b4d-bab1-570f1b87fc07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.882593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.883388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.884462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.885087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.930595 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6019c9ea-ad97-416c-95f4-cbc803bac960 req-ced73a07-1c98-4b4d-bab1-570f1b87fc07 service nova] Creating event network-changed:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h1-845775-3 Jul 25 20:14:57.942093 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6019c9ea-ad97-416c-95f4-cbc803bac960 req-ced73a07-1c98-4b4d-bab1-570f1b87fc07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094551 Jul 25 20:14:57.955681 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1063/2163] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:14:57.962454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:57.969565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:57.988228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.988984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:57.991401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:57.993721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:58.103891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:58.186382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:14:58.730722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:58.748367 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-03649544-040d-418c-85d0-4efa85823a01 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 0.888254 Jul 25 20:14:58.749877 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1101/2164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:57 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:58.768286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:58.769747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:58.798944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:58.800259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:58.801283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:58.801891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:58.859162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:58.895668 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fbd7dd55-172b-413b-a60f-ce2c81f017ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.935331 Jul 25 20:14:58.921060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1064/2165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:57 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:58.938749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:58.939516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:58.961529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:58.962016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:58.962852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:58.963675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:59.661886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:59.677486 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0edbe0b-b753-42b0-b46c-08e09d9e5499 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1468 microversion: 2.1 time: 0.924931 Jul 25 20:14:59.678501 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1102/2166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:58 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1468 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:59.709440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1175119203"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:14:59.712954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:59.734339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:59.739623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:59.741130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:59.741980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:59.827794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:14:59.854996 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-654548a4-8fb0-447d-8b16-fa91558ea4d7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1313 microversion: 2.1 time: 0.932010 Jul 25 20:14:59.877073 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1065/2167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:58 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:14:59.885202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:14:59.905577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:14:59.923687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:59.926732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:14:59.932263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:14:59.932835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:00.345080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07ba8488-008e-4162-b79d-eb467e70b6c7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "POST /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc/action" status: 202 len: 0 microversion: 2.1 time: 0.639918 Jul 25 20:15:00.355429 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1103/2168] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:14:59 2022] POST /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:15:00.365934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-12d94084-11c6-45ba-8a40-f6e7e27e5847 req-094e7d09-164d-4702-9c38-dcf34b3c0884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1754d-5d46-4ace-bc70-b6c00bf08b99", "name": "network-vif-unplugged", "status": "completed", "tag": "707a75e3-3d04-4fab-b129-8ae3088e09f1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:00.404657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12d94084-11c6-45ba-8a40-f6e7e27e5847 req-094e7d09-164d-4702-9c38-dcf34b3c0884 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:00.409591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12d94084-11c6-45ba-8a40-f6e7e27e5847 req-094e7d09-164d-4702-9c38-dcf34b3c0884 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:00.444856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-12d94084-11c6-45ba-8a40-f6e7e27e5847 req-094e7d09-164d-4702-9c38-dcf34b3c0884 service nova] Creating event network-vif-unplugged:707a75e3-3d04-4fab-b129-8ae3088e09f1 for instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 on n-h1-845775-3 Jul 25 20:15:00.458975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-12d94084-11c6-45ba-8a40-f6e7e27e5847 req-094e7d09-164d-4702-9c38-dcf34b3c0884 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101573 Jul 25 20:15:00.462034 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1104/2169] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:00.474604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:00.475336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:00.496775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:00.497272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:00.501012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:00.502209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.350460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:01.387223 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1eb5702e-9230-4566-b8c8-378228de04bb tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 1.500190 Jul 25 20:15:01.393817 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1066/2170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:14:59 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:01.418390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63d586a1-5778-43ec-9668-8d5e703c2a95 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea51670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:01.559780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:01.599399 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63d586a1-5778-43ec-9668-8d5e703c2a95 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1453 microversion: 2.1 time: 0.197069 Jul 25 20:15:01.607457 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1067/2171] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:01 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1453 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:01.612183 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9dfa6d64-0f4f-4d6b-aa86-48c5533cbee8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.148495 Jul 25 20:15:01.615247 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1105/2172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:00 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:01.639554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-be33a34a-ed6e-4b33-9648-d0c35bd31a2a req-f04b2af5-2531-4a59-8a9a-104afeb23b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a3012b-c8be-45c9-89b8-3be7cf3225dc", "name": "network-vif-deleted", "tag": "7a0aaba6-88bf-4161-8ae7-b8408bede917"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:01.643504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:01.644523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:01.683759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.686238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.692955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.702295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.709762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-be33a34a-ed6e-4b33-9648-d0c35bd31a2a req-f04b2af5-2531-4a59-8a9a-104afeb23b59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.713284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-be33a34a-ed6e-4b33-9648-d0c35bd31a2a req-f04b2af5-2531-4a59-8a9a-104afeb23b59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.772986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-be33a34a-ed6e-4b33-9648-d0c35bd31a2a req-f04b2af5-2531-4a59-8a9a-104afeb23b59 service nova] Creating event network-vif-deleted:7a0aaba6-88bf-4161-8ae7-b8408bede917 for instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc on n-h2-845775-3 Jul 25 20:15:01.799036 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-be33a34a-ed6e-4b33-9648-d0c35bd31a2a req-f04b2af5-2531-4a59-8a9a-104afeb23b59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182686 Jul 25 20:15:01.808335 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:15:01.808335 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 20:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Jul 25 20:15:01.809547 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1068/2173] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:01.851953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1422621670"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:01.862185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:01.905398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.911073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:01.916416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:01.919764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:02.460551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:02.494742 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a887db5c-dd76-4bd0-876c-fea1488e17bc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1313 microversion: 2.1 time: 0.877894 Jul 25 20:15:02.500275 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1106/2174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:01 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:02.531270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:02.537704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:02.570068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:02.573093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:02.580018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:02.581366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:02.924301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d411bfa-b819-45a5-b967-2a16d969ca80 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 1.091820 Jul 25 20:15:02.926151 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1069/2175] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:15:01 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 25 20:15:02.959514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a07677d9-3d02-4029-a83c-4c23aba41bd4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ead5e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:03.010091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:03.031757 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1336cff4-3077-4b4e-9a4b-215bbb87ec80 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 0.529024 Jul 25 20:15:03.034759 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1107/2176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:02 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:03.057741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:03.058734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:03.079095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.079874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.082659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.083434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.126786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a07677d9-3d02-4029-a83c-4c23aba41bd4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1453 microversion: 2.1 time: 0.194218 Jul 25 20:15:03.132447 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1070/2177] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:02 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1453 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:03.426904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a52af633-9421-42b3-b453-bc9377896915 req-3950a727-f4ca-4573-b0b5-0e22f3f4ebfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:03.463208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a52af633-9421-42b3-b453-bc9377896915 req-3950a727-f4ca-4573-b0b5-0e22f3f4ebfe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.464678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a52af633-9421-42b3-b453-bc9377896915 req-3950a727-f4ca-4573-b0b5-0e22f3f4ebfe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.497280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a52af633-9421-42b3-b453-bc9377896915 req-3950a727-f4ca-4573-b0b5-0e22f3f4ebfe service nova] Creating event network-vif-unplugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:15:03.524914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a52af633-9421-42b3-b453-bc9377896915 req-3950a727-f4ca-4573-b0b5-0e22f3f4ebfe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104504 Jul 25 20:15:03.529281 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1071/2178] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:15:03.543428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:03.558811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:03.573677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.577348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:03.585249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:03.586003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:04.936437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:04.993343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-50c8871d-0e20-49ad-b277-464dffb635bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 1.948635 Jul 25 20:15:05.007248 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1108/2179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:03 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:05.043905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.045054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.061867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.068248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.069823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.070774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.083952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:05.097529 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37802ae7-5395-4c0e-9d65-072e0dda6425 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1313 microversion: 2.1 time: 1.559364 Jul 25 20:15:05.117852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1072/2180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:03 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1313 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:05.136984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.145546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.153445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc HTTP/1.1 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:05.160251 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.162310 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c5a3012b-c8be-45c9-89b8-3be7cf3225dc'} Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:05.163234 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.165160 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.175758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:05.177220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e5402c64-2f27-46df-9302-301efaa26d4f tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 404 len: 111 microversion: 2.1 time: 0.167622 Jul 25 20:15:05.179033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.180524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.180756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1109/2181] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:05 2022] DELETE /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:05.183444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.186628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.192764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12edf1e6-0801-4444-971a-6be32e6b8fce tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea21280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.323834 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12edf1e6-0801-4444-971a-6be32e6b8fce tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1453 microversion: 2.1 time: 0.140969 Jul 25 20:15:05.325595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1110/2182] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:05 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:05.340086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.343591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: c5a3012b-c8be-45c9-89b8-3be7cf3225dc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.360337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.363888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.366186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.367277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.400809 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc HTTP/1.1 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:05.403399 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.405100 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c5a3012b-c8be-45c9-89b8-3be7cf3225dc'} Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:05.408235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. Jul 25 20:15:05.410061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.414249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance c5a3012b-c8be-45c9-89b8-3be7cf3225dc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:05.427967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-458b6810-0d6e-49a2-aaad-95f1cefed23a tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc" status: 404 len: 111 microversion: 2.1 time: 0.100503 Jul 25 20:15:05.432304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1111/2183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:05 2022] GET /compute/v2.1/servers/c5a3012b-c8be-45c9-89b8-3be7cf3225dc => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:05.500248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.502911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.526134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.533866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.536724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.538171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.654972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:05.688206 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dafd61d3-fa53-4648-a7ee-7211d5f28d9e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 0.568104 Jul 25 20:15:05.724437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1073/2184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:05 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:05.734563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6fe4157a-759e-467d-970d-5701c354f007 req-23114562-8306-4715-8d5e-aca9205c3f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "name": "network-vif-plugged", "status": "completed", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:05.754626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6fe4157a-759e-467d-970d-5701c354f007 req-23114562-8306-4715-8d5e-aca9205c3f45 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.755730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6fe4157a-759e-467d-970d-5701c354f007 req-23114562-8306-4715-8d5e-aca9205c3f45 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.767392 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 HTTP/1.1 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:05.778557 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.781286 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '25b59dc5-ee2b-470f-aa3e-6eb4162c3021'} Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:05.783446 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.786228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.794555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6fe4157a-759e-467d-970d-5701c354f007 req-23114562-8306-4715-8d5e-aca9205c3f45 service nova] Creating event network-vif-plugged:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h1-845775-3 Jul 25 20:15:05.794555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6fe4157a-759e-467d-970d-5701c354f007 req-23114562-8306-4715-8d5e-aca9205c3f45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066983 Jul 25 20:15:05.796453 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1074/2185] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:05.802260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:05.803456 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1983ce86-909b-4430-9ae6-0eaf9d383c6e tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 404 len: 111 microversion: 2.1 time: 0.314213 Jul 25 20:15:05.830839 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1112/2186] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:05 2022] DELETE /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 111 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:05.841953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:05.843197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] [instance: 25b59dc5-ee2b-470f-aa3e-6eb4162c3021] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:05.877180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.877847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.884893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:05.888425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:05.981442 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] HTTP exception thrown: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Request method failure captured: Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 HTTP/1.1 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vj_NHSVUjMo8-hBOJ4SV5x6TV0R9B45gGfJtCEMQdnQtxHaalDpM9fUbvNxUFogBcRfwmZIP4ahThhnfX6XQeiC_aDWDNO7uPf0FC4jYaiROuMmSchu6zcYSY7UPHoFXSeVYGqlXQIRVAc_jcQNGNe_uKqqR1okLlBHQ-_s9eT6pww Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:15:05.988334 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb643c0372d04a3495e515c2a76a3697"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb643c0372d04a3495e515c2a76a3697"}]}] Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: cb643c0372d04a3495e515c2a76a3697 Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestMultiNic-1760901832 Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 23377768dc934265bf4eb9550084d731 Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestMultiNic-1760901832-project Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.991359 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '25b59dc5-ee2b-470f-aa3e-6eb4162c3021'} Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:05.992829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. Jul 25 20:15:05.995871 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:06.006898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] Returning 404 to user: Instance 25b59dc5-ee2b-470f-aa3e-6eb4162c3021 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:06.006898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97df27b4-5149-474b-b17e-59d58e1ae910 tempest-ServersTestMultiNic-1760901832 tempest-ServersTestMultiNic-1760901832-project] 10.222.0.48 "GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021" status: 404 len: 111 microversion: 2.1 time: 0.165004 Jul 25 20:15:06.006898 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1075/2187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:05 2022] GET /compute/v2.1/servers/25b59dc5-ee2b-470f-aa3e-6eb4162c3021 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:06.033772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:06.041582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:06.094549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.095326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:06.096798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.111650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:06.147837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:06.150411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:06.176889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.180803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:06.182982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:06.188008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:08.020319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:08.055078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:08.057303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a113a136-b842-4ec7-9eb9-7c348fb5fda5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1689 microversion: 2.1 time: 2.031893 Jul 25 20:15:08.059752 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1113/2188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:06 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1689 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:08.083275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28b7c3dd-4711-46c1-a277-437d71140013 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f19692bd0d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:08.086390 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8599a5a6-79f8-4ee7-8cfb-1d1ad93b99be tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1313 microversion: 2.1 time: 1.950223 Jul 25 20:15:08.097747 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1076/2189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:06 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1313 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:08.124559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:08.141483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:08.169072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:08.179521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:08.184704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:08.194573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.223148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:09.248658 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a9f8f6f-2aaf-4e6d-98e6-be48d0114355 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 1.149167 Jul 25 20:15:09.249677 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1077/2190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:08 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:09.269494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:09.271020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:09.311561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.313179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:09.315864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:09.321477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:10.092648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:10.174321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-72fcf3e3-fa1e-43c3-a949-c44b2eb454a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1689 microversion: 2.1 time: 0.919890 Jul 25 20:15:10.185588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1078/2191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:09 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1689 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:10.225912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:10.233827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:10.288235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:10.289156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:10.301398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:10.302501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:11.651368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:11.694856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9862592d-b833-4cce-bd06-6babe83b7f8c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1462 microversion: 2.1 time: 1.504646 Jul 25 20:15:11.695833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1079/2192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:10 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1462 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:11.735961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:11.737621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:11.786385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:11.786949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:11.787954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:11.788564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:11.897676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:12.721890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:12.759708 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ea4eda5-83a2-400d-a866-8ed06412adad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 1.048356 Jul 25 20:15:12.761275 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1080/2193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:11 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:12.777984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f4b3e9bf-27e4-4cc0-901e-bbd86b8607d4 req-ede8399d-b072-47bc-a66d-abee4944b5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-plugged", "status": "completed", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:12.838921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f4b3e9bf-27e4-4cc0-901e-bbd86b8607d4 req-ede8399d-b072-47bc-a66d-abee4944b5a3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:12.841165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f4b3e9bf-27e4-4cc0-901e-bbd86b8607d4 req-ede8399d-b072-47bc-a66d-abee4944b5a3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:12.923337 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f4b3e9bf-27e4-4cc0-901e-bbd86b8607d4 req-ede8399d-b072-47bc-a66d-abee4944b5a3 service nova] Creating event network-vif-plugged:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:15:12.942045 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f4b3e9bf-27e4-4cc0-901e-bbd86b8607d4 req-ede8399d-b072-47bc-a66d-abee4944b5a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177882 Jul 25 20:15:12.960363 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1081/2194] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:12.985571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:12.994041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:13.013103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:13.014154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:13.015908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:13.017720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:13.815734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:13.831014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f7a6d84-7fde-4c19-bd97-9cb48e1fc39d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.864078 Jul 25 20:15:13.834105 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1082/2195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:12 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:14.560216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:14.561470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:14.575087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:14.580637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.581382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:14.586754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:14.587588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:15.308307 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac2c18b0-62db-4eea-b413-8f7dbdc6f096 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1613 microversion: 2.1 time: 1.472380 Jul 25 20:15:15.317822 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1083/2196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:13 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1613 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:15.627409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-750aaedf-7865-43b4-b4bb-50486a6a8be2 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Calling method '.version_select at 0x7f196eaf7790>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:15.929748 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-750aaedf-7865-43b4-b4bb-50486a6a8be2 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 371 microversion: 2.1 time: 0.609776 Jul 25 20:15:15.930364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1084/2197] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:15:15 2022] GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 371 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:15.956446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:15.962653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:15.984381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:15.984962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:15.995317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:15.995317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:16.074488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=34 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:16.354389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:16.370455 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d460076c-be34-4dc5-a1c3-33e0d537bcd2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 0.430754 Jul 25 20:15:16.376265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1085/2198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:15 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:16.392316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:16.393329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:16.406487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:16.408082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:16.409628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:16.410347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:16.714351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:16.727369 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be2c0882-8681-4606-95db-f771d56e525a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.346573 Jul 25 20:15:16.731945 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1086/2199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:16 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:16.743068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-58960c71-c9be-454c-876c-54f92d466ad8 req-4c378652-4748-49cd-a5c3-30f41139f452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-plugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:16.787219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-58960c71-c9be-454c-876c-54f92d466ad8 req-4c378652-4748-49cd-a5c3-30f41139f452 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:16.788126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-58960c71-c9be-454c-876c-54f92d466ad8 req-4c378652-4748-49cd-a5c3-30f41139f452 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:16.837856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-58960c71-c9be-454c-876c-54f92d466ad8 req-4c378652-4748-49cd-a5c3-30f41139f452 service nova] Creating event network-vif-plugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:15:16.865151 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-58960c71-c9be-454c-876c-54f92d466ad8 req-4c378652-4748-49cd-a5c3-30f41139f452 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131409 Jul 25 20:15:16.871152 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1087/2200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:16.881681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:16.889750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:16.898680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:16.899553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:16.900852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:16.902056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:17.377328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '333091122e5c4b96bec76f17ea3cdd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c66bfd753ca43688db92c9f28efe7a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:17.378034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] flavor_id is None. Assuming migration. {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 20:15:17.378464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:15:18.049188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:18.539599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85cf1e27-d726-4472-8e0b-62d9d5ce8866 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce/action" status: 202 len: 0 microversion: 2.1 time: 1.666454 Jul 25 20:15:18.544968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1088/2201] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:15:16 2022] POST /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce/action => generated 0 bytes in 1668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:15:18.560903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f196eade790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:18.708956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28b7c3dd-4711-46c1-a277-437d71140013 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1453 microversion: 2.1 time: 10.647437 Jul 25 20:15:18.710214 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1114/2202] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:08 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1453 bytes in 10649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:18.719798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:18.722819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:18.733650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:18.736537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:18.739074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:18.740401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:18.777321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:18.791460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:18.792572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:18.816556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:18.983078 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e08dadb-3001-4f40-95a9-71d3d3c0dae9 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 328 microversion: 2.1 time: 0.437423 Jul 25 20:15:18.984495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1089/2203] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:18 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 328 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:18.989949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:18.991321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:19.002334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:19.002953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:19.003949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:19.005178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:19.129292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:19.138722 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e64f540a-166e-4a22-a626-8834ce1d4e13 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1535 microversion: 2.1 time: 0.427038 Jul 25 20:15:19.145038 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1115/2204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:18 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1535 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:19.161662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:19.162896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:19.176963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:19.177744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:19.183278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:19.185106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:19.817426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:19.851937 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc92a70d-0526-455f-ac56-0da2f0e48d3a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1471 microversion: 2.1 time: 0.702189 Jul 25 20:15:19.853068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1116/2205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:19 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1471 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:20.020474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:20.033872 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d607125b-52a8-4e28-b006-d0b62fe874ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 1.047545 Jul 25 20:15:20.062896 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1090/2206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:18 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:20.069268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-709abf49-084b-48dd-a64f-be057b726746 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea523a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:20.101416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-423327239", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:28.846313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:28.972429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:29.000007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:29.830807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:30.033615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:30.145640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:31.602609 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-709abf49-084b-48dd-a64f-be057b726746 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1462 microversion: 2.1 time: 11.537320 Jul 25 20:15:31.604928 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1091/2207] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:20 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1462 bytes in 11540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:31.617474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:31.617799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:31.620806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:31.636815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:31.640961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:31.642999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:31.643496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:32.816498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:32.825183 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-165f25b1-7cdd-4947-8535-5bbe2671c2da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1522 microversion: 2.1 time: 1.220631 Jul 25 20:15:32.829645 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1092/2208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:31 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1522 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:32.836255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:32.837201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:32.855668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:32.856485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:32.862358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:32.867442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:32.954862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:32.956138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:32.956791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:32.957380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:32.958164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:32.978700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:32.982287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:32.984128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:32.984800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.039491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:33.049313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for user 183a8cadb31c4ea7920409455b4b0318 and project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:33.099911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.utils [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] cores quota exceeded for 7c5f2e989aaa49b4babc734a1bab5bd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 20:15:33.101489 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 20:15:33.208623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:33.222735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df88bb81-6df0-4ba1-8ba8-e76ceba5c49f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1476 microversion: 2.1 time: 0.387805 Jul 25 20:15:33.223592 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1093/2209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:32 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:33.228655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:33.229994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:33.237329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.237777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.238548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.238982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Request method failure captured: Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 144 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnMUydBvVqk8OTPsVrn3tU6skbvQ6GnL6SAxfJK_-fFX7MZ7SSYwU39QdWjVEjgVHAhyAMtn2-V6YNRbrb03Ii_yUJ4LcLgMcATFswQmAk94OsjhGU32krKk6NPNzevJiWaXlAzT_UbzAYa9PikJMqbz_bmB8w0EnGxRjHakVfPbdM Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:33.281118 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}] Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 183a8cadb31c4ea7920409455b4b0318 Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-423327239", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} Jul 25 20:15:33.282845 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-423327239', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452'}}} Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 20:15:33.283757 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:33.285049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.286235 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 25 20:15:33.287380 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:33.289242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:33.291209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad309243-f36e-4e40-9b4b-1dd74e5a17c0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 13.435360 Jul 25 20:15:33.292211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1117/2210] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:15:19 2022] POST /compute/v2.1/servers => generated 111 bytes in 13438 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:33.302944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e310ead0-ea0d-48eb-bb37-543f9130cd4d req-4cec56ba-1022-4583-855b-5b2c62fe90e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779a51de-08d4-4639-b4fd-61e3db2d6ecc", "name": "network-vif-unplugged", "status": "completed", "tag": "fe2a2b27-f50a-4260-88b0-9a43b958e985"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:33.356580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e310ead0-ea0d-48eb-bb37-543f9130cd4d req-4cec56ba-1022-4583-855b-5b2c62fe90e9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.357851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e310ead0-ea0d-48eb-bb37-543f9130cd4d req-4cec56ba-1022-4583-855b-5b2c62fe90e9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.385078 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e310ead0-ea0d-48eb-bb37-543f9130cd4d req-4cec56ba-1022-4583-855b-5b2c62fe90e9 service nova] Creating event network-vif-unplugged:fe2a2b27-f50a-4260-88b0-9a43b958e985 for instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc on n-h2-845775-3 Jul 25 20:15:33.391312 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e310ead0-ea0d-48eb-bb37-543f9130cd4d req-4cec56ba-1022-4583-855b-5b2c62fe90e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097579 Jul 25 20:15:33.392583 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1118/2211] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:33.399775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43e6dff6-ab68-4387-a474-93ccf79d711e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Action: 'create', calling method: .version_select at 0x7f196944ae50>, body: {"keypair": {"name": "tempest-keypair-656422458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+jqBsetMzhXGiEd1YRkpFSfPoysWd9y5IX9nqCILpzpGGUk6b540UEai0gbk0dAdkJH7OHB7prPmKOcDdjhW3r7+SMpXCg6lGj9NTUYl8TntARmr33Z9EoFqGHGw26rA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:33.486446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-43e6dff6-ab68-4387-a474-93ccf79d711e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Getting quotas for project dca617b4772e4aa0a186e3538b185797. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:33.522250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-43e6dff6-ab68-4387-a474-93ccf79d711e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Getting quotas for user bc3fd947993e42919723d0a83baba88a and project dca617b4772e4aa0a186e3538b185797. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:33.565133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:33.601985 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0eaa85aa-55c2-4c50-9ea3-8b3efd70b6e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.377098 Jul 25 20:15:33.606461 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1094/2212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:33 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:33.614077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75b65803-f044-45fa-8914-e62c1f6a1675 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea52940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:33.668460 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43e6dff6-ab68-4387-a474-93ccf79d711e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.273792 Jul 25 20:15:33.669475 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1119/2213] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:15:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 276 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:15:33.689737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:33.694021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:33.703399 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75b65803-f044-45fa-8914-e62c1f6a1675 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 200 len: 1462 microversion: 2.1 time: 0.095556 Jul 25 20:15:33.708578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.708943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1095/2214] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:33 2022] GET /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:33.710613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.713285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.713877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.721342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f196e9b5dc0>, body: {"quota_set": {"cores": 20}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:33.756783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:15:33.942995 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e773ef1-d9cb-4bbc-abbc-cd8707b5d8e2 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 204 len: 0 microversion: 2.1 time: 0.267597 Jul 25 20:15:33.944632 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1120/2215] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:15:33 2022] DELETE /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:15:33.954636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:33.955868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:33.974790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.976968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:33.978374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:33.980130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:34.503558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:34.513561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:34.514625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:34.515095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:34.619874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:34.641747 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-434ed5bb-e1be-4116-b9a9-b82f3d499343 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1467 microversion: 2.1 time: 0.689883 Jul 25 20:15:34.642461 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1121/2216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:33 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1467 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:34.725525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e84e31a9-37cf-4a83-8c80-1c51598f2dbc tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 329 microversion: 2.1 time: 1.015318 Jul 25 20:15:34.736060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1096/2217] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:33 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 329 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:34.742647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:34.743632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:34.784309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:34.789631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:34.791045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:34.791834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:35.235548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-517398916", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "7e06e3ef-6cc7-4e12-9ed6-8d3a951c128d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:35.322082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:35.350890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] validate_networks() for [('7e06e3ef-6cc7-4e12-9ed6-8d3a951c128d', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:35.362826 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b932bbf-9e59-498d-9569-783ba4f2e0ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1528 microversion: 2.1 time: 0.624797 Jul 25 20:15:35.366866 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1097/2218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:34 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1528 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:35.392465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:35.394446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:35.414767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:35.418342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:35.424564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:35.429666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:36.071055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:36.085721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01c80a8c-727d-4d4b-9ec2-0deacb8e8b05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1476 microversion: 2.1 time: 0.700763 Jul 25 20:15:36.106991 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1098/2219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:35 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1476 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:36.121024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:36.123174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:36.153300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:36.154079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:36.159313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:36.162385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:36.969610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:36.970093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:36.970510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:36.971171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:36.971814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:37.008900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:37.021534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:37.022315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:37.024747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:37.025412 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36361683-1649-4824-b0eb-316346aaf65f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.911645 Jul 25 20:15:37.026883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:37.028171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1099/2220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:36 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:37.038639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c9d456f-ed33-4fe5-a006-a884d3af9d07 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea8b310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:37.104652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Getting quotas for project 9a348d4a0df747d799ae0f279f869bdc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:37.116123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Getting quotas for user 74a5f549ecc04cda87da139bad246400 and project 9a348d4a0df747d799ae0f279f869bdc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:37.140503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Going to run 2 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:15:37.144184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: a47f6ae9-42de-4662-a9fc-f7de74097977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:15:37.228465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=a47f6ae9-42de-4662-a9fc-f7de74097977,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:15:37.393798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-530e661e-e69d-4a0c-9d7b-be020b88c97e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.749927 Jul 25 20:15:37.416122 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1122/2221] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:15:37.421575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e37ab4b-5bbc-44ba-b196-2f884dfac5f3 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Calling method '.version_select at 0x7f196eb715e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:37.483416 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c9d456f-ed33-4fe5-a006-a884d3af9d07 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?changes-since=2022-07-25T20%3A12%3A48Z" status: 200 len: 1903 microversion: 2.1 time: 0.430047 Jul 25 20:15:37.498927 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1100/2222] 10.222.0.48 () {58 vars in 1199 bytes} [Mon Jul 25 20:15:37 2022] GET /compute/v2.1/images?changes-since=2022-07-25T20%3A12%3A48Z => generated 1903 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:37.505844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:37.513996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:37.527496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:37.530546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:37.532745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:37.534333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:37.701587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:37.726168 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76d8453a-eae9-444e-8d5d-f55373f67334 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 200 len: 1486 microversion: 2.1 time: 0.234994 Jul 25 20:15:37.728421 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1101/2223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:37 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 1486 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:37.755470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-75056189-fd89-4b2a-84ed-591005ba7961 req-53c9f8ed-85c0-4d46-8930-19d317c1c45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-unplugged", "status": "completed", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:37.816016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-75056189-fd89-4b2a-84ed-591005ba7961 req-53c9f8ed-85c0-4d46-8930-19d317c1c45b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:37.816223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-75056189-fd89-4b2a-84ed-591005ba7961 req-53c9f8ed-85c0-4d46-8930-19d317c1c45b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:37.874293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-75056189-fd89-4b2a-84ed-591005ba7961 req-53c9f8ed-85c0-4d46-8930-19d317c1c45b service nova] Creating event network-vif-unplugged:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:15:37.894513 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-75056189-fd89-4b2a-84ed-591005ba7961 req-53c9f8ed-85c0-4d46-8930-19d317c1c45b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164371 Jul 25 20:15:37.895326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1102/2224] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:38.037993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:38.039364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:38.079847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.086735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.088197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.096443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.215587 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e37ab4b-5bbc-44ba-b196-2f884dfac5f3 tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 371 microversion: 2.1 time: 0.797534 Jul 25 20:15:38.238918 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1123/2225] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:15:37 2022] GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 371 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:38.277254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:38.299611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:38.300862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Searching by: {'deleted': False, 'project_id': '9a348d4a0df747d799ae0f279f869bdc'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:15:38.374558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.377683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.400767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.407130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.568798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da370488-9654-4bc9-9dac-8cc60cfbc326 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.327226 Jul 25 20:15:38.591743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1124/2226] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:15:38 2022] GET /compute/v2.1/servers => generated 675 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:38.626352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-21846f42-6de1-4e38-8301-73a91f68aa29 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ebb6670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:38.691845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:38.704925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8552234-6cdf-417c-af1b-ce46d9e0d485 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1476 microversion: 2.1 time: 0.764527 Jul 25 20:15:38.706253 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1103/2227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:37 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1476 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:38.738666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-82f38184-e578-46b3-8a75-06f8f527f3e7 req-cc61e037-dc90-417e-88a8-be7da45aa8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779a51de-08d4-4639-b4fd-61e3db2d6ecc", "name": "network-vif-deleted", "tag": "fe2a2b27-f50a-4260-88b0-9a43b958e985"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:38.784302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-82f38184-e578-46b3-8a75-06f8f527f3e7 req-cc61e037-dc90-417e-88a8-be7da45aa8a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.785121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-82f38184-e578-46b3-8a75-06f8f527f3e7 req-cc61e037-dc90-417e-88a8-be7da45aa8a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.843088 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-82f38184-e578-46b3-8a75-06f8f527f3e7 req-cc61e037-dc90-417e-88a8-be7da45aa8a2 service nova] Creating event network-vif-deleted:fe2a2b27-f50a-4260-88b0-9a43b958e985 for instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc on n-h2-845775-3 Jul 25 20:15:38.857798 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-82f38184-e578-46b3-8a75-06f8f527f3e7 req-cc61e037-dc90-417e-88a8-be7da45aa8a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142097 Jul 25 20:15:38.860479 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1104/2228] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:38.866538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:38.869135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:38.927728 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-21846f42-6de1-4e38-8301-73a91f68aa29 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-229008793" status: 200 len: 484 microversion: 2.1 time: 0.317748 Jul 25 20:15:38.938297 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1125/2229] 10.222.0.48 () {58 vars in 1229 bytes} [Mon Jul 25 20:15:38 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-229008793 => generated 484 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:38.950669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.954354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.957659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:38.963803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:38.969179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f196ebba5e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:39.295595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:39.308414 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63da6ee4-8ff2-4a79-823f-60aea3af5f84 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.446472 Jul 25 20:15:39.324093 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1105/2230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:38 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:39.324093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b9cf7a0d-abeb-4b2c-bd3b-c469c0d287ec tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:39.327820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b9cf7a0d-abeb-4b2c-bd3b-c469c0d287ec tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:39.549495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b9cf7a0d-abeb-4b2c-bd3b-c469c0d287ec tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:39.562388 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b9cf7a0d-abeb-4b2c-bd3b-c469c0d287ec tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1219 microversion: 2.1 time: 0.247174 Jul 25 20:15:39.580730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1106/2231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:39 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:39.594388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:39.595463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:39.633785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:39.640368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:39.647507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:39.648330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:39.674635 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc HTTP/1.1 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:15:39.681498 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:15:39.683933 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc'} Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:39.684846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:15:39.686234 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:15:39.688513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:39.689726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3c2fdc3-95a2-4ad7-a6ca-20a2ea40e5ab tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 404 len: 111 microversion: 2.1 time: 0.105051 Jul 25 20:15:39.691879 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1107/2232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:39 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:39.704538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c09a1ae4-5a73-444e-8beb-3a1c908151c3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ead5c10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:39.802164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:39.803388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:39.804486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:39.805153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:39.973230 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c09a1ae4-5a73-444e-8beb-3a1c908151c3 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?server=545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 957 microversion: 2.1 time: 0.272509 Jul 25 20:15:39.975350 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1108/2233] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Jul 25 20:15:39 2022] GET /compute/v2.1/images?server=545121be-117a-432a-9ff1-9d5066eb7afc => generated 957 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:40.003001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69f736d0-231b-47f4-88ca-69dff7f83610 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'create', calling method: .version_select at 0x7f196ea52940>, body: {"keypair": {"name": "tempest-keypair-1422658885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUT+OL9lYMGFLWLXS6XrRK1UU9Wcj91+SVm6xzAwCuggr4d74selIWFQWOmVyE+D6DWnjO+6df8StgRuobiGRJdqUmZCzUsMudO83a8VdO0Ws1kvPoaTeT6OUAjBPARRQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:40.019138 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7d740ab-f45d-41f4-b276-2aa8fbf0285c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 328 microversion: 2.1 time: 1.077049 Jul 25 20:15:40.022938 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1126/2234] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:38 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 328 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:40.033211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:40.038673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:40.061480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:40.062406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:40.064331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:40.065319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:40.068219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-69f736d0-231b-47f4-88ca-69dff7f83610 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:40.076247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-69f736d0-231b-47f4-88ca-69dff7f83610 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for user 7d3883ad9f7744b5890c8847a4376a94 and project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:40.126139 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69f736d0-231b-47f4-88ca-69dff7f83610 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147456 Jul 25 20:15:40.127480 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1109/2235] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:15:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:40.139663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f30c3953-fbe7-4033-9721-8e85ca7e0f29 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaf3dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:40.218337 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f30c3953-fbe7-4033-9721-8e85ca7e0f29 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 485 microversion: 2.1 time: 0.088363 Jul 25 20:15:40.228407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1110/2236] 10.222.0.48 () {58 vars in 1317 bytes} [Mon Jul 25 20:15:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 485 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:40.235157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-769673629", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ed826791-99f8-4eda-8b96-69424a14ef1f"}, {"port": "2998464c-87f5-4c58-8c19-797dbc233cfe", "tag": "port-1"}, {"port": "783b5af4-2aec-4ff0-a438-c9426f47731a", "tag": "port-2"}, {"uuid": "14aa7a34-8812-4d2b-8339-feb5270d03cd", "tag": "net-1"}, {"uuid": "14aa7a34-8812-4d2b-8339-feb5270d03cd"}, {"uuid": "9554e01b-2344-454f-98a9-dc249eeb80d5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9554e01b-2344-454f-98a9-dc249eeb80d5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1b5ed5a9-e1e2-4c44-b462-7385b62ac811", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e6b71d8f-ae7f-41aa-8008-ffe4cfdc2610", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7914ef4c-49c9-4a93-90c5-a2d14d3bd1b5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--67404221"}], "key_name": "tempest-keypair-656422458", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:40.294479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:40.314789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-306c6f83-d200-4cac-9d2d-a19ccc6a1ccf tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1476 microversion: 2.1 time: 0.289430 Jul 25 20:15:40.315812 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1127/2237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:40 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:40.321855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b7c76f25-9df9-4d2c-9dfa-a5cf5880aaa6 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ebaa310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:40.468191 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b7c76f25-9df9-4d2c-9dfa-a5cf5880aaa6 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 485 microversion: 2.1 time: 0.149036 Jul 25 20:15:40.469677 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1128/2238] 10.222.0.48 () {58 vars in 1303 bytes} [Mon Jul 25 20:15:40 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 485 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:40.477136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2140028001", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:40.575169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:40.621713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] validate_networks() for [('ed826791-99f8-4eda-8b96-69424a14ef1f', None, None, None, None, None), (None, None, '2998464c-87f5-4c58-8c19-797dbc233cfe', None, None, None), (None, None, '783b5af4-2aec-4ff0-a438-c9426f47731a', None, None, None), ('14aa7a34-8812-4d2b-8339-feb5270d03cd', None, None, None, None, None), ('14aa7a34-8812-4d2b-8339-feb5270d03cd', None, None, None, None, None), ('9554e01b-2344-454f-98a9-dc249eeb80d5', '10.2.2.100', None, None, None, None), ('9554e01b-2344-454f-98a9-dc249eeb80d5', '10.2.2.200', None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:41.384121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:41.384748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:41.385486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:41.386114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:41.386742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:41.409289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:41.409895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:41.410897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:41.412093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:41.458621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:41.467746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for user 183a8cadb31c4ea7920409455b4b0318 and project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:41.503826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.utils [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] instances quota exceeded for 7c5f2e989aaa49b4babc734a1bab5bd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 20:15:41.504772 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Request method failure captured: Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 145 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnMUydBvVqk8OTPsVrn3tU6skbvQ6GnL6SAxfJK_-fFX7MZ7SSYwU39QdWjVEjgVHAhyAMtn2-V6YNRbrb03Ii_yUJ4LcLgMcATFswQmAk94OsjhGU32krKk6NPNzevJiWaXlAzT_UbzAYa9PikJMqbz_bmB8w0EnGxRjHakVfPbdM Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:41.507112 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}] Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 183a8cadb31c4ea7920409455b4b0318 Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2140028001", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} Jul 25 20:15:41.508427 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2140028001', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452'}}} Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 20:15:41.509090 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:41.510051 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.511178 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 25 20:15:41.512328 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:41.514308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:41.515401 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ee2ee41-1f15-43ec-828f-ab247bb0b6a3 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.043923 Jul 25 20:15:41.519633 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1129/2239] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:15:40 2022] POST /compute/v2.1/servers => generated 119 bytes in 1049 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:41.531216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:41.532336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:41.553965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:41.557241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:41.559218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:41.560527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:42.355922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:42.373247 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2269cb14-d0ac-45c9-9b15-befdce9c5c7b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1684 microversion: 2.1 time: 0.846253 Jul 25 20:15:42.373247 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1130/2240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:41 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1684 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:42.388576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a7e5c3c-1aec-4787-b12b-61475bc6d176 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ebbaee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:42.667543 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a7e5c3c-1aec-4787-b12b-61475bc6d176 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.297535 Jul 25 20:15:42.669087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1131/2241] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:15:42 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:42.677088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:42.677728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:42.684287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:42.684998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:42.686006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:42.686810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:42.851954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:42.869023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c6fe987-36e0-4745-ab97-01efb3aa6dc0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1277 microversion: 2.1 time: 0.195637 Jul 25 20:15:42.870101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1132/2242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:42 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:42.882708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:42.883569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:42.894522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:42.895998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:42.897398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:42.898005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:44.449100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:44.460098 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1522199-d75d-46c2-88e5-e13ba8bea36a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1475 microversion: 2.1 time: 1.588704 Jul 25 20:15:44.461108 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1133/2243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:42 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1475 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:44.484126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f196ea8ef70>, body: {"quota_set": {"instances": 10}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:44.532923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:44.791423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:44.791885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:44.793482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:44.794124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:44.846571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:44.981445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df791c53-e39c-4d19-8c94-aaacdf65b73e tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 329 microversion: 2.1 time: 0.517181 Jul 25 20:15:44.984991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1134/2244] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:44 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 329 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:44.997221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f56bb49-e871-45d8-8f37-7b4e118cdd5b tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb6d430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:45.153381 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f56bb49-e871-45d8-8f37-7b4e118cdd5b tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.164508 Jul 25 20:15:45.153988 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1135/2245] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:15:44 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:45.196026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:45.212807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:45.237267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:45.237839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:45.245581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:45.246102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:46.154860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:46.173446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e310865-3fad-4962-884b-89cd1c776215 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.018373 Jul 25 20:15:46.179835 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1136/2246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:45 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:46.197162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:46.197951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:46.227093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:46.231177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:46.233924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:46.235848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:46.973052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:46.985279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0cb18267-b0be-4c31-9ab3-20ea7c7fdc07 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.803565 Jul 25 20:15:47.000262 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1137/2247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:46 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:47.009546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "name": "network-vif-unplugged", "status": "completed", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:47.030472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:47.031256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:47.051146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] Creating event network-vif-unplugged:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h2-845775-3 Jul 25 20:15:47.080622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] Instance d130ca20-d3ad-4614-b482-f992c69dc8ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:15:47.101953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2ed31109-616f-4831-8cda-9078a2b82684 req-ce8342ab-fe17-4077-84fc-d189cec11e2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100266 Jul 25 20:15:47.103341 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1138/2248] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:47.110412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61a2d63f-b69d-476a-937a-b1298db19fda tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Calling method '.version_select at 0x7f196eb71c10>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:47.246452 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61a2d63f-b69d-476a-937a-b1298db19fda tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 371 microversion: 2.1 time: 0.141501 Jul 25 20:15:47.247992 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1139/2249] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:15:47 2022] GET /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:47.254424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0985d2a7-e6f9-4778-b805-bffd3c5bbc09 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea21820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:47.341100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0985d2a7-e6f9-4778-b805-bffd3c5bbc09 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.091647 Jul 25 20:15:47.341954 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1140/2250] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:15:47 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:47.351495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:47.352883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:47.368615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:47.371481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:47.372116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:47.372577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:47.858104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:47.866922 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cde8f208-7d39-4e0f-b08f-280802c65622 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1475 microversion: 2.1 time: 0.523741 Jul 25 20:15:47.867769 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1141/2251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:47 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1475 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:47.872427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f1969d0ba60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:48.236811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.237585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:48.238687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.239339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:48.334783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ace30c3c-8611-4a20-b1db-59bdd51e481c tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 325 microversion: 2.1 time: 0.465689 Jul 25 20:15:48.336330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1142/2252] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:47 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:48.348817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f7c835d-aca1-41dd-98a2-921a2ffbdece tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f1969aa98b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:48.492377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f7c835d-aca1-41dd-98a2-921a2ffbdece tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?changes-since=2022-07-25T20%3A12%3A43Z" status: 200 len: 6326 microversion: 2.1 time: 0.153840 Jul 25 20:15:48.493511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1143/2253] 10.222.0.48 () {58 vars in 1220 bytes} [Mon Jul 25 20:15:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-25T20%3A12%3A43Z => generated 6326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:48.499037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:48.499782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:48.511739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.512315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:48.513210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.513889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:48.899404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:48.908319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68d529c7-4a68-42a9-8ea3-0e10c691cc6c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.412986 Jul 25 20:15:48.918340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1144/2254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:48 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:48.926854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:48.927785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:48.944542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.945336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:48.946508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:48.947162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:49.411796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:49.424746 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d92c9267-88de-496f-beb4-5209aa09f9c1 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.502325 Jul 25 20:15:49.425465 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1145/2255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:48 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:49.444596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-01613ce3-21b9-44a9-a701-589e98055641 req-e6b903e9-3c03-405e-8a52-2226ba011790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:49.465105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-01613ce3-21b9-44a9-a701-589e98055641 req-e6b903e9-3c03-405e-8a52-2226ba011790 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:49.465564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-01613ce3-21b9-44a9-a701-589e98055641 req-e6b903e9-3c03-405e-8a52-2226ba011790 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:49.506683 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-01613ce3-21b9-44a9-a701-589e98055641 req-e6b903e9-3c03-405e-8a52-2226ba011790 service nova] Creating event network-vif-unplugged:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:15:49.514363 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-01613ce3-21b9-44a9-a701-589e98055641 req-e6b903e9-3c03-405e-8a52-2226ba011790 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087160 Jul 25 20:15:49.514987 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1146/2256] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:49.522896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2061627769", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:49.598572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] validate_networks() for [('1dc75bc8-6a1d-4286-815a-04492dd5f726', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:49.656650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=62 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:50.089183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:50.358328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:50.358761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:50.359665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:50.359781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:50.360313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:50.381319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:50.382171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:50.383526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:50.384791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:50.435974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Getting quotas for project dca617b4772e4aa0a186e3538b185797. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:50.447005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Getting quotas for user bc3fd947993e42919723d0a83baba88a and project dca617b4772e4aa0a186e3538b185797. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:50.608055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:50.608508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:50.609010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:50.609846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:50.610266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:50.632458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:50.632738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:50.633585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:50.634052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:50.648520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:50.667681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:50.676096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for user 7d3883ad9f7744b5890c8847a4376a94 and project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:50.697874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:15:50.702620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1b5ed5a9-e1e2-4c44-b462-7385b62ac811',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e6b71d8f-ae7f-41aa-8008-ffe4cfdc2610',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7914ef4c-49c9-4a93-90c5-a2d14d3bd1b5',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:15:50.703408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:15:50.705898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:15:50.794479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ff60d8a-374a-4052-9441-e5b3338dbcad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.276438 Jul 25 20:15:50.795876 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1147/2257] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:15:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:15:50.802232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-741889596", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:50.875859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:15:51.199189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:15:51.200380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:15:51.201517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:15:51.202529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:15:51.204131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:15:51.221304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.223135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.225496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.226714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.260843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:15:51.274580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Getting quotas for user 183a8cadb31c4ea7920409455b4b0318 and project 7c5f2e989aaa49b4babc734a1bab5bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:15:51.299564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.utils [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] ram quota exceeded for 7c5f2e989aaa49b4babc734a1bab5bd4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119724) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 25 20:15:51.300570 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Request method failure captured: Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 144 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnMUydBvVqk8OTPsVrn3tU6skbvQ6GnL6SAxfJK_-fFX7MZ7SSYwU39QdWjVEjgVHAhyAMtn2-V6YNRbrb03Ii_yUJ4LcLgMcATFswQmAk94OsjhGU32krKk6NPNzevJiWaXlAzT_UbzAYa9PikJMqbz_bmB8w0EnGxRjHakVfPbdM Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:51.304785 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}] Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 183a8cadb31c4ea7920409455b4b0318 Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-741889596", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} Jul 25 20:15:51.307501 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-741889596', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452'}}} Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 20:15:51.308834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:51.310173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.311668 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9867a86c-b8bf-448e-a3b5-e51ff996bafe tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.510301 Jul 25 20:15:51.315143 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1148/2258] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:15:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 512 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:51.332272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62501db2-3051-4af8-8ce7-46fefd5f1204 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eb718b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:51.392884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62501db2-3051-4af8-8ce7-46fefd5f1204 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-229008793" status: 200 len: 664 microversion: 2.1 time: 0.082465 Jul 25 20:15:51.397120 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1149/2259] 10.222.0.48 () {58 vars in 1250 bytes} [Mon Jul 25 20:15:51 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-229008793 => generated 664 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:51.411999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:51.413603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:51.431903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.433987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.436551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.438556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.474114 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9539e613-6ee9-4543-b3e5-8b0efcd78c46 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 11.243765 Jul 25 20:15:51.482989 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1111/2260] 10.222.0.48 () {62 vars in 1189 bytes} [Mon Jul 25 20:15:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 11251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:15:51.485945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-469e1d1b-6bfb-4400-b6be-3a0eb294489b req-36cbccf0-a83f-4673-bb90-eeda128e523d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97867022-8276-4093-a58d-15da705bb37f", "tag": "45d60c80-85fa-43ce-a5bb-6a1c2b85db2b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:51.505216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-469e1d1b-6bfb-4400-b6be-3a0eb294489b req-36cbccf0-a83f-4673-bb90-eeda128e523d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.505661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-469e1d1b-6bfb-4400-b6be-3a0eb294489b req-36cbccf0-a83f-4673-bb90-eeda128e523d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.545828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-469e1d1b-6bfb-4400-b6be-3a0eb294489b req-36cbccf0-a83f-4673-bb90-eeda128e523d service nova] Creating event network-changed:45d60c80-85fa-43ce-a5bb-6a1c2b85db2b for instance 97867022-8276-4093-a58d-15da705bb37f on n-h1-845775-3 Jul 25 20:15:51.553282 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-469e1d1b-6bfb-4400-b6be-3a0eb294489b req-36cbccf0-a83f-4673-bb90-eeda128e523d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071454 Jul 25 20:15:51.553827 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1112/2261] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:51.581470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}, {"name": "network-changed", "server_uuid": "a47f6ae9-42de-4662-a9fc-f7de74097977", "tag": "36feca69-6cf2-448c-a5f4-7e908f4dfba2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:51.601676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.602577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.624883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Creating event network-changed:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h2-845775-3 Jul 25 20:15:51.625752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Creating event network-changed:36feca69-6cf2-448c-a5f4-7e908f4dfba2 for instance a47f6ae9-42de-4662-a9fc-f7de74097977 on n-h2-845775-3 Jul 25 20:15:51.635883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] Instance d130ca20-d3ad-4614-b482-f992c69dc8ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:15:51.659419 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-dd42777c-ce1c-426f-9ae9-0ab972c5592a req-7d6e510f-f88f-4721-b749-cc6665cdb493 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.100540 Jul 25 20:15:51.666698 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1113/2262] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:51.678102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:51.679121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:51.710826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.711749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.712265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.712707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.894678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:51.905299 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-47f11c83-055c-435a-9bf8-4b4c0131afe8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1470 microversion: 2.1 time: 0.504892 Jul 25 20:15:51.908059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1150/2263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:51 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:51.919360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:51.920345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:51.938201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.944549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:51.946233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:51.948027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.036996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:52.047273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-499a5b30-a058-4c7f-a31f-c53502e85dc9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.378470 Jul 25 20:15:52.055998 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1114/2264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:51 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:52.068997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:52.069933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:52.086218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.086985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.088011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.088684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.165563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:52.188445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6269cb63-aab4-4095-b491-c2127e8e0328 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1277 microversion: 2.1 time: 0.278636 Jul 25 20:15:52.190585 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1151/2265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:51 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:52.197880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Action: 'update', calling method: .version_select at 0x7f196ea21700>, body: {"quota_set": {"ram": 51200}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:52.593224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:52.619151 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-143b77ed-ca64-4a08-ad6c-f5e7accc2494 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.561161 Jul 25 20:15:52.624192 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1115/2266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:52 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:52.643586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05b867c4-f92e-4054-8288-84c6a730aa52 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196e9afa60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:52.743207 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05b867c4-f92e-4054-8288-84c6a730aa52 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1465 microversion: 2.1 time: 0.104141 Jul 25 20:15:52.755511 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1116/2267] 10.222.0.48 () {58 vars in 1338 bytes} [Mon Jul 25 20:15:52 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1465 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:52.767308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:52.770376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:52.775205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.777769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.778938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.779604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.902044 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8860ac50-cbc7-48da-a3f3-e723922d995a tempest-QuotasAdminNegativeTest-1595873031 tempest-QuotasAdminNegativeTest-1595873031-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 200 len: 329 microversion: 2.1 time: 0.707968 Jul 25 20:15:52.912610 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1152/2268] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:52 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 329 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:52.919153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:52.920071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:52.930445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.931106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.933303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:52.935298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:52.965355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:52.989966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:53.002352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:53.005426 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-497df905-6cb2-4dbc-b3c7-e9d7e33582c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1284 microversion: 2.42 time: 0.248536 Jul 25 20:15:53.006049 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1117/2269] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:15:52 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:15:53.020290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:53.022068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:53.034412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.035229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.036329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.037019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.067451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-587a77da-a804-4834-b41a-250237eda27c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce/action" status: 204 len: 0 microversion: 2.1 time: 0.152897 Jul 25 20:15:53.075061 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1153/2270] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:15:52 2022] POST /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce/action => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:15:53.087816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04298b98-96a8-4b92-a912-cbb4e2d9fddc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196c14c820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:53.173090 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04298b98-96a8-4b92-a912-cbb4e2d9fddc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1465 microversion: 2.1 time: 0.089473 Jul 25 20:15:53.174691 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1154/2271] 10.222.0.48 () {58 vars in 1324 bytes} [Mon Jul 25 20:15:53 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:53.188804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "name": "network-vif-plugged", "status": "completed", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:53.221178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.223733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.253170 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] Creating event network-vif-plugged:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h2-845775-3 Jul 25 20:15:53.269958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] Instance d130ca20-d3ad-4614-b482-f992c69dc8ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:15:53.294112 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d1e038a7-fa1f-49ba-94fd-c8fea2507bf6 req-bcc78cdf-2c16-460b-bdf7-8da3a7b128a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115081 Jul 25 20:15:53.295305 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1155/2272] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:53.305830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7caff33-eea5-489d-be9c-4573996f22b0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Action: 'update', calling method: .version_select at 0x7f1969bc7a60>, body: {"quota_set": {"ram": 0}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:53.320254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e7caff33-eea5-489d-be9c-4573996f22b0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '183a8cadb31c4ea7920409455b4b0318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5f2e989aaa49b4babc734a1bab5bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7caff33-eea5-489d-be9c-4573996f22b0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Request method failure captured: Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 HTTP/1.1 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 25 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnMUydBvVqk8OTPsVrn3tU6skbvQ6GnL6SAxfJK_-fFX7MZ7SSYwU39QdWjVEjgVHAhyAMtn2-V6YNRbrb03Ii_yUJ4LcLgMcATFswQmAk94OsjhGU32krKk6NPNzevJiWaXlAzT_UbzAYa9PikJMqbz_bmB8w0EnGxRjHakVfPbdM Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:15:53.331645 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c5f2e989aaa49b4babc734a1bab5bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c5f2e989aaa49b4babc734a1bab5bd4"}]}] Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7c5f2e989aaa49b4babc734a1bab5bd4 Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-761934759 Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 183a8cadb31c4ea7920409455b4b0318 Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-QuotasAdminNegativeTest-761934759-project Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: {"quota_set": {"ram": 0}} Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 20:15:53.333241 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '7c5f2e989aaa49b4babc734a1bab5bd4', 'body': {'quota_set': {'ram': 0}}} Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:15:53.334218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:53.335523 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 25 20:15:53.336925 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:15:53.338201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7caff33-eea5-489d-be9c-4573996f22b0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:15:53.339212 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7caff33-eea5-489d-be9c-4573996f22b0 tempest-QuotasAdminNegativeTest-761934759 tempest-QuotasAdminNegativeTest-761934759-project] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4" status: 403 len: 116 microversion: 2.1 time: 0.042648 Jul 25 20:15:53.340270 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1156/2273] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:15:53 2022] PUT /compute/v2.1/os-quota-sets/7c5f2e989aaa49b4babc734a1bab5bd4 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:15:53.352599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:53.353667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:53.372598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.373217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.374152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.374583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.914870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:53.925881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5dbaa0cc-df59-4344-a4bd-ac32f8af6b69 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.916336 Jul 25 20:15:53.947638 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1118/2274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:53 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:53.953098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:53.954253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:53.962147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.963834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:53.964954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:53.965753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.133301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.149505 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70e83db2-51f5-4277-999f-9984402e99e5 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.806202 Jul 25 20:15:54.152998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1157/2275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:53 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:54.167537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a5c7e32-3829-443c-a5c0-a6edd534182a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f1969e0aaf0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:54.357804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.375651 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3eabfb5f-e2ab-4223-b4e9-c663403832d3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1470 microversion: 2.1 time: 0.424695 Jul 25 20:15:54.376284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1119/2276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:53 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:54.398705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:54.399380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:54.411446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a5c7e32-3829-443c-a5c0-a6edd534182a tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.254529 Jul 25 20:15:54.412784 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1158/2277] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:15:54 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:54.421894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.422258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:54.423334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.426787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:54.428550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.430804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.456810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.457572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.458655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.459450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.590483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.604196 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4385babe-2513-42c2-abaa-fb04e7dbb5ce tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1283 microversion: 2.1 time: 0.224005 Jul 25 20:15:54.605130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1120/2278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:54 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:54.610035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:54.610576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:54.618947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.619765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.620806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:54.621454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:54.826726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.843234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.847296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:54.849703 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b4a1296-68fa-48a8-a862-15ff2527108e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1592 microversion: 2.42 time: 0.243298 Jul 25 20:15:54.850752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1121/2279] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:15:54 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1592 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:15:54.876724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-345aeb30-92af-4f70-997c-f81f0420edf4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196e9b5e50>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.033540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-345aeb30-92af-4f70-997c-f81f0420edf4 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.178802 Jul 25 20:15:55.035284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1122/2280] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:15:54 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:55.050969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-280d93c2-b42a-4076-b920-f8a49eea4fa9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196e96c4c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.103676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-280d93c2-b42a-4076-b920-f8a49eea4fa9 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba" status: 200 len: 784 microversion: 2.1 time: 0.056893 Jul 25 20:15:55.104829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1123/2281] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:15:55 2022] GET /compute/v2.1/images/152afe05-2c67-43aa-ad3c-bacbf2d878ba => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:15:55.122592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6572996-45d1-4c2e-af49-3e743bf5c47f tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea51ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.184257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6572996-45d1-4c2e-af49-3e743bf5c47f tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.067042 Jul 25 20:15:55.185500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1124/2282] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:15:55 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:55.191509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.192446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:55.206775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:55.207617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:55.208816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:55.209125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:55.561955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:55.574178 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bfd36eb2-fd77-4654-86a2-5ee529f420a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.158271 Jul 25 20:15:55.588062 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1159/2283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:54 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:55.588062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0183f26-88d7-4798-8853-3431b5ae07df tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea78ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.834574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:55.847918 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2d8791ac-d512-4219-a02b-b3d59c8edcd3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.660950 Jul 25 20:15:55.849121 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1125/2284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:55 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:55.864156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-232e9464-895d-4eab-b40d-0d7a5395b854 req-5c437d41-1916-450c-af0e-173a4c0488f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47f6ae9-42de-4662-a9fc-f7de74097977", "name": "network-vif-plugged", "status": "completed", "tag": "36feca69-6cf2-448c-a5f4-7e908f4dfba2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:55.884131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-232e9464-895d-4eab-b40d-0d7a5395b854 req-5c437d41-1916-450c-af0e-173a4c0488f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:55.896688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-232e9464-895d-4eab-b40d-0d7a5395b854 req-5c437d41-1916-450c-af0e-173a4c0488f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:55.909508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-232e9464-895d-4eab-b40d-0d7a5395b854 req-5c437d41-1916-450c-af0e-173a4c0488f4 service nova] Creating event network-vif-plugged:36feca69-6cf2-448c-a5f4-7e908f4dfba2 for instance a47f6ae9-42de-4662-a9fc-f7de74097977 on n-h2-845775-3 Jul 25 20:15:55.929976 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-232e9464-895d-4eab-b40d-0d7a5395b854 req-5c437d41-1916-450c-af0e-173a4c0488f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079368 Jul 25 20:15:55.931238 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1126/2285] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:55.936712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:55.937832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:55.941215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:55.958940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:55.959962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:55.960951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:55.961558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.654296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0183f26-88d7-4798-8853-3431b5ae07df tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2" status: 204 len: 0 microversion: 2.1 time: 1.076655 Jul 25 20:15:56.655205 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1160/2286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:55 2022] DELETE /compute/v2.1/images/eba2b698-6b6d-4f29-9dea-db85dde4edd2 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:15:56.662427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:56.668299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:56.677215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:15:56.698180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.699178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.700794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.703272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.735599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:56.754586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0b0c72c-c3b7-427f-9152-1ddd14513c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1470 microversion: 2.1 time: 0.821803 Jul 25 20:15:56.757854 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1127/2287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:55 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1470 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:56.775114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:56.775719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:56.796063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.796870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.798275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.798886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.900793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-caf1485b-1ca5-47c1-854d-c7852d8808e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.239003 Jul 25 20:15:56.906669 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1161/2288] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:15:56 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:15:56.914075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:56.915956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:56.927710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.929346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:56.929346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:56.929718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:57.286427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:57.325696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:57.329103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:57.331631 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9fc84b6-dfb7-4f1e-ad84-591c749932ba tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1592 microversion: 2.42 time: 0.423091 Jul 25 20:15:57.373197 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1162/2289] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:15:56 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1592 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:15:57.395367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e63ab11-934e-4b2d-af34-a3c3dc0fedab tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196944a820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:57.594673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:57.612555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85588f53-a50f-4c36-b258-5930239f54ac tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 0.850686 Jul 25 20:15:57.614728 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1128/2290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:56 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:57.630855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:57.638063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:57.661346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:57.665670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:57.667421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:57.668013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:58.252844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:58.276418 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e7806f1-a1a6-4fba-a536-825d44147319 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.657764 Jul 25 20:15:58.290984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1129/2291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:57 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:58.317848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:58.319486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:58.332275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:58.332767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:58.334514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:58.335124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:59.201888 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e63ab11-934e-4b2d-af34-a3c3dc0fedab tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e" status: 204 len: 0 microversion: 2.1 time: 1.826699 Jul 25 20:15:59.203351 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1163/2292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:57 2022] DELETE /compute/v2.1/images/2b77bb1e-3bc2-4a22-8552-227cf8d3574e => generated 0 bytes in 1829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:15:59.211687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:59.212871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:59.234798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:59.237345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:59.238793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:59.241346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:59.349151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:15:59.366683 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-068eb9eb-a620-48a0-8f6f-cf64d2499df6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1673 microversion: 2.1 time: 1.074826 Jul 25 20:15:59.368116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1130/2293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:58 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1673 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:15:59.375808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5d04ba09-8cde-441f-87ac-d32c229c9c5a req-0e2455c2-9501-4e9b-9cee-4cd1e02fd1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97867022-8276-4093-a58d-15da705bb37f", "name": "network-vif-plugged", "status": "completed", "tag": "45d60c80-85fa-43ce-a5bb-6a1c2b85db2b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:15:59.391075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d04ba09-8cde-441f-87ac-d32c229c9c5a req-0e2455c2-9501-4e9b-9cee-4cd1e02fd1ee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:59.391856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d04ba09-8cde-441f-87ac-d32c229c9c5a req-0e2455c2-9501-4e9b-9cee-4cd1e02fd1ee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:59.429931 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5d04ba09-8cde-441f-87ac-d32c229c9c5a req-0e2455c2-9501-4e9b-9cee-4cd1e02fd1ee service nova] Creating event network-vif-plugged:45d60c80-85fa-43ce-a5bb-6a1c2b85db2b for instance 97867022-8276-4093-a58d-15da705bb37f on n-h1-845775-3 Jul 25 20:15:59.444726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5d04ba09-8cde-441f-87ac-d32c229c9c5a req-0e2455c2-9501-4e9b-9cee-4cd1e02fd1ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073431 Jul 25 20:15:59.448878 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1131/2294] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:15:59.463369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:15:59.472219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:15:59.495664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:59.496153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:15:59.496945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:15:59.497385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:00.134506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:00.148329 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4e619f3-f1a6-4a93-9fe9-9c359dd2ed7f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1462 microversion: 2.1 time: 0.943301 Jul 25 20:16:00.165551 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1164/2295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:15:59 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1462 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:00.174568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-84218ec7-8b8b-45c2-9240-f90756661da3 req-633b339e-b22e-498d-9ca0-cd791e2fe53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e", "tag": "0bd7aba1-4763-4c8b-b479-ff4aed9bf847"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:00.180435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:00.191199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-84218ec7-8b8b-45c2-9240-f90756661da3 req-633b339e-b22e-498d-9ca0-cd791e2fe53c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:00.191659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-84218ec7-8b8b-45c2-9240-f90756661da3 req-633b339e-b22e-498d-9ca0-cd791e2fe53c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:00.198411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:00.201934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:00.204816 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2887ffd6-aeec-43de-a4a4-6bd4953869a7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1658 microversion: 2.42 time: 0.745728 Jul 25 20:16:00.220951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1132/2296] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:15:59 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1658 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:00.225010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-84218ec7-8b8b-45c2-9240-f90756661da3 req-633b339e-b22e-498d-9ca0-cd791e2fe53c service nova] Creating event network-changed:0bd7aba1-4763-4c8b-b479-ff4aed9bf847 for instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e on n-h2-845775-3 Jul 25 20:16:00.230858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:00.231891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:00.236072 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-84218ec7-8b8b-45c2-9240-f90756661da3 req-633b339e-b22e-498d-9ca0-cd791e2fe53c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066977 Jul 25 20:16:00.241146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:00.242001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:00.243290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:00.243417 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1165/2297] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:00.244133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:00.255953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9f5fccb-6dd8-440a-b228-6ab8bd69cac1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196944ab80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:00.418485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:00.734043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:00.755570 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95b868ec-cb0b-49f9-a64b-3c1976c3057c tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 0.532362 Jul 25 20:16:00.758073 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1133/2298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:00 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:00.775157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:00.776916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:00.792322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:00.793890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:00.795336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:00.796394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.384007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:01.405460 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f380d2ae-4d8a-405d-8cf2-77a937afdb9d tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1319 microversion: 2.1 time: 0.643963 Jul 25 20:16:01.406815 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1134/2299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:00 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1319 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:01.420118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:01.424306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:01.453369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.453995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.454927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.456507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.513516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:01.575828 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9f5fccb-6dd8-440a-b228-6ab8bd69cac1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457" status: 204 len: 0 microversion: 2.1 time: 1.331116 Jul 25 20:16:01.577265 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1166/2300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:00 2022] DELETE /compute/v2.1/images/cd73b886-b079-48d1-bf86-ead357012457 => generated 0 bytes in 1333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:01.584557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:01.589031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:01.613464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.621029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.623210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.625750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.844930 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8aac6d09-9678-480d-b391-cd4532d39d39 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1613 microversion: 2.1 time: 0.429302 Jul 25 20:16:01.860288 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1135/2301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:01 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1613 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:01.866184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:01.879913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:01.902225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.905665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:01.906778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:01.907606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.294642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:02.311867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e78a7f7f-fa5c-4b64-bb7d-b0b973f6ea38 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1678 microversion: 2.1 time: 0.732460 Jul 25 20:16:02.313073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1167/2302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:01 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1678 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:02.339690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:02.340658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:02.374078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:02.375405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.376310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:02.377466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.453928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:02.564868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:02.583575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:02.587609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:02.590611 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0bcb28c-d2c3-41a1-8924-8b626316a859 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1703 microversion: 2.42 time: 0.736587 Jul 25 20:16:02.611705 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1136/2303] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:01 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1703 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:02.627291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-792086db-93d1-4b21-a8ae-0ea090a5e315 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 204 len: 0 microversion: 2.1 time: 0.301024 Jul 25 20:16:02.629248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:02.629932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:02.631566 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1168/2304] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:02 2022] DELETE /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:02.644174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26848c71-b62c-4449-b757-5e5b33a8df02 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '.version_select at 0x7f196a033820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:02.650173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:02.650641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.651448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:02.651895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.654953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26848c71-b62c-4449-b757-5e5b33a8df02 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:02.656671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26848c71-b62c-4449-b757-5e5b33a8df02 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:02.679451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26848c71-b62c-4449-b757-5e5b33a8df02 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 410 microversion: 2.1 time: 0.044670 Jul 25 20:16:02.682395 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1169/2305] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:16:02 2022] GET /compute/v2.1/os-migrations => generated 410 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:02.800410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:02.887893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=70 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:02.957251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-741513886", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:02.973082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:03.079193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:03.248015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:03.263532 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a3d7a18-7796-4cd8-b54a-614e8be8195a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 0.649788 Jul 25 20:16:03.280219 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1137/2306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:02 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:03.293465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:03.294415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:03.301791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:03.302724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:03.304321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:03.305330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:04.175428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:04.176967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:04.177585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:04.179435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:04.180192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:04.186371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:04.197598 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37468545-4242-4fcb-9b1a-8203cda6f9b9 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 200 len: 1508 microversion: 2.1 time: 0.914525 Jul 25 20:16:04.207615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:04.208725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:04.210730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:04.211759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:04.216610 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1138/2307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:03 2022] GET /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 1508 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:04.221939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:04.222666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:04.231315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:04.231984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:04.233151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:04.235141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:04.249295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:04.258031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for user b62b2140b1fa4df9bb1701a2dc11776f and project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:04.307029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:04.314895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:04.455754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2fe62de7-4ca3-4c5b-b07a-bc623c4d1d3a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767877 Jul 25 20:16:04.460265 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1170/2308] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:04.481584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1195123694", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:04.652959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:05.510320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:05.540850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-14a1ee10-9618-42bd-8067-2306dd644833 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 200 len: 1474 microversion: 2.1 time: 1.322448 Jul 25 20:16:05.541839 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1139/2309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:04 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 1474 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:05.561146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:05.562892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:05.572967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:05.579393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:05.580784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:05.581675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:05.759260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:05.760370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:05.761133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:05.761714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:05.762351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:05.782098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:05.782855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:05.783889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:05.785847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:05.851766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:05.871880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:05.915323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:05.923511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:05.994271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a0c029c-2751-42c5-992a-982f53b68fa6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530769 Jul 25 20:16:05.995225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1171/2310] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:06.007133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:06.009000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:06.041319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.042126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.047903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.048905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.059702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:06.090879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:06.110711 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6992574-7d0a-4916-a958-bced182ed2fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.567227 Jul 25 20:16:06.151621 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1140/2311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:05 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:06.173972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:06.175939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: a47f6ae9-42de-4662-a9fc-f7de74097977] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:06.191894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.193205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.195100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.196231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.717465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:06.730430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:06.742246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:06.743733 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9687d3a7-a733-48cf-8cc4-b98baa974245 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1748 microversion: 2.42 time: 0.747362 Jul 25 20:16:06.744828 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1172/2312] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:05 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1748 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:06.749853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:06.761005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:06.768475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.769176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.770142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:06.770766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:06.795685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:06.825265 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96afb409-c10d-41fa-95eb-7c8542efbec3 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/a47f6ae9-42de-4662-a9fc-f7de74097977" status: 200 len: 1507 microversion: 2.1 time: 0.671950 Jul 25 20:16:06.826046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1141/2313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:06 2022] GET /compute/v2.1/servers/a47f6ae9-42de-4662-a9fc-f7de74097977 => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:06.887171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1234653969", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:07.062644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:07.714389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:07.751972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99bfe969-9163-46dd-91d7-664006859812 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 1.005431 Jul 25 20:16:07.755108 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1173/2314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:06 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:07.784111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f719aebd-934c-489d-b4d9-a2fb63850e86 req-3ba35e3e-7d6f-4cbc-9487-b3c853922b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e", "name": "network-vif-plugged", "status": "completed", "tag": "0bd7aba1-4763-4c8b-b479-ff4aed9bf847"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:07.816241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f719aebd-934c-489d-b4d9-a2fb63850e86 req-3ba35e3e-7d6f-4cbc-9487-b3c853922b16 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:07.817526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f719aebd-934c-489d-b4d9-a2fb63850e86 req-3ba35e3e-7d6f-4cbc-9487-b3c853922b16 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:07.891783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f719aebd-934c-489d-b4d9-a2fb63850e86 req-3ba35e3e-7d6f-4cbc-9487-b3c853922b16 service nova] Creating event network-vif-plugged:0bd7aba1-4763-4c8b-b479-ff4aed9bf847 for instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e on n-h2-845775-3 Jul 25 20:16:07.916162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f719aebd-934c-489d-b4d9-a2fb63850e86 req-3ba35e3e-7d6f-4cbc-9487-b3c853922b16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155737 Jul 25 20:16:07.917118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1174/2315] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:07.924108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:07.925043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:07.984945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:07.985749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:07.987178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:07.989779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.029679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:08.032364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:08.035930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:08.037652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:08.039159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:08.058574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.059430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.060894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.061669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.101101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:08.113456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for user b62b2140b1fa4df9bb1701a2dc11776f and project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:08.143201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:08.163332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35334b95-03bb-4f35-ab1e-6a5ccbc86c6a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1265 microversion: 2.1 time: 0.243341 Jul 25 20:16:08.165012 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1175/2316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:07 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:08.184284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:08.190286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:08.192059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:08.196359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.222348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.225562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.235404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.237127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.329149 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96a23eb9-fbe0-42bb-b422-b104a60b4ec7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494953 Jul 25 20:16:08.331796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1142/2317] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:08.346182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:08.351027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 1ab1754d-5d46-4ace-bc70-b6c00bf08b99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.375560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.376020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.378281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.379073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.405076 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] HTTP exception thrown: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. Jul 25 20:16:08.407132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2834092e-c48a-4f05-b1f7-29b6561dd928 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 200 len: 323 microversion: 2.1 time: 0.238370 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Request method failure captured: Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 HTTP/1.1 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vk5Hlxl2j98Ap8FjqGwJXnbvSWzf7jIPB1pHbU6-xpB4VUgG4hzqMItGwYUqbq1yMxzH6i8MXUReYQgViFTq2InRqHpIwBigl6rDNLPNQ_Tf-j_JqbVTgLk1AOeqKm5BP6W9RHRLOSOL_VoMqq862mGwOThdIzNWl6tJPmHAjU5v6A Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0f1308036b7a477dbd8d67e93e50bbc9 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:16:08.407535 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f1308036b7a477dbd8d67e93e50bbc9"}]}] Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0f1308036b7a477dbd8d67e93e50bbc9 Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListImageFiltersTestJSON-452834910-project Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 1c5102a00ef64e38a10d89ecb06d643e Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListImageFiltersTestJSON-452834910-project Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. Jul 25 20:16:08.410113 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1ab1754d-5d46-4ace-bc70-b6c00bf08b99'} Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:08.417600 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. Jul 25 20:16:08.421439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:08.426270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Returning 404 to user: Instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:08.426270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c2dc5e98-10e1-4643-bdbd-16c6f39e50be tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99" status: 404 len: 111 microversion: 2.1 time: 0.075042 Jul 25 20:16:08.427941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1176/2318] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:16:08 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 323 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:08.428113 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1143/2319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:08 2022] GET /compute/v2.1/servers/1ab1754d-5d46-4ace-bc70-b6c00bf08b99 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:16:08.428113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:08.428113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: a47f6ae9-42de-4662-a9fc-f7de74097977] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.431249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d278974c-4018-4027-9620-3714dc1e6c76 req-1ea1fe1d-4c78-44c7-8540-4687e7bc97f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab1754d-5d46-4ace-bc70-b6c00bf08b99", "name": "network-vif-deleted", "tag": "707a75e3-3d04-4fab-b129-8ae3088e09f1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:08.445180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.445995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.447421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.449046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.472999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d278974c-4018-4027-9620-3714dc1e6c76 req-1ea1fe1d-4c78-44c7-8540-4687e7bc97f8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.475775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d278974c-4018-4027-9620-3714dc1e6c76 req-1ea1fe1d-4c78-44c7-8540-4687e7bc97f8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.498464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: a47f6ae9-42de-4662-a9fc-f7de74097977] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:08.512669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d278974c-4018-4027-9620-3714dc1e6c76 req-1ea1fe1d-4c78-44c7-8540-4687e7bc97f8 service nova] Creating event network-vif-deleted:707a75e3-3d04-4fab-b129-8ae3088e09f1 for instance 1ab1754d-5d46-4ace-bc70-b6c00bf08b99 on n-h1-845775-3 Jul 25 20:16:08.533341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d278974c-4018-4027-9620-3714dc1e6c76 req-1ea1fe1d-4c78-44c7-8540-4687e7bc97f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115717 Jul 25 20:16:08.534424 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1177/2320] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:08.543135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:08.544218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.566742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.570359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.575551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.580422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.673830 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7ea1a5f-b24e-402d-8d4c-f30ecd071bf0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a47f6ae9-42de-4662-a9fc-f7de74097977" status: 204 len: 0 microversion: 2.1 time: 0.249171 Jul 25 20:16:08.674622 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1144/2321] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:08 2022] DELETE /compute/v2.1/servers/a47f6ae9-42de-4662-a9fc-f7de74097977 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:08.692648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60aeeb05-b6c0-4696-b3dc-d0f11a6c616b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:08.701386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60aeeb05-b6c0-4696-b3dc-d0f11a6c616b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.872696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60aeeb05-b6c0-4696-b3dc-d0f11a6c616b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:08.892059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60aeeb05-b6c0-4696-b3dc-d0f11a6c616b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1214 microversion: 2.1 time: 0.212819 Jul 25 20:16:08.893068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1145/2322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:08 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:08.907164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:08.907164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:08.932614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.933667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:08.935133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:08.935953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.323269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:09.333581 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cd9fc1cf-d8cd-47bd-9c0c-05badef85ad9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.439234 Jul 25 20:16:09.334410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1146/2323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:08 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:09.341645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:09.342660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:09.350736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.351523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.352594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.353238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.361715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:09.389550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:09.394805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:09.399172 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92fe3ed1-c6c3-4ad9-8719-848b7f20093b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1793 microversion: 2.42 time: 0.863071 Jul 25 20:16:09.404972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1178/2324] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:08 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1793 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:09.460498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:09.461940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:09.482789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.484005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.485531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.487116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.509203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:09.571695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 97867022-8276-4093-a58d-15da705bb37f] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:09.748370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8cea809-af86-4520-b5c5-cc416b4c038d tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 204 len: 0 microversion: 2.1 time: 0.411721 Jul 25 20:16:09.754977 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1147/2325] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:09 2022] DELETE /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:09.779503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:09.780295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:09.807890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.808262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.809069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.809521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.854645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc3aa4cf-2c6d-4bc4-9329-f95196380b23 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f" status: 204 len: 0 microversion: 2.1 time: 0.444459 Jul 25 20:16:09.869866 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1179/2326] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:09 2022] DELETE /compute/v2.1/servers/97867022-8276-4093-a58d-15da705bb37f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:09.891383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:09.893058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:09.905328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.906994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:09.908779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:09.909859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.115289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:10.129115 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5c5be5d-3a67-4ab7-83ea-633267f617dd tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 0.372718 Jul 25 20:16:10.135886 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1148/2327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:09 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:10.144598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:10.150026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:10.151109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:10.160608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.161453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.163075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.164366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.168608 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b34376f9-685a-434e-aed5-02b0188fb2d6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1271 microversion: 2.1 time: 0.296340 Jul 25 20:16:10.169220 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1180/2328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:09 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:10.180840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:10.180840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:10.192535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.193323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.194738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.195545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.639512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:10.649598 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-328269c0-f4cd-4981-a03e-f4d7d3b95c42 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.511089 Jul 25 20:16:10.656599 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1149/2329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:10 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:10.680161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:10.684975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:10.707554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.715836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:10.720867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.725953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:10.726919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:10.738387 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6891bcdc-f71b-451b-af53-9507c0e2509e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1473 microversion: 2.1 time: 0.568002 Jul 25 20:16:10.742068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1181/2330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:10 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1473 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:10.767045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1680238122", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "7e06e3ef-6cc7-4e12-9ed6-8d3a951c128d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:10.894053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] validate_networks() for [('7e06e3ef-6cc7-4e12-9ed6-8d3a951c128d', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:11.106656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:11.131408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-02e0e43c-11b4-4b77-ab97-4af303c95dce tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1210 microversion: 2.1 time: 0.473079 Jul 25 20:16:11.132344 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1150/2331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:10 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1210 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:11.152860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:11.158725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:11.180323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:11.181526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:11.183221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:11.183874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:11.191690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:12.643822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:12.662764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:12.664648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:12.666882 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbdfccca-ed62-4557-9804-29653c53511b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1838 microversion: 2.42 time: 1.529444 Jul 25 20:16:12.668048 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1151/2332] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:11 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1838 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:12.673081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:12.673941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:12.690803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:12.691634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:12.692657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:12.693262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.274945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:13.283196 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4564e749-5cf5-4438-ace6-62e09211b8e4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.613907 Jul 25 20:16:13.299582 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1152/2333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:12 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:13.307568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:13.308607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:13.320552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:13.321518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:13.322179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:13.322745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:13.323718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:13.323878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.324266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.325264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.325875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.376267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.377170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.378183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.378796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.410396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Getting quotas for project 9a348d4a0df747d799ae0f279f869bdc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:13.435285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Getting quotas for user 74a5f549ecc04cda87da139bad246400 and project 9a348d4a0df747d799ae0f279f869bdc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:13.466170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Going to run 2 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:13.469705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:13.544286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=20008018-045c-420f-a5b8-4193fb9ed8b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:13.657620 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c713f45-8319-466a-8ea1-93b43ca2eace tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.913743 Jul 25 20:16:13.661723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1182/2334] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2919 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 25 20:16:13.667067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:13.667950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:13.677023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.677925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.679295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.680388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.867159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:13.884605 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42b4c2ba-f751-4a67-8c5d-c753fd329588 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1325 microversion: 2.1 time: 0.582843 Jul 25 20:16:13.900779 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1153/2335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:13 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:13.912389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:13.913369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:13.925544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.928668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:13.932762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:13.933154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:14.553021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:14.589601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f08794c8-ecad-4992-8011-7aea8d97ea70 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1313 microversion: 2.1 time: 0.925912 Jul 25 20:16:14.608559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1183/2336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:13 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1313 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:14.627188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:14.628625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:14.642530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:14.643737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:14.646372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:14.647696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:14.912243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:14.930280 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-11345825-d26b-4f16-a35c-0d71f55b615c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1272 microversion: 2.1 time: 0.319171 Jul 25 20:16:14.931114 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1184/2337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:14 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:14.936059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:14.937717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:14.954799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:14.959738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:14.960625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:14.961871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:14.962535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:15.625544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:15.644907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-712ecc50-edab-4256-a469-ca30b890bfa1 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1473 microversion: 2.1 time: 1.742513 Jul 25 20:16:15.649149 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1154/2338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:13 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1473 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:15.659055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:15.673028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:15.674691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Searching by: {'deleted': False, 'project_id': '9a348d4a0df747d799ae0f279f869bdc'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:16:15.689185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:15.689961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:15.693624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:15.694478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:15.787594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:16:15.891047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78bc8547-9107-4348-beac-5a5ec6550ee4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.239095 Jul 25 20:16:15.891656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1155/2339] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:16:15 2022] GET /compute/v2.1/servers => generated 1004 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:15.908727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:15.909430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:15.927999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:15.928722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:15.930180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:15.930983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:16.374770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:16.393446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d70331ac-201c-4aac-95db-24a32d747576 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.461030 Jul 25 20:16:16.409718 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1185/2340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:14 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:16.438024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-060e7d93-ff7d-42d7-ac6b-e484c711e837 req-c38a82cc-dbb2-4567-b628-d2fb5c0234e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97867022-8276-4093-a58d-15da705bb37f", "name": "network-vif-deleted", "tag": "45d60c80-85fa-43ce-a5bb-6a1c2b85db2b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:16.464842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-060e7d93-ff7d-42d7-ac6b-e484c711e837 req-c38a82cc-dbb2-4567-b628-d2fb5c0234e2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:16.469134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-060e7d93-ff7d-42d7-ac6b-e484c711e837 req-c38a82cc-dbb2-4567-b628-d2fb5c0234e2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:16.484802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-060e7d93-ff7d-42d7-ac6b-e484c711e837 req-c38a82cc-dbb2-4567-b628-d2fb5c0234e2 service nova] Creating event network-vif-deleted:45d60c80-85fa-43ce-a5bb-6a1c2b85db2b for instance 97867022-8276-4093-a58d-15da705bb37f on n-h1-845775-3 Jul 25 20:16:16.493026 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-060e7d93-ff7d-42d7-ac6b-e484c711e837 req-c38a82cc-dbb2-4567-b628-d2fb5c0234e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081944 Jul 25 20:16:16.494202 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1186/2341] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:16.500008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:16.501742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:16.510662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:16.515529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:16.519412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:16.520192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:16.991749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:17.025787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:17.037539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:17.040154 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e23c6ffe-ae77-43a2-95d5-b51582f606e3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1838 microversion: 2.42 time: 1.142617 Jul 25 20:16:17.045509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1156/2342] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:15 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1838 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:17.082391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-488e4d9c-cb96-4b60-a317-694cf112c55e req-7a9aeb7a-32d4-4cd4-a924-c67e5e090598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47f6ae9-42de-4662-a9fc-f7de74097977", "name": "network-vif-unplugged", "status": "completed", "tag": "36feca69-6cf2-448c-a5f4-7e908f4dfba2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:17.126706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-488e4d9c-cb96-4b60-a317-694cf112c55e req-7a9aeb7a-32d4-4cd4-a924-c67e5e090598 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:17.128069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-488e4d9c-cb96-4b60-a317-694cf112c55e req-7a9aeb7a-32d4-4cd4-a924-c67e5e090598 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:17.176794 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-488e4d9c-cb96-4b60-a317-694cf112c55e req-7a9aeb7a-32d4-4cd4-a924-c67e5e090598 service nova] Creating event network-vif-unplugged:36feca69-6cf2-448c-a5f4-7e908f4dfba2 for instance a47f6ae9-42de-4662-a9fc-f7de74097977 on n-h2-845775-3 Jul 25 20:16:17.192827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-488e4d9c-cb96-4b60-a317-694cf112c55e req-7a9aeb7a-32d4-4cd4-a924-c67e5e090598 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143461 Jul 25 20:16:17.196215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1157/2343] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:17.212474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:17.220115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:17.240476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:17.242533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:17.246551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:17.248066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.254998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:18.275480 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-841829a2-24ef-4000-8cdb-207d14109976 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1313 microversion: 2.1 time: 1.073715 Jul 25 20:16:18.278144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1158/2344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:17 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1313 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:18.285340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:18.286411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:18.303967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.304769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.306050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.307275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.520595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:18.533553 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e393a81a-5308-4c9a-8a2f-9a0f1a1daf20 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1523 microversion: 2.1 time: 2.037867 Jul 25 20:16:18.535019 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1187/2345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:16 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1523 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:18.555553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:18.557382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:18.585591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.586130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.586987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.587506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.871190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:18.892942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:18.911988 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0bd69b5-f085-4a35-9698-51b4efb91568 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1276 microversion: 2.1 time: 0.631665 Jul 25 20:16:18.925022 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1159/2346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:18 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1276 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:18.951132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:18.953764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:18.968655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.969951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:18.971687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:18.972857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:19.270651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5102a00ef64e38a10d89ecb06d643e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1308036b7a477dbd8d67e93e50bbc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:19.304132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a1d8e0b-429f-4374-90c6-faca22b1ea86 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 200 len: 1431 microversion: 2.1 time: 0.376533 Jul 25 20:16:19.309041 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1160/2347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:18 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 1431 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:19.359116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2043137667", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "ea7c3422-34fd-4fb8-b7bc-60523dad31bd"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:19.546793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] validate_networks() for [('ea7c3422-34fd-4fb8-b7bc-60523dad31bd', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:20.111656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:20.134694 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ea9c41f-0cf6-4a82-bca9-1c4781b71512 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 1.597932 Jul 25 20:16:20.151789 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1188/2348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:18 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:20.151789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-94b0a142-f55c-48f3-80f9-1b4315b9767a req-aaf9c529-6852-49af-a762-703b8cc36911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47f6ae9-42de-4662-a9fc-f7de74097977", "name": "network-vif-deleted", "tag": "36feca69-6cf2-448c-a5f4-7e908f4dfba2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:20.187229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-94b0a142-f55c-48f3-80f9-1b4315b9767a req-aaf9c529-6852-49af-a762-703b8cc36911 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:20.190789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-94b0a142-f55c-48f3-80f9-1b4315b9767a req-aaf9c529-6852-49af-a762-703b8cc36911 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:20.215474 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-94b0a142-f55c-48f3-80f9-1b4315b9767a req-aaf9c529-6852-49af-a762-703b8cc36911 service nova] Creating event network-vif-deleted:36feca69-6cf2-448c-a5f4-7e908f4dfba2 for instance a47f6ae9-42de-4662-a9fc-f7de74097977 on n-h2-845775-3 Jul 25 20:16:20.224788 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-94b0a142-f55c-48f3-80f9-1b4315b9767a req-aaf9c529-6852-49af-a762-703b8cc36911 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083602 Jul 25 20:16:20.225901 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1189/2349] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:20.238212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:20.240600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:20.248519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:20.249775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:20.250725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:20.251514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:21.802503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:21.811831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:21.836469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:21.846799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:21.858217 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6facca81-a9b6-4506-b6f5-4c8e478cb1af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1838 microversion: 2.42 time: 1.629602 Jul 25 20:16:21.880073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1190/2350] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:20 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1838 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:21.880073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:21.880073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:21.901252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:21.901631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:21.909288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:21.909761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.429264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:22.457442 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28aa086f-b14a-4217-9dd4-ffcb5d6d5352 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1523 microversion: 2.1 time: 0.595437 Jul 25 20:16:22.460283 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1191/2351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:21 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:22.476246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-39492207-1406-4879-87c0-7cf2ae8291ca req-c2cf6dd4-355e-4f02-b2c1-28fa268ee90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:22.543391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-39492207-1406-4879-87c0-7cf2ae8291ca req-c2cf6dd4-355e-4f02-b2c1-28fa268ee90e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:22.544465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-39492207-1406-4879-87c0-7cf2ae8291ca req-c2cf6dd4-355e-4f02-b2c1-28fa268ee90e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.589277 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-39492207-1406-4879-87c0-7cf2ae8291ca req-c2cf6dd4-355e-4f02-b2c1-28fa268ee90e service nova] Creating event network-changed:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h1-845775-3 Jul 25 20:16:22.645878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-39492207-1406-4879-87c0-7cf2ae8291ca req-c2cf6dd4-355e-4f02-b2c1-28fa268ee90e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160111 Jul 25 20:16:22.648100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1192/2352] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:22.668523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:22.670397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:22.684501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:22.686741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:22.687354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.688103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:22.688826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:22.689368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:22.689663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:22.690296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.690417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:22.710988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:22.711452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.712582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:22.713040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:22.792712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:22.809240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:22.835602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:22.892311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:22.895645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:23.024916 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db5c7667-84a7-4fad-b11b-d6c1b6f6f8fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.696845 Jul 25 20:16:23.026880 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1161/2353] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:23.052179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:23.058617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:23.094959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.096501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:23.099673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.105052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:23.389528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:23.454978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=18 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:23.692239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:23.717918 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7cf74909-6769-4e69-9b6d-53bf4d5d1f0f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1313 microversion: 2.1 time: 1.065896 Jul 25 20:16:23.720779 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1193/2354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:22 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:23.739494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:23.743108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] [instance: 545121be-117a-432a-9ff1-9d5066eb7afc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:23.768834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.769858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:23.771515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.775167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:23.835312 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] HTTP exception thrown: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Request method failure captured: Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc HTTP/1.1 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vk5Hlxl2j98Ap8FjqGwJXnbvSWzf7jIPB1pHbU6-xpB4VUgG4hzqMItGwYUqbq1yMxzH6i8MXUReYQgViFTq2InRqHpIwBigl6rDNLPNQ_Tf-j_JqbVTgLk1AOeqKm5BP6W9RHRLOSOL_VoMqq862mGwOThdIzNWl6tJPmHAjU5v6A Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0f1308036b7a477dbd8d67e93e50bbc9 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:23.850863 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f1308036b7a477dbd8d67e93e50bbc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f1308036b7a477dbd8d67e93e50bbc9"}]}] Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0f1308036b7a477dbd8d67e93e50bbc9 Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-452834910 Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListImageFiltersTestJSON-452834910-project Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1c5102a00ef64e38a10d89ecb06d643e Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListImageFiltersTestJSON-452834910-project Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. Jul 25 20:16:23.853369 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '545121be-117a-432a-9ff1-9d5066eb7afc'} Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:23.854770 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. Jul 25 20:16:23.857008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:23.863310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Returning 404 to user: Instance 545121be-117a-432a-9ff1-9d5066eb7afc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:23.865397 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2487e400-4be9-424a-b944-b3fdcdabeeb7 tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc" status: 404 len: 111 microversion: 2.1 time: 0.141815 Jul 25 20:16:23.867452 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1194/2355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:23 2022] GET /compute/v2.1/servers/545121be-117a-432a-9ff1-9d5066eb7afc => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:16:23.877946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:23.879454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:23.897980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.901897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:23.905935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:23.906473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:24.382139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:24.410064 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b010c6c-1c8c-4dc1-9ba9-f15567b6af9b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 1.380844 Jul 25 20:16:24.411038 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1162/2356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:23 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:24.429110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1663533402"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:24.450235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:24.476898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:24.477951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:24.479602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:24.480674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.236779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:25.286982 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe2674ae-f4ce-49aa-baaa-073fffe8da69 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e/action" status: 202 len: 0 microversion: 2.1 time: 0.871612 Jul 25 20:16:25.288012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04688639-28ce-4a57-bf3d-ed32996e15ea tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 1.414012 Jul 25 20:16:25.290040 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1163/2357] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:16:24 2022] POST /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:16:25.320733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-97ba688c-b439-486c-b421-4166c5b57226 req-26b1899b-23b9-4737-b9f3-e5d6a6df4bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "0c9dbc51-bf07-41b0-b58d-f47b07bac99f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:25.321037 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1195/2358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:23 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:25.375754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:25.380078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-97ba688c-b439-486c-b421-4166c5b57226 req-26b1899b-23b9-4737-b9f3-e5d6a6df4bbf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:25.381293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:25.382874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-97ba688c-b439-486c-b421-4166c5b57226 req-26b1899b-23b9-4737-b9f3-e5d6a6df4bbf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.420810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:25.422017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.423736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:25.425080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.432952 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-97ba688c-b439-486c-b421-4166c5b57226 req-26b1899b-23b9-4737-b9f3-e5d6a6df4bbf service nova] Creating event network-changed:0c9dbc51-bf07-41b0-b58d-f47b07bac99f for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:25.460422 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-97ba688c-b439-486c-b421-4166c5b57226 req-26b1899b-23b9-4737-b9f3-e5d6a6df4bbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158297 Jul 25 20:16:25.462329 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1164/2359] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:25.491507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:25.493284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:25.516707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:25.518224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.521363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:25.523078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:25.969292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:25.988505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5fb85bf5-9bd5-4dde-9c27-79b4ff9f5844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1275 microversion: 2.1 time: 0.522156 Jul 25 20:16:25.991450 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1165/2360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:25 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1275 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:26.016696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17d7cdb7-ed5b-4972-9dc8-848796796cfd tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196eaf73a0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:26.907346 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17d7cdb7-ed5b-4972-9dc8-848796796cfd tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1" status: 204 len: 0 microversion: 2.1 time: 0.900987 Jul 25 20:16:26.910273 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1166/2361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:26 2022] DELETE /compute/v2.1/images/b5014682-134b-4dd6-a55f-aebd768c81f1 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:26.926960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:26.928665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:26.945949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:26.947229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:26.948424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:26.953020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:27.191483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:27.211680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:27.217443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:27.225583 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aedda0a9-f3a0-40af-86a0-be770ff006bb tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1859 microversion: 2.42 time: 1.902750 Jul 25 20:16:27.226659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1196/2362] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:25 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1859 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:27.233446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545121be-117a-432a-9ff1-9d5066eb7afc", "name": "network-vif-deleted", "tag": "2c88f084-eab6-41c0-9cbb-33b0aa8f177d"}, {"name": "network-changed", "server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:27.248931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:27.249751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:27.281775 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] Creating event network-vif-deleted:2c88f084-eab6-41c0-9cbb-33b0aa8f177d for instance 545121be-117a-432a-9ff1-9d5066eb7afc on n-h2-845775-3 Jul 25 20:16:27.283496 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] Creating event network-changed:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:16:27.298461 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4cb41ef5-4136-4993-972f-bfd01ffcd50c req-ddc9496d-803b-434c-a6b6-476187bcaff3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069301 Jul 25 20:16:27.299399 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1197/2363] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:27.307783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c25c879-ebc5-458d-ab3d-e6c11e61e258 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f1969cd7430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:27.673329 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c25c879-ebc5-458d-ab3d-e6c11e61e258 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a" status: 204 len: 0 microversion: 2.1 time: 0.371897 Jul 25 20:16:27.674818 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1198/2364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:27 2022] DELETE /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:27.692209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:27.693716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:27.704954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:27.705801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:27.706869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:27.707642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:27.971896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:27.996343 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69b15dc1-47ed-43dc-9760-95ab463375b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1313 microversion: 2.1 time: 1.081518 Jul 25 20:16:27.998743 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1167/2365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:26 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:28.006018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a8bbceff-81e0-42b2-b016-6452978416d2 req-e20f1c5a-7f3d-4b11-8e2c-61b83aa84b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "name": "network-vif-plugged", "status": "completed", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:28.032608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a8bbceff-81e0-42b2-b016-6452978416d2 req-e20f1c5a-7f3d-4b11-8e2c-61b83aa84b15 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:28.033780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a8bbceff-81e0-42b2-b016-6452978416d2 req-e20f1c5a-7f3d-4b11-8e2c-61b83aa84b15 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:28.067390 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a8bbceff-81e0-42b2-b016-6452978416d2 req-e20f1c5a-7f3d-4b11-8e2c-61b83aa84b15 service nova] Creating event network-vif-plugged:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h1-845775-3 Jul 25 20:16:28.078014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a8bbceff-81e0-42b2-b016-6452978416d2 req-e20f1c5a-7f3d-4b11-8e2c-61b83aa84b15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077060 Jul 25 20:16:28.079108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1168/2366] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:28.087689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:28.089341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:28.108915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:28.109809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:28.111493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:28.113146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:28.540895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:28.554001 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2da69c4e-ad26-4725-9dde-0fd264963cb2 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.870742 Jul 25 20:16:28.556703 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1199/2367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:27 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:28.573726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16dd2cfc-14f5-4888-b051-a39f203383bc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f19692929d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:28.753573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:28.760491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:28.792943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dcbc3bc5-3da7-4287-a20d-f2c7413b39c1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 0.708413 Jul 25 20:16:28.794692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1169/2368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:28 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:28.819000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:28.825429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:28.857719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:28.859424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:28.860427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:28.862071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.036317 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16dd2cfc-14f5-4888-b051-a39f203383bc tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df" status: 204 len: 0 microversion: 2.1 time: 0.471531 Jul 25 20:16:29.036317 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1200/2369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:28 2022] DELETE /compute/v2.1/images/ec358ea9-93a6-4dab-895c-f634d3d0a1df => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:29.045757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "2998464c-87f5-4c58-8c19-797dbc233cfe"}, {"name": "network-changed", "server_uuid": "74fc46fd-b20a-4216-a72d-4a6693619f7a", "tag": "4ad995ab-6f03-464b-936c-045dae1b2818"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:29.062258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:29.067911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:29.068427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.075022 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a15cee4-1cf1-4f59-8332-b23d4cee75f4 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1273 microversion: 2.1 time: 0.276011 Jul 25 20:16:29.078862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1170/2370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:28 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:29.085958 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] Creating event network-changed:2998464c-87f5-4c58-8c19-797dbc233cfe for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:29.086651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] Creating event network-changed:4ad995ab-6f03-464b-936c-045dae1b2818 for instance 74fc46fd-b20a-4216-a72d-4a6693619f7a on n-h1-845775-3 Jul 25 20:16:29.094690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-51b5044c-6613-4727-b8e4-b333abe33622 req-40fcd9c2-3fd9-4993-9e48-db5607d7f86d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057133 Jul 25 20:16:29.095319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1201/2371] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:29.097471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd8c11c7-4726-48f7-a0f1-dae1d3ea5c64 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f196ea514c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:29.106547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:29.107543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:29.124865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:29.125750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.127803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:29.128716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.133467 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fd8c11c7-4726-48f7-a0f1-dae1d3ea5c64 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Image not found. Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd8c11c7-4726-48f7-a0f1-dae1d3ea5c64 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a HTTP/1.1 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:16:29.137158 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '842e6ff1-2c28-4958-813c-542fc23a1b3a'} Jul 25 20:16:29.138780 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:16:29.140348 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 842e6ff1-2c28-4958-813c-542fc23a1b3a Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:16:29.141735 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 842e6ff1-2c28-4958-813c-542fc23a1b3a could not be found. Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:29.143254 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:29.145631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd8c11c7-4726-48f7-a0f1-dae1d3ea5c64 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:29.148820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd8c11c7-4726-48f7-a0f1-dae1d3ea5c64 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a" status: 404 len: 62 microversion: 2.1 time: 0.068198 Jul 25 20:16:29.149610 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1171/2372] 10.222.0.48 () {58 vars in 1233 bytes} [Mon Jul 25 20:16:29 2022] GET /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:16:29.168020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:29.169069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:29.183382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:29.184471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.190323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:29.191802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:29.807314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:29.833629 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-387585be-fbef-47ce-80c8-eef34749dda4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1313 microversion: 2.1 time: 0.682330 Jul 25 20:16:29.834560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1172/2373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:29 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1313 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:29.839888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99e80cbd-357a-40c1-a59f-f051eed2ca5e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] Calling method '.version_select at 0x7f196ea51dc0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:29.906817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:29.951592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:29.960349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:29.970251 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49958b87-3ac7-4b73-b1eb-9854f9b72b99 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.873353 Jul 25 20:16:29.976002 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1202/2374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:29 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:30.009379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:30.010318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:30.035872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:30.038111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:30.047324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:30.048354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:30.466828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99e80cbd-357a-40c1-a59f-f051eed2ca5e tempest-ListImageFiltersTestJSON-452834910 tempest-ListImageFiltersTestJSON-452834910-project] 10.222.0.48 "DELETE /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def" status: 204 len: 0 microversion: 2.1 time: 0.630781 Jul 25 20:16:30.470104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1173/2375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:29 2022] DELETE /compute/v2.1/images/a61e6419-ee23-4c44-bf22-2259e25b2def => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:30.486492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-327d87a6-0cbb-407a-9fe7-3553f979ed8a req-ca38ec8a-f3bd-41d4-9baf-a15a197782bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf182a3-b352-41ef-95a0-837842223c49", "tag": "ec8fadc4-839c-4fb6-95d7-1a01e1028fb4"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:30.528877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-327d87a6-0cbb-407a-9fe7-3553f979ed8a req-ca38ec8a-f3bd-41d4-9baf-a15a197782bd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:30.538357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-327d87a6-0cbb-407a-9fe7-3553f979ed8a req-ca38ec8a-f3bd-41d4-9baf-a15a197782bd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:30.583710 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-327d87a6-0cbb-407a-9fe7-3553f979ed8a req-ca38ec8a-f3bd-41d4-9baf-a15a197782bd service nova] Creating event network-changed:ec8fadc4-839c-4fb6-95d7-1a01e1028fb4 for instance cdf182a3-b352-41ef-95a0-837842223c49 on n-h1-845775-3 Jul 25 20:16:30.593702 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-327d87a6-0cbb-407a-9fe7-3553f979ed8a req-ca38ec8a-f3bd-41d4-9baf-a15a197782bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120616 Jul 25 20:16:30.595224 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1174/2376] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:30.606686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:30.607964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:30.620151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:30.620992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:30.622423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:30.623491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:30.936288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:30.956383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5570723a-9711-498c-aee3-800c9a134eba tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1536 microversion: 2.1 time: 0.962844 Jul 25 20:16:30.967762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1203/2377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:29 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1536 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:30.984536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:30.986197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:31.002277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:31.003461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:31.006265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:31.007185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.351527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:32.357743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:32.378710 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a8a08d7-0a30-4093-beff-7bb37f5168b0 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 1.780868 Jul 25 20:16:32.379720 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1175/2378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:30 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:32.381129 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a08d1f8e-6313-431b-aa40-5340465ab63f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 1.402985 Jul 25 20:16:32.382638 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1204/2379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:30 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:32.392823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:32.401167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:32.416485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:32.417637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.421063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:32.422074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.436167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8d6ffffd-40d4-4042-9ba3-5040dd84bb78 req-c64d1e15-23c6-4731-b755-6912a653eaad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:32.479780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8d6ffffd-40d4-4042-9ba3-5040dd84bb78 req-c64d1e15-23c6-4731-b755-6912a653eaad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:32.480644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8d6ffffd-40d4-4042-9ba3-5040dd84bb78 req-c64d1e15-23c6-4731-b755-6912a653eaad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.526907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8d6ffffd-40d4-4042-9ba3-5040dd84bb78 req-c64d1e15-23c6-4731-b755-6912a653eaad service nova] Creating event network-vif-plugged:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:16:32.564402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8d6ffffd-40d4-4042-9ba3-5040dd84bb78 req-c64d1e15-23c6-4731-b755-6912a653eaad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160932 Jul 25 20:16:32.566268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1176/2380] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:32.584507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:32.587119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:32.611237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:32.612491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.614651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:32.615766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:32.773094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:32.856988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:33.051532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:33.070630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:33.088872 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f625dce2-d928-4c8a-b619-79ec4e00a159 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.702206 Jul 25 20:16:33.091763 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1205/2381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:32 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:33.109200 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-def02ff6-7e6c-419a-810e-49261f1489b7 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1463 microversion: 2.1 time: 0.538448 Jul 25 20:16:33.122172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:33.124444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:33.138763 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1177/2382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:32 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1463 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:33.150117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:33.150927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:33.152925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:33.153921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:33.154441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20008018-045c-420f-a5b8-4193fb9ed8b6", "tag": "7a44ab40-1cca-4a3a-b5a3-0e5483cef79a"}, {"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "783b5af4-2aec-4ff0-a438-c9426f47731a"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:33.218585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:33.221494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:33.258702 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] Creating event network-changed:7a44ab40-1cca-4a3a-b5a3-0e5483cef79a for instance 20008018-045c-420f-a5b8-4193fb9ed8b6 on n-h2-845775-3 Jul 25 20:16:33.260027 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] Creating event network-changed:783b5af4-2aec-4ff0-a438-c9426f47731a for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:33.283769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e921dc69-18d7-4c91-beb1-f07bb28dc90a req-5ffe5fa5-aed3-4a66-b1d3-4f0b53cf5a1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.134753 Jul 25 20:16:33.285560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1178/2383] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:33.311099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:33.314267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:33.331504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:33.332927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:33.334667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:33.335730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:34.279473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:34.303499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:34.310991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:34.313722 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51b61ef5-d042-4a86-ad50-fe0a7a8a5e09 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.217507 Jul 25 20:16:34.314711 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1206/2384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:33 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:34.324598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:34.355423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:34.374888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:34.376682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:34.379797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:34.381476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:34.608351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:34.621734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a4b3760-eb72-41b4-b4ca-0ef4fa4ed9a9 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1523 microversion: 2.1 time: 1.332451 Jul 25 20:16:34.622341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:34.625947 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1179/2385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:33 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1523 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:34.634733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-74b235e1-0da1-4ba1-9813-7ceaa15e53b9 req-de4e230c-02f6-4aaf-b8c3-0c60d1bb697a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "f3cb5213-d562-41bc-b3d4-7ed5d9645a1b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:34.656011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Old instance type m1.heat2, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:16:34.669587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-74b235e1-0da1-4ba1-9813-7ceaa15e53b9 req-de4e230c-02f6-4aaf-b8c3-0c60d1bb697a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:34.676342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-74b235e1-0da1-4ba1-9813-7ceaa15e53b9 req-de4e230c-02f6-4aaf-b8c3-0c60d1bb697a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:34.683787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:34.687089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:34.687762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:34.691971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:34.692590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:34.715133 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-74b235e1-0da1-4ba1-9813-7ceaa15e53b9 req-de4e230c-02f6-4aaf-b8c3-0c60d1bb697a service nova] Creating event network-changed:f3cb5213-d562-41bc-b3d4-7ed5d9645a1b for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:34.731283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-74b235e1-0da1-4ba1-9813-7ceaa15e53b9 req-de4e230c-02f6-4aaf-b8c3-0c60d1bb697a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101555 Jul 25 20:16:34.733687 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1180/2386] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:34.758103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:34.760876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:34.780421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:34.796629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:34.798331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:34.799194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:35.061270 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9cfe407-260d-4f7d-8894-d1cb8f15bfc3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386/action" status: 202 len: 0 microversion: 2.1 time: 0.744146 Jul 25 20:16:35.062552 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1207/2387] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:16:34 2022] POST /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:16:35.073758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:35.074402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:35.099930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:35.100426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:35.101233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:35.101687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:35.810788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:35.839314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6df240d1-6af5-4193-96a1-1e721bdddfc1 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 1.099814 Jul 25 20:16:35.840406 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1181/2388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:34 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:35.850824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:35.851967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:35.864951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:35.867470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:35.869437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:35.870490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:36.006548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:36.023594 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad25e63a-9f2d-4a50-af2a-e13e3d5ddefc tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.955364 Jul 25 20:16:36.025304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1208/2389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:35 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:36.033588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:36.034455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:36.047730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:36.048527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:36.049656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:36.050116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:36.095159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:36.161930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:36.300853 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f70c511f-daad-4253-bc25-a52073f15619 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 204 len: 0 microversion: 2.1 time: 0.271893 Jul 25 20:16:36.308075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1209/2390] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:36 2022] DELETE /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:36.323665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e", "name": "network-vif-plugged", "status": "completed", "tag": "0bd7aba1-4763-4c8b-b479-ff4aed9bf847"}, {"server_uuid": "04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e", "name": "network-vif-unplugged", "status": "completed", "tag": "0bd7aba1-4763-4c8b-b479-ff4aed9bf847"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:36.361615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:36.364357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:36.411605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] Creating event network-vif-plugged:0bd7aba1-4763-4c8b-b479-ff4aed9bf847 for instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e on n-h2-845775-3 Jul 25 20:16:36.414865 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] Creating event network-vif-unplugged:0bd7aba1-4763-4c8b-b479-ff4aed9bf847 for instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e on n-h2-845775-3 Jul 25 20:16:36.454366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b23d1fd3-bedf-4e21-876f-2a0e5d177a0d req-1fe002e7-5ebc-4a3c-8093-a12e88f0dbb5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.144026 Jul 25 20:16:36.460185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1210/2391] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:36.785598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:36.806805 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a7633c7e-c30c-4991-912e-6cd725125105 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.964174 Jul 25 20:16:36.824828 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1182/2392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:35 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:36.839350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:36.841037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:36.857067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:36.859600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:36.860888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:36.865134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.004265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73889d70-277d-4b58-8d47-31e8ef130a6c tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f196ebaa310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCclp8kdRQE60DyuaP1sMCBpAq8ND66xMD1yQ/Obntxt83tgtpdnSt4Sp4d9U72TBzKMIaZwzwBDe386xFryt+Znn/cdxF1v2I1hCRPl8OFilI+N+t92y2YMmGDaw3d3Kw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:37.037946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-73889d70-277d-4b58-8d47-31e8ef130a6c tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73889d70-277d-4b58-8d47-31e8ef130a6c tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 257 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:37.052918 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCclp8kdRQE60DyuaP1sMCBpAq8ND66xMD1yQ/Obntxt83tgtpdnSt4Sp4d9U72TBzKMIaZwzwBDe386xFryt+Znn/cdxF1v2I1hCRPl8OFilI+N+t92y2YMmGDaw3d3Kw=="}} Jul 25 20:16:37.055800 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCclp8kdRQE60DyuaP1sMCBpAq8ND66xMD1yQ/Obntxt83tgtpdnSt4Sp4d9U72TBzKMIaZwzwBDe386xFryt+Znn/cdxF1v2I1hCRPl8OFilI+N+t92y2YMmGDaw3d3Kw=='}}} Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 25 20:16:37.057421 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 20:16:37.060458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 25 20:16:37.068308 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:37.083729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73889d70-277d-4b58-8d47-31e8ef130a6c tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:37.085893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73889d70-277d-4b58-8d47-31e8ef130a6c tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.618726 Jul 25 20:16:37.094595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1211/2393] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 634 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:16:37.121954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:37.127808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:37.140592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:37.141908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.146669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:37.148206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.785926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:37.792992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:37.807553 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09b7c369-d4e9-4c27-b8e3-774751694aee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1472 microversion: 2.1 time: 0.980702 Jul 25 20:16:37.808702 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1183/2394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:36 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1472 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:37.848429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:37.851270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:37.860061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:37.864442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:37.866474 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52b01a17-ff71-44fe-8799-7c872a92dda2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.769857 Jul 25 20:16:37.868766 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1212/2395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:37 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:37.884567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-59c83a5a-f709-4777-85b1-a571bbc3ac7f req-6b474d07-d42c-457a-a0bc-f61c3349b16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56dc091f-7a2b-430b-96b6-983128b82e85", "tag": "646be811-53a7-4e4c-9252-cc907ed4a466"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:37.889642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:37.890508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.892018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:37.892863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.911832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-59c83a5a-f709-4777-85b1-a571bbc3ac7f req-6b474d07-d42c-457a-a0bc-f61c3349b16b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:37.913026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-59c83a5a-f709-4777-85b1-a571bbc3ac7f req-6b474d07-d42c-457a-a0bc-f61c3349b16b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:37.944349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-59c83a5a-f709-4777-85b1-a571bbc3ac7f req-6b474d07-d42c-457a-a0bc-f61c3349b16b service nova] Creating event network-changed:646be811-53a7-4e4c-9252-cc907ed4a466 for instance 56dc091f-7a2b-430b-96b6-983128b82e85 on n-h2-845775-3 Jul 25 20:16:37.965359 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-59c83a5a-f709-4777-85b1-a571bbc3ac7f req-6b474d07-d42c-457a-a0bc-f61c3349b16b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093526 Jul 25 20:16:37.968443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1213/2396] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:37.994055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:38.001592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:38.018842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.019615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.021411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.022166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.355146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:38.386732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c8ac2ca-14c7-48a6-a7e2-378475e03d68 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1529 microversion: 2.1 time: 0.552737 Jul 25 20:16:38.389000 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1184/2397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:37 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1529 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:38.404201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:38.405691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:38.426588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.427473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.428929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.429767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.471306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:38.491390 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba1db9f1-f081-408d-9a79-5db147b29436 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 0.520727 Jul 25 20:16:38.493522 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1214/2398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:37 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:38.508598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f1969814700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244886268", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:38.541856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:38.559149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for user 5ae67d35888b44858fca5ec262d0fcb6 and project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:38.599733 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 2167 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244886268", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:38.620495 n-d-845775-3 devstack@n-api.service[119724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1244886268', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:38.626346 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4954c12a-0543-43f9-8a7f-a17d5929d656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.127531 Jul 25 20:16:38.630292 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1215/2399] 10.222.0.48 () {60 vars in 1160 bytes} [Mon Jul 25 20:16:38 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:16:38.638584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:38.640960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:38.659984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.661526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.664842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.665984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.745750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:38.765013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbaa214a-9e44-4473-b0e0-3144ac275557 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.372694 Jul 25 20:16:38.767862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1185/2400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:38 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:38.778052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74fc46fd-b20a-4216-a72d-4a6693619f7a", "name": "network-vif-plugged", "status": "completed", "tag": "4ad995ab-6f03-464b-936c-045dae1b2818"}, {"server_uuid": "cdf182a3-b352-41ef-95a0-837842223c49", "name": "network-vif-plugged", "status": "completed", "tag": "ec8fadc4-839c-4fb6-95d7-1a01e1028fb4"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:38.799639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:38.802050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:38.829547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] Creating event network-vif-plugged:4ad995ab-6f03-464b-936c-045dae1b2818 for instance 74fc46fd-b20a-4216-a72d-4a6693619f7a on n-h1-845775-3 Jul 25 20:16:38.830896 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] Creating event network-vif-plugged:ec8fadc4-839c-4fb6-95d7-1a01e1028fb4 for instance cdf182a3-b352-41ef-95a0-837842223c49 on n-h1-845775-3 Jul 25 20:16:38.847856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1a621cbb-e7d1-4694-9b4e-e21dc4ba6d2c req-6d97f80b-1cca-464e-9816-e5cc9a3a7f75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077319 Jul 25 20:16:38.849432 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1186/2401] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:38.863875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5041862-f9c0-4562-ae92-bd69bf5de2a7 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f196ead5940>, body: {"keypair": {"name": "tempest-keypair-695923909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoY2SXLiX8Acc8TnOdH+t9RFCuGxL8jhW+13igYSrrnYRe6U4lPpr9zNFwj3tvvkSTztW9HNXwt+wizOfDm9n9+7HyhB7uGP2FydoqLkb63gvr1fJAKT4KtyAFwnWqEuQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:38.896807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f5041862-f9c0-4562-ae92-bd69bf5de2a7 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:38.911469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f5041862-f9c0-4562-ae92-bd69bf5de2a7 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for user 5ae67d35888b44858fca5ec262d0fcb6 and project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:38.967417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5041862-f9c0-4562-ae92-bd69bf5de2a7 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111580 Jul 25 20:16:38.973931 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1187/2402] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:38.992273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:38.993641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:39.006058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:39.006891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:39.008359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:39.009403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:39.030892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:39.041564 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f368acff-d479-4965-80f3-5401e2665e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.413794 Jul 25 20:16:39.042817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1216/2403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:38 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:39.053130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:39.053955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:39.067190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:39.067960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:39.069378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:39.070055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.202974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.203995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.225664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ededc0e-5e86-401d-9d04-cbbd23d2ba60 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1472 microversion: 2.1 time: 1.249624 Jul 25 20:16:40.227139 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1188/2404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:38 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1472 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:40.235163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.238685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.241076 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-016752db-d491-4e0d-8268-1e3c18c6025b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.195909 Jul 25 20:16:40.243860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f196ead5a60>, body: {"keypair": {"name": "tempest-keypair-695923909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqluxZae8Ge4VpkTi1vcGkbmx4r+cDoymT0iFncSPGRGn0vN/k38PtOrEYR0AHGIWsi/2RDgG+w7BjbLL4UQVYZGHzViRnIJN/vFfvvZ0DCIpvmXk3MBDlQEXgFiWiDtg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:40.253676 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1217/2405] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:39 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:40.265134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:40.266350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:40.275928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.276790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.278103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.278939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.279786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:40.300169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for user 5ae67d35888b44858fca5ec262d0fcb6 and project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:40.377487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Key pair 'tempest-keypair-695923909' already exists. Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 272 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: {"keypair": {"name": "tempest-keypair-695923909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqluxZae8Ge4VpkTi1vcGkbmx4r+cDoymT0iFncSPGRGn0vN/k38PtOrEYR0AHGIWsi/2RDgG+w7BjbLL4UQVYZGHzViRnIJN/vFfvvZ0DCIpvmXk3MBDlQEXgFiWiDtg=="}} Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: exception: Key pair 'tempest-keypair-695923909' already exists. Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-695923909', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqluxZae8Ge4VpkTi1vcGkbmx4r+cDoymT0iFncSPGRGn0vN/k38PtOrEYR0AHGIWsi/2RDgG+w7BjbLL4UQVYZGHzViRnIJN/vFfvvZ0DCIpvmXk3MBDlQEXgFiWiDtg=='}}} Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5ae67d35888b44858fca5ec262d0fcb6-tempest-keypair-695923909' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 20:16:40.392268 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi session.flush() Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result.read() Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 25 20:16:40.399196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5ae67d35888b44858fca5ec262d0fcb6-tempest-keypair-695923909' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 25, 20, 16, 40, 351987), 'updated_at': None, 'name': 'tempest-keypair-695923909', 'user_id': '5ae67d35888b44858fca5ec262d0fcb6', 'fingerprint': '7c:02:8b:92:ed:80:34:8a:46:f7:f5:cd:72:01:c3:6a', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqluxZae8Ge4VpkTi1vcGkbmx4r+cDoymT0iFncSPGRGn0vN/k38PtOrEYR0AHGIWsi/2RDgG+w7BjbLL4UQVYZGHzViRnIJN/vFfvvZ0DCIpvmXk3MBDlQEXgFiWiDtg==', 'type': 'ssh'}] Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi keypair.create() Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._create() Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-695923909' already exists. Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 25 20:16:40.412642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-695923909' already exists. Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-695923909' already exists. Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 409 to user: Key pair 'tempest-keypair-695923909' already exists. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-467f4318-864a-471f-96f7-3fce407bc656 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.167129 Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1189/2406] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:40 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:40.428909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:40.446656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.448296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.450928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.453269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.859795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.891097 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b6a13d7-9b20-4bb6-8646-f949b6268d8d tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1529 microversion: 2.1 time: 0.635671 Jul 25 20:16:40.896758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1218/2407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:40 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1529 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:40.912749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:40.930612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:40.961546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:40.961968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.962444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.963258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:40.963703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:40.981536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0d2de53-dd3c-45cf-b986-63e5b30fda77 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1314 microversion: 2.1 time: 0.576709 Jul 25 20:16:40.997977 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1190/2408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:40 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:41.028658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cdc576d6-61bf-470e-aa58-18ac6b1fcf56 req-f7d9bdd8-eae1-4d9c-b0eb-224afacfec97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "c86962a0-b9d0-40a7-8bd5-496cde816bed"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:41.071658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cdc576d6-61bf-470e-aa58-18ac6b1fcf56 req-f7d9bdd8-eae1-4d9c-b0eb-224afacfec97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.074119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cdc576d6-61bf-470e-aa58-18ac6b1fcf56 req-f7d9bdd8-eae1-4d9c-b0eb-224afacfec97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.099409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cdc576d6-61bf-470e-aa58-18ac6b1fcf56 req-f7d9bdd8-eae1-4d9c-b0eb-224afacfec97 service nova] Creating event network-changed:c86962a0-b9d0-40a7-8bd5-496cde816bed for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:41.107397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cdc576d6-61bf-470e-aa58-18ac6b1fcf56 req-f7d9bdd8-eae1-4d9c-b0eb-224afacfec97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107091 Jul 25 20:16:41.108657 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1191/2409] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:41.118310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:41.119162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:41.151784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.153553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.156621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.158714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.587914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:41.604174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19f2110e-6648-4396-a138-6978cccd2127 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.702255 Jul 25 20:16:41.630179 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1219/2410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:40 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:41.638011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e4d5224-f2b5-444d-b41f-e474fd298fd3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Calling method '.version_select at 0x7f19698d0430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:41.698854 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8e4d5224-f2b5-444d-b41f-e474fd298fd3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695923909" status: 202 len: 0 microversion: 2.1 time: 0.065769 Jul 25 20:16:41.700694 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1220/2411] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695923909 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:16:41.717280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1fc56855-d0ec-4b0a-bf0d-5c3da18b4b91 req-33927262-41ae-471d-952b-074def80d35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20008018-045c-420f-a5b8-4193fb9ed8b6", "name": "network-vif-plugged", "status": "completed", "tag": "7a44ab40-1cca-4a3a-b5a3-0e5483cef79a"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:41.744638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1fc56855-d0ec-4b0a-bf0d-5c3da18b4b91 req-33927262-41ae-471d-952b-074def80d35e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.745778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1fc56855-d0ec-4b0a-bf0d-5c3da18b4b91 req-33927262-41ae-471d-952b-074def80d35e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.775253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1fc56855-d0ec-4b0a-bf0d-5c3da18b4b91 req-33927262-41ae-471d-952b-074def80d35e service nova] Creating event network-vif-plugged:7a44ab40-1cca-4a3a-b5a3-0e5483cef79a for instance 20008018-045c-420f-a5b8-4193fb9ed8b6 on n-h2-845775-3 Jul 25 20:16:41.785147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:41.787634 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1fc56855-d0ec-4b0a-bf0d-5c3da18b4b91 req-33927262-41ae-471d-952b-074def80d35e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083713 Jul 25 20:16:41.789205 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1221/2412] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:41.803391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:41.805415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:41.817291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f12a88c8-3c9f-40b8-b328-7912173be774 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.702235 Jul 25 20:16:41.817291 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1192/2413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:41 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:41.826804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:41.828295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.829033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:41.829689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.831326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.832501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.852302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.858398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:41.861183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:41.862000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:42.741984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:42.746435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:42.766164 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48d98528-8e24-480d-b851-7335104aa143 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1472 microversion: 2.1 time: 0.974051 Jul 25 20:16:42.768441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:42.771262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:42.774249 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8cda03b4-94e4-4db5-b2fa-1350aa51815b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.959299 Jul 25 20:16:42.784484 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1222/2414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:41 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1472 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:42.796973 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1193/2415] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:41 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:42.801959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e644794e-e6e2-4b07-a2ba-89e687b96666 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f1969596c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMXDGfrkwSQp0F6mTVP2vQk2DhZeFG0hC/tPOVleFQPnvFkgX9R/NwJlI4XdgElJmcyIlD84iw42zjhb5EDwQnKCBKk5yNiaWk5bIsaUQv4s29qDGX2G6aWey7/ZB0TQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e644794e-e6e2-4b07-a2ba-89e687b96666 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 247 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMXDGfrkwSQp0F6mTVP2vQk2DhZeFG0hC/tPOVleFQPnvFkgX9R/NwJlI4XdgElJmcyIlD84iw42zjhb5EDwQnKCBKk5yNiaWk5bIsaUQv4s29qDGX2G6aWey7/ZB0TQ=="}} Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAMXDGfrkwSQp0F6mTVP2vQk2DhZeFG0hC/tPOVleFQPnvFkgX9R/NwJlI4XdgElJmcyIlD84iw42zjhb5EDwQnKCBKk5yNiaWk5bIsaUQv4s29qDGX2G6aWey7/ZB0TQ=='}}} Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi '' Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:16:42.811158 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e644794e-e6e2-4b07-a2ba-89e687b96666 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:42.818148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e644794e-e6e2-4b07-a2ba-89e687b96666 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019663 Jul 25 20:16:42.819977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:42.819977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:42.824451 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1223/2416] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:42 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:16:42.840555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:42.846260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:42.853346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:42.854079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:42.856547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:42.857380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:42.869813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:42.871093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:42.872552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:42.873696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:42.926824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:43.117222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:43.139099 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c22314c-51ac-45c0-b92b-25238a3c82ad tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 200 len: 1487 microversion: 2.1 time: 0.339737 Jul 25 20:16:43.152105 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1194/2417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:42 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 1487 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:43.165152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-074b5469-9ee4-43a5-b2b6-4822f4b3e247 req-c06ec493-b510-489b-ad77-d74a899e4a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e", "name": "network-vif-deleted", "tag": "0bd7aba1-4763-4c8b-b479-ff4aed9bf847"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:43.178005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-074b5469-9ee4-43a5-b2b6-4822f4b3e247 req-c06ec493-b510-489b-ad77-d74a899e4a97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:43.184814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-074b5469-9ee4-43a5-b2b6-4822f4b3e247 req-c06ec493-b510-489b-ad77-d74a899e4a97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:43.223247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-074b5469-9ee4-43a5-b2b6-4822f4b3e247 req-c06ec493-b510-489b-ad77-d74a899e4a97 service nova] Creating event network-vif-deleted:0bd7aba1-4763-4c8b-b479-ff4aed9bf847 for instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e on n-h2-845775-3 Jul 25 20:16:43.254323 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-074b5469-9ee4-43a5-b2b6-4822f4b3e247 req-c06ec493-b510-489b-ad77-d74a899e4a97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107641 Jul 25 20:16:43.262973 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1195/2418] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:43.290049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:43.291359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:43.320210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:43.320998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:43.322391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:43.323737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:43.814528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:43.828085 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c016aacc-8f1e-4881-b630-09df7b9992db tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1464 microversion: 2.1 time: 1.010034 Jul 25 20:16:43.839223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1224/2419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:42 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1464 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:43.848308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f1969596ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1744592817", "public_key": " "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:43.892811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:43.908318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for user 5ae67d35888b44858fca5ec262d0fcb6 and project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:43.929249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:43.930467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:43.947366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:43.950176 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e37afe12-83fa-4ca6-9379-ad8973396149 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.684766 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 95 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1744592817", "public_key": " "}} Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1744592817', 'public_key': ' '}}} Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:43.952499 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:43.960277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:43.964902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:43.966675 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f30acc73-2239-4dbd-9255-1c30e0d7499e tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.125633 Jul 25 20:16:43.978603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1196/2420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:43 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:43.980186 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1225/2421] 10.222.0.48 () {60 vars in 1158 bytes} [Mon Jul 25 20:16:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:16:43.991159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-88d77c44-b3e9-4a3c-8e83-49aef9587797 req-1a5c9b07-45af-43bb-9a1b-497282d95147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "58b29d89-9a22-41af-9fc9-634501e8f130"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:44.001041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:44.002944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:44.015412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.015947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-88d77c44-b3e9-4a3c-8e83-49aef9587797 req-1a5c9b07-45af-43bb-9a1b-497282d95147 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.016184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.016813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-88d77c44-b3e9-4a3c-8e83-49aef9587797 req-1a5c9b07-45af-43bb-9a1b-497282d95147 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.018435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.019254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.048808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-88d77c44-b3e9-4a3c-8e83-49aef9587797 req-1a5c9b07-45af-43bb-9a1b-497282d95147 service nova] Creating event network-changed:58b29d89-9a22-41af-9fc9-634501e8f130 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:44.057042 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-88d77c44-b3e9-4a3c-8e83-49aef9587797 req-1a5c9b07-45af-43bb-9a1b-497282d95147 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074385 Jul 25 20:16:44.059895 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1226/2422] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:44.070653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:44.071382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:44.081145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.081611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.082418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.082866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.745904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:44.750163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:44.790892 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac18443a-fb1b-4ba3-8c04-407b17cdf02e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.727397 Jul 25 20:16:44.793325 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df96787c-1c9f-4f04-a84d-8bd16ee8207a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.801251 Jul 25 20:16:44.796588 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1227/2423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:44 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:44.800250 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1197/2424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:43 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:44.821963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:44.824413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:44.829464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:44.832656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:44.846502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.851516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.854979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.856119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.858220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.859841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:44.861271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:44.867556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:45.661048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:45.662124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:45.693544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:45.696544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:45.698188 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-942ab021-4475-4543-b792-50c6a6edc1c7 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.896141 Jul 25 20:16:45.699247 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1198/2425] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:44 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:45.702154 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-32d1813e-e2e3-4624-999f-51c0bba0e293 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1462 microversion: 2.1 time: 0.897321 Jul 25 20:16:45.703567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1228/2426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:44 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1462 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:45.725216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:45.726588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:45.738152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae137e9-3706-477e-a436-9045743f95e3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f196eaf38b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+jDnmB5dIvlyXQS90o927FeiVaNZVy20EdKK27OoLNPlW4Agc/CSbN+duWj50sOowVfJRSiBavsuZjQ6g/DzY+bjI+Q3OQZR4xJtJiyOCAXxGi1itK9ADRfqPBmFiqFw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae137e9-3706-477e-a436-9045743f95e3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 507 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+jDnmB5dIvlyXQS90o927FeiVaNZVy20EdKK27OoLNPlW4Agc/CSbN+duWj50sOowVfJRSiBavsuZjQ6g/DzY+bjI+Q3OQZR4xJtJiyOCAXxGi1itK9ADRfqPBmFiqFw=="}} Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+jDnmB5dIvlyXQS90o927FeiVaNZVy20EdKK27OoLNPlW4Agc/CSbN+duWj50sOowVfJRSiBavsuZjQ6g/DzY+bjI+Q3OQZR4xJtJiyOCAXxGi1itK9ADRfqPBmFiqFw=='}}} Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 25 20:16:45.747486 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae137e9-3706-477e-a436-9045743f95e3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fae137e9-3706-477e-a436-9045743f95e3 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.032948 Jul 25 20:16:45.759155 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1199/2427] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:45 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:16:45.767862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:45.767862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:45.767862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:45.767862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:45.777045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:45.779173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:45.793329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:45.797708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:45.799140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:45.800532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:45.801300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:45.809842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e HTTP/1.1 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e'} Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.827366 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:16:45.835288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:45.840483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:45.841410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5627e82b-389d-479c-8a5f-276ace67fdc5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.135357 Jul 25 20:16:45.849611 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1229/2428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:45 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:16:45.865222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Action: 'create', calling method: .version_select at 0x7f19698fa1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-837934439", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:45.927420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:45.943484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Getting quotas for user 5ae67d35888b44858fca5ec262d0fcb6 and project a4950d547cae41f8be76b20bb78d3ea8. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:46.033669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 117 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-837934439", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: exception: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-837934439', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 25 20:16:46.037995 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 25 20:16:46.049294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.058287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:46.059988 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e988dd0e-f529-4168-83f4-e87e989fdf26 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.207833 Jul 25 20:16:46.061755 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1230/2429] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:16:45 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:16:46.072896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:46.074618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:46.103887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:46.107556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:46.111991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:46.113217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:46.535145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:46.568695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-694a29f3-2d8e-43a2-9a20-4b01c01c5441 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1318 microversion: 2.1 time: 0.809374 Jul 25 20:16:46.571959 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1200/2430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:45 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:46.594707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:46.596257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:46.608848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:46.609968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:46.611615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:46.612739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:46.723609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:46.754878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a67199f5-d8b4-458f-9e88-a685664a6dda tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.690373 Jul 25 20:16:46.755551 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1231/2431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:46 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:46.774885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-102ba764-9a19-4312-b375-bd5dc80ce1d5 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Calling method '.version_select at 0x7f19698fa820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:46.809969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-102ba764-9a19-4312-b375-bd5dc80ce1d5 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-102ba764-9a19-4312-b375-bd5dc80ce1d5 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Request method failure captured: Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1390141990 HTTP/1.1 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voiMRe6BxNF-62EMDz2dcGQIiLCEzQ4jQ1tLGYH_l5EVwcytW9obi8iIWeuSgU4KI-jVRnfYAeT12DqyVbvrDW5Ic9gD4qD1p9H8x6UDYnPQhOEZ8P1WrZNgZXUm8_lizhqiSaMvjvELFfQSo33GcDfNTsVsLD8z4JqhJV4FdEKJR0 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4950d547cae41f8be76b20bb78d3ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4950d547cae41f8be76b20bb78d3ea8"}]}] Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a4950d547cae41f8be76b20bb78d3ea8 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1383657755 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1383657755-project Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: exception: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'tempest-keypair-non-existent-1390141990'} Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.813722 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 Jul 25 20:16:46.817639 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:16:46.825014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-102ba764-9a19-4312-b375-bd5dc80ce1d5 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1390141990 not found for user 5ae67d35888b44858fca5ec262d0fcb6 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:46.826321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-102ba764-9a19-4312-b375-bd5dc80ce1d5 tempest-KeyPairsNegativeTestJSON-1383657755 tempest-KeyPairsNegativeTestJSON-1383657755-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1390141990" status: 404 len: 145 microversion: 2.1 time: 0.069358 Jul 25 20:16:46.837249 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1232/2432] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1390141990 => generated 145 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:16:46.859342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1373259130", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "20886bc0-0c72-4b52-a778-293275bc3fdf"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:47.019974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:47.611881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:47.632955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-034a37d2-cc64-463a-ae96-89c4c69b94e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 1.058363 Jul 25 20:16:47.634862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1201/2433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:46 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:47.643120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-435106117", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:47.755452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] validate_networks() for [('1dc75bc8-6a1d-4286-815a-04492dd5f726', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:47.868123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:47.873283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:47.874949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:47.875909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:47.876935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:47.895612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:47.896869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:47.898808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:47.899937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:47.943361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:47.953102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Getting quotas for user b62b2140b1fa4df9bb1701a2dc11776f and project 0b18817281c94dfc89e0da34cb18f52c. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:47.977905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:47.981090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:48.075572 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c61be2d-1f28-44a5-ba0d-6eeb5dd323f8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230903 Jul 25 20:16:48.077595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1233/2434] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:48.086825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d2faa653-0b22-48d5-a8fe-5a8931ad8663 req-34e4bf8e-1f70-45cc-a4f3-7020186e34bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "74fe7a93-560c-492d-8417-eba24fb3fdc5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:48.116383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d2faa653-0b22-48d5-a8fe-5a8931ad8663 req-34e4bf8e-1f70-45cc-a4f3-7020186e34bf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.117191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d2faa653-0b22-48d5-a8fe-5a8931ad8663 req-34e4bf8e-1f70-45cc-a4f3-7020186e34bf service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:48.142662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d2faa653-0b22-48d5-a8fe-5a8931ad8663 req-34e4bf8e-1f70-45cc-a4f3-7020186e34bf service nova] Creating event network-changed:74fe7a93-560c-492d-8417-eba24fb3fdc5 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:16:48.162159 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d2faa653-0b22-48d5-a8fe-5a8931ad8663 req-34e4bf8e-1f70-45cc-a4f3-7020186e34bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082561 Jul 25 20:16:48.162873 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1234/2435] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:48.186041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:48.190520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:48.203381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.204016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:48.206073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.206743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:48.804225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:16:48.812133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:16:48.822942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:16:48.824706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:16:48.824935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:16:48.858248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.859518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:48.861665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.863185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:48.880421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:48.907522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:48.910923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:48.913612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-85730492-ceb9-4b87-b9df-8e146e26edf0 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.746506 Jul 25 20:16:48.932757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1235/2436] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:48 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:48.942867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:48.955742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cd0891f8-6c78-4f08-98cb-3ad2a129b0b2 req-c561685e-eee7-4b79-a5d6-1608c617b033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dc091f-7a2b-430b-96b6-983128b82e85", "name": "network-vif-plugged", "status": "completed", "tag": "646be811-53a7-4e4c-9252-cc907ed4a466"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:48.963949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Getting quotas for user 7d3883ad9f7744b5890c8847a4376a94 and project 69144de1ae7e4bb8b33b24e874804dc7. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:48.977631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cd0891f8-6c78-4f08-98cb-3ad2a129b0b2 req-c561685e-eee7-4b79-a5d6-1608c617b033 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:48.978700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cd0891f8-6c78-4f08-98cb-3ad2a129b0b2 req-c561685e-eee7-4b79-a5d6-1608c617b033 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.005265 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cd0891f8-6c78-4f08-98cb-3ad2a129b0b2 req-c561685e-eee7-4b79-a5d6-1608c617b033 service nova] Creating event network-vif-plugged:646be811-53a7-4e4c-9252-cc907ed4a466 for instance 56dc091f-7a2b-430b-96b6-983128b82e85 on n-h2-845775-3 Jul 25 20:16:49.014774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:16:49.019283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:16:49.021522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cd0891f8-6c78-4f08-98cb-3ad2a129b0b2 req-c561685e-eee7-4b79-a5d6-1608c617b033 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085379 Jul 25 20:16:49.032574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1236/2437] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:49.051390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:49.053197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:49.079196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.080007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.082608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.084221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.134598 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-816608b5-0ac0-4124-85e1-14cd64d4e7b7 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.497494 Jul 25 20:16:49.136625 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1202/2438] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:16:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:16:49.154366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:49.156015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:49.205781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.207151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.210306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.211743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.640957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:49.641683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:49.654847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12a28517-007d-45e4-affb-519eee3a3ef0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.514961 Jul 25 20:16:49.668856 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1203/2439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:49 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:49.668856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:49.668856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:49.679746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.679746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.679746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.679746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.684406 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0fe4539c-d099-4c98-9195-e9b0186c6ee7 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 200 len: 1507 microversion: 2.1 time: 0.649841 Jul 25 20:16:49.685588 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1237/2440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:49 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:49.702073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:49.702941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:49.719718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.720194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.723307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:49.724211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:49.733564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:49.801090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:49.823014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94b18e38-9485-4100-a039-ce9045a59e0a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1266 microversion: 2.1 time: 0.164595 Jul 25 20:16:49.825436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1204/2441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:49 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:49.865764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d007621f-705a-4f70-bd96-df45327d0993 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:49.867851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d007621f-705a-4f70-bd96-df45327d0993 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:50.047470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d007621f-705a-4f70-bd96-df45327d0993 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:50.068001 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d007621f-705a-4f70-bd96-df45327d0993 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1224 microversion: 2.1 time: 0.240353 Jul 25 20:16:50.069937 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1205/2442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:49 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1224 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:50.092181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:50.095529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:50.121044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:50.129327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:50.130867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:50.131711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:50.220972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:50.265580 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6774489c-89ad-4aea-8ca1-86ee907d9e41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1315 microversion: 2.1 time: 0.576104 Jul 25 20:16:50.279138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1238/2443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:49 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:50.307916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:50.310588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:50.348752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:50.349832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:50.351541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:50.354870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:50.846678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:50.865015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:50.867830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:50.869218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04462d88-7594-43cd-be24-f969ecdc3ebc tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.578660 Jul 25 20:16:50.876695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1239/2444] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:50 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:50.975907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Calling method '.version_select at 0x7f19697188b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:50.996443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:50.997738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:50.999712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:51.003454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.005554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.016675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85e79e3c-a1d1-4ea1-8577-dd6a2172874a tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49" status: 200 len: 1506 microversion: 2.1 time: 0.942400 Jul 25 20:16:51.017933 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1206/2445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:50 2022] GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 => generated 1506 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:51.034350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:51.036004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:51.056515 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0010154-c4a5-458f-857b-7d981e3a38be tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.177790 Jul 25 20:16:51.057129 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1240/2446] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 20:16:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:51.061861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:51.062579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:51.072810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.073782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.074994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.075730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.083846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.085148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.088492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.089561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.497089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:51.521253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-912a68f9-d371-47f0-a800-eea9af9bd963 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1284 microversion: 2.1 time: 0.462675 Jul 25 20:16:51.536112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1241/2447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:51 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:51.544140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:51.544140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:51.555093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.556275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.557873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.558672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.622809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:51.792868 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1856894b-3254-4926-a959-6d0d335f5e0b tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49" status: 204 len: 0 microversion: 2.1 time: 0.261575 Jul 25 20:16:51.797379 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1242/2448] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:51 2022] DELETE /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:51.802246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:51.802966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:51.812138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.813804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.814932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:51.815329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:51.840968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:51.849685 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa33ae8f-18db-421d-b9a4-dc107c0e41b5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.824260 Jul 25 20:16:51.856922 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1207/2449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:51 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:51.863898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-444927023", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:51.980440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:16:52.151713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:52.167182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff3bfe17-35f5-404c-9bfa-2ba0f4bbbd0e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1282 microversion: 2.1 time: 0.371562 Jul 25 20:16:52.178403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1243/2450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:51 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1282 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:52.188723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:52.189867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:52.199812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:52.200741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:52.202413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:52.203118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:52.747083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:52.763273 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-83bedd4f-1088-411a-baa5-e1453b57dff3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1503 microversion: 2.1 time: 0.581649 Jul 25 20:16:52.764413 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1244/2451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:52 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:52.773317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:52.774169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:52.792779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:52.793566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:52.794416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:52.794864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:52.838796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:16:52.949933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Getting quotas for project be90a02851ae4a809d55f4a67b780b5f. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:16:52.988753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Getting quotas for user 30b277f153934d3a903b39aaa9d88d5e and project be90a02851ae4a809d55f4a67b780b5f. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:16:53.030990 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31f20063-5301-4584-8f11-61002a768608 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 204 len: 0 microversion: 2.1 time: 0.263597 Jul 25 20:16:53.039096 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1245/2452] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:16:52 2022] DELETE /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:16:53.050936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:53.054376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 25 20:16:53.054957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:53.067983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.068677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Request method failure captured: Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 1751 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3voyg6QOPnQkkqnd0re11dc8OKH68_CAXvsQig61VER3zuXD7LY0uXCFKpbrrBcB1lrlZSCNvcRtHBD2fHwbhrRVj6zcgbw8LmMwgZCrM5R4qbyPiFYCwsN4ysh6Nh1xsLdamOxVLwahFYjleII7mH2tia09Pb4HygB-mtcPjDCBnJ8 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: be90a02851ae4a809d55f4a67b780b5f Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1513106000 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/be90a02851ae4a809d55f4a67b780b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_be90a02851ae4a809d55f4a67b780b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/be90a02851ae4a809d55f4a67b780b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/be90a02851ae4a809d55f4a67b780b5f"}]}] Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1513106000 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: be90a02851ae4a809d55f4a67b780b5f Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1513106000 Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 30b277f153934d3a903b39aaa9d88d5e Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-444927023", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:16:53.069575 n-d-845775-3 devstack@n-api.service[119723]: exception: Maximum number of metadata items exceeds 128 Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-444927023', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:53.072590 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 25 20:16:53.077419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:16:53.078985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.078985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.082209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:16:53.082209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7dafe277-39a4-4f8f-80fd-e83b70877d4b tempest-AbsoluteLimitsNegativeTestJSON-1513106000 tempest-AbsoluteLimitsNegativeTestJSON-1513106000-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.227741 Jul 25 20:16:53.088287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1208/2453] 10.222.0.48 () {60 vars in 1148 bytes} [Mon Jul 25 20:16:51 2022] POST /compute/v2.1/servers => generated 87 bytes in 1235 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:16:53.116078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:53.133147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:53.164782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.165986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.167376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.168344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.387387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:53.411762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63efae69-fcbe-48f7-b3a6-f7db97b94a3d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1272 microversion: 2.1 time: 0.319112 Jul 25 20:16:53.413268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1209/2454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:53 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:53.419387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a11cab1-4bb3-4d3a-afdd-c4c7cc860334 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:53.431212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a11cab1-4bb3-4d3a-afdd-c4c7cc860334 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.433412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a11cab1-4bb3-4d3a-afdd-c4c7cc860334 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.565006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a11cab1-4bb3-4d3a-afdd-c4c7cc860334 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Going to try to stop instance {{(pid=119723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:16:53.654487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a11cab1-4bb3-4d3a-afdd-c4c7cc860334 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85/action" status: 202 len: 0 microversion: 2.1 time: 0.238649 Jul 25 20:16:53.661917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1210/2455] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:16:53 2022] POST /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:16:53.672929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:53.675732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:53.687912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.688739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:53.690782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:53.691175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:54.357652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:54.381343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:54.384338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:54.386349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-867058d6-c0b1-47f7-9b00-987ca3cd3549 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.345718 Jul 25 20:16:54.387404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1246/2456] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:53 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:54.397956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:54.399488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:54.412776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:54.414186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:54.415853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:54.416923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:55.088665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:55.112578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d00d1a78-fbbc-46af-b434-54fcf89c0267 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 1.448108 Jul 25 20:16:55.133059 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1211/2457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:53 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:55.149358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:55.150322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:55.168320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:55.169087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:55.170835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:55.171891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:55.658776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:55.684019 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-755bf99f-b35a-4bc2-adfa-ae5d3e8866d8 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49" status: 200 len: 1512 microversion: 2.1 time: 1.294290 Jul 25 20:16:55.698111 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1247/2458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:54 2022] GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 => generated 1512 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:55.731341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:55.733716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:55.774892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:55.782805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:55.784164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:55.784884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.180789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:56.197384 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4355821c-b972-49f9-bc00-be985e2bec08 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1324 microversion: 2.1 time: 1.061762 Jul 25 20:16:56.198340 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1212/2459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:55 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1324 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:56.227478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:56.228947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:56.241510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.244094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.244094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.247568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.468679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:56.491375 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e4898dd-e580-4df4-8ced-f565d5f714d6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.775474 Jul 25 20:16:56.494732 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1248/2460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:55 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:56.508868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0612be26-42b2-476a-b393-7e2496cd3e9e req-514f4cc5-e408-49b3-b464-b9a43062d53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd", "tag": "61bad09a-2be6-4cb5-a5e5-3ae3a46edb80"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:56.532932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0612be26-42b2-476a-b393-7e2496cd3e9e req-514f4cc5-e408-49b3-b464-b9a43062d53a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.534088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0612be26-42b2-476a-b393-7e2496cd3e9e req-514f4cc5-e408-49b3-b464-b9a43062d53a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.567334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0612be26-42b2-476a-b393-7e2496cd3e9e req-514f4cc5-e408-49b3-b464-b9a43062d53a service nova] Creating event network-changed:61bad09a-2be6-4cb5-a5e5-3ae3a46edb80 for instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd on n-h1-845775-3 Jul 25 20:16:56.579654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0612be26-42b2-476a-b393-7e2496cd3e9e req-514f4cc5-e408-49b3-b464-b9a43062d53a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082980 Jul 25 20:16:56.580845 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1249/2461] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:56.588521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:56.589814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:56.631872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.633147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.634594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.635563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.868531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:56.890058 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb999ba9-05f5-4bfc-a534-6c6915125378 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 0.674644 Jul 25 20:16:56.897113 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1213/2462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:56 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:56.908542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:56.911521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:56.930411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.950998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:56.954305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:56.955947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:57.035091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:57.622177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:57.638812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:57.642420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:57.654064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ae3f54f4-f6a1-4fbf-bfdb-a32632cf68a5 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.071113 Jul 25 20:16:57.657226 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1250/2463] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:56 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:16:57.674827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:57.677857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:57.697352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:57.697841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:57.699498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:57.704294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.050133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:58.067599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a5f549ecc04cda87da139bad246400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a348d4a0df747d799ae0f279f869bdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:58.075903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6ff94b5-d1ef-46a0-894a-0a1dc5eb9a08 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 1.176956 Jul 25 20:16:58.078209 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1214/2464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:56 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:58.083412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-93bf86af-fa57-4fc9-93a1-4464143ad7ff tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49" status: 200 len: 1470 microversion: 2.1 time: 0.419816 Jul 25 20:16:58.084338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1251/2465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:57 2022] GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:58.092928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-15ca6b3b-3fc1-4dca-a34d-a6a37eb78a49 req-ddd2e130-07f6-47bc-b9c2-44527fe10b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf182a3-b352-41ef-95a0-837842223c49", "name": "network-vif-deleted", "tag": "ec8fadc4-839c-4fb6-95d7-1a01e1028fb4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:16:58.112845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:58.114383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:58.119742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-15ca6b3b-3fc1-4dca-a34d-a6a37eb78a49 req-ddd2e130-07f6-47bc-b9c2-44527fe10b9f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:58.120747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-15ca6b3b-3fc1-4dca-a34d-a6a37eb78a49 req-ddd2e130-07f6-47bc-b9c2-44527fe10b9f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.126405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:58.127787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.129544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:58.130331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.143096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-15ca6b3b-3fc1-4dca-a34d-a6a37eb78a49 req-ddd2e130-07f6-47bc-b9c2-44527fe10b9f service nova] Creating event network-vif-deleted:ec8fadc4-839c-4fb6-95d7-1a01e1028fb4 for instance cdf182a3-b352-41ef-95a0-837842223c49 on n-h1-845775-3 Jul 25 20:16:58.151238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-15ca6b3b-3fc1-4dca-a34d-a6a37eb78a49 req-ddd2e130-07f6-47bc-b9c2-44527fe10b9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065304 Jul 25 20:16:58.151911 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1252/2466] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:16:58.161690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:58.162606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:58.170970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:58.171568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.172744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:58.174263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:58.213773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:58.887246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:16:59.254358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:59.303048 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfb2ca92-7f2c-47e8-959d-727a6022e950 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1324 microversion: 2.1 time: 1.217121 Jul 25 20:16:59.307012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1215/2467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:58 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1324 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:59.331828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:16:59.361677 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a41eb613-beeb-4459-abfe-9375cc80094a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 1.204737 Jul 25 20:16:59.366535 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1253/2468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:58 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:16:59.370901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:59.381467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:16:59.382568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:59.398511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:16:59.427530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:59.428425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:59.429705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:59.436610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:59.438822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:59.439712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:16:59.444411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:16:59.446962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.351142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:00.368078 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5059d89-af25-4d3b-aeab-01e4ea53cfba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 1.053113 Jul 25 20:17:00.379485 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1216/2469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:16:59 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:00.402186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-921dc28e-7345-4b8e-aa80-919492320822 req-c32b35b6-8ec4-46ce-834a-22679877b139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20008018-045c-420f-a5b8-4193fb9ed8b6", "name": "network-vif-deleted", "tag": "7a44ab40-1cca-4a3a-b5a3-0e5483cef79a"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:00.426686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-921dc28e-7345-4b8e-aa80-919492320822 req-c32b35b6-8ec4-46ce-834a-22679877b139 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.427656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-921dc28e-7345-4b8e-aa80-919492320822 req-c32b35b6-8ec4-46ce-834a-22679877b139 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.451093 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-921dc28e-7345-4b8e-aa80-919492320822 req-c32b35b6-8ec4-46ce-834a-22679877b139 service nova] Creating event network-vif-deleted:7a44ab40-1cca-4a3a-b5a3-0e5483cef79a for instance 20008018-045c-420f-a5b8-4193fb9ed8b6 on n-h2-845775-3 Jul 25 20:17:00.465827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-921dc28e-7345-4b8e-aa80-919492320822 req-c32b35b6-8ec4-46ce-834a-22679877b139 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078871 Jul 25 20:17:00.467108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1217/2470] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:00.478704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:00.480499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:00.497489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.498641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.500158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.502017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.635723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:00.672776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:00.675860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:00.685531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-904da1c6-8d87-4b9c-8021-31d0831ed875 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.313213 Jul 25 20:17:00.687086 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1254/2471] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:16:59 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:00.727612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:00.729099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: cdf182a3-b352-41ef-95a0-837842223c49] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:00.754569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.755699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.759504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.760700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.801944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] HTTP exception thrown: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Request method failure captured: Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 HTTP/1.1 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnlqaS33KyBiU_28YC-POG_GNcaFvrevXBQ5yXVuK7aIIlFQgim2g5QHHVIAIosxYLxEgyU3hAl-GFgWOnsB093RXS1ampbWxQ9d4b0___8RiQr2f1EiTvedwM9mtcyAmPBPIr370giUIdfDOyp2p382qP02RJ-72w1F0F7iwPk420 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 9a348d4a0df747d799ae0f279f869bdc Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a348d4a0df747d799ae0f279f869bdc"}]}] Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 9a348d4a0df747d799ae0f279f869bdc Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateTestJSON-1421046403-project Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 74a5f549ecc04cda87da139bad246400 Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateTestJSON-1421046403-project Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'cdf182a3-b352-41ef-95a0-837842223c49'} Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:00.804888 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Returning 404 to user: Instance cdf182a3-b352-41ef-95a0-837842223c49 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59e949e2-1a93-4794-affd-a2166c59def4 tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49" status: 404 len: 111 microversion: 2.1 time: 0.100386 Jul 25 20:17:00.815422 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1255/2472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:00 2022] GET /compute/v2.1/servers/cdf182a3-b352-41ef-95a0-837842223c49 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:00.819928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:00.819928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:00.823425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:00.839204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.844102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.845632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:00.846398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:00.995378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:01.029201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:01.303444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:01.320165 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21f3dc6b-e315-4c82-93d6-09e1bdc77c74 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.849095 Jul 25 20:17:01.367718 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1218/2473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:00 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:01.385164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:01.386081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:01.396880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:01.397770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:01.398965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:01.399532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:01.743043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:01.757110 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-106b7161-a244-4901-a26d-5ca72a223468 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1324 microversion: 2.1 time: 0.946163 Jul 25 20:17:01.758969 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1256/2474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:00 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1324 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:01.837654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:01.838404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] [instance: 20008018-045c-420f-a5b8-4193fb9ed8b6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:01.858219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:01.859220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:01.860870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:01.861668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:01.892565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] HTTP exception thrown: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Request method failure captured: Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 HTTP/1.1 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vnlqaS33KyBiU_28YC-POG_GNcaFvrevXBQ5yXVuK7aIIlFQgim2g5QHHVIAIosxYLxEgyU3hAl-GFgWOnsB093RXS1ampbWxQ9d4b0___8RiQr2f1EiTvedwM9mtcyAmPBPIr370giUIdfDOyp2p382qP02RJ-72w1F0F7iwPk420 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 9a348d4a0df747d799ae0f279f869bdc Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a348d4a0df747d799ae0f279f869bdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a348d4a0df747d799ae0f279f869bdc"}]}] Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 9a348d4a0df747d799ae0f279f869bdc Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1421046403 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MultipleCreateTestJSON-1421046403-project Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 74a5f549ecc04cda87da139bad246400 Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MultipleCreateTestJSON-1421046403-project Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '20008018-045c-420f-a5b8-4193fb9ed8b6'} Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:01.897049 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. Jul 25 20:17:01.907815 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:01.917848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] Returning 404 to user: Instance 20008018-045c-420f-a5b8-4193fb9ed8b6 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:01.920022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80d07244-61c8-4e90-8a74-cf78390fb58e tempest-MultipleCreateTestJSON-1421046403 tempest-MultipleCreateTestJSON-1421046403-project] 10.222.0.48 "GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6" status: 404 len: 111 microversion: 2.1 time: 0.101816 Jul 25 20:17:01.921454 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1257/2475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:01 2022] GET /compute/v2.1/servers/20008018-045c-420f-a5b8-4193fb9ed8b6 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:01.930109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-03f3d9d5-8419-49d7-b96f-25272f437b91 req-eedd849c-c842-4258-b62d-7d3835cfe6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c81d0d3-df32-49a5-824a-ce9316aa6740", "tag": "47ac04dc-1338-4f88-8e8b-e6623a2179ce"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:01.948626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-03f3d9d5-8419-49d7-b96f-25272f437b91 req-eedd849c-c842-4258-b62d-7d3835cfe6b1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:01.949780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-03f3d9d5-8419-49d7-b96f-25272f437b91 req-eedd849c-c842-4258-b62d-7d3835cfe6b1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:01.966528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:01.968567 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-03f3d9d5-8419-49d7-b96f-25272f437b91 req-eedd849c-c842-4258-b62d-7d3835cfe6b1 service nova] Creating event network-changed:47ac04dc-1338-4f88-8e8b-e6623a2179ce for instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 on n-h2-845775-3 Jul 25 20:17:01.977726 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-03f3d9d5-8419-49d7-b96f-25272f437b91 req-eedd849c-c842-4258-b62d-7d3835cfe6b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054187 Jul 25 20:17:01.980273 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1258/2476] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:01.982339 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5fb38155-83f7-47ce-9649-37c966e95f7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.608967 Jul 25 20:17:01.991483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:01.993142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:02.002971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.003699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.004851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.005793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.009586 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1219/2477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:01 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:02.018007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-568ca57e-7a08-4615-9768-a0f18fe4d49e req-1ab70c92-eadd-46c5-89e3-f3140c727bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd", "name": "network-vif-plugged", "status": "completed", "tag": "61bad09a-2be6-4cb5-a5e5-3ae3a46edb80"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:02.053274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-568ca57e-7a08-4615-9768-a0f18fe4d49e req-1ab70c92-eadd-46c5-89e3-f3140c727bbc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.058053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-568ca57e-7a08-4615-9768-a0f18fe4d49e req-1ab70c92-eadd-46c5-89e3-f3140c727bbc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.089070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-568ca57e-7a08-4615-9768-a0f18fe4d49e req-1ab70c92-eadd-46c5-89e3-f3140c727bbc service nova] Creating event network-vif-plugged:61bad09a-2be6-4cb5-a5e5-3ae3a46edb80 for instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd on n-h1-845775-3 Jul 25 20:17:02.102376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-568ca57e-7a08-4615-9768-a0f18fe4d49e req-1ab70c92-eadd-46c5-89e3-f3140c727bbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090567 Jul 25 20:17:02.114533 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1220/2478] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:02.128543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:02.132008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:02.141552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.142234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.143332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.144980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.617965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:02.633750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86c53768-9eab-4a93-8d2c-d349d602ad0b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 0.649054 Jul 25 20:17:02.637029 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1259/2479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:01 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:02.645191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:02.646052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:02.655509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.656185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.657157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.657755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.691608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:02.718115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:02.719922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:02.724769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0695ea5c-3cd6-4327-9258-8717ced10822 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.608226 Jul 25 20:17:02.726801 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1221/2480] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:02 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:02.809133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:02.811339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:02.824971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.826280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.828835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:02.830097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:02.949854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:02.975246 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6349af30-77d2-47ac-a8ea-0cc0a596022a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.336559 Jul 25 20:17:03.004277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1260/2481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:02 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:03.020360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:03.021189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:03.026233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=20 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:03.041820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.042615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:03.043986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.044833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:03.247395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:03.264209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a445a50-99a0-4c82-bf71-025100b616da tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1324 microversion: 2.1 time: 0.463790 Jul 25 20:17:03.271631 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1222/2482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:02 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:17:03.273931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:03.284360 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-264209df-c8ff-48b9-8e44-4ecb1ce00aff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.268068 Jul 25 20:17:03.285935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1261/2483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:03 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:03.676349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:03.677835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:03.695790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.697981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:03.701234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.702971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:03.752983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:03.754037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:03.761711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.762542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:03.763964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:03.765207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.124952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:04.139648 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9b64e2e-9d56-4aa6-a2f1-e83817ea64b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 0.471411 Jul 25 20:17:04.140656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1223/2484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:03 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:04.153225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:04.153946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:04.170378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.172801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.176668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.177360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.362448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:04.391792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:04.396397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:04.399012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c0536b8-05c0-464a-84cd-e26aa4bbfe3b tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.650902 Jul 25 20:17:04.400709 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1262/2485] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:03 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:17:04.415741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:04.417005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:04.434096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.435435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.438700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.440578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.754376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:04.785842 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e65040a5-548f-4df7-bfd1-b487d3464e28 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.644029 Jul 25 20:17:04.793864 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1224/2486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:04 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:04.831175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:04.832870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:04.847192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.849067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:04.851710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:04.852953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.000898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:05.015459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61303525-b49e-44fd-9b8d-d599aecf0a7a tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1522 microversion: 2.1 time: 0.612618 Jul 25 20:17:05.018404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1263/2487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:04 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:05.072880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:05.075663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:05.111077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.113573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.115651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.117567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.196872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:17:05.382914 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f1598b1-055c-4489-a517-a8ca95e23c11 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 204 len: 0 microversion: 2.1 time: 0.321177 Jul 25 20:17:05.386243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1264/2488] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:17:05 2022] DELETE /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:17:05.408967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:05.419819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:05.444152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.445289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.450292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.454485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.697915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:05.731996 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a725f974-f1e6-47c2-9d23-2c2a39489338 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.919190 Jul 25 20:17:05.735568 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1225/2489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:04 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:05.753714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:05.761149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:05.796052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.796806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:05.798172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:05.798974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:06.495106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:06.533677 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1e8ec51-0fd5-45aa-9f3e-747c7ac10080 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 1.145746 Jul 25 20:17:06.538530 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1265/2490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:05 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:06.551946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:06.553109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:06.566852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:06.567622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:06.569023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:06.570812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:06.683416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:06.696886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-442cb517-c1a9-42da-a09e-8c58cb9d94d5 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1528 microversion: 2.1 time: 0.956229 Jul 25 20:17:06.702342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1226/2491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:05 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1528 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:06.733062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:06.734361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:06.743829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:06.745212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:06.749420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:06.750163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:07.499221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:07.513028 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f3ce18d-1571-4ffc-8355-9b40121527b4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1477 microversion: 2.1 time: 0.808477 Jul 25 20:17:07.513634 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1227/2492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:06 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1477 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:07.595458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:07.644173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:07.660870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:07.675548 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29d310ef-b99f-4c3b-9f1b-8543725b857d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.131217 Jul 25 20:17:07.682488 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1266/2493] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:06 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:07.702822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:07.703953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:07.725133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:07.726932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:07.731468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:07.732650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:08.091735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:08.093028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:08.108819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:08.109629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:08.112916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:08.113640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.110028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:09.139986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5525bc5-76af-4664-9693-d5d5ab9127b2 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 1.454396 Jul 25 20:17:09.150251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:09.159958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07d7773d-9544-4dae-b7f9-570774dfa607 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 1.630293 Jul 25 20:17:09.168306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1228/2494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:07 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:09.173469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:09.176765 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1267/2495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:07 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:09.180175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:09.199868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.200358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.201158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.202218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.213247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cf31ca66-94a6-4e15-b99a-1ee8e9f0a90f req-5fec7a5c-8d68-4d44-9ae6-569a2bb8f4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c81d0d3-df32-49a5-824a-ce9316aa6740", "name": "network-vif-plugged", "status": "completed", "tag": "47ac04dc-1338-4f88-8e8b-e6623a2179ce"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:09.251463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cf31ca66-94a6-4e15-b99a-1ee8e9f0a90f req-5fec7a5c-8d68-4d44-9ae6-569a2bb8f4ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.252606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cf31ca66-94a6-4e15-b99a-1ee8e9f0a90f req-5fec7a5c-8d68-4d44-9ae6-569a2bb8f4ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.269009 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cf31ca66-94a6-4e15-b99a-1ee8e9f0a90f req-5fec7a5c-8d68-4d44-9ae6-569a2bb8f4ab service nova] Creating event network-vif-plugged:47ac04dc-1338-4f88-8e8b-e6623a2179ce for instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 on n-h2-845775-3 Jul 25 20:17:09.279045 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cf31ca66-94a6-4e15-b99a-1ee8e9f0a90f req-5fec7a5c-8d68-4d44-9ae6-569a2bb8f4ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078618 Jul 25 20:17:09.279753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1268/2496] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:09.285618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:09.286695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:09.302386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.303412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.304792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.305679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.886370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3883ad9f7744b5890c8847a4376a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69144de1ae7e4bb8b33b24e874804dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:09.898184 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-994405fe-a358-4dcf-8d5c-0ef4bfeb9403 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 200 len: 1528 microversion: 2.1 time: 0.728214 Jul 25 20:17:09.915879 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1229/2497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:09 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 1528 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:09.924995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:09.926916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:09.936864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.937573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:09.938534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:09.939218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.093357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:10.130126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdbae551-1b4e-4e0b-8356-9f8f73b9f914 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1476 microversion: 2.1 time: 0.847178 Jul 25 20:17:10.132944 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1269/2498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:09 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1476 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:10.145072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "name": "network-vif-unplugged", "status": "completed", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:10.168398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:10.169440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.209767 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] Creating event network-vif-unplugged:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h2-845775-3 Jul 25 20:17:10.221481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:17:10.250036 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-00eeccc3-222b-4bf3-9d4f-c3727e05ae3f req-9253a9b5-729c-495f-8a1f-59a5a1d64910 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111606 Jul 25 20:17:10.254028 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1270/2499] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:10.269249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:10.272171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:10.298454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:10.298454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.298454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:10.298454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.365625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:10.754469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:10.782540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:10.786498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:10.790382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f3cbb59-6342-4612-b327-89a4957e2169 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.869915 Jul 25 20:17:10.792708 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1230/2500] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:09 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:10.809460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:10.812394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:10.832247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:10.833226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.835218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:10.837602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:10.861267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:10.904228 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d746864-d29c-44cb-babf-6aed8c7c002f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 0.645440 Jul 25 20:17:10.908287 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1271/2501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:10 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:10.933057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-15d86d30-18dd-4d71-82e0-1dc1fee91cc4 req-dc509e99-7237-4add-900d-8115bbbd98ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd", "name": "network-vif-deleted", "tag": "61bad09a-2be6-4cb5-a5e5-3ae3a46edb80"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:11.030362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-15d86d30-18dd-4d71-82e0-1dc1fee91cc4 req-dc509e99-7237-4add-900d-8115bbbd98ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.035186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-15d86d30-18dd-4d71-82e0-1dc1fee91cc4 req-dc509e99-7237-4add-900d-8115bbbd98ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.095065 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-15d86d30-18dd-4d71-82e0-1dc1fee91cc4 req-dc509e99-7237-4add-900d-8115bbbd98ba service nova] Creating event network-vif-deleted:61bad09a-2be6-4cb5-a5e5-3ae3a46edb80 for instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd on n-h1-845775-3 Jul 25 20:17:11.116989 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-15d86d30-18dd-4d71-82e0-1dc1fee91cc4 req-dc509e99-7237-4add-900d-8115bbbd98ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205415 Jul 25 20:17:11.131301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1272/2502] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:11.157857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.169142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.201080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.207861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.211727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.212992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.243942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:11.266493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b59f6ea1-33e5-46c8-a7c2-eb9294a60e61 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.469527 Jul 25 20:17:11.267788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1231/2503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:10 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:11.281673 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. Jul 25 20:17:11.288383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.289651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd HTTP/1.1 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd'} Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.291866 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. Jul 25 20:17:11.297683 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.301166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:11.304981 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-97a35c0a-3183-44fc-a544-cb4f4bc19240 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd" status: 404 len: 111 microversion: 2.1 time: 0.168417 Jul 25 20:17:11.308760 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1273/2504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:11 2022] GET /compute/v2.1/servers/cefacd7c-efaf-47b0-a6c2-f8dc2799c6bd => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:11.322669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.323015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.326347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.327319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.327818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b30805c-4ffd-48ea-a390-b240dbd209fc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f19695c3670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.400216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-4b30805c-4ffd-48ea-a390-b240dbd209fc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Image not found. Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b30805c-4ffd-48ea-a390-b240dbd209fc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a HTTP/1.1 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '842e6ff1-2c28-4958-813c-542fc23a1b3a'} Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 842e6ff1-2c28-4958-813c-542fc23a1b3a to delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 842e6ff1-2c28-4958-813c-542fc23a1b3a could not be found. Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.402775 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:17:11.413476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.419077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:11.419260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b30805c-4ffd-48ea-a390-b240dbd209fc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:11.421323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b30805c-4ffd-48ea-a390-b240dbd209fc tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a" status: 404 len: 62 microversion: 2.1 time: 0.103647 Jul 25 20:17:11.429409 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1274/2505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:11 2022] DELETE /compute/v2.1/images/842e6ff1-2c28-4958-813c-542fc23a1b3a => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:17:11.456950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.462013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.490730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.497534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.507124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.507835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.565976 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e HTTP/1.1 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e'} Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:11.575004 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:11.583795 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-481f929e-65f6-4a22-bd07-7231a38690be tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.141931 Jul 25 20:17:11.590161 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1275/2506] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:17:11 2022] DELETE /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:17:11.603035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.608915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.619302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.620414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.621863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.622974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.672343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e HTTP/1.1 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e'} Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.674441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. Jul 25 20:17:11.679497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:11.680879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:11.682148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7a689c4c-121e-43be-b02a-4fd80e76fed3 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e" status: 404 len: 111 microversion: 2.1 time: 0.090470 Jul 25 20:17:11.683426 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1276/2507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:11 2022] GET /compute/v2.1/servers/04572dc5-4ac1-4fbf-9f7b-fea5bbe1eb8e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:11.691507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:11.696913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7b24b23-be2c-4aa1-90cd-f4ba7d96cba1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f1969b10700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.706896 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f415c24e-0458-4438-af8e-f6529dff3218 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1476 microversion: 2.1 time: 0.437202 Jul 25 20:17:11.708477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1232/2508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:11 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:11.758479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7b24b23-be2c-4aa1-90cd-f4ba7d96cba1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422658885" status: 202 len: 0 microversion: 2.1 time: 0.067487 Jul 25 20:17:11.760116 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1277/2509] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422658885 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:17:11.840972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.841512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.875002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.876099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.877667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.879733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.957017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:11.958464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:11.970543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.971277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:11.972480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:11.973094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:12.650058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:12.668770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:12.683353 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13748f0d-a4c0-4a17-9a3e-28982a3eec8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1314 microversion: 2.1 time: 0.735553 Jul 25 20:17:12.692126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1278/2510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:11 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:12.693341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:12.694489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:12.700462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:12.702709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:12.705160 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c685bcc-13ef-447e-9fef-a925a2d87537 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.872425 Jul 25 20:17:12.727320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1233/2511] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:11 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:12.734974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:12.735947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:12.737652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:12.738663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:12.739082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:12.757586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:12.758802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:12.788076 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] Creating event network-changed:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h2-845775-3 Jul 25 20:17:12.799789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:17:12.830612 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ace2ce19-f792-4b02-bfff-8f1c7fbe928a req-794facdf-dddd-4df4-91ed-46893f283388 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100373 Jul 25 20:17:12.830612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1234/2512] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:12.844507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:12.845700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:12.857574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:12.858340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:12.860569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:12.861565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:13.683692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:13.706409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-157444a5-ae95-43fd-b492-2c8713ab4911 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 1.019660 Jul 25 20:17:13.709026 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1279/2513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:12 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:13.815555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:13.835184 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f90bd6b6-abed-40af-8583-3e5662954b03 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1476 microversion: 2.1 time: 1.002657 Jul 25 20:17:13.840525 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1235/2514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:12 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1476 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:13.851884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:13.855120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:13.876789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:13.881542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:13.884094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:13.884846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:14.469568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbf15bad-3950-449f-bdf4-08019c6d3d58 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196965f280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1219267209", "description": "tempest-description-669086183"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:14.918037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:14.947034 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f39d6e76-46f7-4a54-9839-53b12de7abb4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1464 microversion: 2.1 time: 1.102592 Jul 25 20:17:14.964848 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1236/2515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:13 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1464 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:14.988936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:14.990372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:15.006327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:15.007553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:15.009063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:15.010152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:16.180847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:16.215275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:16.220541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:16.226572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4469f350-8484-4475-a54e-c29d537e062c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.260116 Jul 25 20:17:16.229745 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1237/2516] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:14 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:16.245731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:16.247466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:16.271490 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbf15bad-3950-449f-bdf4-08019c6d3d58 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.547969 Jul 25 20:17:16.271490 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1280/2517] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:16.272372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:16.281691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:16.282060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:16.283146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:16.283937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:16.291433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:16.292718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:16.318444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:16.321318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:16.329097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:16.331990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:16.699425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:16.715007 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1f441126-8426-4527-81b4-deb7c5f66ed8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.483427 Jul 25 20:17:16.716127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1238/2518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:16 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:16.911099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:16.938925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d706e2ac-00db-4e35-a2d5-7d0b3e3f9c43 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1474 microversion: 2.1 time: 0.676867 Jul 25 20:17:16.941953 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1281/2519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:16 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1474 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:16.958171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c08a035f-d44d-46b6-9537-ad406ee631a1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '.version_select at 0x7f19698fa280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:17.052793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c08a035f-d44d-46b6-9537-ad406ee631a1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Image not found. Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c08a035f-d44d-46b6-9537-ad406ee631a1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/429cd209-555c-4884-91ef-791f47d124fa HTTP/1.1 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '429cd209-555c-4884-91ef-791f47d124fa'} Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 429cd209-555c-4884-91ef-791f47d124fa to delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 429cd209-555c-4884-91ef-791f47d124fa could not be found. Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:17.056822 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c08a035f-d44d-46b6-9537-ad406ee631a1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:17.067267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c08a035f-d44d-46b6-9537-ad406ee631a1 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/images/429cd209-555c-4884-91ef-791f47d124fa" status: 404 len: 62 microversion: 2.1 time: 0.117754 Jul 25 20:17:17.073066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1282/2520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:16 2022] DELETE /compute/v2.1/images/429cd209-555c-4884-91ef-791f47d124fa => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:17:17.087425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7fba5525-08c9-4018-b5cd-0508be734c84 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196965f280>, body: {"security_group_rule": {"parent_group_id": "5eb102b3-103e-4aff-9534-924a678261bf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:17.674586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:17.709496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'deleted': False, 'project_id': '16f8f59c2ec04c78a94f57cba5906577'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:17.733817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:17.734810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:17.736373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:17.737664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:17.786458 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7fba5525-08c9-4018-b5cd-0508be734c84 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.713596 Jul 25 20:17:17.788668 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1283/2521] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:17 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:17.806329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:17.807289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:17.842635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:17.843528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:17.846002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:17.847628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:17.930727 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc HTTP/1.1 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc'} Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:17.950073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3aaca89-a98b-41e5-a66b-2dc17cce4c86 tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 404 len: 111 microversion: 2.1 time: 0.162963 Jul 25 20:17:17.957961 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1284/2522] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:17:17 2022] DELETE /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:17.966389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:17.970641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:17.987678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:17.991231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:18.001796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:18.011471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:18.274592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9e28c40-e526-4534-8934-571aa8729981 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.556821 Jul 25 20:17:18.279329 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1239/2523] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:17:16 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:18.293866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:18.297668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:18.319294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:18.326226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:18.330937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:18.334635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:18.895883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:18.896832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:18.909920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:18.911604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:18.912857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-56c3086f-e1bc-4eb4-8a47-551281f0acc8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.957223 Jul 25 20:17:18.924493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1285/2524] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:17 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:18.932164 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0183b98-fb64-4047-a9c4-8db517af740d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 0.650824 Jul 25 20:17:18.934210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1240/2525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:18 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:18.963721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:18.965377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26d74066-5316-41ce-870a-5db7e38976b0 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196965f3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2084947296", "description": "tempest-description-2076608363"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:18.966304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:18.997294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:18.998450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.013254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.014613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.335781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:19.361218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21aca544-59cc-4170-9d09-1f93121dd014 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1471 microversion: 2.1 time: 0.424931 Jul 25 20:17:19.368443 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1241/2526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:18 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:19.394611 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26d74066-5316-41ce-870a-5db7e38976b0 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.468555 Jul 25 20:17:19.395678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1286/2527] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:19.403638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:19.411120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:19.413919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] [instance: 779a51de-08d4-4639-b4fd-61e3db2d6ecc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:19.432973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.436754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.439079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.441613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.446735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'deleted': False} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:19.471431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.475722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.478613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.479786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.496699 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] HTTP exception thrown: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Request method failure captured: Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc HTTP/1.1 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlqvyzWlPxkB_D9adcxabAU83f7dYCveG9G7PFOazYLR7ctY8pCZQVDxxuyAQ9fZssGdjsE0K3scrixrU4lxjyNde7xQTu8RCoRShohyubBOWi6IKk9hg9gymtwgf7WTbi0R5kA6j-YAyAeFWF6TuXRbckYR-IqM7XRoZSFtPCCMoA Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/69144de1ae7e4bb8b33b24e874804dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/69144de1ae7e4bb8b33b24e874804dc7"}]}] Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 69144de1ae7e4bb8b33b24e874804dc7 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7d3883ad9f7744b5890c8847a4376a94 Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1905364165-project Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '779a51de-08d4-4639-b4fd-61e3db2d6ecc'} Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:19.503787 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:19.512880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] Returning 404 to user: Instance 779a51de-08d4-4639-b4fd-61e3db2d6ecc could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:19.518497 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2655e82a-608e-4d91-9b1f-8501eeaa749e tempest-ImagesOneServerNegativeTestJSON-1905364165 tempest-ImagesOneServerNegativeTestJSON-1905364165-project] 10.222.0.48 "GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc" status: 404 len: 111 microversion: 2.1 time: 0.147837 Jul 25 20:17:19.550189 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1242/2528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:19 2022] GET /compute/v2.1/servers/779a51de-08d4-4639-b4fd-61e3db2d6ecc => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:19.581385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:19.582235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:19.616058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.627398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.628646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.629395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:19.724576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:17:19.855621 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f662b615-aad3-4d7e-bae1-e14f69799c8e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386/action" status: 204 len: 0 microversion: 2.1 time: 0.303247 Jul 25 20:17:19.861923 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1243/2529] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:19 2022] POST /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386/action => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:17:19.880483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fde5545d-d56b-45d7-b93e-7955ad8e0ad6 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f19694ad4c0>, body: {"security_group_rule": {"parent_group_id": "23a4a827-2bd3-4ab1-93bc-1b3ee888f152", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:19.931005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:19.933192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:20.926124 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fde5545d-d56b-45d7-b93e-7955ad8e0ad6 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.061379 Jul 25 20:17:20.927932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1244/2530] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:19 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:20.946412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:20.948142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:20.970923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:20.974189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:20.979781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:20.980621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:21.503616 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0208183-c0fb-422e-82b1-022bac4993df tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13370 microversion: 2.1 time: 2.105470 Jul 25 20:17:21.506188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1287/2531] 10.222.0.48 () {58 vars in 1171 bytes} [Mon Jul 25 20:17:19 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13370 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:17:21.517004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:21.518831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:21.532535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:21.533987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:21.535641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:21.538018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:21.649874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:21.691589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f98ec56-ebdd-47dd-b84a-52005107d031 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1471 microversion: 2.1 time: 0.753930 Jul 25 20:17:21.692656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1245/2532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:20 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1471 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:21.721050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:21.722541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:21.755565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:21.757918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:21.759746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:21.767921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:22.925819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:22.937239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:22.939140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:22.940594 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d57576a9-7b25-45ed-9334-58e4c0b6916c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.432572 Jul 25 20:17:22.942126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1288/2533] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:21 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:22.955233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:22.982916 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8dc0cb29-c159-4070-9714-21e9bee42013 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1513 microversion: 2.1 time: 1.288626 Jul 25 20:17:22.997949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1246/2534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:21 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1513 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:23.014633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e0e87f8-95cb-4d2e-b9e8-3033d93e9326 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196ead55e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1043430078", "description": "tempest-description-1684650185"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:23.345446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2026753042", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:23.445244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:23.446337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:23.447637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:23.448190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:23.451220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:23.472462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:23.474178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:23.475881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:23.476816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:23.517820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Getting quotas for project 23fb4d73e6eb4eb89d3c61d8e0647bba. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:17:23.537397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Getting quotas for user 1ef2c132d75448f982c39ee09917bd19 and project 23fb4d73e6eb4eb89d3c61d8e0647bba. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:17:23.580707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:17:23.588109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:17:23.705543 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bccd503c-3e67-43d9-b6d3-aafd309f38ec tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.761923 Jul 25 20:17:23.706900 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1289/2535] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:17:23.723089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:23.744831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'deleted': False, 'project_id': '16f8f59c2ec04c78a94f57cba5906577'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:23.784664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:23.786312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:23.788096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:23.789300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:23.851711 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-467aa22b-490f-485f-a29e-20ecb172d409 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?tenant_id=0b18817281c94dfc89e0da34cb18f52c" status: 200 len: 15 microversion: 2.1 time: 0.142897 Jul 25 20:17:23.891136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1290/2536] 10.222.0.48 () {58 vars in 1231 bytes} [Mon Jul 25 20:17:23 2022] GET /compute/v2.1/servers/detail?tenant_id=0b18817281c94dfc89e0da34cb18f52c => generated 15 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:23.908274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "name": "network-vif-plugged", "status": "completed", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:23.942749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:23.943913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:23.972714 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] Creating event network-vif-plugged:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h2-845775-3 Jul 25 20:17:23.984007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:17:24.009056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b33ec827-f32e-4985-8b81-5037ddf27e33 req-20bc4587-525b-4589-8acb-cd1a81211ad5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113837 Jul 25 20:17:24.009912 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1291/2537] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:24.031406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:24.032100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:24.061540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:24.061540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:24.062658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:24.063340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:24.194122 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e0e87f8-95cb-4d2e-b9e8-3033d93e9326 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.194374 Jul 25 20:17:24.195917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1247/2538] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:24.203060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:24.213281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:24.379023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:24.401087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:24.416966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:24.419227 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2c33fc52-34f8-4877-9739-51b93c6521d5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 200 len: 1278 microversion: 2.47 time: 0.221470 Jul 25 20:17:24.420867 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1248/2539] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:24 2022] GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:24.475519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:24.495021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'tenant_id': '0b18817281c94dfc89e0da34cb18f52c', 'deleted': False} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:24.580674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:24.582024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:24.583692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:24.588888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:24.704111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:17:24.917158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:24.929734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:24.931836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:24.955215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7480a56c-91c7-4b65-b6da-f46161da2912 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1471 microversion: 2.1 time: 0.935670 Jul 25 20:17:24.957164 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1292/2540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:24 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1471 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:24.976440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:24.979584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:25.013830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:25.020994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:25.023465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:25.027924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:25.417886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d63eee14-830b-4510-a5fd-ff23114a97d0 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0b18817281c94dfc89e0da34cb18f52c" status: 200 len: 4826 microversion: 2.1 time: 0.979504 Jul 25 20:17:25.419903 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1249/2541] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:17:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0b18817281c94dfc89e0da34cb18f52c => generated 4826 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:25.440095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:25.442158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:25.468370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:25.469175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:25.470240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:25.470935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:25.644172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:25.681569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:25.684623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:25.686862 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69b25512-1f1e-4c38-ba76-1353e1caf8a3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.728214 Jul 25 20:17:25.703314 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1293/2542] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:24 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:25.717460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-909558d6-3deb-42d2-a18e-413c7b6d66e1 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196972a790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-291703767", "description": "tempest-description-1517574624"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:25.838160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:25.862187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32f95c94-aec0-4a3d-bd21-5fd4073926ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1490 microversion: 2.1 time: 0.439188 Jul 25 20:17:25.864067 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1250/2543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:25 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1490 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:25.872546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1578266221", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:25.981941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:25.983154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:25.984374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:25.985480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:25.987178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:26.016266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.017398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.019163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.021428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.062680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Getting quotas for project 23fb4d73e6eb4eb89d3c61d8e0647bba. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:17:26.076438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Getting quotas for user 1ef2c132d75448f982c39ee09917bd19 and project 23fb4d73e6eb4eb89d3c61d8e0647bba. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:17:26.102941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:17:26.110288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:17:26.218890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-397d3e26-dcc3-4ae4-876c-ce8cc70940c4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.352719 Jul 25 20:17:26.220534 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1251/2544] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 356 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:17:26.239707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:26.271226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'tenant_id': '16f8f59c2ec04c78a94f57cba5906577', 'deleted': False} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:26.294565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.296008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.298202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.299531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.407170 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-909558d6-3deb-42d2-a18e-413c7b6d66e1 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.701736 Jul 25 20:17:26.409924 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1294/2545] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:26.421030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:26.433117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:26.455250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.459784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.462144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.468203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.472707 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8df5416-6b6c-4e8e-a95b-c109294616e9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=16f8f59c2ec04c78a94f57cba5906577" status: 200 len: 15 microversion: 2.1 time: 0.250146 Jul 25 20:17:26.474330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1252/2546] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:17:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=16f8f59c2ec04c78a94f57cba5906577 => generated 15 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:26.491382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:26.492791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:26.509693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.510729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.511928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:26.512698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:26.571190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:26.610760 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64b65baa-5550-42fc-828b-d1bb058cd88e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 200 len: 139 microversion: 2.1 time: 0.198736 Jul 25 20:17:26.618798 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1295/2547] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:26 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 139 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:26.631366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44ef5ebb-fcc0-47d7-abc7-0dc103fd63fd tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:26.641126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44ef5ebb-fcc0-47d7-abc7-0dc103fd63fd tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:26.709136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:26.739165 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44ef5ebb-fcc0-47d7-abc7-0dc103fd63fd tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "PUT /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 992 microversion: 2.47 time: 0.118186 Jul 25 20:17:26.740635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1296/2548] 10.222.0.48 () {62 vars in 1297 bytes} [Mon Jul 25 20:17:26 2022] PUT /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 992 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:17:26.768221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79cc9ef9-ad20-406d-929e-8a71c2f92fc6 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f19695ff5e0>, body: {"security_group_rule": {"parent_group_id": "c600d110-295a-4853-8abb-1b02ad325e42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "26c2bcd7-794a-490c-81d0-f6f9945d0fac"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:27.173924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:27.194826 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d38b9270-3d33-43dd-8c5a-22b96bee6bcd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1463 microversion: 2.1 time: 0.717304 Jul 25 20:17:27.196736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1253/2549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:26 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1463 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:27.206128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3592778-6b1f-4a72-b6ba-f2a0bce7c894 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:27.212870 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3592778-6b1f-4a72-b6ba-f2a0bce7c894 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014085 Jul 25 20:17:27.214130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1254/2550] 10.222.0.48 () {58 vars in 1189 bytes} [Mon Jul 25 20:17:27 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:27.223283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:27.224890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:27.238064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:27.239232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:27.241259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:27.242229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:27.825551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:27.865383 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e45ed0d3-9a24-4bb3-90a9-6e5b27238f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.648989 Jul 25 20:17:27.866318 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1255/2551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:27 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:27.883384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:27.884102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:27.909200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:27.913286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:27.914321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:27.914797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:27.978723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79cc9ef9-ad20-406d-929e-8a71c2f92fc6 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.234467 Jul 25 20:17:27.993985 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1297/2552] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:28.010572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:28.011888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:28.033041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:28.034038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:28.035219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:28.041359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:28.265807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:28.283596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:28.285900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:28.288346 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ff9663c-0311-4b7d-ac03-c0db6900bbfa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1330 microversion: 2.47 time: 0.292308 Jul 25 20:17:28.290093 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1298/2553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:27 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1330 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:28.300284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:28.316408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:28.346793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:28.348456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:28.356248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:28.357022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:28.985133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:29.031561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:29.039002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:29.039750 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28c0b91b-2a3c-4da7-936a-d952b4129233 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 1.169328 Jul 25 20:17:29.041419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1256/2554] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:27 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:29.067404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:29.071983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:29.083986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:29.085506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:29.087949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:29.089121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:29.140794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:29.191477 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81e68de4-25f5-4505-bf72-4d4b9c1050d9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1463 microversion: 2.1 time: 0.899308 Jul 25 20:17:29.193043 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1299/2555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:28 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1463 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:29.207631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-98e4b579-55a4-4ef2-8cd3-38be589ee6b6 req-871f5318-a803-4430-82f8-3d18e4996b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "c86962a0-b9d0-40a7-8bd5-496cde816bed"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:29.250661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98e4b579-55a4-4ef2-8cd3-38be589ee6b6 req-871f5318-a803-4430-82f8-3d18e4996b99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:29.252377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98e4b579-55a4-4ef2-8cd3-38be589ee6b6 req-871f5318-a803-4430-82f8-3d18e4996b99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:29.277125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-98e4b579-55a4-4ef2-8cd3-38be589ee6b6 req-871f5318-a803-4430-82f8-3d18e4996b99 service nova] Creating event network-vif-plugged:c86962a0-b9d0-40a7-8bd5-496cde816bed for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:29.288848 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-98e4b579-55a4-4ef2-8cd3-38be589ee6b6 req-871f5318-a803-4430-82f8-3d18e4996b99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093482 Jul 25 20:17:29.300935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1300/2556] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:29.312364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:29.313843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:29.326479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:29.327294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:29.329273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:29.330465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:29.362914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d076cfdf-29ba-4fa0-b08e-3bc1505287aa tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.318220 Jul 25 20:17:29.369806 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1257/2557] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:29 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:29.426128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a01e1d23-55bc-4bfa-a8ec-ef88656759d8 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196ea51f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1483734802", "description": "tempest-description-827077975"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:29.902336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:29.925797 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0bfd6f0-ae91-4a70-b9ca-05fd06db49d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.621149 Jul 25 20:17:29.940858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1301/2558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:29 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:29.956697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa01f24a-33e2-4907-b981-b02ee61f680a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'create', calling method: .version_select at 0x7f1969582af0>, body: {"keypair": {"name": "tempest-keypair-1722325294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFA1+2tIZnkMNN30EstMZ7vaXwv7eVO2uGNwoVThJffqi3ot+9wRL2rSaXn94djxQyN17yAhT1pI3+Y4vaZwGY3rQctdHgd6jjlenC/JERxG0gkASGFF5O6pAkuXFlLYA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:29.981092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-aa01f24a-33e2-4907-b981-b02ee61f680a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:17:29.991705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-aa01f24a-33e2-4907-b981-b02ee61f680a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:17:30.112622 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa01f24a-33e2-4907-b981-b02ee61f680a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169336 Jul 25 20:17:30.115289 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1302/2559] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:17:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:30.127548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:30.128487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:30.160187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.162933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.164894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.167312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.227797 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a01e1d23-55bc-4bfa-a8ec-ef88656759d8 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.853441 Jul 25 20:17:30.228435 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1258/2560] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:30.245269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:30.264332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:30.265780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:30.269412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '0b18817281c94dfc89e0da34cb18f52c'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:30.298737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.299657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.303046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.304188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.399708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:30.417282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:30.419633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:30.429888 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ebb6dc9a-14ee-4ae7-867b-8cb72a06487b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1336 microversion: 2.47 time: 0.312752 Jul 25 20:17:30.432272 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1303/2561] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:30 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1336 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:30.447128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:30.448753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:30.474941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.479021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.480382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.481025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.553979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:17:30.740864 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1de74c8-a88b-4a85-b2ec-87bdc8806049 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.510233 Jul 25 20:17:30.741925 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1259/2562] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Jul 25 20:17:30 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:30.750139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:30.751390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:30.766237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.767295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:30.769654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:30.770425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.025756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:31.053659 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-317dc74b-cbe1-4225-98c9-c166a6bc36be tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.617813 Jul 25 20:17:31.067239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1304/2563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:30 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:31.103655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25ca13c7-6388-4d05-bbfc-48850b0f07eb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f19695c3670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-740955965", "description": "tempest-description-1268532218"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:31.409572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:31.438034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:31.439890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:31.441247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac40fc43-5977-43f3-9b19-2521aed56832 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.697985 Jul 25 20:17:31.456554 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1260/2564] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:30 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:31.485370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:31.495011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:31.520603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.524484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.526202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.531157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.642487 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25ca13c7-6388-4d05-bbfc-48850b0f07eb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.568704 Jul 25 20:17:31.645879 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1305/2565] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:31.668000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:31.677972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:31.729020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.732944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.734447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.754042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.779994 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bea69fc4-c994-406d-af9c-bb64ffa83c24 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.320968 Jul 25 20:17:31.781727 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1261/2566] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:31 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:31.791865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:31.793610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:31.803208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.804296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:31.805855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:31.807303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.066396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:32.081818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:32.086422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:32.089895 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4e8cbed-8d09-42a1-85c6-d12d5a15972f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1336 microversion: 2.47 time: 0.305550 Jul 25 20:17:32.090804 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1262/2567] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:31 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1336 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:32.121802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "0c9dbc51-bf07-41b0-b58d-f47b07bac99f"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "58b29d89-9a22-41af-9fc9-634501e8f130"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "783b5af4-2aec-4ff0-a438-c9426f47731a"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "74fe7a93-560c-492d-8417-eba24fb3fdc5"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "2998464c-87f5-4c58-8c19-797dbc233cfe"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:32.149055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:32.150576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.184724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Creating event network-vif-plugged:0c9dbc51-bf07-41b0-b58d-f47b07bac99f for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:32.186346 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Creating event network-vif-plugged:58b29d89-9a22-41af-9fc9-634501e8f130 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:32.187623 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Creating event network-vif-plugged:783b5af4-2aec-4ff0-a438-c9426f47731a for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:32.189601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Creating event network-vif-plugged:74fe7a93-560c-492d-8417-eba24fb3fdc5 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:32.189762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] Creating event network-vif-plugged:2998464c-87f5-4c58-8c19-797dbc233cfe for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:32.214866 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-98aff28b-baa5-4bb1-922d-c34aae397cad req-3314a0a3-d833-4590-876f-72f43aadaa03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.121874 Jul 25 20:17:32.219325 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1263/2568] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:32.237586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db146f14-7137-4959-90ca-326d19e93572 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196a8340d0>, body: {"security_group_rule": {"parent_group_id": "4db0d325-fb19-458e-8de5-dc1319a8e402", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7ecccbc2-6891-4151-b93b-5a1a400688c1"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:32.378462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:32.402872 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05ff1a5a-7932-4092-9b4f-3c43c37fdf0f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.751549 Jul 25 20:17:32.418694 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1306/2569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:31 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:32.429672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:32.430543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:32.461001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:32.461517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.464250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:32.464250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.912760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db146f14-7137-4959-90ca-326d19e93572 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.690115 Jul 25 20:17:32.915003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1264/2570] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:32 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:32.926872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:32.929227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:32.935048 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba8d59f1-d0da-4521-9fe8-d6e97024be0c tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1613 microversion: 2.1 time: 0.508829 Jul 25 20:17:32.936266 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1307/2571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:32 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1613 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:32.940296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:32.941374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.942411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:32.943074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:32.955043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2083575194", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "ea7c3422-34fd-4fb8-b7bc-60523dad31bd"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:33.123385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] validate_networks() for [('ea7c3422-34fd-4fb8-b7bc-60523dad31bd', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:17:33.411940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:33.436478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:33.440652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:33.443736 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8304806a-f5c0-4766-996c-f41fdd33a1fd tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.526417 Jul 25 20:17:33.463108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1265/2572] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:32 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:33.490924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59825a66-d3e0-47ce-b5b3-c0f03e675b3f tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f19695d1b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:33.816938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:34.187284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:34.189413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:34.190767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:34.191805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:34.193734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:34.215180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.216811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.218539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.219468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.250346 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59825a66-d3e0-47ce-b5b3-c0f03e675b3f tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7ecccbc2-6891-4151-b93b-5a1a400688c1" status: 202 len: 0 microversion: 2.1 time: 0.784957 Jul 25 20:17:34.256633 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1266/2573] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:33 2022] DELETE /compute/v2.1/os-security-groups/7ecccbc2-6891-4151-b93b-5a1a400688c1 => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:34.290760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:34.293455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:34.311616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:17:34.325449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:17:34.329247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.330232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.332096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.333072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.355427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:17:34.358830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:17:34.442974 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2da1355a-682e-4707-9a11-0b32cfebf0f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504530 Jul 25 20:17:34.448100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1308/2574] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:17:34.471891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:34.472996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:34.497460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.503302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.504875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.505907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.655086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:34.677967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-696ca498-fb43-4d24-8a80-ddcb17756ecd tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1613 microversion: 2.1 time: 0.414685 Jul 25 20:17:34.684288 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1267/2575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:34 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1613 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:34.701661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:34.704194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:34.707416 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-927a5ec8-e72c-400a-ac41-e133e517548c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1357 microversion: 2.47 time: 0.257110 Jul 25 20:17:34.710868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1309/2576] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:34 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:34.724621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-51f88d3a-3281-4168-8e9d-5099e5b1fb1c req-cc9d148e-aee0-48c3-9397-035af0b9a372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-plugged", "status": "completed", "tag": "f3cb5213-d562-41bc-b3d4-7ed5d9645a1b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:34.758728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51f88d3a-3281-4168-8e9d-5099e5b1fb1c req-cc9d148e-aee0-48c3-9397-035af0b9a372 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:34.759640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51f88d3a-3281-4168-8e9d-5099e5b1fb1c req-cc9d148e-aee0-48c3-9397-035af0b9a372 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:34.789530 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-51f88d3a-3281-4168-8e9d-5099e5b1fb1c req-cc9d148e-aee0-48c3-9397-035af0b9a372 service nova] Creating event network-vif-plugged:f3cb5213-d562-41bc-b3d4-7ed5d9645a1b for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:34.800492 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-51f88d3a-3281-4168-8e9d-5099e5b1fb1c req-cc9d148e-aee0-48c3-9397-035af0b9a372 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087214 Jul 25 20:17:34.802221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1310/2577] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:34.812717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13bd6b47-05c4-4fcd-865d-aa5e611af9cb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f196962db80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.106056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13bd6b47-05c4-4fcd-865d-aa5e611af9cb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/4db0d325-fb19-458e-8de5-dc1319a8e402" status: 200 len: 247 microversion: 2.1 time: 0.301663 Jul 25 20:17:35.107019 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1311/2578] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:17:34 2022] GET /compute/v2.1/os-security-groups/4db0d325-fb19-458e-8de5-dc1319a8e402 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:35.113288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8819dcf-1359-4f21-b16b-b02abf98f485 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.114427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8819dcf-1359-4f21-b16b-b02abf98f485 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:35.253054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.260371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.262211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.270630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.271276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.288310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8819dcf-1359-4f21-b16b-b02abf98f485 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:35.316965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8819dcf-1359-4f21-b16b-b02abf98f485 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1215 microversion: 2.1 time: 0.208129 Jul 25 20:17:35.319002 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1312/2579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:35 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:35.338041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.338041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:35.374159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.374978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.376658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.377373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.385474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cab5edea-424f-42d8-b5ba-46bca06cfdfb tempest-AZV2TestJSON-507540487 tempest-AZV2TestJSON-507540487-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.704197 Jul 25 20:17:35.396930 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1268/2580] 10.222.0.48 () {58 vars in 1164 bytes} [Mon Jul 25 20:17:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:35.417118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-91e413dc-c176-4b0d-aed8-0fdc6a6be3a0 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '.version_select at 0x7f19695d1b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.429449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91e413dc-c176-4b0d-aed8-0fdc6a6be3a0 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.431065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91e413dc-c176-4b0d-aed8-0fdc6a6be3a0 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.455582 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-91e413dc-c176-4b0d-aed8-0fdc6a6be3a0 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 805 microversion: 2.1 time: 0.055969 Jul 25 20:17:35.457075 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1269/2581] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:17:35 2022] GET /compute/v2.1/os-migrations => generated 805 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:35.466471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:35.483386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'host': 'n-h2-845775-3', 'deleted': False} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:35.511424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.512062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.513381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.513900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.742412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:17:35.871168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:35.872081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b1d2a90-7179-4d52-9fba-4f3b05d4cc86 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=n-h2-845775-3&all_tenants=1" status: 200 len: 2292 microversion: 2.1 time: 0.412208 Jul 25 20:17:35.876531 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1270/2582] 10.222.0.48 () {58 vars in 1190 bytes} [Mon Jul 25 20:17:35 2022] GET /compute/v2.1/servers?host=n-h2-845775-3&all_tenants=1 => generated 2292 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:35.884112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:35.886005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:35.886577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:35.889057 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-90d79089-cce9-4506-9eb6-d8a6a517f96d tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1868 microversion: 2.42 time: 0.568389 Jul 25 20:17:35.889370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:35.905695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1313/2583] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:35 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1868 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:35.906619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.907812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.910091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:35.911293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:35.924378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bbb0b74-5647-416e-a52d-0f21e69a2227 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f196962d040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1678724719", "description": "tempest-description-78055031"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:36.079185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:36.079825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:36.081556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:36.081808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:36.084023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:36.098679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:36.116126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:36.210282 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1bbb0b74-5647-416e-a52d-0f21e69a2227 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.303264 Jul 25 20:17:36.211368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:36.222752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.223291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.225674 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1314/2584] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:17:35 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:36.226067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.226709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.234926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a211a8c-498e-46d6-b999-298e0bfe61b3 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:36.268053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a211a8c-498e-46d6-b999-298e0bfe61b3 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034462 Jul 25 20:17:36.271094 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1315/2585] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:17:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:36.294868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:36.328577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:17:36.367400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.368212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.369631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.370406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.392854 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4282b1cf-e6dd-4837-815d-975619b937aa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "POST /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182/action" status: 202 len: 1079 microversion: 2.47 time: 0.513516 Jul 25 20:17:36.394454 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1271/2586] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:17:35 2022] POST /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182/action => generated 1079 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 20:17:36.411647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76014679-7316-4eb3-9571-039c4854656e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f19698c3820>, body: {"security_group_rule": {"parent_group_id": "331e1152-c7bb-4d29-9619-1664ca13baa8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:36.654574 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e376444f-f608-41a6-80d8-afd0d817ead9 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.379414 Jul 25 20:17:36.655942 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1316/2587] 10.222.0.48 () {58 vars in 1196 bytes} [Mon Jul 25 20:17:36 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:36.665109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa6ceee3-2bb8-488e-9039-cb5d797ea886 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-449024806", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:36.669071 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:17:36.669071 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:17:36.701536 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa6ceee3-2bb8-488e-9039-cb5d797ea886 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.043585 Jul 25 20:17:36.703351 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1317/2588] 10.222.0.48 () {60 vars in 1146 bytes} [Mon Jul 25 20:17:36 2022] POST /compute/v2.1/flavors => generated 498 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:36.713520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:36.714954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:36.730384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.730384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.730973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.731532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.828727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76014679-7316-4eb3-9571-039c4854656e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.432240 Jul 25 20:17:36.839099 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1272/2589] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:36.847477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:36.848373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:36.856813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.858065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.859538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.860467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.869556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:36.883267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-885b2484-65cd-410a-8094-8220f23389fa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1267 microversion: 2.1 time: 0.177796 Jul 25 20:17:36.884497 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1318/2590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:36 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:36.890743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:36.896219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:36.933602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.934517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:36.936003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:36.936872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:37.068362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:37.100921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:37.112461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:37.114513 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41287c1d-e458-4c07-8ff3-5e79d5b62ec1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.273474 Jul 25 20:17:37.115760 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1273/2591] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:36 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:37.131929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-adfbca4a-1481-400f-b9ef-5acd27daae1a tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:37.174172 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-adfbca4a-1481-400f-b9ef-5acd27daae1a tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048383 Jul 25 20:17:37.196083 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1274/2592] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Jul 25 20:17:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:17:37.213892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-667f621c-8961-465f-b7a5-6ebb501cc28a tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Action: 'create', calling method: .version_select at 0x7f19695d11f0>, body: {"security_group_rule": {"parent_group_id": "331e1152-c7bb-4d29-9619-1664ca13baa8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:37.236609 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9befff96-52c6-44bb-9c69-345bc7fb6b7b tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.348924 Jul 25 20:17:37.240737 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1319/2593] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:36 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:37.258603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:37.262350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:37.281934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:37.282567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:37.283605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:37.284324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.031083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:38.059385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:38.062479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:38.066326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c19264f-7039-4400-ba4c-b22e2453b62c tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2825 microversion: 2.42 time: 0.822815 Jul 25 20:17:38.068621 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1320/2594] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:37 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2825 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:38.078295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:38.084112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:38.096827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.097957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.100001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.101657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.323551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:38.324371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:38.325040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:38.325664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:38.326243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:38.425124 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-667f621c-8961-465f-b7a5-6ebb501cc28a tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.232014 Jul 25 20:17:38.427783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1275/2595] 10.222.0.48 () {60 vars in 1195 bytes} [Mon Jul 25 20:17:37 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:38.454678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-431842331", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "bd427588-152a-46d7-aafa-d89a5f9054db"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:38.465204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:38.500342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.501155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.504148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.505423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.625900 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9f9e0b3-56e8-4a55-8460-1c9223e4d5d3 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 1066 microversion: 2.1 time: 0.554863 Jul 25 20:17:38.638737 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1321/2596] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:17:38 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 1066 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 20:17:38.653555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:38.655112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:38.673440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.674330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.675483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:38.676481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:38.681743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:17:38.941511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:38.978929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a45d84a3-85ac-4ce0-9b41-1a2135b0a59b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1273 microversion: 2.1 time: 0.328392 Jul 25 20:17:38.980341 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1322/2597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:38 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:38.992414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:38.993525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:39.006164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.007949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.010674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.011647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.445780 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c13f481d-e65a-43af-9397-2eec451a207e tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.462939 Jul 25 20:17:39.447578 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1323/2598] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:17:38 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271/os-interface => generated 1831 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:39.458145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:39.460018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:39.472923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.473682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.475750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.478822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.664152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:39.675135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:39.687073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:39.690760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:39.693054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc63875d-d803-4b56-9744-3780573bd79a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.242988 Jul 25 20:17:39.694358 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1324/2599] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:39 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:39.704736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5532032a-3a0d-44be-8205-dbc036eed463 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f1969897d30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:39.801064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:17:39.803243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:17:39.804436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:17:39.805615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:17:39.806940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:17:39.848088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.851536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.853597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:39.862188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:39.910438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=15 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:39.975385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:17:39.991037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:17:40.020694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:17:40.027736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:17:40.045197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5532032a-3a0d-44be-8205-dbc036eed463 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/331e1152-c7bb-4d29-9619-1664ca13baa8" status: 200 len: 663 microversion: 2.1 time: 0.347967 Jul 25 20:17:40.046574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1325/2600] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:17:39 2022] GET /compute/v2.1/os-security-groups/331e1152-c7bb-4d29-9619-1664ca13baa8 => generated 663 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:40.061690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:40.064818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:40.085285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:40.091471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:40.093346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:40.096076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:40.097037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:40.133311 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e54f0923-5552-45d8-a538-fa209d10c685 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703333 Jul 25 20:17:40.146993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1276/2601] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:17:40.160723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:40.160723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:40.179756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:40.180608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:40.181834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:40.182755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:40.906966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:40.928006 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69167e84-2000-42f7-821f-f2b86733cbe2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.781065 Jul 25 20:17:40.929240 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1277/2602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:40 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:40.957063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17f674db-941e-479f-8ead-45a365d3426f tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f19695d18b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:41.120153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:41.143966 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ec61264-ad94-4057-86dd-8660927ea330 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 1.095433 Jul 25 20:17:41.160573 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1326/2603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:40 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:41.180504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:41.182048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:41.196478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:41.197673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:41.199402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:41.200515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:41.510537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:41.526400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-068f8cc6-9274-482b-8bb4-73577359bed8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1274 microversion: 2.1 time: 0.363267 Jul 25 20:17:41.527575 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1327/2604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:41 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:41.540006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:41.543036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:41.555776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:41.556597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:41.562650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:41.565985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:41.828449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:41.855800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:41.858592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:41.860214 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74838ad5-db3b-4e5a-9ca3-200c1fd04fa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.330421 Jul 25 20:17:41.880486 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1328/2605] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:41 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:42.229342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f8904305-d874-48d3-a27a-8a21d10d815c req-2afd0a15-9c8b-4bfe-8a89-0b2c879e3658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "tag": "0c9dbc51-bf07-41b0-b58d-f47b07bac99f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:42.278739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f8904305-d874-48d3-a27a-8a21d10d815c req-2afd0a15-9c8b-4bfe-8a89-0b2c879e3658 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:42.280272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f8904305-d874-48d3-a27a-8a21d10d815c req-2afd0a15-9c8b-4bfe-8a89-0b2c879e3658 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:42.329317 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f8904305-d874-48d3-a27a-8a21d10d815c req-2afd0a15-9c8b-4bfe-8a89-0b2c879e3658 service nova] Creating event network-changed:0c9dbc51-bf07-41b0-b58d-f47b07bac99f for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:17:42.339482 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f8904305-d874-48d3-a27a-8a21d10d815c req-2afd0a15-9c8b-4bfe-8a89-0b2c879e3658 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455375 Jul 25 20:17:42.342052 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1329/2606] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:42.380930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:42.387184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:42.415820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:42.417115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:42.418416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:42.419082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:42.433060 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17f674db-941e-479f-8ead-45a365d3426f tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/19305827-da95-4159-8a77-42b0e55313f6" status: 202 len: 0 microversion: 2.1 time: 1.489969 Jul 25 20:17:42.435512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1278/2607] 10.222.0.48 () {58 vars in 1287 bytes} [Mon Jul 25 20:17:40 2022] DELETE /compute/v2.1/os-security-group-rules/19305827-da95-4159-8a77-42b0e55313f6 => generated 0 bytes in 1494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:42.457428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:42.461179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:42.510235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:42.511462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:42.519704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:42.520899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:43.092420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:43.120539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81c002bd-3a57-4813-ba8a-cd9c118a06a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.767679 Jul 25 20:17:43.121802 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1330/2608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:42 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:43.136180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9135d5ba-68f6-4fc8-afc5-cd4188de98e0 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f1968cd9160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:43.714153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:43.761767 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-744cbda4-2823-4f8f-bd5e-3a0d04b0f41c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 1.312993 Jul 25 20:17:43.764529 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1279/2609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:42 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:43.784288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:43.791538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:43.818137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:43.819294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:43.820411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:43.823549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.106071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:45.122566 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bcd0b25c-43f2-4866-ba7e-7e0649349756 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 1.355195 Jul 25 20:17:45.130449 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1280/2610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:43 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:45.149203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:45.151056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:45.166270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.167676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.171206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.172181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.295185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:45.468153 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9135d5ba-68f6-4fc8-afc5-cd4188de98e0 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/331e1152-c7bb-4d29-9619-1664ca13baa8" status: 202 len: 0 microversion: 2.1 time: 2.344081 Jul 25 20:17:45.469730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1331/2611] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:43 2022] DELETE /compute/v2.1/os-security-groups/331e1152-c7bb-4d29-9619-1664ca13baa8 => generated 0 bytes in 2347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:45.475385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:45.476008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:45.499702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.500836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.503143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.508832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.579707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:45.612606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:45.615213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:45.628177 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11c5a655-96ed-479a-bb1c-1c63224c9f72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.495678 Jul 25 20:17:45.628895 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1281/2612] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:45 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:45.646970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:45.654993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:45.677005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.677503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:45.681097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:45.681606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:46.513922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:46.701670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:46.703893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:46.741775 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74b3ce0a-b717-4292-813a-dc19b7803cf7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 1.266656 Jul 25 20:17:46.743002 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8273251-33c9-4c7a-8abd-00894e1daa20 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 1.111151 Jul 25 20:17:46.747090 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1332/2613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:45 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:46.762329 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1282/2614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:45 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:46.799400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f19698218b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:46.956670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:17:46.958066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Neutron security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:17:46.959070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] HTTP exception thrown: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.959070 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Request method failure captured: Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/7ecccbc2-6891-4151-b93b-5a1a400688c1 HTTP/1.1 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vpIBNGWgcEZ9rhEeAfMzDarCaiX2HDdJCtMbN_DJt25FswGi0tq16dWftS5k3Y08m_OYRhtZxHOQQKD5FvW6Cvrs1ZwIjekTXn3Cj-exX9JGqn7g0Vs7wbnHthQapCDkRYYIllyVI314iowyIDCx1oRrC7BC1mS_I8RnQS58S8SOvg Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 02de3439562d48bb979eb677d4455afb Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-742445934 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02de3439562d48bb979eb677d4455afb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_02de3439562d48bb979eb677d4455afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/02de3439562d48bb979eb677d4455afb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/02de3439562d48bb979eb677d4455afb"}]}] Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupRulesTestJSON-742445934 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 02de3439562d48bb979eb677d4455afb Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-742445934 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupRulesTestJSON-742445934-project Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 2be56b4c11d1420aab478ceec4cb551a Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupRulesTestJSON-742445934-project Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7ecccbc2-6891-4151-b93b-5a1a400688c1'} Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:17:46.962638 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Returning 404 to user: Security group 7ecccbc2-6891-4151-b93b-5a1a400688c1 does not exist Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-3e48ec57-83ec-4502-bfb2-4984f96349de'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da654987-4229-478b-ae1d-022dd2601f7e tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7ecccbc2-6891-4151-b93b-5a1a400688c1" status: 404 len: 194 microversion: 2.1 time: 0.195447 Jul 25 20:17:46.978103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1283/2615] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:46 2022] DELETE /compute/v2.1/os-security-groups/7ecccbc2-6891-4151-b93b-5a1a400688c1 => generated 194 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:17:47.007049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8f6cb081-daa9-4476-b65f-db0a6c7e0a89 req-43090ac5-731b-4e02-8531-323d299b033f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:47.039168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8f6cb081-daa9-4476-b65f-db0a6c7e0a89 req-43090ac5-731b-4e02-8531-323d299b033f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.039707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8f6cb081-daa9-4476-b65f-db0a6c7e0a89 req-43090ac5-731b-4e02-8531-323d299b033f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.065187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8f6cb081-daa9-4476-b65f-db0a6c7e0a89 req-43090ac5-731b-4e02-8531-323d299b033f service nova] Creating event network-changed:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:17:47.072201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b86aa31b-45e4-486e-b008-2581ee7b921d req-c41e140d-b415-41e9-8cd7-7ceae5da239c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e8c3c8-798e-417c-ab99-94b1f55413d2", "tag": "6c1f336e-78fe-49e7-ac27-d119bafe0146"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:47.072507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8f6cb081-daa9-4476-b65f-db0a6c7e0a89 req-43090ac5-731b-4e02-8531-323d299b033f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096611 Jul 25 20:17:47.083616 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1284/2616] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:47.113935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:47.118964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:47.121700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b86aa31b-45e4-486e-b008-2581ee7b921d req-c41e140d-b415-41e9-8cd7-7ceae5da239c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.122523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b86aa31b-45e4-486e-b008-2581ee7b921d req-c41e140d-b415-41e9-8cd7-7ceae5da239c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.149532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.152602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.160188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.162258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.180449 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b86aa31b-45e4-486e-b008-2581ee7b921d req-c41e140d-b415-41e9-8cd7-7ceae5da239c service nova] Creating event network-changed:6c1f336e-78fe-49e7-ac27-d119bafe0146 for instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 on n-h1-845775-3 Jul 25 20:17:47.217911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b86aa31b-45e4-486e-b008-2581ee7b921d req-c41e140d-b415-41e9-8cd7-7ceae5da239c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450752 Jul 25 20:17:47.222324 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1333/2617] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:47.254918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:47.256651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:47.271317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.273220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.276655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.277830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.546286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:47.561726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:47.565382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:47.568447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f99d682-4079-45bc-bd38-bcc3dda2ddaa tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.341731 Jul 25 20:17:47.584473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1334/2618] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:47 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:47.614962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3804fa88-3857-4088-891c-8d5c34cf4944 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f196962dca0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:47.796892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:47.820382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8480fb19-0b9f-4877-be11-00e23b205fd3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 0.729958 Jul 25 20:17:47.840930 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1285/2619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:47 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:47.846887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:47.848541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:47.864225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.865316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:47.867048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:47.867931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:48.434176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:48.459156 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa7d9d02-e26b-44a1-a338-f9cc6e4513d7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.616136 Jul 25 20:17:48.478587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1286/2620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:47 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:48.493282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:48.494292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:48.508298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:48.509284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:48.510938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:48.511773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:48.556202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3804fa88-3857-4088-891c-8d5c34cf4944 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/4db0d325-fb19-458e-8de5-dc1319a8e402" status: 202 len: 0 microversion: 2.1 time: 0.964570 Jul 25 20:17:48.556202 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1335/2621] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:47 2022] DELETE /compute/v2.1/os-security-groups/4db0d325-fb19-458e-8de5-dc1319a8e402 => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:48.567422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-648d2701-5a4e-43ec-8554-a538a9358a27 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f1968cd99d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:48.906567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:48.936331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33c057f6-9cb7-4ef2-b776-d2b91f684198 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.453285 Jul 25 20:17:48.938301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1287/2622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:48 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:48.950466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:48.952174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:48.984772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:48.985546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:48.987275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:48.988559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:49.196647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:49.213597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:49.218543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:49.220571 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f3417ee2-36e4-44cc-9bd1-50090570a6ab tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.280101 Jul 25 20:17:49.221392 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1288/2623] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:48 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:49.239626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:49.241358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:49.252846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:49.253986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:49.255699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:49.256786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:49.392019 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-648d2701-5a4e-43ec-8554-a538a9358a27 tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/26c2bcd7-794a-490c-81d0-f6f9945d0fac" status: 202 len: 0 microversion: 2.1 time: 0.832273 Jul 25 20:17:49.398873 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1336/2624] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:48 2022] DELETE /compute/v2.1/os-security-groups/26c2bcd7-794a-490c-81d0-f6f9945d0fac => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:49.416486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84cf3eb4-8384-4247-86c4-2be4a9e9896b tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f1968c74040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:49.924931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:49.940406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:49.949145 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-955cd55e-6d81-4079-914b-657265be2636 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 0.725911 Jul 25 20:17:49.960090 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1289/2625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:49 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:49.964560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:49.984900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:50.009017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:50.012612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.013459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:50.014913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.015686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:50.635483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84cf3eb4-8384-4247-86c4-2be4a9e9896b tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/c600d110-295a-4853-8abb-1b02ad325e42" status: 202 len: 0 microversion: 2.1 time: 1.233219 Jul 25 20:17:50.636531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1337/2626] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:49 2022] DELETE /compute/v2.1/os-security-groups/c600d110-295a-4853-8abb-1b02ad325e42 => generated 0 bytes in 1237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:50.658850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:50.660610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:50.694393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.695679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:50.699612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.700854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:50.714791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:50.748998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2d92e7bd-92e4-4d26-b280-34988a972272 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.794007 Jul 25 20:17:50.750689 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1290/2627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:49 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:50.768571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:50.769869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:50.790953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.796778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:50.806776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:50.808183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:51.022471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:51.061441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:51.066859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:51.070108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29caecfb-8aea-46c0-ade9-0d8aca2fd528 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.317225 Jul 25 20:17:51.076479 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1291/2628] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:50 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:51.085437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f829a7a1-eb0b-4ae7-90f9-ac4464093f3d tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f19698c8820>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:51.219697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:51.234692 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-284f1b34-11f6-42a5-9f4b-49ecc55eb12c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.595954 Jul 25 20:17:51.236125 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1338/2629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:50 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:51.251862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:51.254537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:51.266099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:51.280433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:51.281677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:51.285146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:51.286378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.014378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:52.031524 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-769b16cc-cd47-4e07-bc3a-0f492488707b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 0.793352 Jul 25 20:17:52.037135 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1339/2630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:51 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:52.042667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:52.047580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:52.082478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.084113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.088927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.090549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.127072 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f829a7a1-eb0b-4ae7-90f9-ac4464093f3d tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/23a4a827-2bd3-4ab1-93bc-1b3ee888f152" status: 202 len: 0 microversion: 2.1 time: 1.048741 Jul 25 20:17:52.128130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1292/2631] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:51 2022] DELETE /compute/v2.1/os-security-groups/23a4a827-2bd3-4ab1-93bc-1b3ee888f152 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:52.153036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:52.155008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:52.184931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.185745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.187176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.187973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.433165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:52.449007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:52.452450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:52.455514 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f5e89ae-2561-4d13-b01b-984855068475 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.320831 Jul 25 20:17:52.457428 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1293/2632] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:52 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:52.465042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-615fcf38-e46e-4423-8c82-a669074d8edb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] Calling method '.version_select at 0x7f19698c8af0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:52.468824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:52.504807 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42ce377e-8f03-40c6-9d31-aab4c413f7bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.466039 Jul 25 20:17:52.507142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1340/2633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:52 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:52.550147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:52.556222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:52.570707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.571843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:52.576644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:52.577165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.139061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:53.167882 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7004f104-ccca-4d58-b67d-157a18d5c384 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.653878 Jul 25 20:17:53.185256 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1341/2634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:52 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:53.209448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:53.213355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:53.251400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.256169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.262190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.264730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.286779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-615fcf38-e46e-4423-8c82-a669074d8edb tempest-SecurityGroupRulesTestJSON-742445934 tempest-SecurityGroupRulesTestJSON-742445934-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/5eb102b3-103e-4aff-9534-924a678261bf" status: 202 len: 0 microversion: 2.1 time: 0.827543 Jul 25 20:17:53.292256 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1294/2635] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:17:52 2022] DELETE /compute/v2.1/os-security-groups/5eb102b3-103e-4aff-9534-924a678261bf => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:17:53.497489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:53.499007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:53.514433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.515716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.518491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.519716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.587500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:53.799617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:53.817046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:53.820327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:53.822478 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75dcf240-c07f-4ade-8252-0968f0cc4601 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.334048 Jul 25 20:17:53.843668 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1295/2636] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:53 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:53.860556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:53.862264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:53.869486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:53.873588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c38483c-2635-45de-b5e2-bda71190ff52 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 0.686375 Jul 25 20:17:53.875706 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1342/2637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:53 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:53.900167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.900919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:53.902308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:53.903384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:54.207821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:54.211917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:54.248977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:54.254107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:54.255969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:54.259564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:54.690814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:54.707600 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d0a05fb6-62a5-4613-9531-be1a4f5ad55c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.861837 Jul 25 20:17:54.709446 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1296/2638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:53 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:55.198894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:55.219049 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd06e1f3-10fc-40a8-b3b6-af3f7e2f6dd0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 1.022348 Jul 25 20:17:55.227418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1343/2639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:54 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:55.247572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-04f58803-b0db-4f8c-be75-3238aab71808 req-bd0e269a-f0f6-4fe3-8d5e-930813c05ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-plugged", "status": "completed", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:55.255573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:55.258589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:55.290101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-04f58803-b0db-4f8c-be75-3238aab71808 req-bd0e269a-f0f6-4fe3-8d5e-930813c05ba8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.301630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-04f58803-b0db-4f8c-be75-3238aab71808 req-bd0e269a-f0f6-4fe3-8d5e-930813c05ba8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.311083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.312102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.313822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.315023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.349273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-04f58803-b0db-4f8c-be75-3238aab71808 req-bd0e269a-f0f6-4fe3-8d5e-930813c05ba8 service nova] Creating event network-vif-plugged:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:17:55.360613 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-04f58803-b0db-4f8c-be75-3238aab71808 req-bd0e269a-f0f6-4fe3-8d5e-930813c05ba8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.648612 Jul 25 20:17:55.369758 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1297/2640] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:55.382789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:55.384502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:55.399260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.403966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.406448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.407569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.690124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:55.708123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:55.710640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:55.712634 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7a0f1c9e-8afc-492f-87b5-19234bdb4e7a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.480309 Jul 25 20:17:55.713953 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1344/2641] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:55 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:55.752072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:55.752865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:55.764173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.765407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:55.766802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:55.767756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.118626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.144843 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb826778-d332-4018-a9f0-e3db426ac28e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 1.770885 Jul 25 20:17:57.163029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1298/2642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:55 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:57.179540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:57.184909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:57.205864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:57.206571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.208070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:57.209117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.629969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.677302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-17f99e78-179f-45b9-8c8b-f46b54a79342 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 1.930082 Jul 25 20:17:57.697516 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1345/2643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:55 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:57.714467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:57.721198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:57.736366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:57.737146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.738447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:57.739305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.806242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.828701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01e4771d-b2e5-48a7-a407-a0865fde5b47 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.662702 Jul 25 20:17:57.844330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1299/2644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:57 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:57.844330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-14bd977b-a4c8-46ef-9953-7273a7b1cd82 req-279ac2c0-770e-483c-b05f-d8cff5660a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8c3c8-798e-417c-ab99-94b1f55413d2", "name": "network-vif-plugged", "status": "completed", "tag": "6c1f336e-78fe-49e7-ac27-d119bafe0146"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:57.860274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-14bd977b-a4c8-46ef-9953-7273a7b1cd82 req-279ac2c0-770e-483c-b05f-d8cff5660a61 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:57.860274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-14bd977b-a4c8-46ef-9953-7273a7b1cd82 req-279ac2c0-770e-483c-b05f-d8cff5660a61 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:57.880550 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-14bd977b-a4c8-46ef-9953-7273a7b1cd82 req-279ac2c0-770e-483c-b05f-d8cff5660a61 service nova] Creating event network-vif-plugged:6c1f336e-78fe-49e7-ac27-d119bafe0146 for instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 on n-h1-845775-3 Jul 25 20:17:57.893717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-14bd977b-a4c8-46ef-9953-7273a7b1cd82 req-279ac2c0-770e-483c-b05f-d8cff5660a61 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062187 Jul 25 20:17:57.900662 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1300/2645] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:17:57.952520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.970593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.979096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:57.983956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92241202-f2ce-44ad-9662-10496db297bb tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.284792 Jul 25 20:17:57.984587 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1346/2646] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:17:57 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:17:58.067504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-103101801", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "26410ec9-f9f8-4561-a996-9acba0a24fde"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:17:58.195096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] validate_networks() for [('26410ec9-f9f8-4561-a996-9acba0a24fde', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:17:58.211108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:58.212665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:58.224489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:58.225273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:58.226760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:58.227468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:59.098045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:59.102912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:17:59.119473 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74ab362c-9187-4080-9e1a-f2c6ad04cc56 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1378 microversion: 2.1 time: 0.931140 Jul 25 20:17:59.140613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1347/2647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:58 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1378 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:59.140613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:59.140613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:59.152982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:59.154185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:59.155733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:59.162213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:59.774011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:17:59.791910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-227e9f94-9e22-4383-a3d0-e2dbc0af7caa tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1315 microversion: 2.1 time: 0.665671 Jul 25 20:17:59.814763 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1348/2648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:59 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:17:59.824341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:17:59.826176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:17:59.834744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:59.836422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:17:59.837781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:17:59.838559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.078180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:18:00.080523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:18:00.081782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:18:00.082525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:18:00.084080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:18:00.099304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.100134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.115725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.117049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.159733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Getting quotas for project d114efff73d041adb5bf4dcfc2ba98fb. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:18:00.169426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Getting quotas for user 477648b7254d4b5abf34a749f6190d28 and project d114efff73d041adb5bf4dcfc2ba98fb. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:18:00.204746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:18:00.217811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:18:00.335610 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0cff29e-2ff0-4790-90fe-1a0df3d443cf tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424170 Jul 25 20:18:00.344415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1301/2649] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:18:00.357256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:00.357912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:00.379646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:00.383895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.384400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.385343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.385848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.398230 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d908443-8e63-4428-b3d7-7a69883e8e52 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.581589 Jul 25 20:18:00.399236 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1349/2650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:17:59 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:00.441946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:00.447200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:00.474750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.481125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.483754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:00.486763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:00.855007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:00.882231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:00.893272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:00.904097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fcf21d5-6b01-44dd-815c-327ef6c6ccb1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.559220 Jul 25 20:18:00.907118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1302/2651] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:00 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:00.922891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-582dd826-c192-43f5-9855-d62573d8d54d tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:00.924462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-582dd826-c192-43f5-9855-d62573d8d54d tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:01.052078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:01.072663 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f442b9d2-165f-4a12-92c7-c61db873f4d0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1528 microversion: 2.1 time: 0.668237 Jul 25 20:18:01.074113 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1350/2652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:00 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1528 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:01.097050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:01.100373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:01.129493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-582dd826-c192-43f5-9855-d62573d8d54d tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:01.144823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-582dd826-c192-43f5-9855-d62573d8d54d tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1216 microversion: 2.1 time: 0.235680 Jul 25 20:18:01.145908 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1303/2653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:00 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1216 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:01.146980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.147660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.150323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.151315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.181528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:01.184648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:01.197664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.199868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.202010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.203245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.816344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:01.848009 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67fb7947-250b-420e-997c-421e0b1a8bb1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1502 microversion: 2.1 time: 0.764305 Jul 25 20:18:01.849133 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1351/2654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:01 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1502 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:01.854818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:01.855533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:01.885923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.886572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.890766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:01.891671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:01.926480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:01.950011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db5ee23c-3327-4747-9c45-4715a2a0c1a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1528 microversion: 2.1 time: 0.784275 Jul 25 20:18:01.972142 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1304/2655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:01 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1528 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:01.980163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:01.986466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:02.027642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.037399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.039653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.046349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.181900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60bd6693-7c83-4d5f-b59a-07b1b2212b66 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.207712 Jul 25 20:18:02.192379 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1305/2656] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:01 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:02.204157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:02.205450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:02.219770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.220640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.223396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.224335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.407603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.421267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.426254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.428934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e495c3d3-da47-4e33-8fe8-f7a00c613619 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.233558 Jul 25 20:18:02.431382 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1306/2657] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:02 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:02.453560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58eb20fb-4260-4450-8d37-09b6611e9eb9 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:02.463570 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:18:02.463570 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:18:02.476830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.501323 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58eb20fb-4260-4450-8d37-09b6611e9eb9 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/bd427588-152a-46d7-aafa-d89a5f9054db" status: 202 len: 0 microversion: 2.1 time: 0.067749 Jul 25 20:18:02.506698 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1307/2658] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:18:02 2022] DELETE /compute/v2.1/flavors/bd427588-152a-46d7-aafa-d89a5f9054db => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:02.515819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:02.517744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:02.521440 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35f2e82e-69c2-4318-8e76-85787deffb68 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1470 microversion: 2.1 time: 0.670784 Jul 25 20:18:02.530817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1352/2659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:01 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:02.537162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.538439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.551986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.552698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.554959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-869c8409-0887-4b3e-b040-d83160d9f332 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:02.620406 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-869c8409-0887-4b3e-b040-d83160d9f332 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086953 Jul 25 20:18:02.622735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1353/2660] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:18:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:02.656759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:02.660600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:02.687167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.691917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.691917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:02.691917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:02.725337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.755436 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9fe69aab-b0cf-4bc0-87d3-3237a960198c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1268 microversion: 2.1 time: 0.245925 Jul 25 20:18:02.758916 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1308/2661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:02 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:02.802007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:02.827734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Old instance type tempest-test_resize_flavor_-449024806, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:18:02.848395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:18:02.853754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:18:02.854510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:18:02.855113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:18:02.855717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:18:03.019936 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d48de39-47da-46f2-816c-8ca53491f3a8 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0/action" status: 202 len: 0 microversion: 2.1 time: 0.373204 Jul 25 20:18:03.021080 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1354/2662] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:02 2022] POST /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:03.031620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:03.033227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:03.059020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.060416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.061967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.062722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.200774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:03.204308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:03.228601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.230691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.254581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.259669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.382236 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1cc41e59-fe72-4a33-aae2-6017afe46f36 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.185305 Jul 25 20:18:03.388839 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1355/2663] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:03 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:03.474627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:03.477931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:03.509782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:03.517987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.518787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.520245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.521030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.534303 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f54311c-d223-45d9-aff4-80748b7d3226 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1537 microversion: 2.1 time: 0.506802 Jul 25 20:18:03.545293 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1309/2664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:03 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1537 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:03.565808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:03.567151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:03.585511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.586578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.587922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.589026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.684557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:03.723481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:03.728344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:03.734151 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dfaca999-88dc-42ca-93f2-b08906a9134b tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.266531 Jul 25 20:18:03.736281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1356/2665] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:03 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:03.810793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:03.812487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:03.849924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.851236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:03.858537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:03.859687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:04.487892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:04.521264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-307f9ba9-d67e-4bbf-94f8-f3bb193ebf3a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1268 microversion: 2.1 time: 0.727753 Jul 25 20:18:04.538351 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1357/2666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:03 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1268 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:04.558984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:04.565422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:04.574267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:04.576235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:04.579125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:04.580234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:04.674704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b1abf93-609d-45b9-8d75-bf07079f0aef tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.134031 Jul 25 20:18:04.676229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1358/2667] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:04 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:04.688760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:04.688760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:04.708857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:04.709949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:04.710982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:04.711614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:04.914814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:04.940823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1ff3737-0672-4ac4-b1ee-d194780455c6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 1.382387 Jul 25 20:18:04.948717 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1310/2668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:03 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:04.973991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:04.977895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:05.002012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.005594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.008464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.010949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.146597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:05.169972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80cbdf1f-02c4-43c5-93f1-19eb70e8a35e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1537 microversion: 2.1 time: 0.491878 Jul 25 20:18:05.204258 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1359/2669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:04 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1537 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:05.276416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:05.322202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:05.349598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:05.354190 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c3104f40-80b8-4058-a21e-fff134b60c8d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.396477 Jul 25 20:18:05.358724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1311/2670] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:04 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:05.569861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:05.570660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:05.581153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.581779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.582936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.593363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.693486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:05.709707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:05.734574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.736896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.741250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:05.745716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:05.840193 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4716864f-3d6d-46ae-a91e-d261db5a178a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.153794 Jul 25 20:18:05.841828 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1312/2671] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:05 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:05.935896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:05.978322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6fc1af02-1258-4de4-990a-16b5badd8a16 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1274 microversion: 2.1 time: 0.412828 Jul 25 20:18:05.981465 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1360/2672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:05 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:06.009762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:06.014393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:06.040220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.042336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:06.044092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.046777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:06.248310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:06.252322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:06.283900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.289316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:06.295098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.299228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:06.804189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:06.831348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed1a8013-451f-4ef0-8f39-bf6bea4de93a tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.845094 Jul 25 20:18:06.832685 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1313/2673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:05 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:06.860282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:06.861462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:06.890237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.891463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:06.894120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:06.895159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.042735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:07.067605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00af403c-a433-4353-9466-b18da2068c51 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1537 microversion: 2.1 time: 0.850507 Jul 25 20:18:07.069790 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1361/2674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:06 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1537 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:07.083641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-17b007c5-5491-44e5-a1c1-ec2ac7122e4e req-738fc6d1-2110-4061-bb5d-5fe86c547134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:07.114743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-17b007c5-5491-44e5-a1c1-ec2ac7122e4e req-738fc6d1-2110-4061-bb5d-5fe86c547134 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.115708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-17b007c5-5491-44e5-a1c1-ec2ac7122e4e req-738fc6d1-2110-4061-bb5d-5fe86c547134 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.141383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-17b007c5-5491-44e5-a1c1-ec2ac7122e4e req-738fc6d1-2110-4061-bb5d-5fe86c547134 service nova] Creating event network-vif-unplugged:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:18:07.152740 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-17b007c5-5491-44e5-a1c1-ec2ac7122e4e req-738fc6d1-2110-4061-bb5d-5fe86c547134 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080540 Jul 25 20:18:07.156101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1362/2675] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:07.172418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:07.173244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:07.179019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:07.197616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.198563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.199686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.204071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.213183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:07.216945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:07.219122 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f552c052-8bc5-40c2-87eb-49958f302f28 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.373694 Jul 25 20:18:07.220788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1314/2676] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:06 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:07.240907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:07.241965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:07.267374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.268698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.271207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.272008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.286931 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5651ee0-e544-417e-bc8d-85173b816384 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.128704 Jul 25 20:18:07.289788 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1363/2677] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:07 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:07.430958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:07.460820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-704782cb-e001-4045-8710-91da355a5762 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1274 microversion: 2.1 time: 0.238344 Jul 25 20:18:07.478000 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1315/2678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:07 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:07.894499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:07.900861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:07.923214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.923669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:07.924812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:07.925265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.116955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:08.117723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:08.127137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.128360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.129661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.130518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.694209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:08.724079 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac3ed49c-0035-4253-b328-df57002fef03 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.848353 Jul 25 20:18:08.725495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1364/2679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:07 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:08.735917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:08.747718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:08.779415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.780417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.782002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.782975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.892133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:08.895247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:08.917381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b67c378c-4b10-4a14-8e20-41c822ef8900 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1537 microversion: 2.1 time: 0.806713 Jul 25 20:18:08.920740 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1316/2680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:08 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1537 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:08.928612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:08.932002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:08.955003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.956190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:08.957884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:08.958945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.044839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:09.053393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:09.067639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:09.071862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:09.073951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14cf0037-8440-467d-aaed-3995ff0d3aaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.345613 Jul 25 20:18:09.076805 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1365/2681] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:08 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:09.086280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:09.088288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:09.129494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.130653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.134928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.137925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.142743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a05e1557-b8c7-4356-a687-377f6cccfb2e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.206987 Jul 25 20:18:09.150555 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1317/2682] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:08 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:09.684954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:09.701186 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-47cdca24-708d-4c64-a0f3-37c10df1dec1 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.621911 Jul 25 20:18:09.703988 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1366/2683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:09 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:09.775478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:09.777094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:09.790616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.792206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.793956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.794800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.961080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:09.962432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:09.982075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.982825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:09.983926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:09.984737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.135885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:10.281995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:10.300356 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63ff8273-c50f-47ca-8bde-cce0ce3de781 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.535652 Jul 25 20:18:10.325096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1318/2684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:09 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:10.365627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:10.367080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:10.382665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:DELETE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:10.386759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.388508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.390516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.391706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.442068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:10.464929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f07a811-d3b3-43c8-aa5b-a8524af89512 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.510081 Jul 25 20:18:10.467485 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1367/2685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:09 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:10.474915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:10.479970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:10.501254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.502136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.503153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.503950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.612768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:10.633580 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0b253206-52e7-41e9-a5af-1d008e4cbdf0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.163634 Jul 25 20:18:10.634686 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1368/2686] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:10 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:10.640642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:10.643548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:10.645735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-af4a4257-b23b-4069-b2b9-dd611d8f09b6 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.317059 Jul 25 20:18:10.647514 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1319/2687] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:10 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:10.653301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e94be7bf-53a4-4e0f-89eb-ca406b29e793 req-2d319762-d30a-4d4c-ab65-a2c2093fa9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e", "tag": "47e3754a-90b9-49f7-af24-120ffebd195d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:10.708559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e94be7bf-53a4-4e0f-89eb-ca406b29e793 req-2d319762-d30a-4d4c-ab65-a2c2093fa9c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.709474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e94be7bf-53a4-4e0f-89eb-ca406b29e793 req-2d319762-d30a-4d4c-ab65-a2c2093fa9c3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.742510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:10.747996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:10.770080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.770080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.775637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:10.776629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:10.780203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e94be7bf-53a4-4e0f-89eb-ca406b29e793 req-2d319762-d30a-4d4c-ab65-a2c2093fa9c3 service nova] Creating event network-changed:47e3754a-90b9-49f7-af24-120ffebd195d for instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e on n-h2-845775-3 Jul 25 20:18:10.800565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e94be7bf-53a4-4e0f-89eb-ca406b29e793 req-2d319762-d30a-4d4c-ab65-a2c2093fa9c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160243 Jul 25 20:18:10.810672 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1369/2688] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:11.135064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.139488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:11.170028 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba9e162a-81bd-4c1c-8f55-b8b294e02111 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.427712 Jul 25 20:18:11.185268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1320/2689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:10 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:11.200354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-81210689-45b4-483b-b3ba-c66380c1ca76 req-63cfd95f-7c27-462c-93e5-85bf309284a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:11.233272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81210689-45b4-483b-b3ba-c66380c1ca76 req-63cfd95f-7c27-462c-93e5-85bf309284a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.234192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81210689-45b4-483b-b3ba-c66380c1ca76 req-63cfd95f-7c27-462c-93e5-85bf309284a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.268891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-81210689-45b4-483b-b3ba-c66380c1ca76 req-63cfd95f-7c27-462c-93e5-85bf309284a5 service nova] Creating event network-vif-plugged:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:18:11.285588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-81210689-45b4-483b-b3ba-c66380c1ca76 req-63cfd95f-7c27-462c-93e5-85bf309284a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101794 Jul 25 20:18:11.289427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1370/2690] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:11.339385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:11.340009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:11.354258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.354719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.356131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.356375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.505556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:11.507509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:11.527395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.528117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.540003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.541040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.663984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.682385 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65daed15-1526-45c9-8f6e-fa595884a31d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.350646 Jul 25 20:18:11.684263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1321/2691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:11 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:11.692566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:11.695899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:11.706601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.707651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.709786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.710884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.793751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-91812c8e-9d42-4b38-bd96-cb2561b5d0c1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.107177 Jul 25 20:18:11.799284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1322/2692] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:11 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:11.805040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:11.806493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:11.821521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.822660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.825314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:11.825314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:11.863508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.878115 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7443e519-a2e2-43a5-919a-8b06994f20c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.380841 Jul 25 20:18:11.878709 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1371/2693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:11 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:11.966201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.981074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.984186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:11.985899 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82b7608f-2a88-472f-91ef-a68fe006fd72 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.189647 Jul 25 20:18:11.987169 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1323/2694] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:11 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:12.208906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:12.211736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:12.228611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.228611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.228611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.228611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.436381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:12.450610 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99d9213c-b7ac-4334-8668-c74a57e57228 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.254418 Jul 25 20:18:12.464255 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1372/2695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:12 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:12.716979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:12.718907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:12.730143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.731041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.733036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.734077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.817615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:12.822988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:12.833349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.834462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.836219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.837282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.923296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00c39e9c-04e0-4ddc-a108-a89ac41af2f1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.112008 Jul 25 20:18:12.927407 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1373/2696] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:12 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:12.936256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:12.938998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:12.956784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.958052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.959998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:12.961237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:12.973331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:12.988890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6be9fb4f-9b28-48db-850a-8dd6d572f2b6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.277454 Jul 25 20:18:12.989951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1324/2697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:12 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:13.024711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:13.025383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:13.051827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:13.056177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:13.057593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:13.058650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:13.251659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:13.274403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:13.277482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:13.280509 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ac42e16-dded-40ce-81e9-8e6fbc9c5f9f tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.260228 Jul 25 20:18:13.282498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1325/2698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:13 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:18:13.317023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:13.340559 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5be66b88-fe74-445a-8ed6-4732af0f9b78 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.410444 Jul 25 20:18:13.342401 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1374/2699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:12 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:13.490430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:13.492156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:13.510711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:13.511837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:13.514108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:13.514946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:13.923387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:13.946074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:13.954765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:13.955360 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5334cde-e063-4bb7-9c34-9a62450b250c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.479802 Jul 25 20:18:13.958243 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1326/2700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:13 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:13.994178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:13.999976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.001697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.002645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.036260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:14.038268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:14.059339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.061467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.062692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.063548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.070685 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e425f368-cf67-43eb-9d73-29760f8ba72a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.131479 Jul 25 20:18:14.071519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1375/2701] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:13 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:14.320151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:14.321279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:14.335254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.336749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.338662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.339743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.477121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:14.497994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:14.501737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:14.509836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c469ddb-2013-431e-aa19-73b904599937 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.190556 Jul 25 20:18:14.510456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:14.517372 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1376/2702] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:14 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:14.536545 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-519130cc-99a5-434f-b692-9cfdb9f4114e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.509668 Jul 25 20:18:14.537430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:14.538269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:14.548262 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1327/2703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:14 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:14.553791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.554850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.557296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:14.558035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:14.835172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:14.849218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82b804c4-43fc-4c7b-9a53-cd5f20334b0a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.329893 Jul 25 20:18:14.850440 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1377/2704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:14 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:15.000321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:15.001842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:15.023008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.031691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.033412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.034480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.092598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:15.100508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:15.135288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.136152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.137230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.138696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.210145 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9de4f92c-8cf8-46bb-94c6-d4342b2c856d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 14 microversion: 2.1 time: 0.126919 Jul 25 20:18:15.213718 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1378/2705] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:15 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:18:15.547751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:15.551831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:15.585088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.586978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.591985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.611507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:15.615156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.631086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-635d283f-f12e-431b-b227-9e366b89cb3c tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.640549 Jul 25 20:18:15.635585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1328/2706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:14 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:15.651529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:15.657237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:15.728469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.733254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:15.745308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:15.750121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.067142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:16.077840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:16.088884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:16.092433 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6584680-f7d8-4708-a988-f6c1e352e87a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.551681 Jul 25 20:18:16.094613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1379/2707] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:15 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:18:16.118059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:16.119249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:16.144864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.145722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.147994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.149200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.307567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:16.333295 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f332749-da7b-4d36-9bd5-38dafc2c53df tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1476 microversion: 2.1 time: 0.695858 Jul 25 20:18:16.357596 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1329/2708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:15 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1476 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:16.357596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:16.364005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:16.390574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.392643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.400800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.402791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.528235 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d2380a8-7778-4720-8234-82c4494c8c87 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action" status: 200 len: 8193 microversion: 2.1 time: 0.183228 Jul 25 20:18:16.530007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1330/2709] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:16 2022] POST /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2/action => generated 8193 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:16.545404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:16.552658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:16.584019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.587421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.588449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.590176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.609969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:16.625359 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-003c3834-2ce6-4e93-9f26-719aaaad1e61 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.519193 Jul 25 20:18:16.626358 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1380/2710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:16 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:16.673016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:16.679237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:16.704859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.706030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:16.707633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:16.708383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.180919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.190757 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17f72e38-11cd-4398-9160-e75c7942eb14 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.654179 Jul 25 20:18:17.192012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1331/2711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:16 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:17.197562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:17.198063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.198995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:17.212371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.222647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.224064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.224835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.228886 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2eecb3ee-e940-44a0-a8d7-541a11d657ea tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.551842 Jul 25 20:18:17.230191 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1381/2712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:16 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:17.237209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:17.238072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:17.253314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.254524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.256218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.257141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.350911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.372135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.374710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.376606 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04f0cc14-fc82-40b3-9f58-692d6da8798d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.183280 Jul 25 20:18:17.377483 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1332/2713] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:17 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:17.384638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:17.385986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:17.397883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.399239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.400699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.401484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.643531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.671028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-326b56c2-edf5-45d0-be0a-c0202518e90c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.438107 Jul 25 20:18:17.672001 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1382/2714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:17 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:17.689689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:17.690622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:17.707770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.708262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.709283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.709889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.754959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:17.783494 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f75d8ab-2021-400d-a7af-74ed965ceff7 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1462 microversion: 2.1 time: 0.404400 Jul 25 20:18:17.785697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1333/2715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:17 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1462 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:17.797060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:17.805702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:17.827700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.828687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.830216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:17.832204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:17.872558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:18.144430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.161536 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d65cb3a-dec9-4ab2-acdc-36aba8fef257 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.483835 Jul 25 20:18:18.163374 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1383/2716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:17 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:18.178782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:18.186166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:18.186448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.195342 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f5fb9cc-28c3-419a-86f4-099a6db48288 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.408268 Jul 25 20:18:18.196315 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1334/2717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:17 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:18.215977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.217878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.219829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.220973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.240147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:18.241894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:18.254829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.255920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.257610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.258622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.629863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.643732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.648480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-501bbd1f-729e-410c-8c77-34ba7d91f871 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1462 microversion: 2.1 time: 0.482302 Jul 25 20:18:18.650196 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1384/2718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:18 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1462 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:18.660318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:18.662067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:18.672150 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a23857f5-d6f1-45c3-b2ea-c2847474c291 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.442744 Jul 25 20:18:18.673498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1335/2719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:18 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:18.674938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.676024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.677956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.679028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.683379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:18.684553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:18.703919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.704425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.705236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.705684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.724227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:18.867893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.885944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.889076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.890713 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0d0cc28-22a7-4578-aeb1-9a6b381a676d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.215803 Jul 25 20:18:18.900150 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1336/2720] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:18 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:18.900578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:18.912082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:18.914697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.915187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.916240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:18.916745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:18.961878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:18.977700 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b5f31ead-e155-4666-b93c-08816b1fd77e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.325600 Jul 25 20:18:18.979310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1385/2721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:18 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:19.003937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:19.005043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.016974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.017674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.019022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.019721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.066969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:18:19.067681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:18:19.068939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:18:19.069648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:18:19.070341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:18:19.136113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Locking {{(pid=119724) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 25 20:18:19.164173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.175283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.175928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.177332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.177942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.235381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-add39d3e-2118-475b-91b3-83f9dfb7bb67 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 1066 microversion: 2.1 time: 0.341239 Jul 25 20:18:19.237136 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1337/2722] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:18 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 1066 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 20:18:19.239269 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-740791bd-18cc-45d5-9a20-55b99bae0716 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.256850 Jul 25 20:18:19.240930 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1386/2723] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:18 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:19.246746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:19.248186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.263634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:19.263634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.264099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.264099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.264099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.264099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.273849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:19.296007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.296890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.299754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.302926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.610368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:19.624828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59e4977a-18fa-4310-9534-5c08646f9c00 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.385988 Jul 25 20:18:19.627547 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1338/2724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:19 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:19.637928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:19.646417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.668900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.671783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.673874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.679148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.720228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:19.741181 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a787272f-c358-4e98-8fd9-1b0f4e277f65 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.490301 Jul 25 20:18:19.752814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1387/2725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:19 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:19.754911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cad92aed-7099-4f30-82c7-737bc33326ff req-bfa98198-af1f-406a-9236-e6120ab1e823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e", "name": "network-vif-plugged", "status": "completed", "tag": "47e3754a-90b9-49f7-af24-120ffebd195d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:19.774384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cad92aed-7099-4f30-82c7-737bc33326ff req-bfa98198-af1f-406a-9236-e6120ab1e823 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.775003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cad92aed-7099-4f30-82c7-737bc33326ff req-bfa98198-af1f-406a-9236-e6120ab1e823 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.814693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cad92aed-7099-4f30-82c7-737bc33326ff req-bfa98198-af1f-406a-9236-e6120ab1e823 service nova] Creating event network-vif-plugged:47e3754a-90b9-49f7-af24-120ffebd195d for instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e on n-h2-845775-3 Jul 25 20:18:19.823744 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cad92aed-7099-4f30-82c7-737bc33326ff req-bfa98198-af1f-406a-9236-e6120ab1e823 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077717 Jul 25 20:18:19.826732 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1388/2726] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:19.838118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:19.855550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.856390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.910073 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action HTTP/1.1 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: {"os-stop": {}} Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1a904b9c-0421-417a-8862-a93b4ea610b8', 'body': {'os-stop': {}}} Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked Jul 25 20:18:19.913279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:19.921803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 409 to user: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 is locked {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:18:19.921803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d937f53b-d389-4fe8-a50c-af557f36e2cb tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 409 len: 107 microversion: 2.1 time: 0.085843 Jul 25 20:18:19.921803 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1389/2727] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:19 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 107 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:18:19.938692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:19.945879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:19.977553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.978876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:19.980763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:19.982170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.103679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Unlocking {{(pid=119724) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 20:18:20.131162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:20.163289 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b5fbc2e-fef9-4996-864a-556ef5bcd789 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.528564 Jul 25 20:18:20.174988 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1339/2728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:19 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:20.185790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:20.185790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:20.209392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.210882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.213353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.213353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.283905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c1d58fb-9b86-4f8a-9a44-fc9021cf7432 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.355241 Jul 25 20:18:20.287932 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1390/2729] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:19 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:20.326979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:20.332471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:20.350213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:20.355279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.360777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.361028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.363795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.375598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:20.380813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:20.384120 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54f1ade4-99f6-4850-a87c-110f23c6f5bf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.216719 Jul 25 20:18:20.401226 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1340/2730] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:20 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:20.427605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22dba2aa-dc64-42e8-b2d1-8a8a82d7b7ae tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:20.456793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22dba2aa-dc64-42e8-b2d1-8a8a82d7b7ae tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.457769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22dba2aa-dc64-42e8-b2d1-8a8a82d7b7ae tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.514549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-22dba2aa-dc64-42e8-b2d1-8a8a82d7b7ae tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Going to try to stop instance {{(pid=119723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:18:20.650489 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22dba2aa-dc64-42e8-b2d1-8a8a82d7b7ae tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.246642 Jul 25 20:18:20.654364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1341/2731] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:20 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:20.669182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:20.670811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:20.697900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.699680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.702141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.703700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.774197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:20.837961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80ae3dcb-a913-43f3-ae0f-146b9a8ecd5b tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.544040 Jul 25 20:18:20.843442 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1391/2732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:20 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:20.891507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:20.896783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:20.924606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.925560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:20.927389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:20.928281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:21.373808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:21.387253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0257c7e9-c722-4fd4-b4a0-93a648e4f8a2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.542781 Jul 25 20:18:21.391294 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1392/2733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:20 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:21.403341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:21.403341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:21.425916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:21.425916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:21.425916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:21.425916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:21.459543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:21.507970 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a56c7f2d-30ce-41c9-a991-911c919f484a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.851104 Jul 25 20:18:21.509213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1342/2734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:20 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:21.525499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:21.526581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:21.557797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:21.558558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:21.560592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:21.571980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.244333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:22.263930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:22.267248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:22.269274 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29f35bbb-985a-40b1-b6f0-3317be0a7d5d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.758073 Jul 25 20:18:22.270494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1343/2735] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:21 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:22.280165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:22.281042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:22.293284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.294056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.295480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.296004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.435318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:22.453128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bbf2e19c-b82a-44b3-b513-173fdc6c6f54 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 1.058125 Jul 25 20:18:22.454244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1393/2736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:21 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:22.519019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:22.521830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:22.541393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.542234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.547355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.549197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.749666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:22.768376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7659803-1594-4325-9b4c-643f24a63ef0 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1316 microversion: 2.1 time: 0.496088 Jul 25 20:18:22.787781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1344/2737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:22 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:22.795208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:22.796826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:22.822205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.823696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:22.826103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:22.826850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:23.445206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:23.466114 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-743682b3-a72c-428b-94a7-72ba8c138fd9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.964783 Jul 25 20:18:23.467106 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1394/2738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:22 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:23.501991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:23.514181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:23.519993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:23.545747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f66778e2-c362-4c53-a7b6-f644b630235a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.751288 Jul 25 20:18:23.547043 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1345/2739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:22 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:23.549232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:23.556997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:23.558715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:23.560413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:23.568667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:23.570093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:23.592512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:23.593782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:23.597570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:23.607371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:23.834225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:23.869167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:23.886499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:23.899562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b838817e-1ed5-43e0-9423-c886a7292955 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.422714 Jul 25 20:18:23.901692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1395/2740] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:23 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:24.032022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:24.077246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69a1bc9f-6218-40cd-ac52-58d03a18b1af tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.519760 Jul 25 20:18:24.078752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1346/2741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:23 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:24.089615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:24.091546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:24.115660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.116374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.117743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.118533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.298674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b8ea3d9-9760-4f0f-bf2b-91c043591ede tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Action: 'create', calling method: .version_select at 0x7f1968c593a0>, body: {"keypair": {"name": "tempest-keypair-135680844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK4B5tipg6WNaMSGJSDFdKf3TrY7Ar0e38e3SVA3LpO69e4PsEDMnouu2ymEuTQ6eVlvmvNpBzn5ddaL7FvV8RSb3hyQJEhDp+vEuKeZkhVHIwRqUGo0v39x1YekqZ6pA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:24.351607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7b8ea3d9-9760-4f0f-bf2b-91c043591ede tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for project 77666e0fc00c420c8536dd89e53c2d9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:18:24.368523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-7b8ea3d9-9760-4f0f-bf2b-91c043591ede tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for user 2003037f4b744b73907a004ccd142a07 and project 77666e0fc00c420c8536dd89e53c2d9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:18:24.446894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b8ea3d9-9760-4f0f-bf2b-91c043591ede tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.540331 Jul 25 20:18:24.451194 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1396/2742] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:18:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:24.510052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:24.511201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:24.524912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.526611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.529269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.554573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.601823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:24.616790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2874cc0-2911-47cd-b974-1510c7631276 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1504 microversion: 2.1 time: 0.535723 Jul 25 20:18:24.618327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1347/2743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:24 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:24.627266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:24.629597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:24.662608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.663764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.667134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:24.674261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:24.682047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:25.069273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.095384 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c24f42df-6f47-4f23-8203-5725a3e67c71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.590410 Jul 25 20:18:25.098096 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1397/2744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:24 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:25.115868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.117395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.140286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.141494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.143173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.144331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.170646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.198160 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b9b62a9-fcad-4e70-a64c-99ccf0720c55 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.577133 Jul 25 20:18:25.201586 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1348/2745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:24 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:25.209407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.209407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.222138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.222951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.224460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.225110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.227172 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-caac2f29-7126-45a5-99e7-d045bdf0890e tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips" status: 200 len: 108 microversion: 2.1 time: 0.123566 Jul 25 20:18:25.228815 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1398/2746] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:18:25 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips => generated 108 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:25.237660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.238818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.264793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.265786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.267134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.267874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.276216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:25.470619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.500108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.504926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.508554 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60571f74-0194-4d15-b9ac-2c39322adcaf tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1366 microversion: 2.47 time: 0.307354 Jul 25 20:18:25.510659 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1349/2747] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:25 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:25.529591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.536540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.573239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.575574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.577941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.580535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.637969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6020e7f6-c252-4657-88c7-206306d413b4 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips" status: 200 len: 108 microversion: 2.1 time: 0.118876 Jul 25 20:18:25.640319 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1350/2748] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:18:25 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips => generated 108 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:25.661712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.662480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.684880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.687456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.694454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.695327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.774927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:25.801291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6e47bae2-1deb-4100-bea0-248dd2e08eba tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.569911 Jul 25 20:18:25.805302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1399/2749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:25 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:25.808436 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c16763f-ab3c-4911-9ea9-4c01912e17be tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips/tempest-ServerAddressesTestJSON-199550301-network" status: 200 len: 93 microversion: 2.1 time: 0.147404 Jul 25 20:18:25.811707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1351/2750] 10.222.0.48 () {58 vars in 1398 bytes} [Mon Jul 25 20:18:25 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e/ips/tempest-ServerAddressesTestJSON-199550301-network => generated 93 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:18:25.831601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:25.840699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:25.862715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.863140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.865529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:25.866558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:25.975985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:18:26.143372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:26.144519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:26.175489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.176311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:26.192251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.193409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:26.378309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a209c26-db54-444a-aad0-862dfd2a8790 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 204 len: 0 microversion: 2.1 time: 0.552826 Jul 25 20:18:26.385154 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1400/2751] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:18:25 2022] DELETE /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:18:26.397011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:26.399834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:26.426773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.428480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:26.430156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.431239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:26.869974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:26.911196 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-860ad656-4e6a-4acc-8188-872c7e348b7e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.774194 Jul 25 20:18:26.913096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1352/2752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:26 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:26.922335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:26.923198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:26.934515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.936109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:26.938380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:26.939462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.198993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:27.222951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6fcce13-4b74-4da8-b377-160c83bcac98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1542 microversion: 2.1 time: 0.833956 Jul 25 20:18:27.228518 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1401/2753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:26 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1542 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:27.257938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:27.259558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:27.283995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.290749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.292313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.298837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.455211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:27.468487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe028244-ad9c-4a49-a97e-c46fb0e982b3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1510 microversion: 2.1 time: 0.553689 Jul 25 20:18:27.470883 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1353/2754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:26 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:27.478039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:27.483652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:27.494227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.495386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.497180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.497886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.538726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:27.558350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:27.567299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:27.569332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0b53680-4ac4-493e-a98a-ceb87af5edca tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1372 microversion: 2.47 time: 0.338681 Jul 25 20:18:27.570533 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1402/2755] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:27 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:27.956605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:27.960452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:27.982890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.990303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:27.992058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:27.993142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:28.326571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:28.373345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5e6e497-71df-4c04-9ff3-deb5e7ada609 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.900708 Jul 25 20:18:28.377041 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1354/2756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:27 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:28.397267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:28.400423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:28.416617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:28.420004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:28.422763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:28.423802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:28.588973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:28.611895 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1d33d13-c9f3-4c50-b987-2cc980e11ff7 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.669307 Jul 25 20:18:28.612915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1403/2757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:27 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:28.633084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:28.634233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:28.664103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:28.664736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:28.665789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:28.666340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.110223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:29.130575 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d02f170b-0681-423f-a15e-9679b7f71ed4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1541 microversion: 2.1 time: 0.749479 Jul 25 20:18:29.135712 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1355/2758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:28 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1541 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:29.154158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:29.155271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:29.179332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.180187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.198746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.199970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.503053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:29.508421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:29.522774 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a911957-fa6f-4be3-b3b2-5d3a4a38e59a tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1510 microversion: 2.1 time: 0.905510 Jul 25 20:18:29.536766 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1404/2759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:28 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:29.548912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:29.550616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:29.551429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:29.561757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.566380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:29.568096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.568623 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51567d98-02bd-40f6-9237-e0be3b6ad451 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1372 microversion: 2.47 time: 0.430995 Jul 25 20:18:29.569342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.569582 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1356/2760] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:29 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:29.570105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.650707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:29.653357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:29.681855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.685403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:29.687119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:29.687959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.128305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:30.146101 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fa968e4-b01e-44a7-858f-6859b9a2a0a8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.502232 Jul 25 20:18:30.160639 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1357/2761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:29 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:30.167631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:30.169238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:30.178138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.179262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.181003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.181823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.208696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:30.231432 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b41069d-adb4-4d81-ab63-81443b8dd550 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.692222 Jul 25 20:18:30.262010 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1405/2762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:29 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:30.500176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:30.520936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dfffb6e-0095-455a-854e-bd85b9e3bb11 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1541 microversion: 2.1 time: 0.358442 Jul 25 20:18:30.525073 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1358/2763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:30 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1541 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:30.565683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:30.573685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:30.619433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:30.621040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:30.633618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.640876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.642257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.644779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.645156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.646704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:30.649296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:30.650119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:31.206174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:31.222086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:31.237140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:31.248268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-392c96da-46e0-4685-aa20-ee05db32d0a1 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1372 microversion: 2.47 time: 0.628215 Jul 25 20:18:31.249611 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1359/2764] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:30 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1372 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:31.255281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:31.262660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:31.283603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:31.289573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:31.291725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:31.295723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:31.639659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:31.662302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7becb2f-70a7-4cb1-975c-0dd5953fa112 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1510 microversion: 2.1 time: 1.109034 Jul 25 20:18:31.673588 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1406/2765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:30 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1510 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:31.689968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-unplugged", "status": "completed", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:31.711979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:31.713012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:31.747813 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] Creating event network-vif-unplugged:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:18:31.766778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:18:31.791975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5093b9a4-ebf4-4430-b86a-87bb30335c9e req-92c5a16a-6eac-4ba2-875b-03cb84674bc7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112845 Jul 25 20:18:31.810085 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1407/2766] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:31.839266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:31.847471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:31.889883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:31.893236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:31.898247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:31.900399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:32.319730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:32.343508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e3d5efc-6b82-4ea6-8bde-25750eb54f53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 1.092441 Jul 25 20:18:32.363228 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1360/2767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:31 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:32.400524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:32.403207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:32.431283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:32.431579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:32.438139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:32.454876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.607429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:33.634423 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-acf20cb7-863e-44a9-8b79-7ddbc3d7ba4c tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 1.812174 Jul 25 20:18:33.650263 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1408/2768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:31 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:33.686001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:33.688014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:33.710943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.711402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.712241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.713824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.909391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:33.920972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c31282f-00a8-4130-bb63-432ed1b1808c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1473 microversion: 2.1 time: 1.553942 Jul 25 20:18:33.924809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:33.936118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1361/2769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:32 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1473 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:33.939053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:33.941511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:33.942971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e272080-dc10-4d7c-8a63-ce5bbea1ad67 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1357 microversion: 2.47 time: 0.290051 Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.956062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.957330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1409/2770] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:33 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:33.970864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:33.971746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:33.979712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.980498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:33.982743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:33.983514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.033701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.034228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.034622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lazy-loading 'fault' on Instance uuid 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:18:34.286963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '477648b7254d4b5abf34a749f6190d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd114efff73d041adb5bf4dcfc2ba98fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.341668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.354920 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-596adc52-fd53-47b4-ac5d-81bee6db6ec3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 200 len: 1306 microversion: 2.1 time: 0.416929 Jul 25 20:18:34.370589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1362/2771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:33 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 1306 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:34.373279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-570d7542-1b41-491f-a503-3fbb2546c84a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.414312 Jul 25 20:18:34.376183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d53f17e2-e9a1-49fa-86e4-2ac346d2934a req-f69ed64b-4a28-47c1-a228-7c71292d64d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e", "name": "network-vif-deleted", "tag": "47e3754a-90b9-49f7-af24-120ffebd195d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:34.380635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1410/2772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:33 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:34.403239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:34.419407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.421269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d53f17e2-e9a1-49fa-86e4-2ac346d2934a req-f69ed64b-4a28-47c1-a228-7c71292d64d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.421819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d53f17e2-e9a1-49fa-86e4-2ac346d2934a req-f69ed64b-4a28-47c1-a228-7c71292d64d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.436804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Searching by: {'deleted': False, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:18:34.450287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:34.463331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.464873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.467000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.468768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.524206 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d53f17e2-e9a1-49fa-86e4-2ac346d2934a req-f69ed64b-4a28-47c1-a228-7c71292d64d4 service nova] Creating event network-vif-deleted:47e3754a-90b9-49f7-af24-120ffebd195d for instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e on n-h2-845775-3 Jul 25 20:18:34.565125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d53f17e2-e9a1-49fa-86e4-2ac346d2934a req-f69ed64b-4a28-47c1-a228-7c71292d64d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188303 Jul 25 20:18:34.587170 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1363/2773] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:34.692491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:34.700624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:34.713348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.714351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.717473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.718627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.730560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:18:34.848966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.869987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:34.871014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:34.890836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.894463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:34.979377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-40eb3fa3-c5f3-4572-a91c-1abd186a4bda tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.595977 Jul 25 20:18:34.981476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1411/2774] 10.222.0.48 () {60 vars in 1187 bytes} [Mon Jul 25 20:18:34 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:34.993461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:35.003763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:35.035899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.036491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.037391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.037861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.176495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:35.197391 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83383bab-82ba-443a-901a-716568bcaaff tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.513358 Jul 25 20:18:35.208837 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1364/2775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:34 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:35.225657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:35.234829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:35.245938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.251504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.252961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.253677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.361275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:18:35.368866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:35.534042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:35.605090 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2305307-321a-4441-93bf-e4cda8bcf68c tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 204 len: 0 microversion: 2.47 time: 0.393340 Jul 25 20:18:35.607574 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1365/2776] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:18:35 2022] DELETE /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:18:35.618969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:35.620994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] [instance: 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:35.633032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.635656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.637880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.639089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.680233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] HTTP exception thrown: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Request method failure captured: Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e HTTP/1.1 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vp1cHqXa3bStXb3jZbs_cJXFqav2uKSiZYbysQHad-R_-z_XJtnEAOMwuErDlRMhh3kGJQmfXOOZs06DsRXfFBDk0TSUj751JFDmHRtObaDeY9ikGVhGrbRBQEeQ5Rv9MC_SCAbqWzQBDC29bQZrZ3q5ap-_S7q37A3ayk-0HU6gvg Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d114efff73d041adb5bf4dcfc2ba98fb Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerAddressesTestJSON-719315171 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d114efff73d041adb5bf4dcfc2ba98fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d114efff73d041adb5bf4dcfc2ba98fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d114efff73d041adb5bf4dcfc2ba98fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d114efff73d041adb5bf4dcfc2ba98fb"}]}] Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerAddressesTestJSON-719315171 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d114efff73d041adb5bf4dcfc2ba98fb Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerAddressesTestJSON-719315171 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerAddressesTestJSON-719315171-project Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 477648b7254d4b5abf34a749f6190d28 Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerAddressesTestJSON-719315171-project Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e'} Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:35.684546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. Jul 25 20:18:35.692312 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:35.697215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] Returning 404 to user: Instance 3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:18:35.701372 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f774e1c3-6038-4d98-b4cd-053fbeaa08c3 tempest-ServerAddressesTestJSON-719315171 tempest-ServerAddressesTestJSON-719315171-project] 10.222.0.48 "GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e" status: 404 len: 111 microversion: 2.1 time: 0.089121 Jul 25 20:18:35.703160 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1366/2777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:35 2022] GET /compute/v2.1/servers/3d2d6ceb-01d4-4dec-95a2-8d09103f0b5e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:18:35.716243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:35.717826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:35.728543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.729901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.731453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:35.733562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:35.989584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:36.006785 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aae593e4-bce4-4b17-ae90-4e62a86951dd tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1470 microversion: 2.1 time: 1.022659 Jul 25 20:18:36.012937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1412/2778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:34 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1470 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:36.026943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:36.028697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:36.050065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.050765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:36.052163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.053196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:36.724567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:36.755416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:36.773568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:36.777469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:36.780462 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b386ce90-f840-4bf3-b5cc-c61358284bd5 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1363 microversion: 2.47 time: 0.766369 Jul 25 20:18:36.783519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1413/2779] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:36 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1363 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:36.790823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:36.793132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:36.826835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.827916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:36.829997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.830570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:36.889894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:36.936606 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46740a85-692e-411e-b714-6ca24e00e537 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 1.228715 Jul 25 20:18:36.941210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1367/2780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:35 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:36.954872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:36.957793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:36.985858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.986659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:36.994144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:36.994898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.006237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.010031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.011466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.012867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.097332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:18:37.110797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:18:37.416836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b60768bb-1216-43ed-8841-59d9418264c6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0/action" status: 202 len: 0 microversion: 2.1 time: 0.631294 Jul 25 20:18:37.422274 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1414/2781] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:36 2022] POST /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:37.432488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:37.433524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:37.444341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.444341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.447965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.452790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.682082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:37.712238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1991edf8-8ceb-4042-994e-f6b7c0d0459e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.768925 Jul 25 20:18:37.713656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1368/2782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:36 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:37.834779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:37.836311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:37.859103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.859994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:37.861270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:37.873473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.079664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:38.098669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70763279-91c8-4aab-8044-5b2b6c1ba9ca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1469 microversion: 2.1 time: 0.669369 Jul 25 20:18:38.103992 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1415/2783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:37 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1469 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:38.116240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:38.116240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:38.156702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:38.157512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.163548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:38.171117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.445815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:38.463023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:38.469149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:38.470986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6daae7b-a24b-4cb8-bfae-baa3b31d7b2a tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1363 microversion: 2.47 time: 0.661155 Jul 25 20:18:38.471582 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1369/2784] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:37 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:18:38.695311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:38.721309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa6895e1-1ecf-4570-b816-282f7c55f26f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1658 microversion: 2.1 time: 0.614249 Jul 25 20:18:38.738439 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1416/2785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:38 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1658 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:38.761724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:38.763003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:38.785141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6b8be64-9c42-445a-80d5-a42db25c022a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:38.801056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:38.801815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.803139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:38.803914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.831584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6b8be64-9c42-445a-80d5-a42db25c022a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:38.832363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6b8be64-9c42-445a-80d5-a42db25c022a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:38.880020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6b8be64-9c42-445a-80d5-a42db25c022a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Going to try to start instance {{(pid=119724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 20:18:39.045325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6b8be64-9c42-445a-80d5-a42db25c022a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.277088 Jul 25 20:18:39.046995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1417/2786] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:38 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:39.061829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:39.064005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:39.077340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:39.078352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:39.080324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:39.081087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:39.422201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:39.455934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01774bb2-54f1-46da-af39-3c4725409f8e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.703153 Jul 25 20:18:39.457830 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1370/2787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:38 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:39.479444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:39.480561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:39.535896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:39.535896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:39.535896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:39.535896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:39.907714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:39.921735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c35715f0-f709-444c-be79-2c297e1311ed tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1667 microversion: 2.1 time: 0.868161 Jul 25 20:18:39.923405 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1418/2788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:39 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1667 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:39.930551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-plugged", "status": "completed", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:39.972429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:39.975156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.020202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] Creating event network-vif-plugged:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:18:40.028498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:40.042532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:18:40.062205 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-33e53c93-3844-43e9-a6dc-339e62e2e2f9 req-939b9963-5263-47e8-bd1d-a4ee863e5c9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133483 Jul 25 20:18:40.070553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1419/2789] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:40.070769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-396df2dd-d3ab-43b5-a85d-684d90ac04ce tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1469 microversion: 2.1 time: 0.608330 Jul 25 20:18:40.071725 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1371/2790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:39 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1469 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:40.091560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:40.102039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:40.119849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.120617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.122356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.123822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.177191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:40.183193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.184699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.184900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lazy-loading 'fault' on Instance uuid 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:18:40.299066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:40.323687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:40.327882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:40.329405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1263c50-7001-4ff4-9d08-eb7616c1caa4 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 200 len: 1368 microversion: 2.47 time: 0.257374 Jul 25 20:18:40.345330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1420/2791] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:40 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:40.505570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:40.506279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:40.529569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.530144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.531029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.531611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.948372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:40.950251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:40.972190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.974316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:40.982486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:40.984853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.064479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:41.081819 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-086b228d-91de-4928-962a-f462463fc11d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.580485 Jul 25 20:18:41.083741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1372/2792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:40 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:41.119114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:41.120246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:41.138301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.139113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.140562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.141081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.566027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:41.593405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0d490328-01c3-4919-b7da-dabaed3148f6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1667 microversion: 2.1 time: 0.652051 Jul 25 20:18:41.615498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1421/2793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:40 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1667 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:41.627944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:41.630037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 0e2ec90a-8561-4b47-8cd3-b62a6cd72182] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:41.654014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.655158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.656404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.661129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.678157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:41.687580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfb9ab95-bf3a-436f-b1fe-5fba1fe4cc8b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1469 microversion: 2.1 time: 0.589147 Jul 25 20:18:41.688235 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1373/2794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:41 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1469 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:41.701983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] HTTP exception thrown: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Request method failure captured: Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 HTTP/1.1 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vpQiHOjo9Nf7VDVzbu872vZFRcCmgvF3eq8p1yzzFjU7-zuOPP_K5-Lv4SZIYFxtd4gLiiq7dxv0lDC3WmFSlhz7uRXAzmkRVWbDknEz5JBNW90fMnAbUq_-yppfwwGKGGC_el5BF_X-BSeAcym7yc8sBFQ1VgngSdZ-kF7z4MFXws Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23fb4d73e6eb4eb89d3c61d8e0647bba Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerShowV247Test-861720690 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}] Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerShowV247Test-861720690 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23fb4d73e6eb4eb89d3c61d8e0647bba Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerShowV247Test-861720690 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerShowV247Test-861720690-project Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 1ef2c132d75448f982c39ee09917bd19 Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerShowV247Test-861720690-project Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '0e2ec90a-8561-4b47-8cd3-b62a6cd72182'} Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:41.703738 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Returning 404 to user: Instance 0e2ec90a-8561-4b47-8cd3-b62a6cd72182 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:18:41.708233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b4ae648-9e4b-4589-b41c-6fe343a48183 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182" status: 404 len: 111 microversion: 2.47 time: 0.086734 Jul 25 20:18:41.716511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1422/2795] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:41 2022] GET /compute/v2.1/servers/0e2ec90a-8561-4b47-8cd3-b62a6cd72182 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:18:41.719399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:41.720442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:41.735971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.737130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.738673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:41.739865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:41.792143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:18:41.989000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a13850ce-cfcf-4dbe-a631-02fa0ac6308d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 204 len: 0 microversion: 2.47 time: 0.277498 Jul 25 20:18:41.989254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1374/2796] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:18:41 2022] DELETE /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 20:18:41.999775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:42.000628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:42.013032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.013357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.014201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.014623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.107748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:42.108884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:42.127918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.128462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.129361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.129857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.189975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:42.206310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:42.208191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:42.209446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6fa82912-52ac-4957-8a2f-9ac8d13e2323 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 200 len: 1363 microversion: 2.47 time: 0.215410 Jul 25 20:18:42.210010 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1423/2797] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:41 2022] GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:42.547244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:42.607585 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e189daa-22cc-44fc-a763-74cbde8bf009 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.504507 Jul 25 20:18:42.615653 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1375/2798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:42 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:42.620462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:42.622107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:42.631161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.631621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.632444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.632888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.714196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:42.716688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:42.740404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.740886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:42.743933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:42.744426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:43.665710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:43.694734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:43.704183 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d8863d8-27d7-4069-aa21-bcd17d13cf23 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1469 microversion: 2.1 time: 0.995799 Jul 25 20:18:43.710023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0b264960-3b68-4a46-85de-462572f0f30f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1667 microversion: 2.1 time: 1.095016 Jul 25 20:18:43.713738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1424/2799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:42 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1667 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:43.715312 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1376/2800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:42 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1469 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:43.734219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:43.742752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:43.760359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:43.762151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:43.766800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:43.769699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:43.771331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:43.775483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:43.777318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:43.780546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:43.781862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:43.785795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:43.966755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:43.995803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:43.999212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:44.002021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89e602f7-ab33-4842-9506-250213abff6d tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 200 len: 1363 microversion: 2.47 time: 0.287147 Jul 25 20:18:44.007473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1425/2801] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:43 2022] GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:44.308068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:44.338178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b6e8e1e-7842-497e-9922-b73a2c707e59 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.613859 Jul 25 20:18:44.340639 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1377/2802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:43 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:44.767768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:44.768543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:44.770465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:44.771173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:44.787439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:44.788280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:44.790386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:44.790773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:44.791391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:44.792028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:44.797857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:44.798831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:44.837150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:45.600595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:45.611890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0bacf86-3bf5-4f13-946a-186db01587bb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1535 microversion: 2.1 time: 0.857735 Jul 25 20:18:45.625287 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1426/2803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:44 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1535 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:45.642787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:45.645520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:45.647350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:45.657958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d8dadebf-4e1e-4129-b427-11881b97b1ff tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.898436 Jul 25 20:18:45.658528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.659863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.661470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.662401 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1378/2804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:44 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:45.662680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.667872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:45.695009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:45.708566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.709287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.715979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lazy-loading 'fault' on Instance uuid 27bd1d79-3d3e-4316-af0c-ba480a1507b8 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:18:45.727064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:45.734773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.735482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.736487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.737350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.822247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:45.838357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:45.842226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ef2c132d75448f982c39ee09917bd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fb4d73e6eb4eb89d3c61d8e0647bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:45.845243 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7eab9604-e27f-4d8f-8c9b-60a285543dbe tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 200 len: 1368 microversion: 2.47 time: 0.216189 Jul 25 20:18:45.861138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1427/2805] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:45 2022] GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:45.885645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:45.886525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:45.910736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.911206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:45.912028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:45.913369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.244375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:46.258222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:46.280849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:46.291623 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d27e70d-f1f9-442f-8f9a-f0df24405aab tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.428621 Jul 25 20:18:46.292538 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1428/2806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:45 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:46.295723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:46.301653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:46.302622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:46.304950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:46.306285 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d4ebd98b-1d5d-4e29-8c15-e881270c14ae tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2943 microversion: 2.42 time: 0.624346 Jul 25 20:18:46.306856 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1379/2807] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:45 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2943 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:46.312235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.312235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.312235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.312235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.334403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:46.334915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:46.346636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.347590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.348862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.349465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.530808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:46.545434 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-460f589b-262a-4291-af19-400929cb944b tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.251532 Jul 25 20:18:46.546612 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1429/2808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:46 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:46.569335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:46.570339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:46.584133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.585172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.588492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.589233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.674584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55f5e29a-5739-4982-8bde-2c96e24efa93 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.344488 Jul 25 20:18:46.679148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Unlocking {{(pid=119724) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 25 20:18:46.687007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1380/2809] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:18:46 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271/os-interface => generated 1831 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:18:46.698758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:46.700680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:46.709324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.710579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.713313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.714544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.787242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2642fabf-1148-4169-ad60-419d38be4d6f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.222589 Jul 25 20:18:46.795824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1430/2810] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:46 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Jul 25 20:18:46.801762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-unplugged", "status": "completed", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:46.829200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.831117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.861588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] Creating event network-vif-unplugged:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:18:46.885884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:18:46.901190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-66cc17f4-05df-4bb1-b513-163123f7365f req-5106f3b4-f6f3-4bbd-b797-ba437a3162d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102593 Jul 25 20:18:46.903002 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1431/2811] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:46.916801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:46.925750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:46.947883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.948752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:46.951811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:46.953823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.065707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:47.108097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:47.118645 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7f02e98-f21b-450a-9e57-8fff64d615a3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1535 microversion: 2.1 time: 0.430306 Jul 25 20:18:47.119306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1381/2812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:46 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1535 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:47.126957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:47.134618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] [instance: 27bd1d79-3d3e-4316-af0c-ba480a1507b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:47.158893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.159345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.160193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.160639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.199717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] HTTP exception thrown: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Request method failure captured: Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 HTTP/1.1 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vpQiHOjo9Nf7VDVzbu872vZFRcCmgvF3eq8p1yzzFjU7-zuOPP_K5-Lv4SZIYFxtd4gLiiq7dxv0lDC3WmFSlhz7uRXAzmkRVWbDknEz5JBNW90fMnAbUq_-yppfwwGKGGC_el5BF_X-BSeAcym7yc8sBFQ1VgngSdZ-kF7z4MFXws Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23fb4d73e6eb4eb89d3c61d8e0647bba Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerShowV247Test-861720690 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23fb4d73e6eb4eb89d3c61d8e0647bba"}]}] Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerShowV247Test-861720690 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23fb4d73e6eb4eb89d3c61d8e0647bba Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerShowV247Test-861720690 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerShowV247Test-861720690-project Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 1ef2c132d75448f982c39ee09917bd19 Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerShowV247Test-861720690-project Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '27bd1d79-3d3e-4316-af0c-ba480a1507b8'} Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:47.204515 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. Jul 25 20:18:47.209374 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:47.213188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] Returning 404 to user: Instance 27bd1d79-3d3e-4316-af0c-ba480a1507b8 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:18:47.214301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37a6a1f3-7586-49f2-a31c-94d043a4cfb9 tempest-ServerShowV247Test-861720690 tempest-ServerShowV247Test-861720690-project] 10.222.0.48 "GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8" status: 404 len: 111 microversion: 2.47 time: 0.091228 Jul 25 20:18:47.218572 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1382/2813] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:18:47 2022] GET /compute/v2.1/servers/27bd1d79-3d3e-4316-af0c-ba480a1507b8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:18:47.274648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:47.288064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f6520fd-c426-4653-baf4-fb607588a630 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.381733 Jul 25 20:18:47.290532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1432/2814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:46 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:47.314278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:47.315033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:47.325485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:47.326575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:47.341167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.341953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.346876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.347963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.348623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.349121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.349659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.351308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.850529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:47.877601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f3dd2d2-0051-4bbc-9a92-8e0223601689 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.560041 Jul 25 20:18:47.878740 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1433/2815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:47 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:47.890599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:47.919127 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c207f67d-6513-4f70-bf78-26e75cced566 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.608613 Jul 25 20:18:47.925882 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1383/2816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:47 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:47.976451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:47.977338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:47.991900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.993146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:47.994645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:47.995735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.148113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:48.148113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:48.158057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.158897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.160787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.168859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.692847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:48.706739 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21580c6f-a7b8-49e9-8440-5b7e01bc1769 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1535 microversion: 2.1 time: 0.562902 Jul 25 20:18:48.710846 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1384/2817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:48 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1535 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:48.768898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:48.779682 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-212511ac-9286-4c96-bfaa-7020ea392e8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.819212 Jul 25 20:18:48.784981 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1434/2818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:47 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:48.812717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:48.813599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:48.824122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.834593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.835597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.837280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.903368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:48.903920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:48.915230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.921728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:48.923038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:48.923655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:49.017239 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3c1d074-7ba2-4258-b9dc-0797db400ff8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.208618 Jul 25 20:18:49.020428 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1385/2819] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:48 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:49.036024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:49.045127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:49.066895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:49.069963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:49.071672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:49.072462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:49.909652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:49.918856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dcb6a9a8-8130-45ee-971a-ba79cbcbe66a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1676 microversion: 2.1 time: 0.891362 Jul 25 20:18:49.924008 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1386/2820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:49 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1676 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:49.946455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:49.947957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:49.960309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:49.961524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:49.963080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:49.964121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:49.964485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:49.988887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b14a1dd-9ce8-4c81-b10e-6b9662ed06fe tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 1.087809 Jul 25 20:18:49.992930 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1435/2821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:48 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:50.426082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:50.437674 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afe25eaa-6810-40fd-861e-b67b21bde365 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1535 microversion: 2.1 time: 0.499666 Jul 25 20:18:50.441720 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1387/2822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:49 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1535 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:50.970490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:50.977587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:51.015898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.018637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.024958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.025206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.030336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:51.032516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:51.042758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.044175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.049324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.051520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.440428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:51.452896 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1da016b5-57ec-44ad-af51-58f019056ccd tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.429590 Jul 25 20:18:51.453953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1388/2823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:51 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:51.467146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:51.468228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:51.486797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.488145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:51.489131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.492549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.493066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.499600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-03f24336-0988-4376-94d6-994e519f5f0a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1656 microversion: 2.1 time: 0.553429 Jul 25 20:18:51.502115 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1436/2824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:50 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1656 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:51.535987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:51.537650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:51.549228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.550370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.551673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.552360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.672362 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6136aa5b-5670-4d86-89e1-cdaf09500601 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.151048 Jul 25 20:18:51.673803 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1437/2825] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:18:51 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:18:51.691083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:51.692981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:51.703643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.704509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.706143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:51.706762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:51.927943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:51.954204 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7fcb591-e82c-4f6a-a397-2ba3b7d62173 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1528 microversion: 2.1 time: 0.492244 Jul 25 20:18:51.977477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1389/2826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:51 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1528 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:51.995469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:52.003212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:52.019365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:52.020277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:52.022460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:52.024533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:52.482095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:52.495994 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16cb348a-652a-41f0-bfce-3ec75c58b874 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1663 microversion: 2.1 time: 0.817046 Jul 25 20:18:52.498059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1438/2827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:51 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1663 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:52.505919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:52.506819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:52.517912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:52.518887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:52.519958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:52.521271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:52.566093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:52.579347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d239ac46-b67b-4b12-87fd-5ed353886047 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1528 microversion: 2.1 time: 0.600201 Jul 25 20:18:52.595049 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1390/2828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:51 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1528 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:52.600074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a7ea3f2-f613-4c30-908f-76a68dae6843 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:52.601062 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:18:52.601062 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:18:52.608903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-6a7ea3f2-f613-4c30-908f-76a68dae6843 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] HTTP exception thrown: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a7ea3f2-f613-4c30-908f-76a68dae6843 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Request method failure captured: Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/flavors/bd427588-152a-46d7-aafa-d89a5f9054db HTTP/1.1 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vmmEcJgeKdZD8yTznkFWG8yj-icuB9Oa2lIzto6PxBoCeHlUCLmVKu158u4RWjOFobp0P-yuvaKDE9ZVdrXZhNf9x0qiVhg6CmQJnsNIk1ilzB1dyJFPPf8sv7JqPq9Ph2nkmJLPdvw3MtsNbR3zqXmHk9Zthl2pBWkcZ7miMHJV9Q Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2c66bfd753ca43688db92c9f28efe7a1 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-MigrationsAdminTest-1636942488 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c66bfd753ca43688db92c9f28efe7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c66bfd753ca43688db92c9f28efe7a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c66bfd753ca43688db92c9f28efe7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c66bfd753ca43688db92c9f28efe7a1"}]}] Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-MigrationsAdminTest-1636942488 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2c66bfd753ca43688db92c9f28efe7a1 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-MigrationsAdminTest-1636942488 Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-MigrationsAdminTest-1636942488-project-admin Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 333091122e5c4b96bec76f17ea3cdd7b Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-MigrationsAdminTest-1636942488-project-admin Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: exception: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'bd427588-152a-46d7-aafa-d89a5f9054db'} Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:52.613959 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a7ea3f2-f613-4c30-908f-76a68dae6843 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Returning 404 to user: Flavor bd427588-152a-46d7-aafa-d89a5f9054db could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:18:52.619414 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a7ea3f2-f613-4c30-908f-76a68dae6843 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/bd427588-152a-46d7-aafa-d89a5f9054db" status: 404 len: 109 microversion: 2.1 time: 0.019122 Jul 25 20:18:52.622556 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1391/2829] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:18:52 2022] DELETE /compute/v2.1/flavors/bd427588-152a-46d7-aafa-d89a5f9054db => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:18:52.846150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2006536073", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:52.937828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:52.949372 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a905ed9f-d888-442b-bd84-19fa98e63713 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.449557 Jul 25 20:18:52.951618 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1439/2830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:52 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:52.986858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:18:53.369803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:18:53.370868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:18:53.371615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:18:53.372700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:18:53.375864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:18:53.388750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.389795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.390943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.391839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.419389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:18:53.426802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Getting quotas for user 418b129a58aa475fa1066c4b7a8fccf6 and project 68fb52420238467eb822db188e9b1416. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:18:53.447827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:18:53.451710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:18:53.514664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eac5803a-4a0b-4d6b-af95-48ffdbbfa9ac tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673438 Jul 25 20:18:53.521791 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1392/2831] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:18:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:18:53.527038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:53.527704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:53.529160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7cac4c3f-940b-4659-a3a8-d73dae78d765 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:53.530590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7cac4c3f-940b-4659-a3a8-d73dae78d765 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:53.564907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.565620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.566212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.566654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.604112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:53.636556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7cac4c3f-940b-4659-a3a8-d73dae78d765 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:53.647518 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7cac4c3f-940b-4659-a3a8-d73dae78d765 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1213 microversion: 2.1 time: 0.124113 Jul 25 20:18:53.660129 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1393/2832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:53 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:53.914277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:53.931381 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88fa3d2a-e652-4b6e-95b5-2ec69e01ffd0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.410900 Jul 25 20:18:53.945065 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1440/2833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:53 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:53.961787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:53.962872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:53.973155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:53.973755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:53.977028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.977974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.979131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.980261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.997781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.998240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:53.999044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:53.999493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:54.485883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:54.513893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-90a7ef21-4946-4629-b9c3-a867c9d6d1d5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.556632 Jul 25 20:18:54.514974 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1394/2834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:53 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:54.548233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:54.549900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:54.565523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:54.566706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:54.568953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:54.570065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:54.666150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:54.710110 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ed0c631-3196-4b10-b36c-98a5e0f89316 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.734680 Jul 25 20:18:54.711667 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1441/2835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:53 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:54.733954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:54.736380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:54.746917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:54.748501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:54.749859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:54.750683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:54.876320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:54.898889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a96729c0-3aef-4ae1-b878-353a22c22e45 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1217 microversion: 2.1 time: 0.178714 Jul 25 20:18:54.900338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1442/2836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:54 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:55.066862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:55.082570 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-92038f57-325b-46b8-83b0-9fcd869f6f24 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.542331 Jul 25 20:18:55.083733 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1395/2837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:54 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:55.115465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:55.116844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:55.132787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.133941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.135442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.136195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.474110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:55.552611 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f24d7381-8967-400e-875b-e068a61f0ad1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.444875 Jul 25 20:18:55.555300 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1443/2838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:55 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:55.576511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:55.578365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:55.587003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.587751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.588750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.589380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.748278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:55.750346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:55.766981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.769177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.771174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.772278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.919434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:55.929876 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f53296dd-5d3b-4213-b025-6d17b435795c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.357270 Jul 25 20:18:55.930769 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1396/2839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:55 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:55.953324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:55.954249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:55.971487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.973477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:55.974790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:55.975805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:56.179051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:56.202439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5c7a1a8-b17c-4dee-9240-b38d58498b1d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1271 microversion: 2.1 time: 0.255363 Jul 25 20:18:56.203527 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1397/2840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:55 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:56.231049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:56.232749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:56.255900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:56.267077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:56.269322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:56.270647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:56.303319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:56.356230 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e95dd83-35db-4399-97d5-cc26bed46a91 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 0.613129 Jul 25 20:18:56.380478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1444/2841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:55 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:56.403857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ff6f078c-c657-43b1-9835-6c1a5c9d156a req-c72d68e6-527f-42e3-a394-e7587ec201b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-plugged", "status": "completed", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:18:56.458603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ff6f078c-c657-43b1-9835-6c1a5c9d156a req-c72d68e6-527f-42e3-a394-e7587ec201b2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:56.460914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ff6f078c-c657-43b1-9835-6c1a5c9d156a req-c72d68e6-527f-42e3-a394-e7587ec201b2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:56.501472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ff6f078c-c657-43b1-9835-6c1a5c9d156a req-c72d68e6-527f-42e3-a394-e7587ec201b2 service nova] Creating event network-vif-plugged:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:18:56.510104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ff6f078c-c657-43b1-9835-6c1a5c9d156a req-c72d68e6-527f-42e3-a394-e7587ec201b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127438 Jul 25 20:18:56.513482 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1445/2842] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:18:56.654241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:56.691024 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-451b4134-b40a-46a3-9d1c-023b4fdb6c7d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.485891 Jul 25 20:18:56.693241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1398/2843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:56 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:57.231573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:57.232340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:57.254547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:57.255741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:57.256794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:57.257933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:57.400150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:57.401410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:57.433000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:57.433826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:57.435526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:57.435996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:57.439242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:18:57.508690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:57.533836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-867a2e28-f4a7-4835-b73d-7a7d69838a05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1271 microversion: 2.1 time: 0.311704 Jul 25 20:18:57.539092 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1446/2844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:57 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:58.579060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:58.583933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:58.623729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:58.623885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:58.625027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:58.626693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:58.632219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:58.641549 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e93c1ca-5630-4dac-abdd-ca32b8e853be tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 1.248474 Jul 25 20:18:58.654519 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1399/2845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:57 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:18:59.049373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:18:59.082988 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67fcf242-2309-4110-9ec4-dd3f6629e2b3 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1271 microversion: 2.1 time: 0.514281 Jul 25 20:18:59.085058 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1447/2846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:58 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1271 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:18:59.685600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:18:59.687214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:18:59.711072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:59.711478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:18:59.723697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:18:59.724249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:00.113461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:00.114993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:00.170746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:00.171709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:00.181118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:00.181946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:01.144964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:01.227629 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ce50fb6-67c4-4084-b80c-61e2dbe055fa tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 1.541008 Jul 25 20:19:01.231942 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1400/2847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:18:59 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:01.584002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:01.602506 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-95c1d6c3-96d5-4d6b-b83d-5beee8b3ba93 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 1.495580 Jul 25 20:19:01.617202 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1448/2848] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:00 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:02.275576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:02.276801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:02.318106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:02.318827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:02.320266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:02.321069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:02.642681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:02.643319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:02.664336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:02.664811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:02.673939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:02.674423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:03.402662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:03.646851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:03.748163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:03.759461 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30db845d-214c-468e-97b3-4442992a38fa tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 1.121303 Jul 25 20:19:03.763391 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1449/2849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:02 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:03.782057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9e5171ef-17d2-4168-b25d-4459af91b080 req-f27254a2-94fa-4f60-84bd-461b3fffbf9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:03.816101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9e5171ef-17d2-4168-b25d-4459af91b080 req-f27254a2-94fa-4f60-84bd-461b3fffbf9a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:03.817819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9e5171ef-17d2-4168-b25d-4459af91b080 req-f27254a2-94fa-4f60-84bd-461b3fffbf9a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:03.839018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9e5171ef-17d2-4168-b25d-4459af91b080 req-f27254a2-94fa-4f60-84bd-461b3fffbf9a service nova] Creating event network-changed:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:19:03.853479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9e5171ef-17d2-4168-b25d-4459af91b080 req-f27254a2-94fa-4f60-84bd-461b3fffbf9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087873 Jul 25 20:19:03.854384 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1450/2850] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:04.382565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:04.393685 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d63aa18f-2ea9-4343-8036-34b1c5126bf4 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1471 microversion: 2.1 time: 2.134614 Jul 25 20:19:04.398919 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1401/2851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:02 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1471 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:04.788295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:04.789189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:04.804069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:04.804792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:04.808480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:04.809151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:05.418059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:05.418690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:05.421614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:05.442728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:05.443116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:05.443923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:05.444401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:05.850985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:05.861363 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e730befe-66fb-46a0-8a19-9375be2c8690 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 1.077012 Jul 25 20:19:05.877478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1451/2852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:04 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:06.549776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:06.575448 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e8beafa-7862-4eb1-af76-892982255320 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 1.161475 Jul 25 20:19:06.593025 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1402/2853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:05 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:06.899351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:06.901132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:06.938059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:06.939340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:06.941942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:06.942668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:07.601191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:07.601811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:07.619748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:07.620486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:07.622018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:07.622618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:07.749905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:07.760630 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4082fea9-f04b-4da8-9978-06c83c69d092 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.865916 Jul 25 20:19:07.767040 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1452/2854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:06 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:08.111015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:08.126166 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f38e1359-6ebf-408f-87ac-7005e987d64e tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 0.529438 Jul 25 20:19:08.126787 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1403/2855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:07 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:08.309553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3460bc03-ca45-4563-a3d9-74ea3e524aef req-721b4afa-9f1f-4fac-be7e-3ce27d40242e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-unplugged", "status": "completed", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:08.325265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3460bc03-ca45-4563-a3d9-74ea3e524aef req-721b4afa-9f1f-4fac-be7e-3ce27d40242e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:08.325923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3460bc03-ca45-4563-a3d9-74ea3e524aef req-721b4afa-9f1f-4fac-be7e-3ce27d40242e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:08.378303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3460bc03-ca45-4563-a3d9-74ea3e524aef req-721b4afa-9f1f-4fac-be7e-3ce27d40242e service nova] Creating event network-vif-unplugged:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:19:08.396003 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3460bc03-ca45-4563-a3d9-74ea3e524aef req-721b4afa-9f1f-4fac-be7e-3ce27d40242e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089822 Jul 25 20:19:08.398978 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1453/2856] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:19:08.797771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:08.798996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:08.808737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:08.809483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:08.811990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:08.812803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:09.154783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:09.156741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:09.162768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:09.165812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:09.166503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:09.167531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:09.168198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:09.201574 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6abdafc1-4ee8-412d-b534-77129400f5b1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.404573 Jul 25 20:19:09.204585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1404/2857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:08 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:09.301147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1794199370", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ff05ef26-f9a0-4263-8dd5-cc7087632fcc"}], "security_groups": [{"name": "tempest-securitygroup--1216387838"}], "key_name": "tempest-keypair-135680844", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "be1ae5e9-fac4-4482-b003-67be64c2236e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:09.905290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] validate_networks() for [('ff05ef26-f9a0-4263-8dd5-cc7087632fcc', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:19:10.014091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:10.039196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-258733a0-49cd-49e5-8574-d649ce197b04 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 0.889855 Jul 25 20:19:10.042975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1454/2858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:09 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:10.238576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:10.239673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:10.244181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=72 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:10.265691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:10.267519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:10.269492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:10.276207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:11.115191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:11.137550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdb7407b-9e30-466b-8d88-57bd51e539b6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.910380 Jul 25 20:19:11.153971 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1455/2859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:10 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:11.188706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:11.189286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:11.192348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for project 77666e0fc00c420c8536dd89e53c2d9b. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:11.217262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:11.217726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:11.218553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:11.218998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:11.220459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for user 2003037f4b744b73907a004ccd142a07 and project 77666e0fc00c420c8536dd89e53c2d9b. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:11.277767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:19:11.278181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:19:11.287502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:19:11.288348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:19:11.292288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:19:11.360278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:11.368824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:11.369981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:11.370443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:11.435668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for project 77666e0fc00c420c8536dd89e53c2d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:11.442905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Getting quotas for user 2003037f4b744b73907a004ccd142a07 and project 77666e0fc00c420c8536dd89e53c2d9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:11.666494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:19:11.669194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be1ae5e9-fac4-4482-b003-67be64c2236e',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:19:12.029355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b1ce651-58dd-489d-a902-fe93697db44b tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.737836 Jul 25 20:19:12.051715 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1405/2860] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:19:09 2022] POST /compute/v2.1/servers => generated 407 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:19:12.071978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3ed289b-5ded-44c7-8d3b-40bd2fc8e655 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:12.086039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3ed289b-5ded-44c7-8d3b-40bd2fc8e655 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:12.510924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3ed289b-5ded-44c7-8d3b-40bd2fc8e655 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:12.521640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:12.552735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25a4dd11-ad6c-4910-9502-f0bcf0fca137 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 1.391254 Jul 25 20:19:12.553068 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3ed289b-5ded-44c7-8d3b-40bd2fc8e655 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1121 microversion: 2.1 time: 0.483623 Jul 25 20:19:12.556524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1406/2861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:12 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1121 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:12.559258 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1456/2862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:11 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:12.577913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:12.583250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:12.624607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:12.625438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:12.626660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:12.627510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:13.363838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1815989109", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:13.502607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:19:13.509470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:13.533950 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-328b8124-9f8c-402f-a947-a5efb0cc8570 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.975916 Jul 25 20:19:13.542261 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1407/2863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:12 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:13.578724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:13.579266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:13.596473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:13.597136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:13.599584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:13.601051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:14.403771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:14.421303 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cdbcdf86-3624-4a0c-a5b7-2647d42e9bf1 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1171 microversion: 2.1 time: 0.843449 Jul 25 20:19:14.426054 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1408/2864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:13 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1171 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:14.435484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:14.436686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:14.460724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:14.464349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:14.465919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:14.466678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:14.930905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:14.959370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-139d8dc5-8bf8-4505-badb-6eadcbb6e28d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 0.531648 Jul 25 20:19:14.978632 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1409/2865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:14 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:14.994667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:14.996608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:15.003974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.004717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.005730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.006370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.754389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:15.766433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75af5a0a-9575-42d8-ab14-e3ece12b47fb tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.784111 Jul 25 20:19:15.787046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1410/2866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:14 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:15.794806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c0280850-2a2f-4391-b7e5-4e9c4280ae26 req-7a31bf41-90b0-4eec-8773-9c8464af4fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-plugged", "status": "completed", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:15.818506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0280850-2a2f-4391-b7e5-4e9c4280ae26 req-7a31bf41-90b0-4eec-8773-9c8464af4fe5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.822311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0280850-2a2f-4391-b7e5-4e9c4280ae26 req-7a31bf41-90b0-4eec-8773-9c8464af4fe5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.858958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c0280850-2a2f-4391-b7e5-4e9c4280ae26 req-7a31bf41-90b0-4eec-8773-9c8464af4fe5 service nova] Creating event network-vif-plugged:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:19:15.878387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c0280850-2a2f-4391-b7e5-4e9c4280ae26 req-7a31bf41-90b0-4eec-8773-9c8464af4fe5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085809 Jul 25 20:19:15.880707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1411/2867] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:15.897044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:15.900360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:15.916861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.918561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.919484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.921521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.936976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:19:15.937949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:19:15.938727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:19:15.939280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:19:15.939837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:19:15.954112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.959130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:15.960583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:15.961279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:16.035717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:16.062486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:16.115738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:19:16.127070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:19:16.236327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:16.251038 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fef1bdef-9d82-4b3c-a4fb-e3d822ab1846 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1237 microversion: 2.1 time: 0.365535 Jul 25 20:19:16.251659 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1412/2868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:15 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1237 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:16.256517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:16.257146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:16.286021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41d4c9d1-7c38-4aa3-92ff-8f92e69d22b0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.226804 Jul 25 20:19:16.288091 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1457/2869] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:19:16.296601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:16.297383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:16.298415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:16.299028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:16.312925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa2e68ee-fed7-4147-a633-0fdb612983bb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:16.313594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa2e68ee-fed7-4147-a633-0fdb612983bb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:16.481115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa2e68ee-fed7-4147-a633-0fdb612983bb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:16.501014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa2e68ee-fed7-4147-a633-0fdb612983bb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1193 microversion: 2.1 time: 0.203666 Jul 25 20:19:16.503408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1458/2870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:16 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1193 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:16.648583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:16.658918 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e8e8f63a-211e-484e-9698-c511fc082ee6 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 0.406115 Jul 25 20:19:16.661841 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1413/2871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:16 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:16.798093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:16.798986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:16.805960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:16.806687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:16.807665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:16.808351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.099850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:17.138209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7595ba98-02b8-4aa4-a325-09dad76e15df tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1313 microversion: 2.1 time: 0.346818 Jul 25 20:19:17.140068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1459/2872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:16 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:17.278933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:17.279862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:17.310136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.310610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.311413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.311863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.469681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:17.481958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ad1ca9c-d6ef-4bee-ba9c-ea7cf2ece5cd tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1237 microversion: 2.1 time: 0.211419 Jul 25 20:19:17.496569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1414/2873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:17 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1237 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:17.530144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:17.531027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:17.573941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.575373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.577825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.578791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.686578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:17.687208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:17.701168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.701930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.703623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:17.704568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:17.987384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:17.994833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:18.001442 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc6e034a-2653-433f-8475-520b441c65d9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1189 microversion: 2.1 time: 0.475944 Jul 25 20:19:18.007663 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1460/2874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:17 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1189 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:18.014371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-55f92595-36ed-4157-9f93-0081f85b67c2 req-24dd070b-62a1-4f9f-9208-50984aebe308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-plugged", "status": "completed", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:18.050847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55f92595-36ed-4157-9f93-0081f85b67c2 req-24dd070b-62a1-4f9f-9208-50984aebe308 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:18.051682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55f92595-36ed-4157-9f93-0081f85b67c2 req-24dd070b-62a1-4f9f-9208-50984aebe308 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:18.080533 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-55f92595-36ed-4157-9f93-0081f85b67c2 req-24dd070b-62a1-4f9f-9208-50984aebe308 service nova] Creating event network-vif-plugged:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:19:18.092266 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-55f92595-36ed-4157-9f93-0081f85b67c2 req-24dd070b-62a1-4f9f-9208-50984aebe308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081509 Jul 25 20:19:18.098936 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1461/2875] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:18.169861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:18.171811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:18.186868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:18.188739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:18.193266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:18.196346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:18.230767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:18.240092 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c4415a3-2c67-452a-8bdf-962911ed29ee tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 0.557934 Jul 25 20:19:18.240703 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1415/2876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:17 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:18.520926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:18.521608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:18.545084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:18.547000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:18.550329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:18.553917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.543893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:19.565827 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d7e6b80-9888-4051-bb0b-7558f33faa9b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1462 microversion: 2.1 time: 1.400587 Jul 25 20:19:19.588194 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1462/2877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:18 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1462 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:19.588194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:19.588194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:19.608101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.608953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.610008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.610680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.651436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:19.673346 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0bb2f7f-6e2f-4b5d-a5f5-de6193f20766 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1305 microversion: 2.1 time: 1.160456 Jul 25 20:19:19.677941 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1416/2878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:18 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1305 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:19.717859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:19.718642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:19.742455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.743336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.744762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.745621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.848792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:19.883664 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b69c61f5-98aa-4f34-b0bf-c8049ef0e9d1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1251 microversion: 2.1 time: 0.308138 Jul 25 20:19:19.891712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1463/2879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:19 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1251 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:19.897400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:19.910602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:19.934513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.941933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:19.944892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:19.945676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:20.736588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:20.752987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33421c6e-e1db-4888-87e3-4c3dba8aaa33 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1477 microversion: 2.1 time: 1.055779 Jul 25 20:19:20.753840 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1417/2880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:19 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1477 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:20.776476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:20.784307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:20.796637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:20.798226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:20.799519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:20.800217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:20.805344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:21.409650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:21.447199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04b09988-0028-44e1-843e-eb6f4b93cd4e tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1613 microversion: 2.1 time: 1.553844 Jul 25 20:19:21.479075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1464/2881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:19 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1613 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:21.502739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:21.503900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:21.520171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:21.536603 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80701405-1a34-4c08-8811-7e19144ade65 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1305 microversion: 2.1 time: 0.770138 Jul 25 20:19:21.543784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1418/2882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:20 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1305 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:21.562353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:21.565259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.568713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:21.574673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.578822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:21.580192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:21.619662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.620257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:21.621739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.622191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:21.736477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '333091122e5c4b96bec76f17ea3cdd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c66bfd753ca43688db92c9f28efe7a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:21.737103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] flavor_id is None. Assuming migration. {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 20:19:21.737758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:19:21.797275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:21.821559 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60dfb66f-7e7c-45db-a294-66bada54f6b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1251 microversion: 2.1 time: 0.340852 Jul 25 20:19:21.833975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1465/2883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:21 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1251 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:21.839691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:21.853054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:21.861611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.862335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:21.864124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:21.872979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:22.198853 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e18ae37-4ff1-41a1-9924-1a8942624928 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e/action" status: 202 len: 0 microversion: 2.1 time: 0.652196 Jul 25 20:19:22.200494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1419/2884] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:19:21 2022] POST /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:19:22.212191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:22.213972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:22.227972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:22.228941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:22.230575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:22.237018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:22.539387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:22.542921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:22.558784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f627280-9f52-4465-aab8-2709cdc6a95b tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1462 microversion: 2.1 time: 0.723392 Jul 25 20:19:22.560026 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1466/2885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:21 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1462 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:22.569366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:22.570293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:22.614159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:22.614623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:22.615444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:22.615886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:23.022621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:23.050764 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63e4ecf9-b678-4d5d-ada1-7f9f65ef2107 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1471 microversion: 2.1 time: 0.843909 Jul 25 20:19:23.055920 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1420/2886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:22 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1471 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:23.090564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:23.109013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:23.129614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:23.132622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:23.133530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:23.133996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:23.397740 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f62c3c2-19a9-4c72-8305-db2f89f3c7c3 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.339720 Jul 25 20:19:23.400719 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1421/2887] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:19:23 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:19:23.417175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:23.419602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:23.430510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:23.431607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:23.433338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:23.434257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:24.355245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:24.409355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91eb0ca8-7a6c-42f5-8a7c-801b25a26abb tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1305 microversion: 2.1 time: 1.837104 Jul 25 20:19:24.418564 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1467/2888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:22 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1305 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:24.444679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:24.445599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:24.498496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:24.505617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:24.513731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:24.519724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:24.697995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:24.700310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:24.701120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lazy-loading 'fault' on Instance uuid 20886bc0-0c72-4b52-a778-293275bc3fdf {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:19:24.910876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:24.924206 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c376a9b-1029-4c1b-9c2d-b21fd2fc2701 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 1.522152 Jul 25 20:19:24.924826 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1422/2889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:23 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:24.936880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:24.937514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:24.965280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:24.965748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:24.966553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:24.967063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.013630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:26.065838 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf6017bd-a604-433c-8021-421d656785dc tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1596 microversion: 2.1 time: 1.645528 Jul 25 20:19:26.070799 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1468/2890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:24 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1596 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:26.099684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-93413e90-0aef-4948-acff-9e58c3752763 req-16140bef-d24e-4904-95c0-30a493d47afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4b8b91-f265-41bf-b736-59d30f678d53", "tag": "dc207114-b6cf-4e4f-bbbe-f0a14731e300"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:26.128671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-93413e90-0aef-4948-acff-9e58c3752763 req-16140bef-d24e-4904-95c0-30a493d47afb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:26.129558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-93413e90-0aef-4948-acff-9e58c3752763 req-16140bef-d24e-4904-95c0-30a493d47afb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.143468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:26.170277 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-93413e90-0aef-4948-acff-9e58c3752763 req-16140bef-d24e-4904-95c0-30a493d47afb service nova] Creating event network-changed:dc207114-b6cf-4e4f-bbbe-f0a14731e300 for instance ff4b8b91-f265-41bf-b736-59d30f678d53 on n-h1-845775-3 Jul 25 20:19:26.181053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-93413e90-0aef-4948-acff-9e58c3752763 req-16140bef-d24e-4904-95c0-30a493d47afb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105879 Jul 25 20:19:26.185509 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1469/2891] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:26.191880 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a173b7c-9423-45fc-9792-2c6f6ca75fea tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1471 microversion: 2.1 time: 1.259692 Jul 25 20:19:26.197690 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1423/2892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:24 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1471 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:26.218670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:26.224339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:26.242359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:26.243121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.245571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:26.248638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.256356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:26.274594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:26.295062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:26.295581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.304818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:26.306159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:26.488263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:27.570271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:27.597375 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bac6409-fb09-459a-907f-67231fb91416 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1305 microversion: 2.1 time: 1.408903 Jul 25 20:19:27.599386 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1470/2893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:26 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1305 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:27.635306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:27.642375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:27.663081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.663689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:27.676968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.678337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:27.738612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:27.747400 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e439b97-3509-4dbc-a798-607c9fd86006 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 1.543466 Jul 25 20:19:27.753108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1424/2894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:26 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:27.760610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:27.761944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:27.779770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.780244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:27.782567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.783925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:27.884061 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e95383d0-839e-4827-8f73-dff9278f99d7 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action" status: 202 len: 0 microversion: 2.1 time: 0.282429 Jul 25 20:19:27.896610 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1471/2895] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:19:27 2022] POST /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:19:27.905994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:27.907058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:27.930604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.931269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:27.932651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:27.933952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.214737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:28.267998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e39bb04d-5616-4a1b-98cd-2783aa9e0507 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1471 microversion: 2.1 time: 0.512924 Jul 25 20:19:28.300446 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1425/2896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:27 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:28.528742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5b16e6d5-7a90-4b5a-b5ad-b3c5edb9ea49 req-af47269e-874b-49a7-89f9-de0277589e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281a4f84-cd59-4e8e-9a34-65745e2def6d", "tag": "585d2d18-98d5-4a14-87dd-d9108630ff32"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:28.567520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5b16e6d5-7a90-4b5a-b5ad-b3c5edb9ea49 req-af47269e-874b-49a7-89f9-de0277589e3d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:28.571670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5b16e6d5-7a90-4b5a-b5ad-b3c5edb9ea49 req-af47269e-874b-49a7-89f9-de0277589e3d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.642946 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5b16e6d5-7a90-4b5a-b5ad-b3c5edb9ea49 req-af47269e-874b-49a7-89f9-de0277589e3d service nova] Creating event network-changed:585d2d18-98d5-4a14-87dd-d9108630ff32 for instance 281a4f84-cd59-4e8e-9a34-65745e2def6d on n-h2-845775-3 Jul 25 20:19:28.665465 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5b16e6d5-7a90-4b5a-b5ad-b3c5edb9ea49 req-af47269e-874b-49a7-89f9-de0277589e3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143424 Jul 25 20:19:28.668097 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1426/2897] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:19:28.669252 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e383b865-a94f-4e2c-8e56-a394dd37e052 tempest-ServersAdminTestJSON-1280339788 tempest-ServersAdminTestJSON-1280339788-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1613 microversion: 2.1 time: 0.770933 Jul 25 20:19:28.689254 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1472/2898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:27 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1613 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:28.691258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:28.693147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:28.725115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:28.725860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:28.735022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:28.736434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.738286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:28.739439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.755236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:28.759076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.760505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:28.761992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:28.857280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:19:29.061221 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a944d06e-7e9c-4e5b-a3e8-1b0f0a0afc8f tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 204 len: 0 microversion: 2.1 time: 0.350569 Jul 25 20:19:29.062477 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1473/2899] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:19:28 2022] DELETE /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:29.078194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:29.079260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:29.087910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.089330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.091032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.091795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.455965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:29.486361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11e80a28-190e-416f-a8d7-07962c64bb2d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.814579 Jul 25 20:19:29.487599 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1427/2900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:28 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:29.495564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:29.497180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:29.509244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.510414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.512183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.513163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.555017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:29.570408 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-75e42652-6d5b-4399-b727-542d91159a8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.506082 Jul 25 20:19:29.571855 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1474/2901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:29 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:29.579814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:29.581067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:29.591635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.592663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.594402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:29.595537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:29.601638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:29.960742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:29.995157 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f70129bf-fe3f-475f-a6d1-7da538732b28 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1470 microversion: 2.1 time: 0.505945 Jul 25 20:19:29.999307 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1428/2902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:29 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:30.021335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:30.046557 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ec734d9-ca5a-4465-b24f-55febb577eca tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1471 microversion: 2.1 time: 0.472879 Jul 25 20:19:30.047389 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1475/2903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:29 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:30.520887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:30.525113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:30.537526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:30.544918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:30.546768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:30.548708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:30.612282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:30.622328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:30.640790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:30.641994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:30.646117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:30.647353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:31.005812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:31.007378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:31.017545 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a97d9eea-1a7e-4414-8e16-ec47a1fcdf81 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.417269 Jul 25 20:19:31.018818 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1476/2904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:30 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:31.074210 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-968bb334-68e0-4c3e-b37c-c63585fd86da tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.561513 Jul 25 20:19:31.084784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1429/2905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:30 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:31.112905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:31.116813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:31.135389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:31.136803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:31.139113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:31.140425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:31.186543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-325565982", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f87eea35-5a95-4770-a5f8-40c3162b34b8"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:31.381639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] validate_networks() for [('f87eea35-5a95-4770-a5f8-40c3162b34b8', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:19:31.889084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:31.919209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cab87071-3735-4ce0-b10b-9edf6c2d5338 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1470 microversion: 2.1 time: 0.828834 Jul 25 20:19:31.924291 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1430/2906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:31 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1470 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:31.938916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:31.948213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:31.965178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:31.966194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:31.967631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:31.968625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.472825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:32.498312 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-840befe4-5dfe-412b-b5a8-cbcdc45dcae0 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 0.565901 Jul 25 20:19:32.501249 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1431/2907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:31 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:32.510854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:32.513767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:32.525590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.526625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.527655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.528393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.535342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:32.580318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:19:32.581562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:19:32.582064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:19:32.582710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:19:32.583536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:19:32.617023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.618463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.625856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.627667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.700834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Getting quotas for project 9d12d48f33df4dbc8a23558dd42503fe. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:32.714662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Getting quotas for user 15b4be02bcf5471bb56ea960fd42f826 and project 9d12d48f33df4dbc8a23558dd42503fe. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:32.746694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:19:32.751479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:19:32.910832 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-042930a5-4010-4345-b47b-3c21631244a7 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890411 Jul 25 20:19:32.911649 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1477/2908] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:19:32.927407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:32.939255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:32.942624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:32.957799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.958280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.962074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:32.963377 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb8ea2b4-4df5-4d9d-8426-5e79495b8518 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.460212 Jul 25 20:19:32.965716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:32.976027 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1432/2909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:32 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:33.007348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:33.008232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:33.018758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:33.019624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:33.020655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:33.021266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:33.212005 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4368c17-4fca-4df3-91b9-f0c3e99b18ba tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.297633 Jul 25 20:19:33.228610 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1478/2910] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:19:32 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:19:33.255303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bdd46777-4b24-4bc7-8db5-09178f71c606 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:33.257645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bdd46777-4b24-4bc7-8db5-09178f71c606 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:33.463090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bdd46777-4b24-4bc7-8db5-09178f71c606 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:33.477042 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bdd46777-4b24-4bc7-8db5-09178f71c606 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1227 microversion: 2.1 time: 0.244712 Jul 25 20:19:33.480423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1479/2911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:33 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:33.494026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:33.497573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:33.519192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:33.519944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:33.520954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:33.521562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:34.137300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:34.156188 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d7910f5-7799-47a4-a8ac-c07947855d0a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 1.160432 Jul 25 20:19:34.159309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1433/2912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:32 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:34.166549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:34.169999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:34.178046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:34.195929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-085dc63a-d052-4c2b-bf9c-e1c9bfa82ae8 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1470 microversion: 2.1 time: 0.706607 Jul 25 20:19:34.196923 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1480/2913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:33 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1470 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:34.202126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:34.207423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:34.218715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:34.221662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:34.510281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:34.511213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:34.561098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:34.561844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:34.565258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:34.565719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.311689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:35.333032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37af2e54-812c-424d-9f4f-de73a35f0444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 1.134033 Jul 25 20:19:35.349701 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1481/2914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:34 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:35.364759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:35.370257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:35.390224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.391436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.400672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.402824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.472871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:35.496358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c95c6a59-6fb3-46c3-800e-0348e6d42c67 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1673 microversion: 2.1 time: 1.335624 Jul 25 20:19:35.496980 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1434/2915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:34 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1673 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:35.533916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:35.535217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:35.549624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:35.556759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.561120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.564597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.571292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.797635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:35.806599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65384223-22ca-457a-b3b3-cf3434d72c79 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1285 microversion: 2.1 time: 0.284603 Jul 25 20:19:35.832529 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1435/2916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:35 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:35.838782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:35.840401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:35.857176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.858194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:35.860987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:35.864907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.160206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:36.176104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35742394-3d36-48c9-9221-2eae2655fa70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.824373 Jul 25 20:19:36.178957 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1482/2917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:35 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:36.191608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:36.194754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:36.217351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.217928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.222640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.223318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.614825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:36.658307 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfeecca5-1027-443a-8d7a-c0e467d1b225 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.822968 Jul 25 20:19:36.661144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1436/2918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:35 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:36.671812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0427cad4-76c8-4d32-843f-9f29a7cb008c req-efbbc81f-e849-412b-ad0b-d93ed912d14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c81d0d3-df32-49a5-824a-ce9316aa6740", "name": "network-vif-unplugged", "status": "completed", "tag": "47ac04dc-1338-4f88-8e8b-e6623a2179ce"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:36.697949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0427cad4-76c8-4d32-843f-9f29a7cb008c req-efbbc81f-e849-412b-ad0b-d93ed912d14f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.699310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0427cad4-76c8-4d32-843f-9f29a7cb008c req-efbbc81f-e849-412b-ad0b-d93ed912d14f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.778143 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0427cad4-76c8-4d32-843f-9f29a7cb008c req-efbbc81f-e849-412b-ad0b-d93ed912d14f service nova] Creating event network-vif-unplugged:47ac04dc-1338-4f88-8e8b-e6623a2179ce for instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 on n-h2-845775-3 Jul 25 20:19:36.814175 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0427cad4-76c8-4d32-843f-9f29a7cb008c req-efbbc81f-e849-412b-ad0b-d93ed912d14f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150623 Jul 25 20:19:36.819137 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1437/2919] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:36.840615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:36.842703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:36.846221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:36.859719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.861175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.864092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.864851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.879203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e011b110-d6bc-43cb-b22e-2ef1f6543b69 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 200 len: 1470 microversion: 2.1 time: 0.694955 Jul 25 20:19:36.880803 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1483/2920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:36 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 1470 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:36.899808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:36.900888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:36.928846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.929591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:36.931230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:36.931961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.520190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:38.534260 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4982f95b-b487-485f-83ef-71cfd54870f6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 1.711570 Jul 25 20:19:38.553990 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1438/2921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:36 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:38.564873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:38.567491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:38.589808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:38.596066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.596899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.600800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.602411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.604543 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1229e17b-6cd8-44f0-ab9b-f356a555a23a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1673 microversion: 2.1 time: 1.721845 Jul 25 20:19:38.605166 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1484/2922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:36 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1673 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:38.624358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:38.624358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:38.628998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:38.630899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.631368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.632267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.632722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.876597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:38.911157 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e40e9c1-251c-4837-955f-8f815235b46f tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1285 microversion: 2.1 time: 0.354562 Jul 25 20:19:38.916781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1439/2923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:38 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1285 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:38.945644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:38.947866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:38.981330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.985778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:38.990821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:38.991564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.514722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:39.525288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3e67f94-c254-4ddb-b41b-5279ec844fe6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.918810 Jul 25 20:19:39.540424 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1485/2924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:38 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:39.545782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-bff06451-6706-41d5-bf34-a30dc201a478 req-2ddd5fce-0d13-466a-98a3-893d83388aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c81d0d3-df32-49a5-824a-ce9316aa6740", "name": "network-vif-deleted", "tag": "47ac04dc-1338-4f88-8e8b-e6623a2179ce"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:39.566507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bff06451-6706-41d5-bf34-a30dc201a478 req-2ddd5fce-0d13-466a-98a3-893d83388aa2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.567315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bff06451-6706-41d5-bf34-a30dc201a478 req-2ddd5fce-0d13-466a-98a3-893d83388aa2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.594495 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-bff06451-6706-41d5-bf34-a30dc201a478 req-2ddd5fce-0d13-466a-98a3-893d83388aa2 service nova] Creating event network-vif-deleted:47ac04dc-1338-4f88-8e8b-e6623a2179ce for instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 on n-h2-845775-3 Jul 25 20:19:39.616134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-bff06451-6706-41d5-bf34-a30dc201a478 req-2ddd5fce-0d13-466a-98a3-893d83388aa2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073618 Jul 25 20:19:39.622701 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1486/2925] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:39.623882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:39.637579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:39.644657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e9bce0d-b70d-4f62-b1ba-c878e3e31651 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.725594 Jul 25 20:19:39.645365 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1440/2926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:38 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:39.654647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:39.655806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:39.661201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 3c81d0d3-df32-49a5-824a-ce9316aa6740] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:39.676189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.677055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.677643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.678505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.678936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.679071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.681192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.682238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.774481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] HTTP exception thrown: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Request method failure captured: Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 HTTP/1.1 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3voAC4hnWihFVq9CGkIwvPD1RkzVls8tKzl4UKu6Tmk08kL-U0CXQgSH_Xp35FdKoGvIgBX4rZaRhimii5DdyUxhn8Zq4R_mKX3yiG88icABS6dm6ICFG-1aGUHRlbZCHKxCEmkrdo9DQIfqql6KbQk8_G4QKNajG56rp7ZlgldAvs8 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}] Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b62b2140b1fa4df9bb1701a2dc11776f Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3c81d0d3-df32-49a5-824a-ce9316aa6740'} Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:39.776669 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. Jul 25 20:19:39.782644 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:19:39.786420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Returning 404 to user: Instance 3c81d0d3-df32-49a5-824a-ce9316aa6740 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:19:39.787560 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a04e299-ef43-49dc-9b35-31acd296c66d tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740" status: 404 len: 111 microversion: 2.1 time: 0.162038 Jul 25 20:19:39.793212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1487/2927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:39 2022] GET /compute/v2.1/servers/3c81d0d3-df32-49a5-824a-ce9316aa6740 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:19:39.798683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:39.800165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:39.810946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.811793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:39.812872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:39.813547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.239234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:40.264824 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9fb89ab-3aef-47af-b92f-8a9df850abdc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 0.617095 Jul 25 20:19:40.265865 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1441/2928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:39 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:40.281427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:40.281942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:40.296070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.296973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.297966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.298578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.322779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:40.339280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:19:40.355446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b9ed24b-3758-497b-9118-900115962860 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.560221 Jul 25 20:19:40.356383 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1488/2929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:39 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:40.369053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:40.369812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:40.415139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.416541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.426100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.427941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.499867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97ef00b1-df2a-47d2-b974-d5e6bf8b9322 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 204 len: 0 microversion: 2.1 time: 0.232538 Jul 25 20:19:40.505437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1442/2930] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:19:40 2022] DELETE /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:40.512197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:40.513239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:40.521257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.522219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.523691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:40.525074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:40.913728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:40.941191 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dbe0fafa-b1d7-40e1-a5e5-c8b3d0da8ddd tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 0.579341 Jul 25 20:19:40.946554 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1489/2931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:40 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:40.949948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:40.962470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:40.963576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:40.968687 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-927930a5-81c8-4d97-8fe6-85eea79d6449 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1470 microversion: 2.1 time: 0.460809 Jul 25 20:19:40.971996 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1443/2932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:40 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:40.984858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:40.986955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:40.988761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.000009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.001782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.002589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.004796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.007623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.008866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.009569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.556993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:41.574433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ff06f49-b83e-497e-a225-06ee56cf46af tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.600299 Jul 25 20:19:41.576436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1444/2933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:40 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:41.585628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5f39b93d-b8b4-48f9-bd58-862b760f4cae req-a52680eb-edd7-4bb1-89ab-c30af395f596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4b8b91-f265-41bf-b736-59d30f678d53", "name": "network-vif-plugged", "status": "completed", "tag": "dc207114-b6cf-4e4f-bbbe-f0a14731e300"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:41.597523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5f39b93d-b8b4-48f9-bd58-862b760f4cae req-a52680eb-edd7-4bb1-89ab-c30af395f596 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.598273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5f39b93d-b8b4-48f9-bd58-862b760f4cae req-a52680eb-edd7-4bb1-89ab-c30af395f596 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.609177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:41.624871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f26eb876-dd1a-4a49-99b3-22e7e6aeb2ce tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.676234 Jul 25 20:19:41.625366 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5f39b93d-b8b4-48f9-bd58-862b760f4cae req-a52680eb-edd7-4bb1-89ab-c30af395f596 service nova] Creating event network-vif-plugged:dc207114-b6cf-4e4f-bbbe-f0a14731e300 for instance ff4b8b91-f265-41bf-b736-59d30f678d53 on n-h1-845775-3 Jul 25 20:19:41.626151 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1490/2934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:40 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:41.640412 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5f39b93d-b8b4-48f9-bd58-862b760f4cae req-a52680eb-edd7-4bb1-89ab-c30af395f596 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053195 Jul 25 20:19:41.640412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1445/2935] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:41.640412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:41.640412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:41.647385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.647851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.648738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.649674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.917811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:41.935526 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-419c7795-4a68-415a-a276-ce47127bd4c5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 0.299558 Jul 25 20:19:41.936919 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1446/2936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:41 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:41.967713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:41.968481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:41.977267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.977837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:41.978735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:41.979245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.010524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:42.013132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:42.028452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.029641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.031281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.032390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.626181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:42.651792 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ccaa1c2-645c-48c1-92eb-90da244d8840 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1470 microversion: 2.1 time: 0.647510 Jul 25 20:19:42.653981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1447/2937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:42 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:42.658110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:42.661098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-effb12a2-0233-44c7-977c-621c87bc39d8 req-d2df962f-ed32-4a9a-a8f4-6c62e1a23caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65430964-7290-4e64-9e28-f2ce797b96d5", "tag": "0cd58aab-b294-4d96-a1c4-81b5eada6b3f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:42.670067 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a6dac67-7583-480d-8607-6dac79f1cff1 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 0.707757 Jul 25 20:19:42.671559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1491/2938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:41 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:42.672303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:42.686929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:42.687794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:42.693579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-effb12a2-0233-44c7-977c-621c87bc39d8 req-d2df962f-ed32-4a9a-a8f4-6c62e1a23caa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.698650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-effb12a2-0233-44c7-977c-621c87bc39d8 req-d2df962f-ed32-4a9a-a8f4-6c62e1a23caa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.704157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.704547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.706226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.707516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.741203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-effb12a2-0233-44c7-977c-621c87bc39d8 req-d2df962f-ed32-4a9a-a8f4-6c62e1a23caa service nova] Creating event network-changed:0cd58aab-b294-4d96-a1c4-81b5eada6b3f for instance 65430964-7290-4e64-9e28-f2ce797b96d5 on n-h1-845775-3 Jul 25 20:19:42.750889 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-effb12a2-0233-44c7-977c-621c87bc39d8 req-d2df962f-ed32-4a9a-a8f4-6c62e1a23caa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094974 Jul 25 20:19:42.752358 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1448/2939] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:42.758564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:42.759708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:42.767570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.768226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.769565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:42.770063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:42.776518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:43.035496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:43.049792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aad8c08e-38a5-4f28-8a02-5b42fb2dcb8a tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1293 microversion: 2.1 time: 0.377636 Jul 25 20:19:43.051683 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1492/2940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:42 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:43.058739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:43.060387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:43.069712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:43.071486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.072308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.073929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.074710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.080816 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ab986b0-8f50-419f-956d-52ff5282143e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.326664 Jul 25 20:19:43.081750 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1449/2941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:42 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:43.258823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:43.263404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:43.270157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5df9d850-0918-45bc-8f0f-1d989eb04444 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 0.216594 Jul 25 20:19:43.270728 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1493/2942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:43 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:43.676049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:43.679797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:43.691589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.697627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.699544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:43.700218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:43.702117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:43.705956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.707976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.717114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.720827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.723990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.729169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.833640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:43.846618 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79042896-81b5-4a26-ba3f-444146aca696 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1299 microversion: 2.1 time: 0.174706 Jul 25 20:19:43.850320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1450/2943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:43 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:43.864668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-477bcee9-7d00-4cca-a0b1-dd8e9975df3b req-c1518685-4635-44be-960d-a32c09d95231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a4f84-cd59-4e8e-9a34-65745e2def6d", "name": "network-vif-plugged", "status": "completed", "tag": "585d2d18-98d5-4a14-87dd-d9108630ff32"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:43.894133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-477bcee9-7d00-4cca-a0b1-dd8e9975df3b req-c1518685-4635-44be-960d-a32c09d95231 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:43.894591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-477bcee9-7d00-4cca-a0b1-dd8e9975df3b req-c1518685-4635-44be-960d-a32c09d95231 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:43.917682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-477bcee9-7d00-4cca-a0b1-dd8e9975df3b req-c1518685-4635-44be-960d-a32c09d95231 service nova] Creating event network-vif-plugged:585d2d18-98d5-4a14-87dd-d9108630ff32 for instance 281a4f84-cd59-4e8e-9a34-65745e2def6d on n-h2-845775-3 Jul 25 20:19:43.937425 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-477bcee9-7d00-4cca-a0b1-dd8e9975df3b req-c1518685-4635-44be-960d-a32c09d95231 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085309 Jul 25 20:19:43.937946 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1451/2944] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:44.083781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:44.085522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:44.119787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.120338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:44.121148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.121588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:44.505429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:44.526709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:44.531420 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ae2739cf-bc0f-4ca7-91cf-c12c086e9e92 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 0.836122 Jul 25 20:19:44.532883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1494/2945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:43 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:44.543051 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ddcae86-4334-4412-9de6-1de64651d53d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1484 microversion: 2.1 time: 0.471059 Jul 25 20:19:44.544205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:44.548645 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1452/2946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:44 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1484 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:19:44.560398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:44.562418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:44.564558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:44.585174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.585891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:44.587612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.588072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:44.597298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.598588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:44.599937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:44.600862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.016882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:45.021987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:45.031890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef0519e1-09ab-4b8e-8358-c5409e397166 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 0.480627 Jul 25 20:19:45.035088 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1453/2947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:44 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:45.039282 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-948dfe89-a7a7-4adb-9720-60ce67df4924 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1293 microversion: 2.1 time: 0.503854 Jul 25 20:19:45.041513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:45.042967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:45.049819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.050643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.051645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.052136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.060889 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1495/2948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:44 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1293 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:45.078389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2c54bd86-b894-4d34-96ee-59b133722b92 req-6f020f8b-3132-4a43-8f1d-f19be83896fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74fc46fd-b20a-4216-a72d-4a6693619f7a", "name": "network-vif-deleted", "tag": "4ad995ab-6f03-464b-936c-045dae1b2818"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:45.098365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2c54bd86-b894-4d34-96ee-59b133722b92 req-6f020f8b-3132-4a43-8f1d-f19be83896fb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.099399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2c54bd86-b894-4d34-96ee-59b133722b92 req-6f020f8b-3132-4a43-8f1d-f19be83896fb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.115176 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2c54bd86-b894-4d34-96ee-59b133722b92 req-6f020f8b-3132-4a43-8f1d-f19be83896fb service nova] Creating event network-vif-deleted:4ad995ab-6f03-464b-936c-045dae1b2818 for instance 74fc46fd-b20a-4216-a72d-4a6693619f7a on n-h1-845775-3 Jul 25 20:19:45.120691 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2c54bd86-b894-4d34-96ee-59b133722b92 req-6f020f8b-3132-4a43-8f1d-f19be83896fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057997 Jul 25 20:19:45.122140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1496/2949] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:45.128865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:45.129713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:45.148432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.149712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.160456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.160456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.231321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f91d114-a9f4-4815-a8b7-cf47ebd3f2c7 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194443 Jul 25 20:19:45.235594 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1454/2950] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:19:45 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:45.254533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.254989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.255516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lazy-loading 'fault' on Instance uuid 74fc46fd-b20a-4216-a72d-4a6693619f7a {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:19:45.401699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:45.417277 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bdc7356-98df-4583-889a-48d6d3d11131 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 200 len: 1304 microversion: 2.1 time: 0.293676 Jul 25 20:19:45.441403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1497/2951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:45 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:45.590455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:45.591384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:45.613814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.614716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:45.616150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:45.617269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:46.062453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:46.068003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:46.112147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:46.118081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:46.127660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:46.131710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:47.591221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:47.627324 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d20abce-bfd4-4889-8789-9b7ba807e05c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 1.574878 Jul 25 20:19:47.633244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1498/2952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:46 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:47.663950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:47.680664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:47.692182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:47.699879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:47.701458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:47.702498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:47.823485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:47.861189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2eb1ebed-c34c-435c-928d-c138647581d3 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 2.268610 Jul 25 20:19:47.864721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1455/2953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:45 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:47.873108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:47.874368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 74fc46fd-b20a-4216-a72d-4a6693619f7a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:47.893158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:47.897359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:47.900588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:47.904208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:47.970950 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] HTTP exception thrown: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Request method failure captured: Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a HTTP/1.1 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3voAC4hnWihFVq9CGkIwvPD1RkzVls8tKzl4UKu6Tmk08kL-U0CXQgSH_Xp35FdKoGvIgBX4rZaRhimii5DdyUxhn8Zq4R_mKX3yiG88icABS6dm6ICFG-1aGUHRlbZCHKxCEmkrdo9DQIfqql6KbQk8_G4QKNajG56rp7ZlgldAvs8 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}] Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b62b2140b1fa4df9bb1701a2dc11776f Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '74fc46fd-b20a-4216-a72d-4a6693619f7a'} Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:47.977123 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:47.981586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Returning 404 to user: Instance 74fc46fd-b20a-4216-a72d-4a6693619f7a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:19:47.983628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17595b93-c847-4201-b2ca-73e04d884b14 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a" status: 404 len: 111 microversion: 2.1 time: 0.112277 Jul 25 20:19:47.984611 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1456/2954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:47 2022] GET /compute/v2.1/servers/74fc46fd-b20a-4216-a72d-4a6693619f7a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:19:48.003438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:48.004345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:48.030422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:48.031010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:48.032122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:48.032757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:48.136359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:19:48.419219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7b00307-3b10-407e-846a-06e9419d4aa0 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 204 len: 0 microversion: 2.1 time: 0.427458 Jul 25 20:19:48.429641 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1457/2955] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:19:47 2022] DELETE /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:48.440806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:48.442086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:48.463403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:48.466721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:48.471754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:48.475710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:49.147548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:49.173179 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f187b726-4e19-4121-b19f-23ded888c6de tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1474 microversion: 2.1 time: 1.513359 Jul 25 20:19:49.181542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1499/2956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:47 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1474 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:49.189844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:49.194748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:49.217222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:49.221933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:49.223550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:49.227785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:49.724864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:49.744604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c40575f-ccdf-4af2-a3ee-2dcc863ac251 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1468 microversion: 2.1 time: 1.312536 Jul 25 20:19:49.758241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1458/2957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:48 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1468 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:49.767016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:49.768378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:49.801613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:49.802997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:49.807074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:49.808743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:51.293360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:51.305342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63fbeb12-bb96-48f0-926e-2e8d4d9adf0d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 2.121879 Jul 25 20:19:51.316612 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1500/2958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:49 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:51.335660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1332963526", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:51.449817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:19:51.681432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:51.691270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35e53201-50c5-45c8-914c-acea4fc2a654 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 1.931114 Jul 25 20:19:51.706775 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1459/2959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:49 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:51.713379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1d0f67d5-0e6a-4dcc-8f8c-d3e928c753db req-f9f047a1-d0ad-4ba9-9705-d43352c720f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65430964-7290-4e64-9e28-f2ce797b96d5", "name": "network-vif-plugged", "status": "completed", "tag": "0cd58aab-b294-4d96-a1c4-81b5eada6b3f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:51.725019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1d0f67d5-0e6a-4dcc-8f8c-d3e928c753db req-f9f047a1-d0ad-4ba9-9705-d43352c720f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:51.726141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1d0f67d5-0e6a-4dcc-8f8c-d3e928c753db req-f9f047a1-d0ad-4ba9-9705-d43352c720f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:51.740179 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1d0f67d5-0e6a-4dcc-8f8c-d3e928c753db req-f9f047a1-d0ad-4ba9-9705-d43352c720f6 service nova] Creating event network-vif-plugged:0cd58aab-b294-4d96-a1c4-81b5eada6b3f for instance 65430964-7290-4e64-9e28-f2ce797b96d5 on n-h1-845775-3 Jul 25 20:19:51.747254 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1d0f67d5-0e6a-4dcc-8f8c-d3e928c753db req-f9f047a1-d0ad-4ba9-9705-d43352c720f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038300 Jul 25 20:19:51.748161 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1460/2960] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:51.755144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:51.756117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:51.764897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:51.765652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:51.766656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:51.767284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:52.732411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:52.747665 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23c59d08-39c4-4a3a-a908-093821a17647 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1468 microversion: 2.1 time: 0.997676 Jul 25 20:19:52.748654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1461/2961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:51 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1468 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:52.755584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:52.756582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:52.767524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:52.768571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:52.770357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:52.771869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:53.869206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:53.888256 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9280b9d-af90-4441-bb1a-142cb2443706 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1476 microversion: 2.1 time: 1.137834 Jul 25 20:19:53.891858 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1462/2962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:52 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1476 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:53.911517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:53.914285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:53.929537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:53.930008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:53.930811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:53.931437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.289756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:19:54.290809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:19:54.291688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:19:54.292862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:19:54.293644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:19:54.331221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.338183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.340074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.340664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.398783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:54.424917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:54.500996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:19:54.511163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:19:54.658304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:54.672146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8885758-68b8-44e5-ae8e-2fc892ba6777 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.342983 Jul 25 20:19:54.675443 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-970ac2fa-b504-40fc-a5fd-abcd7aab19be tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1327 microversion: 2.1 time: 0.777915 Jul 25 20:19:54.676898 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1463/2963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:53 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1327 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:54.683372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-unplugged", "status": "completed", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:54.698806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.699962 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1501/2964] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:19:54.700274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.752296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:54.767734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:54.789262 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] Creating event network-vif-unplugged:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h2-845775-3 Jul 25 20:19:54.810850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.814222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] Instance a6aef295-4586-4ad5-8472-d7425558e65e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:19:54.818909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.820403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.821196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.843369 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-645c7d2d-4e0b-4da5-923c-92fbac6a70a4 req-3f224b8f-e23b-4d49-9b61-3db6a5887e67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164261 Jul 25 20:19:54.844504 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1464/2965] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:54.856333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:54.859522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:54.884962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.895032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.896423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.897195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.957208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:54.963558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:54.970981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lazy-loading 'fault' on Instance uuid 20886bc0-0c72-4b52-a778-293275bc3fdf {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:19:55.202246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62b2140b1fa4df9bb1701a2dc11776f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18817281c94dfc89e0da34cb18f52c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:55.251056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3413f108-af34-492a-910c-9a84ef838f96 tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 200 len: 1303 microversion: 2.1 time: 0.549188 Jul 25 20:19:55.260250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1502/2966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:54 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 1303 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:55.290270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b4a2f970-82dd-461d-a020-981f82ea691a req-598c07a3-adbf-4f5b-9539-1f31aee25dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4b8b91-f265-41bf-b736-59d30f678d53", "tag": "dc207114-b6cf-4e4f-bbbe-f0a14731e300"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:55.322643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b4a2f970-82dd-461d-a020-981f82ea691a req-598c07a3-adbf-4f5b-9539-1f31aee25dbb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:55.326729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b4a2f970-82dd-461d-a020-981f82ea691a req-598c07a3-adbf-4f5b-9539-1f31aee25dbb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:55.384577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b4a2f970-82dd-461d-a020-981f82ea691a req-598c07a3-adbf-4f5b-9539-1f31aee25dbb service nova] Creating event network-changed:dc207114-b6cf-4e4f-bbbe-f0a14731e300 for instance ff4b8b91-f265-41bf-b736-59d30f678d53 on n-h1-845775-3 Jul 25 20:19:55.407287 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b4a2f970-82dd-461d-a020-981f82ea691a req-598c07a3-adbf-4f5b-9539-1f31aee25dbb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141427 Jul 25 20:19:55.408581 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1503/2967] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:55.422584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00dd19fd-ce6d-4bfb-bd18-7194af84f2be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:55.423658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00dd19fd-ce6d-4bfb-bd18-7194af84f2be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:55.483183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00dd19fd-ce6d-4bfb-bd18-7194af84f2be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:19:55.795228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:55.806125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc90b6a4-99dc-46f8-8a38-550117e09ad8 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1484 microversion: 2.1 time: 0.960240 Jul 25 20:19:55.822998 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1465/2968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:54 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1484 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:55.829425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:55.830422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:55.837922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:55.838809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:55.839937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:55.840729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:55.985864 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-00dd19fd-ce6d-4bfb-bd18-7194af84f2be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Instance Mapping does not exist while attempting local delete cleanup. Jul 25 20:19:55.988636 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00dd19fd-ce6d-4bfb-bd18-7194af84f2be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a" status: 204 len: 0 microversion: 2.1 time: 0.578312 Jul 25 20:19:55.990276 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1504/2969] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:19:55 2022] DELETE /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:19:56.001098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:56.003406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:56.016820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.018398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:56.020184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.021210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:56.440213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:56.446220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:19:56.453931 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4814148-96b3-4331-8c3c-1a837a5e5890 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1475 microversion: 2.1 time: 0.628526 Jul 25 20:19:56.456680 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1466/2970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:55 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1475 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:56.470148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:56.473954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:56.494193 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a HTTP/1.1 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b983ba4b-e616-415b-a8de-52a9c092c26a'} Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:56.499642 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:19:56.504765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d13aef12-d363-4637-a89f-50d9a88002c3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a" status: 404 len: 111 microversion: 2.1 time: 0.041214 Jul 25 20:19:56.505333 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1467/2971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:56 2022] GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:19:56.522375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:56.523342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] [instance: 20886bc0-0c72-4b52-a778-293275bc3fdf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:56.532542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.533311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:56.534690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.535387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:56.587110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] HTTP exception thrown: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Request method failure captured: Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf HTTP/1.1 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3voAC4hnWihFVq9CGkIwvPD1RkzVls8tKzl4UKu6Tmk08kL-U0CXQgSH_Xp35FdKoGvIgBX4rZaRhimii5DdyUxhn8Zq4R_mKX3yiG88icABS6dm6ICFG-1aGUHRlbZCHKxCEmkrdo9DQIfqql6KbQk8_G4QKNajG56rp7ZlgldAvs8 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b18817281c94dfc89e0da34cb18f52c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b18817281c94dfc89e0da34cb18f52c"}]}] Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0b18817281c94dfc89e0da34cb18f52c Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminTestJSON-1913315120 Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b62b2140b1fa4df9bb1701a2dc11776f Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminTestJSON-1913315120-project Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '20886bc0-0c72-4b52-a778-293275bc3fdf'} Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:19:56.590930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. Jul 25 20:19:56.603204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:19:56.604731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] Returning 404 to user: Instance 20886bc0-0c72-4b52-a778-293275bc3fdf could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:19:56.608516 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-366258da-6536-4fce-84d9-a164c440dbda tempest-ServersAdminTestJSON-1913315120 tempest-ServersAdminTestJSON-1913315120-project] 10.222.0.48 "GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf" status: 404 len: 111 microversion: 2.1 time: 0.100599 Jul 25 20:19:56.611508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1468/2972] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:56 2022] GET /compute/v2.1/servers/20886bc0-0c72-4b52-a778-293275bc3fdf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:19:56.638145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-356182774", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:56.646128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:56.685088 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c1341de-9dfc-496f-a372-d426dd999bd2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1527 microversion: 2.1 time: 0.691531 Jul 25 20:19:56.688756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1505/2973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:55 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1527 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:56.741467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:56.743739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:56.769999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:19:56.783013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.785193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:56.789939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:56.797708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:58.285763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:58.327520 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92ebe409-549b-4f72-acfc-f765d19a0533 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1527 microversion: 2.1 time: 1.605397 Jul 25 20:19:58.348690 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1506/2974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:56 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1527 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:58.367962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:58.400648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:58.402859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:58.447012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] Creating event network-changed:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h2-845775-3 Jul 25 20:19:58.461982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] Instance a6aef295-4586-4ad5-8472-d7425558e65e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:19:58.513216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f77b9351-67c5-4848-b8d5-5c901ade0b5f req-8475a1e3-6aa1-4f15-bfee-9001e6fb6f5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161633 Jul 25 20:19:58.516211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1507/2975] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:58.532854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:58.536089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:19:58.554223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:58.558717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:58.561059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:58.562534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:59.130753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:19:59.146315 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b27273cf-9ba7-4a72-beab-a3b67283b262 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1473 microversion: 2.1 time: 0.627812 Jul 25 20:19:59.156526 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1508/2976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:58 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1473 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:19:59.176904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-af360828-883d-47fc-80dd-1168a18195ac req-11f227fa-b830-4f01-a9e6-115a5c3eb281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20886bc0-0c72-4b52-a778-293275bc3fdf", "name": "network-vif-deleted", "tag": "adb005b3-a91f-4946-b07b-0a35829acfc2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:19:59.218768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-af360828-883d-47fc-80dd-1168a18195ac req-11f227fa-b830-4f01-a9e6-115a5c3eb281 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:59.219890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-af360828-883d-47fc-80dd-1168a18195ac req-11f227fa-b830-4f01-a9e6-115a5c3eb281 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:59.250512 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-af360828-883d-47fc-80dd-1168a18195ac req-11f227fa-b830-4f01-a9e6-115a5c3eb281 service nova] Creating event network-vif-deleted:adb005b3-a91f-4946-b07b-0a35829acfc2 for instance 20886bc0-0c72-4b52-a778-293275bc3fdf on n-h2-845775-3 Jul 25 20:19:59.260889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-af360828-883d-47fc-80dd-1168a18195ac req-11f227fa-b830-4f01-a9e6-115a5c3eb281 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101174 Jul 25 20:19:59.262703 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1509/2977] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:19:59.454535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:19:59.455206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:19:59.455871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:19:59.456774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:19:59.457411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:19:59.531478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:59.532700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:59.534376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:19:59.539723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:19:59.626948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:19:59.646324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:19:59.685537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:19:59.689314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:19:59.861408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c75c66be-863b-4e43-afa8-5985232cf59f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.232418 Jul 25 20:19:59.863183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1469/2978] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:19:59.897347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c1568560-5564-4f18-9cfb-249c959ff6d3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:19:59.898932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c1568560-5564-4f18-9cfb-249c959ff6d3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.109761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:00.111723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.137698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.138378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.139299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.139840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.144574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1568560-5564-4f18-9cfb-249c959ff6d3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:00.158380 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c1568560-5564-4f18-9cfb-249c959ff6d3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1220 microversion: 2.1 time: 0.282663 Jul 25 20:20:00.166407 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] HTTP exception thrown: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Request method failure captured: Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 HTTP/1.1 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vrSRvdYtHW2r9GiHAvvBx8BEUPD5lOFnvD8m-B8Dy09kurJ8609WtjzSYwsRdNdRF6RV7w-iZS4rT9qMOzQO_rSX8313DX9__EGK0JwDriU3h6hnZZJKtmq403XxNTDJPlTN8V77oJIGYcY42ZGf4DPkHj1tXylsEaQF77a8w1ZUiQ Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 3beeac98dbb542eb9f5d0d6dd786597a Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3beeac98dbb542eb9f5d0d6dd786597a"}]}] Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 3beeac98dbb542eb9f5d0d6dd786597a Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1005708781-project Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 36fb42cdac504a3a889a0149a94d7cd4 Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781-project Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '65430964-7290-4e64-9e28-f2ce797b96d5'} Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:00.170108 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Returning 404 to user: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:00.177356 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7236f23a-c7b9-4d02-8cbb-581dd1943a61 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 404 len: 111 microversion: 2.1 time: 0.907466 Jul 25 20:20:00.179552 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1470/2979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:19:59 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1220 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:00.186868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:00.187128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1510/2980] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:19:59 2022] DELETE /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 111 bytes in 923 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:00.187509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.190428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:00.195957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:00.197806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.198715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.199807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.199931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.200656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.224845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.225400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.226378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.226819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.799397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:00.842363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95bff052-9750-4e96-8248-fc95bb5f86f2 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1527 microversion: 2.1 time: 0.660463 Jul 25 20:20:00.843772 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1471/2981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:00 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1527 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:00.868333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:00.875118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Action: 'update', calling method: >, body: {"server": {"name": "65430964-7290-4e64-9e28-f2ce797b96d5_new"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:00.879065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.883349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70093ca4-4cc3-47f3-928d-5e4d84717525 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1473 microversion: 2.1 time: 0.694405 Jul 25 20:20:00.886326 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1511/2982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:00 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1473 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:00.905821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.907348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.908386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.910349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.942136 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] HTTP exception thrown: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Request method failure captured: Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 HTTP/1.1 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 64 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrSRvdYtHW2r9GiHAvvBx8BEUPD5lOFnvD8m-B8Dy09kurJ8609WtjzSYwsRdNdRF6RV7w-iZS4rT9qMOzQO_rSX8313DX9__EGK0JwDriU3h6hnZZJKtmq403XxNTDJPlTN8V77oJIGYcY42ZGf4DPkHj1tXylsEaQF77a8w1ZUiQ Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 3beeac98dbb542eb9f5d0d6dd786597a Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3beeac98dbb542eb9f5d0d6dd786597a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3beeac98dbb542eb9f5d0d6dd786597a"}]}] Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 3beeac98dbb542eb9f5d0d6dd786597a Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1005708781-project Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 36fb42cdac504a3a889a0149a94d7cd4 Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1005708781-project Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "65430964-7290-4e64-9e28-f2ce797b96d5_new"}} Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '65430964-7290-4e64-9e28-f2ce797b96d5', 'body': {'server': {'name': '65430964-7290-4e64-9e28-f2ce797b96d5_new'}}} Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:20:00.944237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] Returning 404 to user: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ac4bb8c-a0ca-4942-8120-a02006715f00 tempest-ServersNegativeTestMultiTenantJSON-1005708781 tempest-ServersNegativeTestMultiTenantJSON-1005708781-project] 10.222.0.48 "PUT /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 404 len: 111 microversion: 2.1 time: 0.076925 Jul 25 20:20:00.958144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1472/2983] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:20:00 2022] PUT /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:00.966325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:00.967491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:00.990259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.991789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:00.995362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:00.995849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.087910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:01.192791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:01.200819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:01.229929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.230613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.242532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.246430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.301008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:01.424922 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63b66255-4ced-46fa-96ad-2c4685a082a6 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "DELETE /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 204 len: 0 microversion: 2.1 time: 0.467893 Jul 25 20:20:01.431950 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1512/2984] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:00 2022] DELETE /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:01.442175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:01.443885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:01.452224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.452973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.454151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.454788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.535376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:01.555487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef97a4e3-c773-4e3f-8d35-668e4eb97d48 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1224 microversion: 2.1 time: 0.370565 Jul 25 20:20:01.556295 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1473/2985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:01 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1224 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:01.772776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:01.786223 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-863863cd-adc5-4ed5-99f4-e6f442e961d9 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1533 microversion: 2.1 time: 0.350789 Jul 25 20:20:01.796935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1513/2986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:01 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1533 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:01.922170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:01.923081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:01.940913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.941862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:01.943616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:01.944655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.361190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:02.383538 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-994f154d-89c4-4e03-8813-2912ed17504a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1470 microversion: 2.1 time: 0.468944 Jul 25 20:20:02.384760 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1474/2987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:01 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:02.415249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:02.417149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:02.425328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.426173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.427251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.427953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.607074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:02.609531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:02.616483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.618971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.620526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.627822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.630924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0de0262-f743-4cb8-8a30-9125ad1b7f7e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "POST /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e/action" status: 202 len: 0 microversion: 2.1 time: 0.217395 Jul 25 20:20:02.631599 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1514/2988] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:20:02 2022] POST /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:20:02.664974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:02.671908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:02.695428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.695428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.697334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:02.700710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:02.976370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:03.001292 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ea13e00-f3db-4a7c-8864-6ec212ac4300 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1280 microversion: 2.1 time: 0.400971 Jul 25 20:20:03.018444 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1475/2989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:02 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1280 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:03.037668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:03.040169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:03.052461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:03.053599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:03.055153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:03.056175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:03.102126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:03.110953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20c3c85f-b8dd-4d87-ae8b-bee2f7e28592 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.474012 Jul 25 20:20:03.120076 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1515/2990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:02 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:03.328159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:03.342034 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a1f68906-6e1f-495a-9936-823b84bc2374 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1533 microversion: 2.1 time: 0.321278 Jul 25 20:20:03.343723 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1476/2991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:03 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1533 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:04.041693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:04.044235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:04.058865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:04.061578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.062510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.063730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.064593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.136144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:04.137106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:04.149880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.151094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.152696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.153342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.378964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:04.716269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:04.728811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:04.742840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e53fc659-54fb-4cf8-aea4-fa8398b290eb tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.707881 Jul 25 20:20:04.760165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1516/2992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:04 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:04.760725 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d99c6609-3eed-4084-b206-692df1e74ed6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.624818 Jul 25 20:20:04.762486 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1477/2993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:04 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:04.768572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-plugged", "status": "completed", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:04.779208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:04.780176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:04.789044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.789882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.790461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.793268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.796107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:04.796564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:04.813048 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] Creating event network-vif-plugged:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h2-845775-3 Jul 25 20:20:04.821170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] Instance a6aef295-4586-4ad5-8472-d7425558e65e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:20:04.840538 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-84a579c2-0f69-4c13-82d8-e9a8310b88ff req-ee350a55-cc57-47d0-a0bb-1de5c127b28f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075197 Jul 25 20:20:04.842662 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1478/2994] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:05.195724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b4be02bcf5471bb56ea960fd42f826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12d48f33df4dbc8a23558dd42503fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:05.219400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8dfea990-d1ee-48fa-b30d-99ee6ad59b58 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 200 len: 1533 microversion: 2.1 time: 0.456932 Jul 25 20:20:05.223182 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1517/2995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:04 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 1533 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:05.461318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f5dcfcb8-b9cf-4dbc-aba5-d7ceb0f4a4a3 req-4b2a2145-33bf-4fb6-971a-c224cf494b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65430964-7290-4e64-9e28-f2ce797b96d5", "name": "network-vif-deleted", "tag": "0cd58aab-b294-4d96-a1c4-81b5eada6b3f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:05.509150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f5dcfcb8-b9cf-4dbc-aba5-d7ceb0f4a4a3 req-4b2a2145-33bf-4fb6-971a-c224cf494b2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:05.510589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f5dcfcb8-b9cf-4dbc-aba5-d7ceb0f4a4a3 req-4b2a2145-33bf-4fb6-971a-c224cf494b2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:05.569795 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f5dcfcb8-b9cf-4dbc-aba5-d7ceb0f4a4a3 req-4b2a2145-33bf-4fb6-971a-c224cf494b2e service nova] Creating event network-vif-deleted:0cd58aab-b294-4d96-a1c4-81b5eada6b3f for instance 65430964-7290-4e64-9e28-f2ce797b96d5 on n-h1-845775-3 Jul 25 20:20:05.592142 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f5dcfcb8-b9cf-4dbc-aba5-d7ceb0f4a4a3 req-4b2a2145-33bf-4fb6-971a-c224cf494b2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142634 Jul 25 20:20:05.595230 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1479/2996] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:05.769474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:05.770889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:05.780323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:05.782711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:05.783423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:05.784626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:05.785337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:05.800237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:05.804724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:05.831332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:05.832160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:05.833143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:05.833810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:06.690827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:06.716558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-14136eae-593a-46c1-95a3-c9adf4290c05 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.926018 Jul 25 20:20:06.720078 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1480/2997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:05 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:06.735220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:06.737370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] [instance: 65430964-7290-4e64-9e28-f2ce797b96d5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:06.751279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:06.763107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:06.764957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:06.766653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:06.767771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:06.774636 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4a2ac1b-f276-47dc-8aec-24134dea0f31 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 1.009788 Jul 25 20:20:06.777274 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1518/2998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:05 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:06.824382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] HTTP exception thrown: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Request method failure captured: Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 HTTP/1.1 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vq9ij4iR--_oechdieDdFvGVnjTjH9SIQ_3i_oaPQfMiUWODj0cC69ah7BdUg32yiCdkiR9lnfNs44XPq-krMe3HXPd-KnvIgsS8DnxyCXurcF9Ek8Mv3IMiPDrZnYI5cWkdYG6qzMctESrv7J-0GlotakNEgZKwkKz_joNwwfS8Zg Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 9d12d48f33df4dbc8a23558dd42503fe Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1934595715 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d12d48f33df4dbc8a23558dd42503fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d12d48f33df4dbc8a23558dd42503fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d12d48f33df4dbc8a23558dd42503fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d12d48f33df4dbc8a23558dd42503fe"}]}] Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1934595715 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 9d12d48f33df4dbc8a23558dd42503fe Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1934595715 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1934595715-project Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 15b4be02bcf5471bb56ea960fd42f826 Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1934595715-project Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '65430964-7290-4e64-9e28-f2ce797b96d5'} Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:06.826319 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] Returning 404 to user: Instance 65430964-7290-4e64-9e28-f2ce797b96d5 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82a1c42c-a2f6-4077-a0ce-ec528fcef938 tempest-ServersNegativeTestMultiTenantJSON-1934595715 tempest-ServersNegativeTestMultiTenantJSON-1934595715-project] 10.222.0.48 "GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5" status: 404 len: 111 microversion: 2.1 time: 0.105989 Jul 25 20:20:06.833723 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1481/2999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:06 2022] GET /compute/v2.1/servers/65430964-7290-4e64-9e28-f2ce797b96d5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:07.080475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-55571fe9-af1c-4552-8456-5aa490756326 req-08b6fdb8-0068-43c3-ba71-169eb1d27e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dcffe15-71ea-45b3-a197-6f381f61a4eb", "tag": "63ebebcf-9978-4ee6-9c60-41986ae21993"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:07.098888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55571fe9-af1c-4552-8456-5aa490756326 req-08b6fdb8-0068-43c3-ba71-169eb1d27e78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:07.100020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55571fe9-af1c-4552-8456-5aa490756326 req-08b6fdb8-0068-43c3-ba71-169eb1d27e78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:07.134425 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-55571fe9-af1c-4552-8456-5aa490756326 req-08b6fdb8-0068-43c3-ba71-169eb1d27e78 service nova] Creating event network-changed:63ebebcf-9978-4ee6-9c60-41986ae21993 for instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb on n-h2-845775-3 Jul 25 20:20:07.144530 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-55571fe9-af1c-4552-8456-5aa490756326 req-08b6fdb8-0068-43c3-ba71-169eb1d27e78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072270 Jul 25 20:20:07.153219 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1519/3000] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:07.753240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:07.754551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:07.771769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:07.772940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:07.776226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:07.779906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:07.816393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:07.817801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:07.830491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:07.835691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:07.837364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:07.838042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:08.552368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:08.596102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35d82dfa-fce0-4511-a0c2-532313a9cb73 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.836606 Jul 25 20:20:08.601465 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1482/3001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:07 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:08.656774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:08.693481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-310e1df4-a823-489b-915c-503751b6321d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.881816 Jul 25 20:20:08.695215 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1520/3002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:07 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:09.644633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:09.646698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:09.654668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:09.660452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:09.661108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:09.662109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:09.662810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:09.727560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:09.728363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:09.747688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:09.748221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:09.752520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:09.754847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:10.111329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:10.122719 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a265c9fb-5783-45c8-9ad0-9b455e02b1ff tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.491869 Jul 25 20:20:10.128487 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1483/3003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:09 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:10.197363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:10.227966 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86b6f68d-6dca-494f-ad51-850e8d2b0fd7 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.507103 Jul 25 20:20:10.228787 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1521/3004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:09 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:11.157315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:11.159198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:11.162073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:11.174312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:11.175407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:11.176442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:11.177367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:11.257074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:11.259234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:11.276580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:11.277651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:11.279204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:11.279965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:11.564447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:11.581466 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-124c1052-6f03-40d5-a8ba-ca5429c78c9e tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.431997 Jul 25 20:20:11.583206 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1484/3005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:11 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:11.653863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:11.686667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ae54841-3191-49ba-8e2f-d9a83450a2ef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.435183 Jul 25 20:20:11.688910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1522/3006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:11 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:12.623797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:12.624751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:12.637819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:12.639201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:12.641174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:12.642139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:12.722544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:12.725842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:12.742540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:12.744129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:12.747851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:12.749676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:12.927387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:12.945244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-86f76305-572f-4d54-97e5-e3c5d330202d tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.328139 Jul 25 20:20:12.957186 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1485/3007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:12 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:12.977112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-unplugged", "status": "completed", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:12.994955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:12.995768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:13.029240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] Creating event network-vif-unplugged:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:20:13.041155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] Instance a6aef295-4586-4ad5-8472-d7425558e65e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:20:13.067030 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c90f0aa4-81d9-44c6-9fc5-e838a669fd45 req-69e014f7-a239-49d2-aae8-f03ee8b7a0b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104060 Jul 25 20:20:13.068909 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1486/3008] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:13.069130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:13.083490 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c868363-3f4a-404b-879d-0b61e3b8697d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.370433 Jul 25 20:20:13.085866 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1523/3009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:12 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:13.986912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:13.990213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:14.006092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:14.006852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:14.008201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:14.009571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:14.140769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:14.142334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:14.157453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:14.162013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:14.164491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:14.165162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:14.402002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:14.420588 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19a6d0b1-3b62-4cd7-a435-599655b42f71 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.444377 Jul 25 20:20:14.426054 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1487/3010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:13 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:14.482964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:14.507279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eeb88f72-d3fd-46b3-bb85-9f6935c80e25 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.388456 Jul 25 20:20:14.507918 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1524/3011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:14 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:15.454804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:15.455544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:15.466819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:15.467174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:15.474054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:15.482291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:15.488846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:15.530485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:15.541287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:15.587355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] Creating event network-changed:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:20:15.601433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] Instance a6aef295-4586-4ad5-8472-d7425558e65e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:20:15.633173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e0c3f160-ec7e-4b01-9abb-17ad86be8fee req-daee45d1-4deb-4756-83b7-57753ecdc0f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155789 Jul 25 20:20:15.635695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1525/3012] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:15.672990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:15.673901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:15.698755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:15.699224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:15.700611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:15.701090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:16.489200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:16.513981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:16.528402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e696b31d-ded2-43f0-be5f-4f9e19a9fa98 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 1.077914 Jul 25 20:20:16.530071 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bb3b0361-8455-485b-bcb2-f6f5541f483f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.889357 Jul 25 20:20:16.533692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1488/3013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:15 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:16.554794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1526/3014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:15 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:17.578738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:17.580439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:17.587327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:17.589892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:17.592908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:17.593563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:17.595569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:17.596943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:17.615204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:17.616444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:17.620490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:17.625123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:17.626235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:18.375238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:18.415018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fdac6474-d583-4bae-b188-91fb152ee370 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 0.844202 Jul 25 20:20:18.426955 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1489/3015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:17 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:18.453558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3b3be189-851c-48a4-b3cf-6e202808113b req-f4aee90b-ac74-4386-bb4d-9324bf34aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcffe15-71ea-45b3-a197-6f381f61a4eb", "name": "network-vif-plugged", "status": "completed", "tag": "63ebebcf-9978-4ee6-9c60-41986ae21993"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:18.461220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:18.475145 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58019c4f-6148-4449-949e-311500419c74 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 0.893121 Jul 25 20:20:18.499995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1527/3016] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:17 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:18.504144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3b3be189-851c-48a4-b3cf-6e202808113b req-f4aee90b-ac74-4386-bb4d-9324bf34aac1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:18.504954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3b3be189-851c-48a4-b3cf-6e202808113b req-f4aee90b-ac74-4386-bb4d-9324bf34aac1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:18.532692 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3b3be189-851c-48a4-b3cf-6e202808113b req-f4aee90b-ac74-4386-bb4d-9324bf34aac1 service nova] Creating event network-vif-plugged:63ebebcf-9978-4ee6-9c60-41986ae21993 for instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb on n-h2-845775-3 Jul 25 20:20:18.539304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3b3be189-851c-48a4-b3cf-6e202808113b req-f4aee90b-ac74-4386-bb4d-9324bf34aac1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105027 Jul 25 20:20:18.541016 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1490/3017] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:19.450936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:19.455801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:19.531201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:19.547549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:19.548290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:19.555757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:19.566772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:19.574052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:19.609792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:19.614547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:19.618953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:19.624882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:20.446157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:20.450984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:20.481423 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c393d950-ca1e-4577-8346-560bc2b1dd77 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1469 microversion: 2.1 time: 1.045129 Jul 25 20:20:20.485059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1528/3018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:19 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1469 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:20.520753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:20.543202 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52d7243b-0c27-4797-8070-63f9cc720dcc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1320 microversion: 2.1 time: 1.036794 Jul 25 20:20:20.548109 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1491/3019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:19 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1320 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:21.530856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:21.531624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:21.554189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:21.555085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:21.556337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:21.557877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:21.586649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:21.588304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:21.605850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:21.607702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:21.609330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:21.611306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:22.540907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:22.554998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-988ea11b-63b6-4747-ba48-53684e96eae6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1501 microversion: 2.1 time: 0.973634 Jul 25 20:20:22.578605 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1492/3020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:21 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1501 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:22.596165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:22.605262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:22.606059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:22.612642 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff964334-7540-452e-a661-72a207a55be6 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1462 microversion: 2.1 time: 1.099090 Jul 25 20:20:22.613635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1529/3021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:21 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1462 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:22.615341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:22.615981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:22.616859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:22.617513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:23.032049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:23.039219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:23.074609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:23.091147 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22cf96e4-f89a-4416-aa79-ae659581b2c2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1501 microversion: 2.1 time: 0.492214 Jul 25 20:20:23.093338 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1493/3022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:22 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:23.097726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:23.098759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:23.100918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:23.106271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:23.131232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:23.132498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:23.167784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:23.170016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:23.171008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:23.184812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:23.263382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:23.622707 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1253361-0476-4363-9444-36a8489b4254 tempest-MigrationsAdminTest-1636942488 tempest-MigrationsAdminTest-1636942488-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1613 microversion: 2.1 time: 0.989910 Jul 25 20:20:23.627097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1530/3023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:22 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1613 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:23.819733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-962034382", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "c441f576-3b14-43c7-9126-13e4c642602e"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:23.997970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] validate_networks() for [('c441f576-3b14-43c7-9126-13e4c642602e', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:20:24.113061 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10af91ab-19ed-4aaa-b86f-88d0677247f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 204 len: 0 microversion: 2.1 time: 0.988610 Jul 25 20:20:24.119234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1494/3024] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:23 2022] DELETE /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 0 bytes in 992 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:24.128321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:24.129367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:24.137354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:24.138503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:24.140614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:24.141295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:24.195443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:24.404744 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-558d87eb-6a0c-490b-9a10-d28cf5dce3c9 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 204 len: 0 microversion: 2.1 time: 0.277179 Jul 25 20:20:24.408576 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1495/3025] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:24 2022] DELETE /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:24.439387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:24.442262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:24.461539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:24.462032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:24.465585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:24.466076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:25.112782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:25.157055 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ba7eb603-4dbf-4981-958f-897fcdfe2783 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1507 microversion: 2.1 time: 0.742263 Jul 25 20:20:25.173268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1496/3026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:24 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:25.205856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f261cd25-1793-445c-8341-cbf8ae6d73a5 req-a491900a-dae9-43cc-aa38-261cbeb79e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-plugged", "status": "completed", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:25.250576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f261cd25-1793-445c-8341-cbf8ae6d73a5 req-a491900a-dae9-43cc-aa38-261cbeb79e32 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:25.251316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f261cd25-1793-445c-8341-cbf8ae6d73a5 req-a491900a-dae9-43cc-aa38-261cbeb79e32 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:25.303091 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f261cd25-1793-445c-8341-cbf8ae6d73a5 req-a491900a-dae9-43cc-aa38-261cbeb79e32 service nova] Creating event network-vif-plugged:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:20:25.326921 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f261cd25-1793-445c-8341-cbf8ae6d73a5 req-a491900a-dae9-43cc-aa38-261cbeb79e32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150528 Jul 25 20:20:25.327876 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1497/3027] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:25.345910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:25.346694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:25.363436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:25.363886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:25.364722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:25.368255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:25.908393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:20:25.913607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:20:25.914444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:20:25.915119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:20:25.915941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:20:25.936102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:25.937392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:25.938588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:25.939638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:26.023803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Getting quotas for project ba72bf5485d140b3b643d4061a0b870a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:20:26.062122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Getting quotas for user 80a1f178785743e0a8f55cf2653a13e5 and project ba72bf5485d140b3b643d4061a0b870a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:20:26.101326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:20:26.104822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:20:26.116028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:26.139953 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-342bee28-7c06-4e8a-8cdf-fc624775998b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1468 microversion: 2.1 time: 0.810756 Jul 25 20:20:26.154659 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1498/3028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:25 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1468 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:26.204105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:26.205350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:26.224288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:26.224866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:26.225994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:26.226599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:26.263907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9190f43a-8e86-4cca-95ce-adbcbd91e79d tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.632179 Jul 25 20:20:26.265066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1531/3029] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:20:26.283827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b76ebd76-107c-41b4-9987-ddbf8216f664 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:26.287384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b76ebd76-107c-41b4-9987-ddbf8216f664 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:26.610054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b76ebd76-107c-41b4-9987-ddbf8216f664 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:26.646386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b76ebd76-107c-41b4-9987-ddbf8216f664 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1223 microversion: 2.1 time: 0.366075 Jul 25 20:20:26.651141 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1532/3030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:26 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1223 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:27.188948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:27.190602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:27.214248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:27.221222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:27.222666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:27.223558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:27.321230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:27.350680 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-459f687c-3f44-493a-be59-383ba40552e8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1507 microversion: 2.1 time: 1.150885 Jul 25 20:20:27.366532 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1499/3031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:26 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1507 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:27.679572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:27.680655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:27.693856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:27.706121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:27.707826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:27.708594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:28.256247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:28.271749 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac546d92-8c5d-4173-9d78-1607eaa03778 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1227 microversion: 2.1 time: 0.596936 Jul 25 20:20:28.284161 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1500/3032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:27 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1227 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:28.310487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-164d0441-77ef-4869-9835-e27b282f71a8 req-96b79f84-3430-4719-bf0d-ef0c983f6c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6aef295-4586-4ad5-8472-d7425558e65e", "name": "network-vif-deleted", "tag": "b9017b20-9c02-4d03-a961-9875d7034d4d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:28.347829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-164d0441-77ef-4869-9835-e27b282f71a8 req-96b79f84-3430-4719-bf0d-ef0c983f6c1c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:28.349322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-164d0441-77ef-4869-9835-e27b282f71a8 req-96b79f84-3430-4719-bf0d-ef0c983f6c1c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:28.401958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-164d0441-77ef-4869-9835-e27b282f71a8 req-96b79f84-3430-4719-bf0d-ef0c983f6c1c service nova] Creating event network-vif-deleted:b9017b20-9c02-4d03-a961-9875d7034d4d for instance a6aef295-4586-4ad5-8472-d7425558e65e on n-h1-845775-3 Jul 25 20:20:28.418794 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-164d0441-77ef-4869-9835-e27b282f71a8 req-96b79f84-3430-4719-bf0d-ef0c983f6c1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130591 Jul 25 20:20:28.422294 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1501/3033] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:28.434942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:28.448967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:28.470742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:28.471487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:28.481429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:28.482508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:28.608913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:28.640404 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3ed700d-ba0b-4a81-ab2f-30a050d2a541 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 200 len: 1468 microversion: 2.1 time: 1.459168 Jul 25 20:20:28.649302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1533/3034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:27 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 1468 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:29.317876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:29.318832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:29.327585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.329377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.330646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.331340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.585787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:29.605703 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b42703bd-103f-4186-89f1-f52fd284666b tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1281 microversion: 2.1 time: 0.293765 Jul 25 20:20:29.611086 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1534/3035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:29 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:29.629586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c42b2b88-9dd0-4e4e-97df-83d90ad464bf req-316160dc-6698-4de6-a703-4c2ae92b01fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcffe15-71ea-45b3-a197-6f381f61a4eb", "name": "network-vif-deleted", "tag": "63ebebcf-9978-4ee6-9c60-41986ae21993"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:29.657956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:29.679977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c42b2b88-9dd0-4e4e-97df-83d90ad464bf req-316160dc-6698-4de6-a703-4c2ae92b01fe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.682998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c42b2b88-9dd0-4e4e-97df-83d90ad464bf req-316160dc-6698-4de6-a703-4c2ae92b01fe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.701866 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78e2a89d-1833-40e8-9917-35b0cf8e7fba tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 200 len: 1507 microversion: 2.1 time: 1.272623 Jul 25 20:20:29.707209 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1502/3036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:28 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 1507 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:29.729956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c42b2b88-9dd0-4e4e-97df-83d90ad464bf req-316160dc-6698-4de6-a703-4c2ae92b01fe service nova] Creating event network-vif-deleted:63ebebcf-9978-4ee6-9c60-41986ae21993 for instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb on n-h2-845775-3 Jul 25 20:20:29.745064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c42b2b88-9dd0-4e4e-97df-83d90ad464bf req-316160dc-6698-4de6-a703-4c2ae92b01fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120417 Jul 25 20:20:29.748608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:29.749350 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1535/3037] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:29.749544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: a6aef295-4586-4ad5-8472-d7425558e65e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:29.792690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.798634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:29.800685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.815248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.816633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:29.819865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.820953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Searching by: {'deleted': False, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:20:29.843428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.845993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.851150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.852435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.899988 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] HTTP exception thrown: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Request method failure captured: Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e HTTP/1.1 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vmk2psjhtgKyoaGgUXPunUDLwxNvHaB_OkaOSG6hICEb0o2oyDgBTEwU2NkFCAnriFeLZWjBfDwuHz_E02MvVNbPolZFIjBvJEXB1mtm9RukZJaSKzDNdkurw4oWk9FECIKxiHWngEPiraPXylUfMEVcKYh1IRvM2AG3QLsoszZwx0 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_68fb52420238467eb822db188e9b1416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/68fb52420238467eb822db188e9b1416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}] Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 418b129a58aa475fa1066c4b7a8fccf6 Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a6aef295-4586-4ad5-8472-d7425558e65e'} Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:29.905802 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Returning 404 to user: Instance a6aef295-4586-4ad5-8472-d7425558e65e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c2ace69-3f8c-4d1e-a95c-cd966c8e8ed5 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e" status: 404 len: 111 microversion: 2.1 time: 0.198493 Jul 25 20:20:29.915310 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1503/3038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:29 2022] GET /compute/v2.1/servers/a6aef295-4586-4ad5-8472-d7425558e65e => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:29.921040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:29.922538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:29.930532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:20:29.934982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.935493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:29.936579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:29.937458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.002265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:30.029031 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b046d29b-1dfe-4f82-9a6c-1824b7c6101f tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.236691 Jul 25 20:20:30.033989 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1536/3039] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:20:29 2022] GET /compute/v2.1/servers => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:30.049442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:30.069406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:30.073092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Searching by: {'deleted': False, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:20:30.087861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.088713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:30.091610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.094864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.097341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.167957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:20:30.183246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e6432cd8-7bfa-4118-93c7-46db6ff5acee tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 204 len: 0 microversion: 2.1 time: 0.265607 Jul 25 20:20:30.184824 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1504/3040] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:29 2022] DELETE /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:30.201188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:30.203172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:30.210491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:30.217706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.218772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.219671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.220303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.260150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:30.271199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.272292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.865702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:30.895736 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6a2d00a-0736-40c1-908b-1cb2a0850a62 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1534 microversion: 2.1 time: 0.705296 Jul 25 20:20:30.900278 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1505/3041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:30 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1534 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:30.919079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:30.921675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:30.944152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.945981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:30.954418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:30.955614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:31.139975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2073497d-ea61-41f2-a4e2-e803e7bf6fbf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.095655 Jul 25 20:20:31.140820 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1537/3042] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:20:30 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:31.164730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:31.166237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:31.191835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:31.193011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:31.198506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:31.200516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:31.258880 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb HTTP/1.1 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '5dcffe15-71ea-45b3-a197-6f381f61a4eb'} Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:31.264280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1bfd4390-8987-4ffb-845a-172fab576038 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 404 len: 111 microversion: 2.1 time: 0.123919 Jul 25 20:20:31.271227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1538/3043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:31 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:31.302652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bde06b7b-0bce-4e47-b8dc-9b3b1ada166d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:31.319010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bde06b7b-0bce-4e47-b8dc-9b3b1ada166d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019838 Jul 25 20:20:31.319931 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1539/3044] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:20:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:31.335179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5d04b64-6b03-41da-9aab-3b6045ef27b4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: .version_select at 0x7f1968d4ee50>, body: {"keypair": {"name": "tempest-key-1820042785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Mq5GAPHXb2cHFuTWJ9PDWdikTRnk7TWnX9u/bSonTMOgP+vztrubgJTCJyGGU+dNUDGS7lDQgRyNemfpmM6g0Iv/k/I3ORcoX67LSAor21RNl65cdy+W/3hnNo/oldA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:31.336993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:31.376364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63e1f867-1529-4af1-9b0c-e1fe565394eb tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 0.469490 Jul 25 20:20:31.381375 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1506/3045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:30 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:31.399024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c5d04b64-6b03-41da-9aab-3b6045ef27b4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:20:31.423408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c5d04b64-6b03-41da-9aab-3b6045ef27b4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:20:31.495977 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5d04b64-6b03-41da-9aab-3b6045ef27b4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.164450 Jul 25 20:20:31.497330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1540/3046] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:20:31 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:31.512010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1a232ef4-9693-4bd8-bc97-1b6f38e67a07 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '.version_select at 0x7f1969530160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:31.541287 n-d-845775-3 devstack@n-api.service[119723]: WARNING oslo_db.sqlalchemy.utils [None req-1a232ef4-9693-4bd8-bc97-1b6f38e67a07 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 25 20:20:31.568602 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1a232ef4-9693-4bd8-bc97-1b6f38e67a07 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.063383 Jul 25 20:20:31.588678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1507/3047] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:20:31 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:31.728492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:31.729725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:31.750906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:31.753358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:31.756931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:31.765545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:31.774833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1088867293", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-key-1820042785", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:31.807599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:31.939792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:20:32.044430 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c921168-7407-4527-9d2e-2a22527eb256 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 204 len: 0 microversion: 2.1 time: 0.324987 Jul 25 20:20:32.046364 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1541/3048] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:31 2022] DELETE /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:32.059919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:32.060657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:32.102264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:32.102945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:32.105865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:32.105865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:32.816712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:32.833901 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c5fe206-487f-4ad2-adb5-a50bf7f5c53c tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1534 microversion: 2.1 time: 0.784132 Jul 25 20:20:32.841770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1542/3049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:32 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1534 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:32.851871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:32.855254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:32.866185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:32.866811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:32.868027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:32.870065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.400706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:33.424007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0dc2b6f6-d765-458d-9ba3-3577fd848ecc tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1609 microversion: 2.1 time: 0.580259 Jul 25 20:20:33.430288 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1543/3050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:32 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1609 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:33.444522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:33.455184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:33.470505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.471375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.472382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.473025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.709852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:20:33.710477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:20:33.711038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:20:33.711578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:20:33.712176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:20:33.730320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.731540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.733101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.733975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.794393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:20:33.807891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:20:33.850415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:20:33.855805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:20:33.880430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:33.906363 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ced2ecd0-057b-4c27-98fa-c7e0435995fc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.474421 Jul 25 20:20:33.911148 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1544/3051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:33 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:33.924672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:33.927880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:33.950226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.953039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:33.955673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:33.956805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:34.006264 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ae0c0b9-0ee5-434f-96f4-82850c58a957 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237316 Jul 25 20:20:34.014310 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1508/3052] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:20:34.025748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-592d3400-d72b-4a03-b7ea-036bee296644 req-970f005f-f4c2-426a-9354-31732098a9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a81406b-ee65-4f2c-b4ee-eedd317dfac0", "name": "network-vif-deleted", "tag": "1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:34.059761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-592d3400-d72b-4a03-b7ea-036bee296644 req-970f005f-f4c2-426a-9354-31732098a9a3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:34.072837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-592d3400-d72b-4a03-b7ea-036bee296644 req-970f005f-f4c2-426a-9354-31732098a9a3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:34.119604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-592d3400-d72b-4a03-b7ea-036bee296644 req-970f005f-f4c2-426a-9354-31732098a9a3 service nova] Creating event network-vif-deleted:1dd09f23-5855-4ba2-8bf0-9c581ed9b2bc for instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 on n-h1-845775-3 Jul 25 20:20:34.135368 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-592d3400-d72b-4a03-b7ea-036bee296644 req-970f005f-f4c2-426a-9354-31732098a9a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120641 Jul 25 20:20:34.136694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1509/3053] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:34.160246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:34.161827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:34.186434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:34.187005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:34.188183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:34.189097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:34.298399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:34.299018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:34.299752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lazy-loading 'fault' on Instance uuid 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:20:35.065414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:35.084813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10e41c25-2027-42ba-8851-51b8abb2306b tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 200 len: 1368 microversion: 2.1 time: 0.936594 Jul 25 20:20:35.096270 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1510/3054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:34 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 1368 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:35.096270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:35.096270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:35.117491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.117962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.118759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.119242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.496857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:35.515285 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55496fe1-0463-4d06-a9b0-df088b9883f9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 1.599848 Jul 25 20:20:35.519534 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1545/3055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:33 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:35.532004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:35.533022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:35.539215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:35.542234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.542961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.544013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.544310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.654858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:35.673180 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e3f2b68-f4fb-44a6-bb80-731968aa7f5f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.584995 Jul 25 20:20:35.693561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:35.698136 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1511/3056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:35 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:35.702555 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd090b99-0bcb-491a-974d-c1f7c9aadea3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1281 microversion: 2.1 time: 0.181377 Jul 25 20:20:35.703646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1546/3057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:35 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:35.710393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:35.711515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:35.712116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e708a373-ea4f-45a6-a89f-737fe7ffb149 req-e1c6712a-4d1d-4266-9ba7-8bb0798efd55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:35.736787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e708a373-ea4f-45a6-a89f-737fe7ffb149 req-e1c6712a-4d1d-4266-9ba7-8bb0798efd55 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.738155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e708a373-ea4f-45a6-a89f-737fe7ffb149 req-e1c6712a-4d1d-4266-9ba7-8bb0798efd55 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.740972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.746053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.747604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.762087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.764774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e708a373-ea4f-45a6-a89f-737fe7ffb149 req-e1c6712a-4d1d-4266-9ba7-8bb0798efd55 service nova] Creating event network-changed:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:20:35.777010 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e708a373-ea4f-45a6-a89f-737fe7ffb149 req-e1c6712a-4d1d-4266-9ba7-8bb0798efd55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075768 Jul 25 20:20:35.778209 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1512/3058] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:35.785539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-320aae00-4c6c-4ebe-a5ee-4aae077ca5c2 req-8936bd0e-8e1e-4fd1-95ac-9ecba59103f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4b8b91-f265-41bf-b736-59d30f678d53", "name": "network-vif-unplugged", "status": "completed", "tag": "dc207114-b6cf-4e4f-bbbe-f0a14731e300"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:35.797861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-320aae00-4c6c-4ebe-a5ee-4aae077ca5c2 req-8936bd0e-8e1e-4fd1-95ac-9ecba59103f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.798443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-320aae00-4c6c-4ebe-a5ee-4aae077ca5c2 req-8936bd0e-8e1e-4fd1-95ac-9ecba59103f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.825627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-320aae00-4c6c-4ebe-a5ee-4aae077ca5c2 req-8936bd0e-8e1e-4fd1-95ac-9ecba59103f4 service nova] Creating event network-vif-unplugged:dc207114-b6cf-4e4f-bbbe-f0a14731e300 for instance ff4b8b91-f265-41bf-b736-59d30f678d53 on n-h1-845775-3 Jul 25 20:20:35.842409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-320aae00-4c6c-4ebe-a5ee-4aae077ca5c2 req-8936bd0e-8e1e-4fd1-95ac-9ecba59103f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062495 Jul 25 20:20:35.843858 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1513/3059] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:35.857338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:35.860212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:35.872129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.873385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:35.875706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:35.876721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.584398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:36.587887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:36.610092 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-38337343-ae40-4288-ad18-d1edb0cdf449 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1609 microversion: 2.1 time: 0.904650 Jul 25 20:20:36.614953 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1547/3060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:35 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1609 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:36.632537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:36.633716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: 2a81406b-ee65-4f2c-b4ee-eedd317dfac0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:36.646939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.647399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.648321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.648771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.668521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] HTTP exception thrown: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Request method failure captured: Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 HTTP/1.1 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vmk2psjhtgKyoaGgUXPunUDLwxNvHaB_OkaOSG6hICEb0o2oyDgBTEwU2NkFCAnriFeLZWjBfDwuHz_E02MvVNbPolZFIjBvJEXB1mtm9RukZJaSKzDNdkurw4oWk9FECIKxiHWngEPiraPXylUfMEVcKYh1IRvM2AG3QLsoszZwx0 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_68fb52420238467eb822db188e9b1416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/68fb52420238467eb822db188e9b1416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}] Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 418b129a58aa475fa1066c4b7a8fccf6 Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2a81406b-ee65-4f2c-b4ee-eedd317dfac0'} Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:36.670684 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. Jul 25 20:20:36.675628 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:36.677917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Returning 404 to user: Instance 2a81406b-ee65-4f2c-b4ee-eedd317dfac0 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:36.679069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a27f050f-6798-4501-8a32-3958f54588cc tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0" status: 404 len: 111 microversion: 2.1 time: 0.062961 Jul 25 20:20:36.683895 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1548/3061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:36 2022] GET /compute/v2.1/servers/2a81406b-ee65-4f2c-b4ee-eedd317dfac0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:36.691960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:36.693458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:36.701258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.702071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.703036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.703653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.765550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:36.783795 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f590950-51c2-4dc1-aa5e-43a1b494c78d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.938352 Jul 25 20:20:36.785617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1514/3062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:35 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:36.793248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-02a4171d-8ffe-4318-827a-d6b9c5d3e462 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '.version_select at 0x7f196eade670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:36.841880 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-02a4171d-8ffe-4318-827a-d6b9c5d3e462 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722325294" status: 202 len: 0 microversion: 2.1 time: 0.054768 Jul 25 20:20:36.842492 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1515/3063] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722325294 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:20:36.855696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:36.856697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:36.872767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.873562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:36.874528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:36.875277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:37.155707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:37.156765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:37.182661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eaceef9e-bf2e-4b08-a3c6-2217634a4a47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1287 microversion: 2.1 time: 0.336683 Jul 25 20:20:37.183694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1516/3064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:36 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1287 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:37.191374 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4568d09b-853c-473d-a917-ff6c2a893d52 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 0.506018 Jul 25 20:20:37.192692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1549/3065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:36 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:37.203986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:37.204763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:37.221472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:37.221920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:37.223335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:37.223663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:37.649352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:37.651264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:37.672673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:37.674504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:37.677011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:37.677859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:37.957099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:37.987417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd6c66be-4c35-4c10-a9cf-8d87d03d72f5 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1541 microversion: 2.1 time: 0.354049 Jul 25 20:20:37.989604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1550/3066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:37 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1541 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:38.047454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:38.055521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f0eceec-7a64-48f7-9f18-29add6b8ea4d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.870732 Jul 25 20:20:38.056365 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1517/3067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:37 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:38.207007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:38.207727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:38.221594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:38.222138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:38.223454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:38.224191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-505649661", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "ea7c3422-34fd-4fb8-b7bc-60523dad31bd"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:38.224438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:38.353409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] validate_networks() for [('ea7c3422-34fd-4fb8-b7bc-60523dad31bd', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:20:38.767058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:38.799726 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7cac9d30-f5cc-442b-a9c4-d91544cae974 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1287 microversion: 2.1 time: 0.596686 Jul 25 20:20:38.804410 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1551/3068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:38 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1287 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:38.815465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:38.818185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:38.825710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:38.826164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:38.826962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:38.827412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:39.384741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:39.405449 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4975467f-e7a9-4155-93af-e54907b285c9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 0.595595 Jul 25 20:20:39.424074 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1552/3069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:38 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:39.456077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:39.458471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:39.472401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:39.472858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:39.480716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:39.481494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:39.769119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:39.779015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e562f0a-a39e-4be9-9800-64a468bb2c4c tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1541 microversion: 2.1 time: 0.350829 Jul 25 20:20:39.788342 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1553/3070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:39 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:39.812167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-93955d8c-1aed-4f60-8b4c-1479f0864ff3 req-5aed76c8-8895-4d6f-9f10-bd3c0431f790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4b8b91-f265-41bf-b736-59d30f678d53", "name": "network-vif-deleted", "tag": "dc207114-b6cf-4e4f-bbbe-f0a14731e300"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:39.858724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-93955d8c-1aed-4f60-8b4c-1479f0864ff3 req-5aed76c8-8895-4d6f-9f10-bd3c0431f790 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:39.859385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-93955d8c-1aed-4f60-8b4c-1479f0864ff3 req-5aed76c8-8895-4d6f-9f10-bd3c0431f790 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:39.912291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-93955d8c-1aed-4f60-8b4c-1479f0864ff3 req-5aed76c8-8895-4d6f-9f10-bd3c0431f790 service nova] Creating event network-vif-deleted:dc207114-b6cf-4e4f-bbbe-f0a14731e300 for instance ff4b8b91-f265-41bf-b736-59d30f678d53 on n-h1-845775-3 Jul 25 20:20:39.929541 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-93955d8c-1aed-4f60-8b4c-1479f0864ff3 req-5aed76c8-8895-4d6f-9f10-bd3c0431f790 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131982 Jul 25 20:20:39.938966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1554/3071] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:39.946257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:39.951500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:39.971175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:39.972894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:39.974029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:39.975470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:40.135126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:40.875042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:40.892894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a85ca9cc-7dc1-4f5c-96b3-cb6f747e9ca5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.950948 Jul 25 20:20:40.896875 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1555/3072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:39 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:40.904780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:40.911167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:40.929503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:40.930382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:40.934999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:40.937006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.021016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:41.181870 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42f7a7b1-19df-4780-99af-1177c90b7f35 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 204 len: 0 microversion: 2.1 time: 0.283029 Jul 25 20:20:41.183305 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1556/3073] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:40 2022] DELETE /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:41.192339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:41.193668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:41.202149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.203126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.204368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.205104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.423125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:20:41.424483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:20:41.425279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:20:41.426160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:20:41.427567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:20:41.446140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:41.456145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.456904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.459710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.460416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.536880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:20:41.552938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:20:41.574253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:20:41.579021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:20:41.741530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15f23c5d-7709-4a2a-b236-d419eca2c332 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.528198 Jul 25 20:20:41.742759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1518/3074] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:20:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:20:41.752019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:41.753369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:41.769161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.770030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:41.771600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:41.772743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:42.297931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:42.314918 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e6c39321-8a4f-425b-8cde-da69a6f0a4de tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1252 microversion: 2.1 time: 0.570096 Jul 25 20:20:42.319850 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1519/3075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:41 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1252 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:42.327992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:42.337681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:42.356419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:42.357570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:42.360952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:42.364645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:42.731006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:42.754707 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e4638da-71d4-4b10-a59b-73c3df025e50 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 1.568996 Jul 25 20:20:42.755743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1557/3076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:41 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:42.767931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fb00868-a185-4c49-8cde-2c38d219c2de tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:42.776085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fb00868-a185-4c49-8cde-2c38d219c2de tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:43.039132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5fb00868-a185-4c49-8cde-2c38d219c2de tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:43.100539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fb00868-a185-4c49-8cde-2c38d219c2de tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1214 microversion: 2.1 time: 0.338981 Jul 25 20:20:43.122548 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1558/3077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:42 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:43.130817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:43.147030 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7cd635a1-7c98-4e38-a267-879f31dfa90f tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1469 microversion: 2.1 time: 0.825615 Jul 25 20:20:43.147633 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1520/3078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:42 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1469 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:43.151099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:43.154641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:43.197589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.198058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:43.201858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.202404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:43.349508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:43.350140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:43.372787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.373201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:43.374016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.374461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:43.850150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:43.882619 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfc0c2cd-7726-4893-9fea-cddbc1f39a78 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1252 microversion: 2.1 time: 0.536675 Jul 25 20:20:43.904400 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1521/3079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:43 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1252 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:43.911817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:43.913963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:43.945140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.945910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:43.947356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:43.948626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.175339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:44.187330 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ed60c88-cd7b-4196-9819-6f045519d51a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 1.063494 Jul 25 20:20:44.190291 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1559/3080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:43 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:44.222731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ee204a35-0c6f-4d5b-af21-899b7c2bffe7 req-f90916f8-76c3-4e17-9b94-73e75045027f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "name": "network-vif-plugged", "status": "completed", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:44.243255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ee204a35-0c6f-4d5b-af21-899b7c2bffe7 req-f90916f8-76c3-4e17-9b94-73e75045027f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.251019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ee204a35-0c6f-4d5b-af21-899b7c2bffe7 req-f90916f8-76c3-4e17-9b94-73e75045027f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.284174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ee204a35-0c6f-4d5b-af21-899b7c2bffe7 req-f90916f8-76c3-4e17-9b94-73e75045027f service nova] Creating event network-vif-plugged:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:20:44.290168 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ee204a35-0c6f-4d5b-af21-899b7c2bffe7 req-f90916f8-76c3-4e17-9b94-73e75045027f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083321 Jul 25 20:20:44.291962 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1560/3081] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:44.526818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8082eb0a-ef5f-4f3b-8e6d-2ac9e6ae0109 tempest-ExtensionsTest-1844042559 tempest-ExtensionsTest-1844042559-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:44.528810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8082eb0a-ef5f-4f3b-8e6d-2ac9e6ae0109 tempest-ExtensionsTest-1844042559 tempest-ExtensionsTest-1844042559-project] 10.222.0.48 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.235115 Jul 25 20:20:44.529369 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1561/3082] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Jul 25 20:20:44 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:44.538627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:44.539373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:44.546721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.547495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.548513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.549152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.582725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:44.594489 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d2b3098-c5fc-4b1c-8acc-6b57981a2aa8 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 0.700841 Jul 25 20:20:44.605014 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1522/3083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:43 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:44.612391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:44.613585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:44.624716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.625621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.627301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.628490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.860478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:44.873958 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-141a1690-b2a2-4fe1-b295-763611e28d15 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1272 microversion: 2.1 time: 0.342168 Jul 25 20:20:44.876560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1562/3084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:44 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:44.886878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ec37413-3e35-4b31-9037-266b06d6039e tempest-ExtensionsTest-1844042559 tempest-ExtensionsTest-1844042559-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:44.895058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ec37413-3e35-4b31-9037-266b06d6039e tempest-ExtensionsTest-1844042559 tempest-ExtensionsTest-1844042559-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016306 Jul 25 20:20:44.898810 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1563/3085] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Jul 25 20:20:44 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:20:44.915358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:44.916777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:44.930700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.933348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:44.934459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:44.936324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.134481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:45.159969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a15e64bb-cbd3-48a5-8145-488ec6989d3e tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1252 microversion: 2.1 time: 0.248352 Jul 25 20:20:45.188081 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1564/3086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:44 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1252 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:45.214706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2aacc117-f6b0-47ec-8417-c8bffabac002 req-530059e5-200b-4fb2-a4a2-0b51b7b9afc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c26498-720c-4998-8207-5a9f9c6a4a26", "tag": "dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:45.246853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2aacc117-f6b0-47ec-8417-c8bffabac002 req-530059e5-200b-4fb2-a4a2-0b51b7b9afc0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.251017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2aacc117-f6b0-47ec-8417-c8bffabac002 req-530059e5-200b-4fb2-a4a2-0b51b7b9afc0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.287869 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2aacc117-f6b0-47ec-8417-c8bffabac002 req-530059e5-200b-4fb2-a4a2-0b51b7b9afc0 service nova] Creating event network-changed:dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f for instance c0c26498-720c-4998-8207-5a9f9c6a4a26 on n-h2-845775-3 Jul 25 20:20:45.300436 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2aacc117-f6b0-47ec-8417-c8bffabac002 req-530059e5-200b-4fb2-a4a2-0b51b7b9afc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108087 Jul 25 20:20:45.310185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1565/3087] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:45.326620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-375490bb-6552-44d9-8ea8-f637c7b9035b req-0ee4a867-5480-47b5-ae17-7753de6c0093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9f2220-88ae-4f89-87a1-de2f34ab3386", "name": "network-vif-deleted", "tag": "630286df-ed6d-4dc9-a286-1e0134417e4f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:45.369504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-375490bb-6552-44d9-8ea8-f637c7b9035b req-0ee4a867-5480-47b5-ae17-7753de6c0093 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.370306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-375490bb-6552-44d9-8ea8-f637c7b9035b req-0ee4a867-5480-47b5-ae17-7753de6c0093 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.428026 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-375490bb-6552-44d9-8ea8-f637c7b9035b req-0ee4a867-5480-47b5-ae17-7753de6c0093 service nova] Creating event network-vif-deleted:630286df-ed6d-4dc9-a286-1e0134417e4f for instance de9f2220-88ae-4f89-87a1-de2f34ab3386 on n-h2-845775-3 Jul 25 20:20:45.448389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-375490bb-6552-44d9-8ea8-f637c7b9035b req-0ee4a867-5480-47b5-ae17-7753de6c0093 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135515 Jul 25 20:20:45.453059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1566/3088] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:45.487219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:45.491841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:45.511156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.513332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.514348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.514894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.547073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:45.569911 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2c7ff7d3-0719-48d6-88fe-d631a72a6066 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 200 len: 1469 microversion: 2.1 time: 0.963228 Jul 25 20:20:45.589330 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1523/3089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:44 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 1469 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:45.625426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:45.626176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:45.639839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.640340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:45.641157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:45.646518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:46.674835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:46.693336 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-76cee63a-13d9-4196-8694-a76e66ffd7c8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 1.235030 Jul 25 20:20:46.701561 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1567/3090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:45 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:46.712260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:46.715199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:46.725503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:46.726451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:46.727651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:46.728971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:46.824989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:46.844769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2d643d7-7989-40d4-b6e7-8ee9848aa934 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1323 microversion: 2.1 time: 1.223654 Jul 25 20:20:46.845917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1524/3091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:45 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1323 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:46.851245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:46.852149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:46.859296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:46.859791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:46.860660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:46.861108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:46.889526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:46.954111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:46.964580 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8310446-ab5e-4754-84c9-b653e9bd8f78 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1272 microversion: 2.1 time: 0.260302 Jul 25 20:20:46.978189 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1568/3092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:46 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:46.987695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:46.989117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: de9f2220-88ae-4f89-87a1-de2f34ab3386] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:46.999110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:46.999823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.000851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.001492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.005233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:47.024548 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] HTTP exception thrown: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Request method failure captured: Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 HTTP/1.1 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vmk2psjhtgKyoaGgUXPunUDLwxNvHaB_OkaOSG6hICEb0o2oyDgBTEwU2NkFCAnriFeLZWjBfDwuHz_E02MvVNbPolZFIjBvJEXB1mtm9RukZJaSKzDNdkurw4oWk9FECIKxiHWngEPiraPXylUfMEVcKYh1IRvM2AG3QLsoszZwx0 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_68fb52420238467eb822db188e9b1416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/68fb52420238467eb822db188e9b1416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}] Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 418b129a58aa475fa1066c4b7a8fccf6 Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'de9f2220-88ae-4f89-87a1-de2f34ab3386'} Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:47.027671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. Jul 25 20:20:47.032779 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:47.033326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:47.035954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Returning 404 to user: Instance de9f2220-88ae-4f89-87a1-de2f34ab3386 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:47.037150 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41c08cf9-f096-4b69-9e36-9a1e2b50087a tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386" status: 404 len: 111 microversion: 2.1 time: 0.055102 Jul 25 20:20:47.038096 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1569/3093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:46 2022] GET /compute/v2.1/servers/de9f2220-88ae-4f89-87a1-de2f34ab3386 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:47.041407 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54590d7b-e594-4f1c-8dbe-465881808fb0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1252 microversion: 2.1 time: 0.193571 Jul 25 20:20:47.042012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1525/3094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:46 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1252 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:47.049264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:47.049776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:47.056547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.057316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.058447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.058964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.090376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:47.243262 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c395ce8-bcc9-4200-a92d-baf9b864daf4 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 204 len: 0 microversion: 2.1 time: 0.199310 Jul 25 20:20:47.247343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1570/3095] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:20:47 2022] DELETE /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:20:47.256159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:47.256892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:47.266161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.266959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.268141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.268636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.729867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:47.732542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:47.733598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:47.741892 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-67fffe90-5b15-4510-b7a6-426fd8021871 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1468 microversion: 2.1 time: 0.491488 Jul 25 20:20:47.745300 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1526/3096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:47 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1468 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:20:47.752270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.753018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.754292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:47.755002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:47.970703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc4dc58a-8be7-4b81-b34c-a22218df1611 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Action: 'create', calling method: .version_select at 0x7f196e99f5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1665201140", "metadata": {"Type": "work"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:48.132689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:48.142464 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f2b1300-143d-41fd-94ad-f37b06d70f85 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.422334 Jul 25 20:20:48.145132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1571/3097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:47 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:48.158828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:48.161814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:48.182784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:48.185094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:48.188408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:48.191949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:48.804728 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc4dc58a-8be7-4b81-b34c-a22218df1611 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.053118 Jul 25 20:20:48.820164 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1527/3098] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Jul 25 20:20:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1070 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 20:20:48.835604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:48.841104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:48.869192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:48.870333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:48.881552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:48.885707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:48.936730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:48.983649 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9e98a0c-114b-44a5-9b4e-2f6f7b30f6de tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1519 microversion: 2.1 time: 0.834594 Jul 25 20:20:48.987595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1572/3099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:48 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1519 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:49.037175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:49.041184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:49.060870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:49.061770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:49.063012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:49.063675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:49.317699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2003037f4b744b73907a004ccd142a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77666e0fc00c420c8536dd89e53c2d9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:49.317699 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28529b5a-2b18-4543-8465-7d7a7346a2cf tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 200 len: 1252 microversion: 2.1 time: 0.310945 Jul 25 20:20:49.317699 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1573/3100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:48 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 1252 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:49.320558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:49.321187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:49.342569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:49.343334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:49.344550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:49.349277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:49.680525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:49.693398 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ec086da-1cb3-4b21-9836-3a94f9bcd01c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 0.871448 Jul 25 20:20:49.698922 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1528/3101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:48 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:49.716715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b6df999-ef88-40a3-b721-5540888d107a tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f19694ea310>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:49.949508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b6df999-ef88-40a3-b721-5540888d107a tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 200 len: 353 microversion: 2.1 time: 0.249062 Jul 25 20:20:49.950512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1529/3102] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:20:49 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:49.962107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c2ba6ac-2ffb-4cd4-9d7d-8c3bef356bdd tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'create', calling method: .version_select at 0x7f19694b9f70>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:50.088570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418b129a58aa475fa1066c4b7a8fccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fb52420238467eb822db188e9b1416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:50.102991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-682bd49a-bc8c-447f-b1ec-64c2615edd54 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 200 len: 1468 microversion: 2.1 time: 0.796105 Jul 25 20:20:50.112148 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1574/3103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:49 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 1468 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:50.134312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:50.140370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:50.163630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:50.164112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:50.165164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:50.175897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:50.888502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:50.903466 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-862d50c5-7b63-4eae-b331-8ea13d448db5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.789501 Jul 25 20:20:50.916850 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1575/3104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:50 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:50.924132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:50.925202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] [instance: ff4b8b91-f265-41bf-b736-59d30f678d53] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:50.932146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:50.932957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:50.933976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:50.934641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:50.981233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] HTTP exception thrown: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Request method failure captured: Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 HTTP/1.1 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vqP6VL-SuJzLZSrvrehi6Fq2m6vSVWvi-i3aXo5am4woSRYE9s05Nj0QAjUPDA0B_TTua5H0e6PTt5cXkp65V52zRaa80zWLcH7NfS5bCOldqLSrbjjJMYeOA-t6VLyfVrAzfWFcGcqPwJYApL1HsXlPckzWhXgc_c6qkdX1vPPipw Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 77666e0fc00c420c8536dd89e53c2d9b Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestBootFromVolume-560530055 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77666e0fc00c420c8536dd89e53c2d9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77666e0fc00c420c8536dd89e53c2d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77666e0fc00c420c8536dd89e53c2d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77666e0fc00c420c8536dd89e53c2d9b"}]}] Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestBootFromVolume-560530055 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 77666e0fc00c420c8536dd89e53c2d9b Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestBootFromVolume-560530055 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestBootFromVolume-560530055-project Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2003037f4b744b73907a004ccd142a07 Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestBootFromVolume-560530055-project Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'ff4b8b91-f265-41bf-b736-59d30f678d53'} Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:50.985848 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:50.990120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Returning 404 to user: Instance ff4b8b91-f265-41bf-b736-59d30f678d53 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:50.991950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3a31e288-0a5c-4bd5-be2b-17d8cd20929d tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53" status: 404 len: 111 microversion: 2.1 time: 0.072503 Jul 25 20:20:51.001739 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1576/3105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:50 2022] GET /compute/v2.1/servers/ff4b8b91-f265-41bf-b736-59d30f678d53 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:51.012210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:51.013223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:51.033172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:51.034073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:51.037207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:51.038394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:51.485441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:51.567421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:52.034896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:52.073814 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e27cec0e-eda3-4982-9e9a-470a2b523c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 1.070624 Jul 25 20:20:52.110412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1577/3106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:51 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:52.124217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a1b3bdd-0cdb-4f75-bdfb-293edf983d71 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f1969b54e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:52.263328 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a1b3bdd-0cdb-4f75-bdfb-293edf983d71 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 200 len: 354 microversion: 2.1 time: 0.151274 Jul 25 20:20:52.264383 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1578/3107] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:20:52 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:52.269357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8cd49243-f92c-41ad-b329-97708e89c9f0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] Calling method '.version_select at 0x7f19697995e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:52.313028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8cd49243-f92c-41ad-b329-97708e89c9f0 tempest-ServersTestBootFromVolume-560530055 tempest-ServersTestBootFromVolume-560530055-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135680844" status: 202 len: 0 microversion: 2.1 time: 0.047304 Jul 25 20:20:52.314296 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1579/3108] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135680844 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:20:52.320453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:52.321344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] [instance: d130ca20-d3ad-4614-b482-f992c69dc8ce] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:52.337770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.339194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:52.345009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.346576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:52.367307 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] HTTP exception thrown: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Request method failure captured: Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce HTTP/1.1 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vmk2psjhtgKyoaGgUXPunUDLwxNvHaB_OkaOSG6hICEb0o2oyDgBTEwU2NkFCAnriFeLZWjBfDwuHz_E02MvVNbPolZFIjBvJEXB1mtm9RukZJaSKzDNdkurw4oWk9FECIKxiHWngEPiraPXylUfMEVcKYh1IRvM2AG3QLsoszZwx0 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_68fb52420238467eb822db188e9b1416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/68fb52420238467eb822db188e9b1416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/68fb52420238467eb822db188e9b1416"}]}] Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 68fb52420238467eb822db188e9b1416 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-MigrationsAdminTest-1984512409 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 418b129a58aa475fa1066c4b7a8fccf6 Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-MigrationsAdminTest-1984512409-project Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd130ca20-d3ad-4614-b482-f992c69dc8ce'} Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:20:52.369806 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. Jul 25 20:20:52.374277 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:20:52.376784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] Returning 404 to user: Instance d130ca20-d3ad-4614-b482-f992c69dc8ce could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:20:52.377871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dec6f848-edfb-4b79-9806-17565d3e92e1 tempest-MigrationsAdminTest-1984512409 tempest-MigrationsAdminTest-1984512409-project] 10.222.0.48 "GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce" status: 404 len: 111 microversion: 2.1 time: 0.062487 Jul 25 20:20:52.378968 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1580/3109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:52 2022] GET /compute/v2.1/servers/d130ca20-d3ad-4614-b482-f992c69dc8ce => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:20:52.403825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-388089ec-48ba-400f-bd86-857fbb061aea req-fc66c9e9-35ab-4d3a-be66-7807f5a02b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d130ca20-d3ad-4614-b482-f992c69dc8ce", "name": "network-vif-deleted", "tag": "8073a03d-0ff9-4bec-ace3-56d9e98dc3a6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:52.435668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-388089ec-48ba-400f-bd86-857fbb061aea req-fc66c9e9-35ab-4d3a-be66-7807f5a02b0f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.440294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-388089ec-48ba-400f-bd86-857fbb061aea req-fc66c9e9-35ab-4d3a-be66-7807f5a02b0f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:52.469522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-388089ec-48ba-400f-bd86-857fbb061aea req-fc66c9e9-35ab-4d3a-be66-7807f5a02b0f service nova] Creating event network-vif-deleted:8073a03d-0ff9-4bec-ace3-56d9e98dc3a6 for instance d130ca20-d3ad-4614-b482-f992c69dc8ce on n-h2-845775-3 Jul 25 20:20:52.485465 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-388089ec-48ba-400f-bd86-857fbb061aea req-fc66c9e9-35ab-4d3a-be66-7807f5a02b0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104855 Jul 25 20:20:52.489125 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1581/3110] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:52.508556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c67258dc-1ca9-4e55-bd8d-2b6f5c112b21 req-b6187abc-6fcf-4a92-955e-7e951a59ce13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29e8e9-e7c4-4844-b01d-729b44dc5201", "tag": "9eae7015-c528-4622-982d-387dafcee800"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:52.539077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c67258dc-1ca9-4e55-bd8d-2b6f5c112b21 req-b6187abc-6fcf-4a92-955e-7e951a59ce13 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.542333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c67258dc-1ca9-4e55-bd8d-2b6f5c112b21 req-b6187abc-6fcf-4a92-955e-7e951a59ce13 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:52.582862 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c67258dc-1ca9-4e55-bd8d-2b6f5c112b21 req-b6187abc-6fcf-4a92-955e-7e951a59ce13 service nova] Creating event network-changed:9eae7015-c528-4622-982d-387dafcee800 for instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 on n-h1-845775-3 Jul 25 20:20:52.599512 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c67258dc-1ca9-4e55-bd8d-2b6f5c112b21 req-b6187abc-6fcf-4a92-955e-7e951a59ce13 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104878 Jul 25 20:20:52.600661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1582/3111] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:52.942337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:52.942337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:52.958577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.959058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:52.959889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:52.964816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:53.020363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:20:53.052960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:53.212737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0073747d-af42-42fd-953c-50b4cb27fa27 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "DELETE /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 204 len: 0 microversion: 2.42 time: 0.607402 Jul 25 20:20:53.213727 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1583/3112] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:20:52 2022] DELETE /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:20:53.231726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:53.232476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:53.255714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:53.260194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:53.261405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:53.262161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:53.915212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:53.941723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b53fabe-9157-44c5-878d-21c2a9b2d79f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.713376 Jul 25 20:20:53.958557 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1584/3113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:53 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:53.958557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35f40251-6bd0-40a1-b943-f03b0180d9d7 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f1968c84f70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:54.091757 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35f40251-6bd0-40a1-b943-f03b0180d9d7 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 200 len: 354 microversion: 2.1 time: 0.145324 Jul 25 20:20:54.092964 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1585/3114] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:20:53 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:54.110114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:54.121410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:54.137677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:54.138143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:54.144998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:54.145478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:54.571453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:54.584589 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d6b3d24-1c0e-4cf8-a051-fab5a8d957dc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 0.490381 Jul 25 20:20:54.585429 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1586/3115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:54 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:54.594016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:54.605034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:54.615458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:54.616351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:54.617367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:54.622872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:55.187213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:55.206761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:55.216228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:55.218801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cda918c1-2cf1-4c41-b494-6211d8262c60 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2949 microversion: 2.42 time: 0.632119 Jul 25 20:20:55.219720 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1587/3116] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:20:54 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2949 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:20:55.224466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-83a16ac8-ff2c-44b1-93a5-dd99fabd22fb tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f1969b10790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:55.373887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-83a16ac8-ff2c-44b1-93a5-dd99fabd22fb tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 202 len: 0 microversion: 2.1 time: 0.152939 Jul 25 20:20:55.374582 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1588/3117] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:20:55 2022] DELETE /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:20:55.381832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:55.382711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:55.398379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:55.399397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:55.401617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:55.402402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:55.851329 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c2ba6ac-2ffb-4cd4-9d7d-8c3bef356bdd tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.899345 Jul 25 20:20:55.852260 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1530/3118] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:20:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:55.857878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-975a8af4-c7de-447b-948c-7e7531311f89 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f1969712a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:55.968907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-975a8af4-c7de-447b-948c-7e7531311f89 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 200 len: 353 microversion: 2.1 time: 0.115362 Jul 25 20:20:55.969887 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1531/3119] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:20:55 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:55.975250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:55.976527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:55.999154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:56.007686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:56.010915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:56.012658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:56.117152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:56.119758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:56.135355 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-edd4a32f-f15d-448a-aca5-98aef2e1d43b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.758908 Jul 25 20:20:56.157515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1589/3120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:55 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:56.175628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1943893237", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "c441f576-3b14-43c7-9126-13e4c642602e"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:56.234685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:20:56.367697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] validate_networks() for [('c441f576-3b14-43c7-9126-13e4c642602e', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:20:56.875796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:56.892870 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5c14be88-5352-468d-b74f-c20308561c9e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 0.920793 Jul 25 20:20:56.893760 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1532/3121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:55 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:56.914122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-843cf5e9-9c21-44fa-b331-309bf8a4be55 req-27148050-02b4-48ad-bf6e-640d6da9bf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c26498-720c-4998-8207-5a9f9c6a4a26", "name": "network-vif-plugged", "status": "completed", "tag": "dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:20:56.938802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-843cf5e9-9c21-44fa-b331-309bf8a4be55 req-27148050-02b4-48ad-bf6e-640d6da9bf29 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:56.941624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-843cf5e9-9c21-44fa-b331-309bf8a4be55 req-27148050-02b4-48ad-bf6e-640d6da9bf29 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:57.012345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-843cf5e9-9c21-44fa-b331-309bf8a4be55 req-27148050-02b4-48ad-bf6e-640d6da9bf29 service nova] Creating event network-vif-plugged:dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f for instance c0c26498-720c-4998-8207-5a9f9c6a4a26 on n-h2-845775-3 Jul 25 20:20:57.031226 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-843cf5e9-9c21-44fa-b331-309bf8a4be55 req-27148050-02b4-48ad-bf6e-640d6da9bf29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124535 Jul 25 20:20:57.031854 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1533/3122] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:57.060460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:57.064833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:57.118406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:57.119770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:57.153819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:57.157826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:58.673251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:58.698585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:58.709957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:58.711205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c64e1f4-7533-4379-aa11-70b1ac225cb4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2949 microversion: 2.42 time: 1.672315 Jul 25 20:20:58.714025 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1534/3123] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:20:57 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2949 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:20:58.734386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03b8b912-3ac8-4351-a734-8d76edb316f9 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f1969b64a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:58.858062 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03b8b912-3ac8-4351-a734-8d76edb316f9 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 200 len: 353 microversion: 2.1 time: 0.138686 Jul 25 20:20:58.859193 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1535/3124] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:20:58 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:20:58.864441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:58.865308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:58.913459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:58.914245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:58.915284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:58.915994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:59.820474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:20:59.838405 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84ac2837-99b2-43d9-b08e-95556b4f4405 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1329 microversion: 2.1 time: 0.976779 Jul 25 20:20:59.841759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1536/3125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:58 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1329 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:20:59.848533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:20:59.849606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:20:59.857052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:59.857927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:20:59.859021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:20:59.859835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.311005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:21:00.312830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:21:00.314129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:21:00.315238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:21:00.316198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:21:00.352418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:00.356519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.366246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:00.366861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.439947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Getting quotas for project ba72bf5485d140b3b643d4061a0b870a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:00.447479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Getting quotas for user 80a1f178785743e0a8f55cf2653a13e5 and project ba72bf5485d140b3b643d4061a0b870a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:00.469912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:21:00.473586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:21:00.591696 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-27ec7c3d-32c8-472b-a9b9-802ffe4e6651 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.423811 Jul 25 20:21:00.602439 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1590/3126] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:21:00.620574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-98b30d4c-6e8f-422f-849c-994e19122f4b req-4e00ec3d-918a-4cbc-a90d-67a7a506b79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-unplugged", "status": "completed", "tag": "f3cb5213-d562-41bc-b3d4-7ed5d9645a1b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:00.641358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98b30d4c-6e8f-422f-849c-994e19122f4b req-4e00ec3d-918a-4cbc-a90d-67a7a506b79c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:00.642905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98b30d4c-6e8f-422f-849c-994e19122f4b req-4e00ec3d-918a-4cbc-a90d-67a7a506b79c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.667521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-98b30d4c-6e8f-422f-849c-994e19122f4b req-4e00ec3d-918a-4cbc-a90d-67a7a506b79c service nova] Creating event network-vif-unplugged:f3cb5213-d562-41bc-b3d4-7ed5d9645a1b for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:00.678000 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-98b30d4c-6e8f-422f-849c-994e19122f4b req-4e00ec3d-918a-4cbc-a90d-67a7a506b79c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065904 Jul 25 20:21:00.681009 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1591/3127] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:00.694660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:00.695384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:00.717766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:00.718226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.719246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:00.719858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:00.847889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:00.865580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da361a46-faa1-4daa-82e4-d93f35bb1452 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 1.021315 Jul 25 20:21:00.871320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1537/3128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:20:59 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:01.262567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:01.278821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:01.280910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:01.284982 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1961e3a2-8a34-4b3b-b047-5598f9ca3983 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2928 microversion: 2.42 time: 0.601763 Jul 25 20:21:01.290947 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1592/3129] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:00 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2928 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:01.300086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01d16f84-ea27-4ba8-b929-647d843cf268 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Calling method '.version_select at 0x7f196944aee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:01.374342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-01d16f84-ea27-4ba8-b929-647d843cf268 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] HTTP exception thrown: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01d16f84-ea27-4ba8-b929-647d843cf268 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Request method failure captured: Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 HTTP/1.1 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vsfkjQ0E3mJrzu9FRTf5eAUvHWnEm7rKBAP4B05Gb3mcOTnTqhYZXW77hWDpDzN0Uj4bHWUO4YrExrA3DnTEe4SBdYXqUZ6noa8UqC47n3RWU7RIjcTybx3HE0A8XmfGbvl1a-odkbAyWPAMmlsAVNG55q7vwbaOozW3E5MRBaMgbA Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b7d659661449480f9d6f63eb94e86283 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesGetTestJSON-1726434740 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7d659661449480f9d6f63eb94e86283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7d659661449480f9d6f63eb94e86283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7d659661449480f9d6f63eb94e86283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7d659661449480f9d6f63eb94e86283"}]}] Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesGetTestJSON-1726434740 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b7d659661449480f9d6f63eb94e86283 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesGetTestJSON-1726434740 Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesGetTestJSON-1726434740-project Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 81d78d322f1742239dc3777a9448aa7b Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesGetTestJSON-1726434740-project Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: exception: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'afcb56e4-cc53-493c-8109-5641fd637541'} Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. (HTTP 404) (Request-ID: req-e59832b6-db4b-4d43-b27a-b38352b54721) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:21:01.377294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. Jul 25 20:21:01.381817 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:01.391160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01d16f84-ea27-4ba8-b929-647d843cf268 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] Returning 404 to user: Volume afcb56e4-cc53-493c-8109-5641fd637541 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:01.392953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-01d16f84-ea27-4ba8-b929-647d843cf268 tempest-VolumesGetTestJSON-1726434740 tempest-VolumesGetTestJSON-1726434740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541" status: 404 len: 109 microversion: 2.1 time: 0.100419 Jul 25 20:21:01.394544 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1593/3130] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:21:01 2022] GET /compute/v2.1/os-volumes/afcb56e4-cc53-493c-8109-5641fd637541 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:21:01.425870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5dcfa52b-6aeb-4c19-98fb-a356200a5d48 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:01.426913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5dcfa52b-6aeb-4c19-98fb-a356200a5d48 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:01.568369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Action: 'update', calling method: .version_select at 0x7f196eade940>, body: {"quota_set": {"ram": "5120"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:01.718598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5dcfa52b-6aeb-4c19-98fb-a356200a5d48 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:01.744259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5dcfa52b-6aeb-4c19-98fb-a356200a5d48 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1224 microversion: 2.1 time: 0.346923 Jul 25 20:21:01.765212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1594/3131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:01 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1224 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:01.797892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:01.799013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:01.826968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:01.847435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:01.852475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:01.855460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:01.863622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:01.879801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:01.880963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:01.885750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:01.893351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:02.154330 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc5521e8-a7b7-42ca-9046-a35e3debf21d tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985" status: 200 len: 240 microversion: 2.36 time: 1.281379 Jul 25 20:21:02.158039 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1538/3132] 10.222.0.48 () {62 vars in 1303 bytes} [Mon Jul 25 20:21:00 2022] PUT /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985 => generated 240 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:21:02.168131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:02.171936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:02.201276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:02.202585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:02.206582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:02.215400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:02.810108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:02.819384 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18c2c329-7c35-4764-8a5a-6ae68b6a882e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1511 microversion: 2.1 time: 1.050399 Jul 25 20:21:02.822306 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1595/3133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:01 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1511 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:02.838461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Calling method '.version_select at 0x7f1968d54d30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:03.004359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:03.019163 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e324803-1b86-4709-aab9-6090a27edcbf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 0.859654 Jul 25 20:21:03.036636 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1539/3134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:02 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:03.058456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:03.059996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:03.076255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.078031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.081271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.081919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.445834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.448335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.450636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.452114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.502508 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3cfa93d-cab8-4275-8ab9-c68018de35d1 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985/detail" status: 200 len: 672 microversion: 2.36 time: 0.678656 Jul 25 20:21:03.503745 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1596/3135] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Jul 25 20:21:02 2022] GET /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985/detail => generated 672 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:21:03.512177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:03.513498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:03.524556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.524556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.525836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.528288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.771470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:03.785024 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d9b66dd-1680-40f7-9d24-ef978a948386 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1282 microversion: 2.1 time: 0.279498 Jul 25 20:21:03.786055 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1597/3136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:03 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:03.803653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-unplugged", "status": "completed", "tag": "c86962a0-b9d0-40a7-8bd5-496cde816bed"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-unplugged", "status": "completed", "tag": "0c9dbc51-bf07-41b0-b58d-f47b07bac99f"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-unplugged", "status": "completed", "tag": "58b29d89-9a22-41af-9fc9-634501e8f130"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:03.814976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.816284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.830221 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Creating event network-vif-unplugged:c86962a0-b9d0-40a7-8bd5-496cde816bed for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:03.831304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Creating event network-vif-unplugged:0c9dbc51-bf07-41b0-b58d-f47b07bac99f for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:03.832412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] Creating event network-vif-unplugged:58b29d89-9a22-41af-9fc9-634501e8f130 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:03.840747 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-dbb3dc82-f673-45eb-b059-f2629d9dc14b req-fb113c14-c2d3-4d6b-95d6-8d949d098c57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.052675 Jul 25 20:21:03.845634 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1598/3137] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:03.857573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:03.859202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:03.868268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.869652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.871090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:03.871743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:03.969281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:03.982407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:03.984007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:03.985346 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a61495a-d4f1-4507-89f4-c4be32461cac tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2907 microversion: 2.42 time: 0.947399 Jul 25 20:21:03.986154 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1540/3138] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:03 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2907 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:04.005188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Action: 'update', calling method: .version_select at 0x7f19694eaca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:04.204269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.204269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.209095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.209579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.293892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.295431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.296493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.297112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.429883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-858f9c03-40ed-46bc-b7d1-d9147eb8dfa9 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985?user_id=f662741958f743de984bb45489572518" status: 200 len: 240 microversion: 2.36 time: 0.442323 Jul 25 20:21:04.430788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1541/3139] 10.222.0.48 () {62 vars in 1384 bytes} [Mon Jul 25 20:21:03 2022] PUT /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985?user_id=f662741958f743de984bb45489572518 => generated 240 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:21:04.461120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:04.468720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:04.490730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.491885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.492420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:04.492945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:04.943144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:04.958772 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-539a46a3-8745-4931-81fa-4e02e939f37e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1511 microversion: 2.1 time: 1.110944 Jul 25 20:21:04.976306 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1599/3140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:03 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1511 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:04.993020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7381d012-368e-489d-b165-a1637eabcb20 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] Calling method '.version_select at 0x7f1969888e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:05.148979 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7381d012-368e-489d-b165-a1637eabcb20 tempest-QuotasAdminTestV236-1370507365 tempest-QuotasAdminTestV236-1370507365-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985?user_id=f662741958f743de984bb45489572518" status: 200 len: 282 microversion: 2.36 time: 0.171395 Jul 25 20:21:05.150995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1600/3141] 10.222.0.48 () {60 vars in 1364 bytes} [Mon Jul 25 20:21:04 2022] GET /compute/v2.1/os-quota-sets/59a55945745445bbba8de4648715e985?user_id=f662741958f743de984bb45489572518 => generated 282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:21:05.166215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:05.206881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-166d160e-1979-4bb8-a46b-1b8bea4f50e9 req-c37dc148-0470-4868-9c6f-27603d293b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-deleted", "tag": "0c9dbc51-bf07-41b0-b58d-f47b07bac99f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:05.212016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1b04ce8-efe8-4284-be74-537784d85058 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 0.778831 Jul 25 20:21:05.222878 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1542/3142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:04 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:05.244136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:05.244817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:05.255393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-166d160e-1979-4bb8-a46b-1b8bea4f50e9 req-c37dc148-0470-4868-9c6f-27603d293b8a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.255811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-166d160e-1979-4bb8-a46b-1b8bea4f50e9 req-c37dc148-0470-4868-9c6f-27603d293b8a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.257606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.258521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.261365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.261847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.289967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-166d160e-1979-4bb8-a46b-1b8bea4f50e9 req-c37dc148-0470-4868-9c6f-27603d293b8a service nova] Creating event network-vif-deleted:0c9dbc51-bf07-41b0-b58d-f47b07bac99f for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:05.304748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-166d160e-1979-4bb8-a46b-1b8bea4f50e9 req-c37dc148-0470-4868-9c6f-27603d293b8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149119 Jul 25 20:21:05.305828 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1601/3143] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:05.321186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:05.326482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:05.344824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.346300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.349038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.349791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.418545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:21:05.629377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef7fd80d-8829-4bfd-9eb5-86f8bc8b1d87 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 204 len: 0 microversion: 2.1 time: 0.318376 Jul 25 20:21:05.631698 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1602/3144] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:21:05 2022] DELETE /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:21:05.646326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:05.649789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:05.661092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:05.665159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.669078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.673226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.674322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.682063 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dea59bd3-0865-4a2b-af4d-4ecc92126cd7 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1282 microversion: 2.1 time: 0.457978 Jul 25 20:21:05.697275 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1543/3145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:05 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1282 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:05.712854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:05.714089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:05.734186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.735492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:05.737195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:05.738209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:06.764737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:06.805925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:06.809816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:06.815007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4914780e-8b02-4053-8df5-f1151e55bead tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2571 microversion: 2.42 time: 1.175478 Jul 25 20:21:06.819712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1603/3146] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:05 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2571 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:06.841700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-unplugged", "status": "completed", "tag": "74fe7a93-560c-492d-8417-eba24fb3fdc5"}, {"server_uuid": "cc29e8e9-e7c4-4844-b01d-729b44dc5201", "name": "network-vif-plugged", "status": "completed", "tag": "9eae7015-c528-4622-982d-387dafcee800"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:06.895281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:06.896079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:06.901143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:06.926666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b506302-23cd-4ab6-841a-86d2643a2d0d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1517 microversion: 2.1 time: 1.227671 Jul 25 20:21:06.927274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1544/3147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:05 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1517 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:06.952518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:06.954448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:06.960290 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] Creating event network-vif-unplugged:74fe7a93-560c-492d-8417-eba24fb3fdc5 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:06.962755 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] Creating event network-vif-plugged:9eae7015-c528-4622-982d-387dafcee800 for instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 on n-h1-845775-3 Jul 25 20:21:06.986708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:06.991134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:06.995810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-efa01177-aaa9-4fe6-964c-2be07b9dbafe req-a1d1d19c-205a-4eae-a4a9-2a281cef01eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.173456 Jul 25 20:21:06.999900 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1604/3148] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:07.000912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:07.001488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:07.059622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:07.060994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:07.108752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:07.112142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:07.120178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:07.121094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:08.099725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:08.115664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fbfd3900-be14-41fe-b56e-f044cf89fb53 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1314 microversion: 2.1 time: 1.184808 Jul 25 20:21:08.116474 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1545/3149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:06 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:08.121889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-11f6e945-d756-42c3-9795-ae585d7368ba req-7133297d-11d3-4f26-837c-b3dc90883c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-deleted", "tag": "c86962a0-b9d0-40a7-8bd5-496cde816bed"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:08.134501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-11f6e945-d756-42c3-9795-ae585d7368ba req-7133297d-11d3-4f26-837c-b3dc90883c7b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:08.135804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-11f6e945-d756-42c3-9795-ae585d7368ba req-7133297d-11d3-4f26-837c-b3dc90883c7b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:08.159221 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-11f6e945-d756-42c3-9795-ae585d7368ba req-7133297d-11d3-4f26-837c-b3dc90883c7b service nova] Creating event network-vif-deleted:c86962a0-b9d0-40a7-8bd5-496cde816bed for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:08.166286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-11f6e945-d756-42c3-9795-ae585d7368ba req-7133297d-11d3-4f26-837c-b3dc90883c7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048329 Jul 25 20:21:08.167644 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1546/3150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:08.178861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:08.180179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:08.188675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:08.189595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:08.190685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:08.191288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:08.230742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:08.246720 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f92be1c-073a-40ad-908f-c5d12201f758 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 1.244328 Jul 25 20:21:08.248303 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1605/3151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:06 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:08.257757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:08.262052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:08.292144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:08.294654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:08.300665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:08.303968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.102406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.115026 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc5305d1-a563-489c-b03b-275aed0ccb0c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1517 microversion: 2.1 time: 0.864830 Jul 25 20:21:09.115874 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1606/3152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:08 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1517 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:09.143013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:09.144544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:09.157282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.159279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.160525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.164018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.326952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.342933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.347304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.359940 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ed9c325-6c85-4947-b7ea-0d9b0a048d82 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2481 microversion: 2.42 time: 1.190345 Jul 25 20:21:09.364440 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1547/3153] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:08 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2481 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:09.377348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:09.377623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:09.407733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.414239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.415840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.416488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.897477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.907866 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-01373217-80d2-4d60-969b-337f0476eb68 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1501 microversion: 2.1 time: 0.774431 Jul 25 20:21:09.914753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1607/3154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:09 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1501 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:09.939776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:09.940472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:09.949312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.950090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.951701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:09.952673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:09.959023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:09.973852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31ac5d33-e44e-47b4-8f42-ccac71cc96e9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 0.605983 Jul 25 20:21:09.980498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1548/3155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:09 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:10.155723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:10.156411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:10.171249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:10.171721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:10.184196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:10.185688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:10.233824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:10.419450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:10.453699 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5e3d157-9632-44a6-9de5-93ac52c509a1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 200 len: 1475 microversion: 2.1 time: 0.302769 Jul 25 20:21:10.460422 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1549/3156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:10 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:21:10.466081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-95e12193-7193-4973-a608-4252b12269bc req-e52f4130-e46c-4baf-b84e-4fec0a081afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-deleted", "tag": "f3cb5213-d562-41bc-b3d4-7ed5d9645a1b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:10.503810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-95e12193-7193-4973-a608-4252b12269bc req-e52f4130-e46c-4baf-b84e-4fec0a081afd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:10.507600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-95e12193-7193-4973-a608-4252b12269bc req-e52f4130-e46c-4baf-b84e-4fec0a081afd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:10.523292 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.security_group_api [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Removing security group 57afa4d3-d104-4762-8e33-70b817ad2a47 from port 9eae7015-c528-4622-982d-387dafcee800 Jul 25 20:21:10.557951 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-95e12193-7193-4973-a608-4252b12269bc req-e52f4130-e46c-4baf-b84e-4fec0a081afd service nova] Creating event network-vif-deleted:f3cb5213-d562-41bc-b3d4-7ed5d9645a1b for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:10.606584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-95e12193-7193-4973-a608-4252b12269bc req-e52f4130-e46c-4baf-b84e-4fec0a081afd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142780 Jul 25 20:21:10.612308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1550/3157] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:10.638603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:10.640018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:10.667105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:10.671674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:10.674458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:10.676681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:11.605084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:11.639671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:11.645975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:11.655293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0ad67c9-4bab-47fb-9701-e0a51a2e1f66 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2253 microversion: 2.42 time: 1.040882 Jul 25 20:21:11.657123 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1551/3158] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:10 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2253 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:11.674237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:11.682231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:11.700819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:11.703895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:11.705045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:11.708614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.153820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:12.167736 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53aee9b4-1d22-4a79-bdf2-87cdea6a8e1c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 0.507047 Jul 25 20:21:12.168564 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1552/3159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:11 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:12.191444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:12.197192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:12.213741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:12.214551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.215704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:12.216348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.248981 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 HTTP/1.1 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c0c26498-720c-4998-8207-5a9f9c6a4a26'} Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:12.251453 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:21:12.256866 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:12.258947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:12.260344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad3e41e0-7d96-4cef-a11f-ffa1a3ca1fc0 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 404 len: 111 microversion: 2.1 time: 0.077605 Jul 25 20:21:12.272962 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1553/3160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:12 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:21:12.286452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61ef8920-5a3e-41cc-a29a-2eec38a816f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '.version_select at 0x7f196962bc10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:12.303287 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ceaa129c-f26f-4eca-89cc-d1f64751103e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201/action" status: 202 len: 0 microversion: 2.1 time: 2.369717 Jul 25 20:21:12.308600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1608/3161] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:09 2022] POST /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201/action => generated 0 bytes in 2376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:21:12.317879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:12.317879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:12.351976 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61ef8920-5a3e-41cc-a29a-2eec38a816f1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-key-1820042785" status: 202 len: 0 microversion: 2.1 time: 0.068473 Jul 25 20:21:12.356096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1554/3162] 10.222.0.48 () {58 vars in 1209 bytes} [Mon Jul 25 20:21:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1820042785 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:21:12.362836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:12.365386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.374486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:12.375012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.391048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0602c622-b5e8-41a4-9f44-83fa9a191a20 req-68f63285-3cc3-4115-a633-40df249b159d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc29e8e9-e7c4-4844-b01d-729b44dc5201", "tag": "9eae7015-c528-4622-982d-387dafcee800"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:12.419401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0602c622-b5e8-41a4-9f44-83fa9a191a20 req-68f63285-3cc3-4115-a633-40df249b159d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:12.422341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0602c622-b5e8-41a4-9f44-83fa9a191a20 req-68f63285-3cc3-4115-a633-40df249b159d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:12.467555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0602c622-b5e8-41a4-9f44-83fa9a191a20 req-68f63285-3cc3-4115-a633-40df249b159d service nova] Creating event network-changed:9eae7015-c528-4622-982d-387dafcee800 for instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 on n-h1-845775-3 Jul 25 20:21:12.474772 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0602c622-b5e8-41a4-9f44-83fa9a191a20 req-68f63285-3cc3-4115-a633-40df249b159d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114462 Jul 25 20:21:12.476721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1555/3163] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:12.610134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-791306854", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:12.766416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:21:13.112860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:13.123793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25512cba-1ba4-4d27-a2cd-03492bac42e1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1459 microversion: 2.1 time: 0.813864 Jul 25 20:21:13.125064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1609/3164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:12 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1459 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:13.141296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:13.142050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:13.154580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:13.155003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:13.158435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:13.160285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:13.472745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:14.225092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:14.241673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:14.244832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:14.247312 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18f78617-785e-46f3-aea2-c0ba82b35598 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 2208 microversion: 2.42 time: 1.120876 Jul 25 20:21:14.249042 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1610/3165] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:13 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 2208 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:14.255076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c26498-720c-4998-8207-5a9f9c6a4a26", "name": "network-vif-deleted", "tag": "dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f"}, {"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-deleted", "tag": "74fe7a93-560c-492d-8417-eba24fb3fdc5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:14.274629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:14.275634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:14.295971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] Creating event network-vif-deleted:dcf40eb1-5ad2-41e0-b7a0-5ec8df13120f for instance c0c26498-720c-4998-8207-5a9f9c6a4a26 on n-h2-845775-3 Jul 25 20:21:14.296711 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] Creating event network-vif-deleted:74fe7a93-560c-492d-8417-eba24fb3fdc5 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:14.310036 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-30f5e277-0621-44e5-b4ae-c376a7ef65c8 req-71317bb5-2dfa-4e03-952f-576a64a57cd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058627 Jul 25 20:21:14.314158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=7 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:14.316004 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1611/3166] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:14.327145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:14.328528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:14.338978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:14.339815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:14.341033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:14.341687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:14.423858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=20 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:15.018759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:15.021755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:15.038314 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b887f35f-4662-45ac-bf65-731b29906ac9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.719736 Jul 25 20:21:15.038919 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1612/3167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:14 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:15.064869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:15.077055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:15.104893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.109423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.111318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.116717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.142761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:15.203315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:21:15.203757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:21:15.204678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:21:15.205109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:21:15.205534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:21:15.239593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.241711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.245509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.248635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.296473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:15.315585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:15.369704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:21:15.379620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:21:15.512693 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afa7de5a-9a71-4e98-b496-858b240dc421 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.906524 Jul 25 20:21:15.525648 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1556/3168] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:21:15.538363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9214e26c-cf65-4c63-8b02-701d158abb47 req-6256179b-a2aa-4bc8-9a3b-a6b75825210a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74", "tag": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:15.607226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9214e26c-cf65-4c63-8b02-701d158abb47 req-6256179b-a2aa-4bc8-9a3b-a6b75825210a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.614343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9214e26c-cf65-4c63-8b02-701d158abb47 req-6256179b-a2aa-4bc8-9a3b-a6b75825210a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.662427 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9214e26c-cf65-4c63-8b02-701d158abb47 req-6256179b-a2aa-4bc8-9a3b-a6b75825210a service nova] Creating event network-changed:8f3dfd10-a53e-45c6-a2da-1d16960ce32c for instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 on n-h2-845775-3 Jul 25 20:21:15.691897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9214e26c-cf65-4c63-8b02-701d158abb47 req-6256179b-a2aa-4bc8-9a3b-a6b75825210a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163081 Jul 25 20:21:15.695035 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1557/3169] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:15.711425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:15.712440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:15.730760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.732977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.737211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.738607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.832670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:15.852325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d9fc2d8-e8ab-4f73-a78e-1967abe2202f tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 0.799024 Jul 25 20:21:15.852325 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1613/3170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:15 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:15.868287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:15.869429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:15.891348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.892087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:15.894335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:15.895782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:16.222188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:16.235642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:16.242239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:16.245929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3823c358-127b-48f5-bfa0-41530eb289af tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.394074 Jul 25 20:21:16.250613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1614/3171] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:15 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:16.264864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77bb1071-9ca8-4104-9e73-dafb2765e3fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:16.265808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77bb1071-9ca8-4104-9e73-dafb2765e3fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:16.536604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:16.553248 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d27bcd80-8221-4380-a924-c1a5076e7b43 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.856345 Jul 25 20:21:16.554129 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1558/3172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:15 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:16.574283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2502d077-4a8d-46d6-ae67-5135e6d3c232 req-2262999b-543c-4377-90d7-6707b1a6909b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435399fe-5008-4c4d-8758-6091b6325271", "name": "network-vif-deleted", "tag": "58b29d89-9a22-41af-9fc9-634501e8f130"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:16.608714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2502d077-4a8d-46d6-ae67-5135e6d3c232 req-2262999b-543c-4377-90d7-6707b1a6909b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:16.609280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2502d077-4a8d-46d6-ae67-5135e6d3c232 req-2262999b-543c-4377-90d7-6707b1a6909b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:16.646511 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2502d077-4a8d-46d6-ae67-5135e6d3c232 req-2262999b-543c-4377-90d7-6707b1a6909b service nova] Creating event network-vif-deleted:58b29d89-9a22-41af-9fc9-634501e8f130 for instance 435399fe-5008-4c4d-8758-6091b6325271 on n-h1-845775-3 Jul 25 20:21:16.659261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2502d077-4a8d-46d6-ae67-5135e6d3c232 req-2262999b-543c-4377-90d7-6707b1a6909b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103658 Jul 25 20:21:16.662252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1559/3173] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:16.676861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:16.678146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:16.683378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77bb1071-9ca8-4104-9e73-dafb2765e3fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:16.689724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:16.691066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:16.692577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:16.693391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:16.717029 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77bb1071-9ca8-4104-9e73-dafb2765e3fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1208 microversion: 2.1 time: 0.463343 Jul 25 20:21:16.718408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1615/3174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:16 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1208 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:16.879657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:16.880586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:16.902256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:16.906402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:16.910453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:16.914009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:17.503476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:17.522624 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d5db223-745e-4c4d-8cfa-bb158cd2b4c8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.850022 Jul 25 20:21:17.537460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1560/3175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:16 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:17.548542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:17.553644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:17.566508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:17.570019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:17.571114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:17.572316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:17.842532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:17.871079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:17.873584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:17.875575 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6c3acc4-f132-4477-ac95-17ecde706c7a tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.335883 Jul 25 20:21:17.893777 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1561/3176] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:17 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:17.924238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:17.941446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:17.975729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:17.988255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:17.989811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:17.990575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:18.122349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:18.186140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d115c8b-dd96-4431-9526-7635c3dc9f41 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 1.315969 Jul 25 20:21:18.187211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1616/3177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:16 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:18.206994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:18.219134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:18.234604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:18.236960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:18.238064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:18.239927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:18.631754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:18.656778 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c323882-d4d2-4a06-9bbc-73d257f1fa44 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1266 microversion: 2.1 time: 0.455945 Jul 25 20:21:18.672931 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1617/3178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:18 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1266 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:18.818444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:18.842159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e95fdf0c-b70a-48a0-82fa-d19083929759 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.945468 Jul 25 20:21:18.848181 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1562/3179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:17 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:18.944694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:18.945462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:18.969312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:18.975450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:18.979770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:18.980187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:18.988352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:19.156458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:19.172075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:19.179403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:19.181762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e38b113f-2627-4380-a033-f9e2092c3406 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.242067 Jul 25 20:21:19.183605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Action: 'update', calling method: .version_select at 0x7f1969292160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:19.187282 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:19.187282 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:21:19.189014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:19.192250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:19.199692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1563/3180] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:18 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:19.223644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:19.224596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:19.230641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:19.233731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:19.237803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:19.238520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:19.242347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:19.243008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:19.273628 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] HTTP exception thrown: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Request method failure captured: Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 HTTP/1.1 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 56 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vs9y5BiQHToaK8sCgauXc9l-MZNU3RSF_cdVGWmOO5CSwoRyb0AdN3Ix6Twma_aZXZItr0v8UNCK-2Zc8Bc0nrUfxDPl40RwQJWD9TaGThvFYdAlLVykYZxQlTFk-tH6yi3ZRIhmc2uuGi4shGsQDrkL1rfxHE9Hn9xsyE5r85QG-w Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}] Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8d454fd8439d4d9195bd73b98f62e466 Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: exception: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4c2b3562-7d24-4c6a-aaa8-092576f7e395', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:21:19.279094 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Returning 404 to user: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:19.284913 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6bace9cc-6e6c-4ecb-8013-a1cb7db4d3e9 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395" status: 404 len: 110 microversion: 2.53 time: 0.606316 Jul 25 20:21:19.287673 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1618/3181] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Jul 25 20:21:18 2022] PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 => generated 110 bytes in 613 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:21:19.298101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-527624155", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "ea7c3422-34fd-4fb8-b7bc-60523dad31bd"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:19.424021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] validate_networks() for [('ea7c3422-34fd-4fb8-b7bc-60523dad31bd', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:21:20.541573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:20.555112 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b32dc520-7f04-46d8-9da2-6823da17428a tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 1.336735 Jul 25 20:21:20.561206 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1564/3182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:19 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:20.577273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Action: 'update', calling method: .version_select at 0x7f1968cbfd30>, body: {"status": "disabled"} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:20.584951 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:20.584951 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:20.592729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:20.593700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:20.639288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:20.643124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:20.665821 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] HTTP exception thrown: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Request method failure captured: Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 HTTP/1.1 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 22 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vs9y5BiQHToaK8sCgauXc9l-MZNU3RSF_cdVGWmOO5CSwoRyb0AdN3Ix6Twma_aZXZItr0v8UNCK-2Zc8Bc0nrUfxDPl40RwQJWD9TaGThvFYdAlLVykYZxQlTFk-tH6yi3ZRIhmc2uuGi4shGsQDrkL1rfxHE9Hn9xsyE5r85QG-w Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}] Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8d454fd8439d4d9195bd73b98f62e466 Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: {"status": "disabled"} Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: exception: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4c2b3562-7d24-4c6a-aaa8-092576f7e395', 'body': {'status': 'disabled'}} Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:21:20.672585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:20.678842 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:20.683589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Returning 404 to user: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:20.685499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81ec2c50-d1fc-43e4-a9d7-43c647fc4377 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395" status: 404 len: 110 microversion: 2.53 time: 0.122676 Jul 25 20:21:20.692386 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1565/3183] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Jul 25 20:21:20 2022] PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 => generated 110 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:21:20.698535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:20.699658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:20.712135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:20.713062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:20.714473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:20.715398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.313437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:21:21.314104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:21:21.315253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:21:21.316016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:21:21.316647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:21:21.336537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.339145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.340370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.341588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.400932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:21.414706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Getting quotas for user c7cd8e51e2c740088fbe9c4d804c1a72 and project afce26d0d3e546a082c76cba1ca213e2. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:21.451449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:21:21.466194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:21:21.522722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:21.542953 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0baebbd-57aa-4e36-a4bb-7f3768853d5f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 0.849102 Jul 25 20:21:21.548443 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1566/3184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:20 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:21.561314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:21.563216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:21.565960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:21.590494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.591073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.591943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.592599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.631140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52a9af0a-00db-4a8d-953f-a5b513127508 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.339585 Jul 25 20:21:21.631548 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1619/3185] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:21:21.652428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Action: 'update', calling method: .version_select at 0x7f196944a430>, body: {"status": "enabled"} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:21.691534 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:21.691534 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:21:21.704164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.705276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.718986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.719525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.736450 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] HTTP exception thrown: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Request method failure captured: Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 HTTP/1.1 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 21 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vs9y5BiQHToaK8sCgauXc9l-MZNU3RSF_cdVGWmOO5CSwoRyb0AdN3Ix6Twma_aZXZItr0v8UNCK-2Zc8Bc0nrUfxDPl40RwQJWD9TaGThvFYdAlLVykYZxQlTFk-tH6yi3ZRIhmc2uuGi4shGsQDrkL1rfxHE9Hn9xsyE5r85QG-w Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b56101c19a7429e8b540ff7fdcd3494"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b56101c19a7429e8b540ff7fdcd3494"}]}] Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 7b56101c19a7429e8b540ff7fdcd3494 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8d454fd8439d4d9195bd73b98f62e466 Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: {"status": "enabled"} Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: exception: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4c2b3562-7d24-4c6a-aaa8-092576f7e395', 'body': {'status': 'enabled'}} Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:21:21.742125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Returning 404 to user: Service 4c2b3562-7d24-4c6a-aaa8-092576f7e395 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fe83324b-e3d1-481f-9c44-2482c4ee9958 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395" status: 404 len: 110 microversion: 2.53 time: 0.111681 Jul 25 20:21:21.748162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1620/3186] 10.222.0.48 () {62 vars in 1309 bytes} [Mon Jul 25 20:21:21 2022] PUT /compute/v2.1/os-services/4c2b3562-7d24-4c6a-aaa8-092576f7e395 => generated 110 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:21:21.769678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:21.770595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:21.789651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.790152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:21.795258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:21.795729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:22.420481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:22.431607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:22.438783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:22.440284 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f707a7aa-59b9-4e57-a940-614cb0c40536 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.890764 Jul 25 20:21:22.452630 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1567/3187] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:21 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:22.476681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8579bdf-afd4-49ca-a5df-44626d2453ac tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:22.477324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f8579bdf-afd4-49ca-a5df-44626d2453ac tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:22.806655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f8579bdf-afd4-49ca-a5df-44626d2453ac tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:22.825009 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8579bdf-afd4-49ca-a5df-44626d2453ac tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1214 microversion: 2.1 time: 0.370557 Jul 25 20:21:22.825612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1568/3188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:22 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1214 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:22.845906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:22.857233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:22.866781 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:22.866781 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:22.870320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c72446f-0de6-4c01-aff7-98a3a16c93b5 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 1.113240 Jul 25 20:21:22.873149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:22.874341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:22.876692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:22.877381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:22.885027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1621/3189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:21 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:22.890815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ca27b14f-969c-4cbf-b030-0e1325c153a0 req-270aab96-c07a-428e-a8b3-7f0a0fcaa0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74", "name": "network-vif-plugged", "status": "completed", "tag": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:22.903558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca27b14f-969c-4cbf-b030-0e1325c153a0 req-270aab96-c07a-428e-a8b3-7f0a0fcaa0c9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:22.903960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ca27b14f-969c-4cbf-b030-0e1325c153a0 req-270aab96-c07a-428e-a8b3-7f0a0fcaa0c9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:22.942938 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ca27b14f-969c-4cbf-b030-0e1325c153a0 req-270aab96-c07a-428e-a8b3-7f0a0fcaa0c9 service nova] Creating event network-vif-plugged:8f3dfd10-a53e-45c6-a2da-1d16960ce32c for instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 on n-h2-845775-3 Jul 25 20:21:22.948902 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37098d1f-9520-4199-848a-2700ff5f113e tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.122206 Jul 25 20:21:22.950871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ca27b14f-969c-4cbf-b030-0e1325c153a0 req-270aab96-c07a-428e-a8b3-7f0a0fcaa0c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064152 Jul 25 20:21:22.951644 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1622/3190] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:22.953458 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1569/3191] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Jul 25 20:21:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:23.000854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.004905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:23.014206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.022623 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:23.022623 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:23.031567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.032269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.033564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.034017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.040718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.041701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.044328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.045010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.168283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2b5467c5-8d1c-49ce-b340-fc06a7aca5e7 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.178680 Jul 25 20:21:23.170007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1570/3192] 10.222.0.48 () {60 vars in 1211 bytes} [Mon Jul 25 20:21:22 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:23.185642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b355fee9-618e-441d-8974-68bb8932cd13 req-cb036abe-189b-4601-b481-78586162a7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0", "tag": "673a2a09-8fe8-4032-8844-8e9b6baf6c79"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:23.211045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b355fee9-618e-441d-8974-68bb8932cd13 req-cb036abe-189b-4601-b481-78586162a7a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.214208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b355fee9-618e-441d-8974-68bb8932cd13 req-cb036abe-189b-4601-b481-78586162a7a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.255218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b355fee9-618e-441d-8974-68bb8932cd13 req-cb036abe-189b-4601-b481-78586162a7a0 service nova] Creating event network-changed:673a2a09-8fe8-4032-8844-8e9b6baf6c79 for instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 on n-h2-845775-3 Jul 25 20:21:23.266082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b355fee9-618e-441d-8974-68bb8932cd13 req-cb036abe-189b-4601-b481-78586162a7a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092770 Jul 25 20:21:23.268171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1571/3193] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:23.274870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.278496 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:23.278496 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:23.282138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.282925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.284742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.285467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.323058 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-06cffae8-be6c-4f94-b4f8-0b9a6eab636b tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.052615 Jul 25 20:21:23.324127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1572/3194] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:23.336810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.343117 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:23.343117 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:23.353859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.355431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.357832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.359541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.403643 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36579ff2-93d0-4707-a85b-86a522369c68 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-845775-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.070739 Jul 25 20:21:23.404713 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1573/3195] 10.222.0.48 () {60 vars in 1235 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/os-services?host=n-d-845775-3&binary=xxx => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:21:23.419784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.422477 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:23.422477 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:21:23.423950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.424443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.427793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.428103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.505957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f491dac1-7c94-4a5b-8f07-dfdd808d0710 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.086202 Jul 25 20:21:23.508060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1574/3196] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:21:23.520202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.521012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:23.540714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.541186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.544756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.548022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.664365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:23.682035 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ded2c61-0417-4977-a111-30b286a159c5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 0.717867 Jul 25 20:21:23.703609 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1623/3197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:22 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:23.726547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:23.739756 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:23.739756 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:21:23.741416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.741890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.742818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:23.743979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:23.809748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa637453-5da6-48d7-8971-cef979ad0f17 tempest-ServicesAdminNegativeV253TestJSON-918025275 tempest-ServicesAdminNegativeV253TestJSON-918025275-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.101452 Jul 25 20:21:23.810521 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1624/3198] 10.222.0.48 () {60 vars in 1239 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:24.117928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:24.135185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:24.146027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:24.147267 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7bfbb6a6-d5ca-4325-b112-f0f85517dce9 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.636833 Jul 25 20:21:24.147866 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1575/3199] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:24.161852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:24.166572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:24.190226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.190714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:24.191546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.194690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:24.381217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:24.385047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:24.402875 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61d2fa28-9b4c-41d5-9cf0-30f1f79a1170 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1272 microversion: 2.1 time: 0.253883 Jul 25 20:21:24.414500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1576/3200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:24 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:24.440298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:24.441835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5741d8e-3081-48de-a1c8-8d94deba2b77 tempest-ServicesAdminNegativeV253TestJSON-1113662942 tempest-ServicesAdminNegativeV253TestJSON-1113662942-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:24.442945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:24.447189 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:21:24.447189 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:21:24.450886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5741d8e-3081-48de-a1c8-8d94deba2b77 tempest-ServicesAdminNegativeV253TestJSON-1113662942 tempest-ServicesAdminNegativeV253TestJSON-1113662942-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f38a1bc85e2f45f693d1863083edaed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce4d63f33e141719a6dd93b010e5da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5741d8e-3081-48de-a1c8-8d94deba2b77 tempest-ServicesAdminNegativeV253TestJSON-1113662942 tempest-ServicesAdminNegativeV253TestJSON-1113662942-project] Request method failure captured: Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vs8aEtHUbXpkgfAKKF_LuECvIRVZvBSf6Mr385RIhz3-QSGqnc9Mc9OCQ0Eixu2KMEczblcXaULDuISzyPLs6CTYW-8mAuXQQknlou1q5RXTtgcmpl0erT1vhL4qvOQxc6zptH0746CIquBDdCoj6Scly2L5iYlExRs5SYYspJxcYQ Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.53 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: cce4d63f33e141719a6dd93b010e5da5 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1113662942 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cce4d63f33e141719a6dd93b010e5da5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cce4d63f33e141719a6dd93b010e5da5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cce4d63f33e141719a6dd93b010e5da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cce4d63f33e141719a6dd93b010e5da5"}]}] Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1113662942 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: cce4d63f33e141719a6dd93b010e5da5 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1113662942 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1113662942-project Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f38a1bc85e2f45f693d1863083edaed7 Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1113662942-project Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: action_args: {} Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:21:24.454971 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 25 20:21:24.460319 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:21:24.463903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5741d8e-3081-48de-a1c8-8d94deba2b77 tempest-ServicesAdminNegativeV253TestJSON-1113662942 tempest-ServicesAdminNegativeV253TestJSON-1113662942-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:24.465755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.466566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:24.466736 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5741d8e-3081-48de-a1c8-8d94deba2b77 tempest-ServicesAdminNegativeV253TestJSON-1113662942 tempest-ServicesAdminNegativeV253TestJSON-1113662942-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.646195 Jul 25 20:21:24.467916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.468350 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1625/3201] 10.222.0.48 () {60 vars in 1178 bytes} [Mon Jul 25 20:21:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 649 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:21:24.468728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:24.712971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:24.713935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:24.732711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.733397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:24.739317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:24.739799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:25.537091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:25.545810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4d08859-db7f-4f9e-ab28-034174cbabb6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 0.838988 Jul 25 20:21:25.551082 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1626/3202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:24 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:21:25.559961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:25.564770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:25.569129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:25.573414 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ee3a752-f5ab-4f84-9538-402edf6d8012 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 1.153512 Jul 25 20:21:25.574304 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1577/3203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:24 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:25.593002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:25.595151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:25.596238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:25.598530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:25.601497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:25.602285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:25.610148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:25.610895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:25.630485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:25.631855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:25.861149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:25.873001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:25.883049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:25.893566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84f5b515-d8d0-4bed-b038-e1c969e12933 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.333311 Jul 25 20:21:25.895693 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1627/3204] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:25 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:25.999359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:26.012102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-40b1b4b7-308c-4043-a0ff-d15ba3750ab2 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1272 microversion: 2.1 time: 0.430164 Jul 25 20:21:26.043651 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1578/3205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:25 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:26.581573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:26.582950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:26.597634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:26.598588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:26.613084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:26.615511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:26.619756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:26.622897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:26.623291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:26.628355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:26.636334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:26.636766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:27.537706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:27.554605 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3b676db-520f-482d-8d0f-ca400528e97c tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1324 microversion: 2.1 time: 0.960217 Jul 25 20:21:27.568309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1579/3206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:26 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1324 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:27.568309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:27.568309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:27.583513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:27.583991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:27.586112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:27.587769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:27.802913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:27.824251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:27.829679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:27.839366 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-966094bb-1830-4074-9526-6846b547e218 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.281566 Jul 25 20:21:27.842439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1580/3207] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:27 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:27.863081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:27.867218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:27.884485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:27.885470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:27.886502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:27.888655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:27.977878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:28.015381 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ce9312dc-53f5-49ce-9eea-c2a00bff6ee3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 1.437685 Jul 25 20:21:28.030055 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1628/3208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:26 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:28.221717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:28.235019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68f71a4a-c0b4-45aa-9781-e485786d92e3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1314 microversion: 2.1 time: 0.387780 Jul 25 20:21:28.238015 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1581/3209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:27 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:28.581258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:28.581946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:28.597465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:28.599507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:28.601930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:28.602951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:28.873270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:28.874042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:28.886060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:28.886529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:28.887318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:28.891580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:29.108851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:29.121856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:29.127110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:29.135856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b357acb-38a6-4c76-a81e-037a7e8d4e58 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.260217 Jul 25 20:21:29.146754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:29.157365 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1582/3210] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:28 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:29.161796 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51be009d-1227-4906-8616-c4d91f1a1d19 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 200 len: 1519 microversion: 2.1 time: 0.585310 Jul 25 20:21:29.163233 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1629/3211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:28 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 1519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:29.189973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:29.191398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:29.192292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:29.196925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:29.200233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:29.200714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:29.201532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:29.202018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:29.219916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:29.220438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:29.221836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:29.222466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:29.311057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Acquired lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:21:30.584981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:30.603125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db8429ee-a2ed-4327-8968-2b6dc9478e18 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 1.443629 Jul 25 20:21:30.611523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1583/3212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:29 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:30.636068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:30.636782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:30.659002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:30.659456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:30.660511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:30.660957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:31.438147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:32.050761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:32.075051 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c5d887f-df2f-40e4-9c2a-c402e5995597 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1314 microversion: 2.1 time: 1.460905 Jul 25 20:21:32.079845 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1584/3213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:30 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1314 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:32.088809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:32.090472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:32.106132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:32.106841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:32.108028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:32.108709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:32.300268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:32.355051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:32.357179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:32.361081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-67096b54-a317-43a4-9847-eb25134870ad tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.277928 Jul 25 20:21:32.365072 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1585/3214] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:32 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:32.816746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.228534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d8e9066-500f-471e-85c3-8c3a5e2aa77d tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Action: 'create', calling method: .version_select at 0x7f19696729d0>, body: {"keypair": {"name": "tempest-keypair-268178717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwE2QK/UdVkI1S/Z8/UkwhywU41D35i9HGXa0teJytICqSSpSQ1U8PKXqGswIO1BI5WSfs8ReZ14ZeL8ZjZYoEvT84yz+e5/6sSrHN4lIwmwV3UyfQxUKGfMvhZphobIg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:33.293591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5d8e9066-500f-471e-85c3-8c3a5e2aa77d tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Getting quotas for project 5d467e77a15c41c48542d0f1e67c94f0. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:33.354278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-5d8e9066-500f-471e-85c3-8c3a5e2aa77d tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Getting quotas for user 4f45a8a701254c609d48a49ceb85c170 and project 5d467e77a15c41c48542d0f1e67c94f0. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:33.490820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.524779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d8e9066-500f-471e-85c3-8c3a5e2aa77d tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.156513 Jul 25 20:21:33.529346 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1586/3215] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:21:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:33.548923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-88e210a9-911b-42a1-aa3b-310cf7740e0f req-6eb4371f-cdc0-4d42-b4ad-db6b82544dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0", "name": "network-vif-plugged", "status": "completed", "tag": "673a2a09-8fe8-4032-8844-8e9b6baf6c79"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:33.623904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-88e210a9-911b-42a1-aa3b-310cf7740e0f req-6eb4371f-cdc0-4d42-b4ad-db6b82544dc2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:33.625699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-88e210a9-911b-42a1-aa3b-310cf7740e0f req-6eb4371f-cdc0-4d42-b4ad-db6b82544dc2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:33.708578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-88e210a9-911b-42a1-aa3b-310cf7740e0f req-6eb4371f-cdc0-4d42-b4ad-db6b82544dc2 service nova] Creating event network-vif-plugged:673a2a09-8fe8-4032-8844-8e9b6baf6c79 for instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 on n-h2-845775-3 Jul 25 20:21:33.743030 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-88e210a9-911b-42a1-aa3b-310cf7740e0f req-6eb4371f-cdc0-4d42-b4ad-db6b82544dc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207089 Jul 25 20:21:33.748118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1587/3216] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:33.773251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:33.774339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-23ff767c-6bf9-4229-a1aa-2d3f27c1493d req-5eeb44fe-dee6-45d9-8030-a8385f9b6cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74d0ef59-28b3-42dc-a048-17ec0a3213bf", "tag": "61248526-caa9-4009-bf65-128a4c475db0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:33.887006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-23ff767c-6bf9-4229-a1aa-2d3f27c1493d req-5eeb44fe-dee6-45d9-8030-a8385f9b6cf2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:33.889642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-23ff767c-6bf9-4229-a1aa-2d3f27c1493d req-5eeb44fe-dee6-45d9-8030-a8385f9b6cf2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:33.954214 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-23ff767c-6bf9-4229-a1aa-2d3f27c1493d req-5eeb44fe-dee6-45d9-8030-a8385f9b6cf2 service nova] Creating event network-changed:61248526-caa9-4009-bf65-128a4c475db0 for instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf on n-h1-845775-3 Jul 25 20:21:33.981747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-23ff767c-6bf9-4229-a1aa-2d3f27c1493d req-5eeb44fe-dee6-45d9-8030-a8385f9b6cf2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218884 Jul 25 20:21:33.999154 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1588/3217] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:34.026502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:34.034382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:34.059444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:34.061594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:34.062724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:34.063627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:34.972055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:35.006207 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-794bc75a-c17a-42d3-9776-7a3085d3e016 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1308 microversion: 2.1 time: 1.005278 Jul 25 20:21:35.024571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1589/3218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:33 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1308 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:35.045912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:35.048777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:35.075302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:35.079365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:35.080585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:35.082951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:36.167057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:21:36.491929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:36.534348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a44a0d5-2392-448d-a10f-0b796d18c74c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1314 microversion: 2.1 time: 1.491974 Jul 25 20:21:36.537403 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1590/3219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:35 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1314 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:36.577235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:36.585983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:36.619627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:36.635400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:36.642247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:36.645058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:37.590778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:37.602247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:37.611284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:37.614511 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-419e50ac-85ac-45d4-8c2a-6ba4731e9ab2 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 1.070640 Jul 25 20:21:37.620263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1591/3220] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:36 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:37.637707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:37.638647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:37.648683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:37.649995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:37.657382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:37.658205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:38.376345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:38.413817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b477384a-33bd-47ae-b564-94d3442f7945 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1490 microversion: 2.1 time: 0.791844 Jul 25 20:21:38.431371 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1592/3221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:37 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1490 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:38.454999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c8b0f634-ae73-4175-adb8-80ffdc0bc2b9 req-4b557091-787b-4576-9f1d-55dfb363c89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:38.482021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c8b0f634-ae73-4175-adb8-80ffdc0bc2b9 req-4b557091-787b-4576-9f1d-55dfb363c89b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:38.483949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c8b0f634-ae73-4175-adb8-80ffdc0bc2b9 req-4b557091-787b-4576-9f1d-55dfb363c89b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:38.533351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c8b0f634-ae73-4175-adb8-80ffdc0bc2b9 req-4b557091-787b-4576-9f1d-55dfb363c89b service nova] Creating event network-changed:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:21:38.549845 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c8b0f634-ae73-4175-adb8-80ffdc0bc2b9 req-4b557091-787b-4576-9f1d-55dfb363c89b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113738 Jul 25 20:21:38.551679 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1593/3222] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:38.559350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:38.560432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:38.568666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:38.569480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:38.570602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:38.571683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:39.216012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:39.352183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:39.367462 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76e34a2e-74be-4608-969f-efdf5e9aca88 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1314 microversion: 2.1 time: 0.812783 Jul 25 20:21:39.368988 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1594/3223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:38 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:39.422499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Updating instance_info_cache with network_info: [{"id": "76255d5c-ea94-4ec7-be12-1f33caf97bcf", "address": "fa:16:3e:d4:fe:37", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76255d5c-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:21:39.438915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Releasing lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:21:39.442193 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9b07050-6e87-4b23-b817-c8d34c3f02ae tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action" status: 202 len: 0 microversion: 2.1 time: 10.255847 Jul 25 20:21:39.443531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1630/3224] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:29 2022] POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action => generated 0 bytes in 10260 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:21:39.455776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:39.457699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:39.474868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:39.478148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:39.479426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:39.481155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:39.691759 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23389a98-153f-4ccd-9b33-840a3a54469a tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T20%3A21%3A38.253241&end=2022-07-26T20%3A21%3A38.253241" status: 404 len: 112 microversion: - time: 0.321442 Jul 25 20:21:39.692660 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1595/3225] 10.222.0.48 () {58 vars in 1316 bytes} [Mon Jul 25 20:21:39 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-24T20%3A21%3A38.253241&end=2022-07-26T20%3A21%3A38.253241 => generated 112 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 20:21:39.708111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-791306854", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:39.831086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:21:40.130734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:40.158091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:40.169013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:40.175420 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-868d4e4d-93f0-48e6-a2a9-87ec6c5115c4 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.724869 Jul 25 20:21:40.179529 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1631/3226] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:39 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:40.194623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:40.204417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:40.234798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:40.238628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:40.241236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:40.242408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:40.415059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Acquired lock "refresh_cache-1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:21:43.229614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:21:43.231019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:21:43.231848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:21:43.232606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:21:43.233221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:21:43.254631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:43.256513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:43.257578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:43.259750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:43.308822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:43.335019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:43.409508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:21:43.417638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:21:43.517069 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-108e25c1-b2cf-414b-a7e6-39d23afe84a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.823021 Jul 25 20:21:43.519029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1596/3227] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:21:43.531295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc032db5-8b19-4212-8e61-c28fd95f8462 tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] Calling method '.version_select at 0x7f196ea8b430>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:43.541808 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-dc032db5-8b19-4212-8e61-c28fd95f8462 tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc032db5-8b19-4212-8e61-c28fd95f8462 tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] Request method failure captured: Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-simple-tenant-usage/3bbd3566ed0c46b0bd01ae25ae9f0897?start=2022-07-26T20%3A21%3A38.253241&end=2022-07-24T20%3A21%3A38.253241 HTTP/1.1 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vtSnpPcVIEVGT9s6j6v5Rz1Jq4A1Tu1B_HNl0mZTnOKQjkh5xBxhz04jURAJtGRjspUffipTedn-b__Z3ER2e3nW2YSJ8PI5oF8Pv14u-aoDPh_CRpFQGWGiJFQYKzzkN02gBdZPAvybuDFYsatGf1K-TXeBniqPN4J3aqcvSKs8GI Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: bf6e0ec056a3400fa9c2f4fd2dcc5637 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-410722078 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6e0ec056a3400fa9c2f4fd2dcc5637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6e0ec056a3400fa9c2f4fd2dcc5637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6e0ec056a3400fa9c2f4fd2dcc5637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6e0ec056a3400fa9c2f4fd2dcc5637"}]}] Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-410722078 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: bf6e0ec056a3400fa9c2f4fd2dcc5637 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-410722078 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TenantUsagesNegativeTestJSON-410722078-project-admin Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 22468622c3ff444d8530d27f76e38445 Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-410722078-project-admin Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid start time. The start time cannot occur after the end time. Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3bbd3566ed0c46b0bd01ae25ae9f0897'} Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 25 20:21:43.553867 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:43.560947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc032db5-8b19-4212-8e61-c28fd95f8462 tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:43.560947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc032db5-8b19-4212-8e61-c28fd95f8462 tempest-TenantUsagesNegativeTestJSON-410722078 tempest-TenantUsagesNegativeTestJSON-410722078-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/3bbd3566ed0c46b0bd01ae25ae9f0897?start=2022-07-26T20%3A21%3A38.253241&end=2022-07-24T20%3A21%3A38.253241" status: 400 len: 111 microversion: 2.1 time: 0.034319 Jul 25 20:21:43.567450 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1597/3228] 10.222.0.48 () {58 vars in 1412 bytes} [Mon Jul 25 20:21:43 2022] GET /compute/v2.1/os-simple-tenant-usage/3bbd3566ed0c46b0bd01ae25ae9f0897?start=2022-07-26T20%3A21%3A38.253241&end=2022-07-24T20%3A21%3A38.253241 => generated 111 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:21:43.573942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:43.574655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:43.593294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:43.614964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:43.615442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:43.616318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:43.616845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:44.484749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:44.499320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5f8c57b-a18a-47cb-8725-38d34cc275a6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1314 microversion: 2.1 time: 0.930527 Jul 25 20:21:44.499933 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1598/3229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:43 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:44.542159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cd815060-d1e7-4c99-8f41-665ea06e6492 req-fe87ad6c-5b02-4d09-89bc-13b942f2c51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d0ef59-28b3-42dc-a048-17ec0a3213bf", "name": "network-vif-plugged", "status": "completed", "tag": "61248526-caa9-4009-bf65-128a4c475db0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:44.577139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cd815060-d1e7-4c99-8f41-665ea06e6492 req-fe87ad6c-5b02-4d09-89bc-13b942f2c51b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:44.582343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cd815060-d1e7-4c99-8f41-665ea06e6492 req-fe87ad6c-5b02-4d09-89bc-13b942f2c51b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:44.588024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:44.624906 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cd815060-d1e7-4c99-8f41-665ea06e6492 req-fe87ad6c-5b02-4d09-89bc-13b942f2c51b service nova] Creating event network-vif-plugged:61248526-caa9-4009-bf65-128a4c475db0 for instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf on n-h1-845775-3 Jul 25 20:21:44.649935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cd815060-d1e7-4c99-8f41-665ea06e6492 req-fe87ad6c-5b02-4d09-89bc-13b942f2c51b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137973 Jul 25 20:21:44.650818 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1599/3230] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:44.666699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:44.667678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:44.701348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:44.704809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:44.705927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:44.706541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:45.136792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:45.183571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:45.189004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc3fd947993e42919723d0a83baba88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca617b4772e4aa0a186e3538b185797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:45.194425 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1c946ae-b92a-44a6-bb6f-f6f23c00b18f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 200 len: 1603 microversion: 2.42 time: 0.542180 Jul 25 20:21:45.208071 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1600/3231] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:44 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 1603 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:21:45.243232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:45.245951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:45.280563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:45.285462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:45.301777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:45.302666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:45.636526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:45.651779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-438b9e09-2c14-4a27-8190-9a97a4c3acc1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1204 microversion: 2.1 time: 0.441398 Jul 25 20:21:45.663750 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1601/3232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:45 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1204 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:46.307991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10710bbd-b4b7-48c5-8107-dbf301ccc45b tempest-TenantUsagesNegativeTestJSON-1584582417 tempest-TenantUsagesNegativeTestJSON-1584582417-project] Calling method '.version_select at 0x7f1969adf280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:46.325849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-10710bbd-b4b7-48c5-8107-dbf301ccc45b tempest-TenantUsagesNegativeTestJSON-1584582417 tempest-TenantUsagesNegativeTestJSON-1584582417-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ed4c69f12e354b24bf37f32fca466dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bbd3566ed0c46b0bd01ae25ae9f0897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10710bbd-b4b7-48c5-8107-dbf301ccc45b tempest-TenantUsagesNegativeTestJSON-1584582417 tempest-TenantUsagesNegativeTestJSON-1584582417-project] Request method failure captured: Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T20%3A21%3A38.253241&end=2022-07-26T20%3A21%3A38.253241&detailed=1 HTTP/1.1 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vtPSRDHTy7bnTuzQPRqByuGReXuQ-Gm9psG68iYySTgAVohagusrlafP8KiQbgnYtFwq6spLFh3eGwVE_SwuEKz4CvRDOG6EEJMawUzClbYapy3b8EmhiUZxMX7xvwqNbcJDkAL2VWWKID38Gap1pTo02NY_Q_V9qUSC5OgC205-tE Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 3bbd3566ed0c46b0bd01ae25ae9f0897 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1584582417 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3bbd3566ed0c46b0bd01ae25ae9f0897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3bbd3566ed0c46b0bd01ae25ae9f0897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3bbd3566ed0c46b0bd01ae25ae9f0897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3bbd3566ed0c46b0bd01ae25ae9f0897"}]}] Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1584582417 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 3bbd3566ed0c46b0bd01ae25ae9f0897 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1584582417 Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TenantUsagesNegativeTestJSON-1584582417-project Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ed4c69f12e354b24bf37f32fca466dfd Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1584582417-project Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise self.value Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 25 20:21:46.342069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 25 20:21:46.347853 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:46.353006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10710bbd-b4b7-48c5-8107-dbf301ccc45b tempest-TenantUsagesNegativeTestJSON-1584582417 tempest-TenantUsagesNegativeTestJSON-1584582417-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:46.355673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10710bbd-b4b7-48c5-8107-dbf301ccc45b tempest-TenantUsagesNegativeTestJSON-1584582417 tempest-TenantUsagesNegativeTestJSON-1584582417-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T20%3A21%3A38.253241&end=2022-07-26T20%3A21%3A38.253241&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.687870 Jul 25 20:21:46.367439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1602/3233] 10.222.0.48 () {58 vars in 1335 bytes} [Mon Jul 25 20:21:45 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-24T20%3A21%3A38.253241&end=2022-07-26T20%3A21%3A38.253241&detailed=1 => generated 123 bytes in 703 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:21:46.402897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "db8e9b4b-1ccb-4b82-8c87-5e6b4f645789"}], "security_groups": [{"name": "tempest-securitygroup--1439525968"}], "key_name": "tempest-keypair-268178717", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:47.322312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] validate_networks() for [('db8e9b4b-1ccb-4b82-8c87-5e6b4f645789', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:21:48.845804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:21:48.848094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:21:48.848094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:21:48.848094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:21:48.848816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:21:48.867656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:48.868413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:48.870325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:48.871103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:48.915017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Getting quotas for project 5d467e77a15c41c48542d0f1e67c94f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:21:48.930426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Getting quotas for user 4f45a8a701254c609d48a49ceb85c170 and project 5d467e77a15c41c48542d0f1e67c94f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:21:48.967200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:21:48.975136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:21:49.087226 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7589850-1bda-4237-aa27-471d78046ac0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.713824 Jul 25 20:21:49.087917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1603/3234] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:21:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:21:49.104281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:49.104989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:49.130675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.131569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:49.132734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.134626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:49.317479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.neutron [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] re-assign floating IP 172.25.3.123 from instance 02648f0e-2a29-44e4-9ec0-075cdc17823a Jul 25 20:21:49.457457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:49.462442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:21:49.608900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:49.626439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd552828-4d08-46ef-a455-96ad25902a74 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1502 microversion: 2.1 time: 0.532143 Jul 25 20:21:49.627404 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1604/3235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:49 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1502 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:49.652338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:49.654595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:49.678496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.679371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:49.680918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.684750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:49.732187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] HTTP exception thrown: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Request method failure captured: Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 HTTP/1.1 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlfuZ9s_YRNniSVZHmJz1pE90gKqrpkfeMq0U-N7Obvoj8gBqtBRvcUqrAHKL59rEhIyvJosN9LnNFr22v5a8-CbUj0PZ1aqmpECmV2dlyaaWg8AOdq-D7fEOedCCLD7BoZ1EtogpTxZJcAMFxVNDxEVdfRxGNr5br7LguVCJQ8FeM Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dca617b4772e4aa0a186e3538b185797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}] Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: bc3fd947993e42919723d0a83baba88a Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '435399fe-5008-4c4d-8758-6091b6325271'} Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:49.741863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Returning 404 to user: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0ec5bd7e-78f7-4e72-80b4-ae51a5cbe42f tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 404 len: 111 microversion: 2.42 time: 0.097282 Jul 25 20:21:49.757863 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1605/3236] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:21:49 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:21:49.768470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:49.773453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:49.790183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.790659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:49.791524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:49.792017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:50.229618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:52.178165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:52.188788 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f574c8e-5be0-4916-a456-03ce8924bfee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1308 microversion: 2.1 time: 2.429269 Jul 25 20:21:52.202237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1606/3237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:49 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1308 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:52.213820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1b65e370-117f-4be9-b34a-f48536b0d7ac req-c80fa95f-5808-4d60-aed4-adbdd4c6275c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:52.238361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b65e370-117f-4be9-b34a-f48536b0d7ac req-c80fa95f-5808-4d60-aed4-adbdd4c6275c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.239395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b65e370-117f-4be9-b34a-f48536b0d7ac req-c80fa95f-5808-4d60-aed4-adbdd4c6275c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.264081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1b65e370-117f-4be9-b34a-f48536b0d7ac req-c80fa95f-5808-4d60-aed4-adbdd4c6275c service nova] Creating event network-changed:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:21:52.271947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1b65e370-117f-4be9-b34a-f48536b0d7ac req-c80fa95f-5808-4d60-aed4-adbdd4c6275c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068422 Jul 25 20:21:52.274082 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1607/3238] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:52.287967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:52.289789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:52.307921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.308526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.309349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.309912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.517191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:52.519128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Updating instance_info_cache with network_info: [{"id": "76255d5c-ea94-4ec7-be12-1f33caf97bcf", "address": "fa:16:3e:d4:fe:37", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76255d5c-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:21:52.528515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d93ca388-55b6-41e7-8319-d3ad5b51d197 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1283 microversion: 2.1 time: 0.251203 Jul 25 20:21:52.529970 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1608/3239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:52 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1283 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:52.553009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:21:52.566933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:52.571715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:52.610586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.612729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.618707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.620623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.771389 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be2cac80-e166-4dc0-a90d-b57058680fa5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf/action" status: 202 len: 0 microversion: 2.1 time: 0.237508 Jul 25 20:21:52.774208 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1609/3240] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:52 2022] POST /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:21:52.786738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bfb156f1-d6ec-4c03-87c0-01135254eb88 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '.version_select at 0x7f19696300d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:52.826283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bfb156f1-d6ec-4c03-87c0-01135254eb88 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656422458" status: 204 len: 0 microversion: 2.42 time: 0.050036 Jul 25 20:21:52.836957 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1610/3241] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Jul 25 20:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656422458 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:21:52.845900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8a00e664-c0b8-4a72-96f0-213b639c1a37 req-f930351f-2779-4a8c-aced-da3c9d242d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61", "tag": "27b779bf-381d-42fc-bf71-abf3a668b19e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:52.875484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8a00e664-c0b8-4a72-96f0-213b639c1a37 req-f930351f-2779-4a8c-aced-da3c9d242d97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.881856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8a00e664-c0b8-4a72-96f0-213b639c1a37 req-f930351f-2779-4a8c-aced-da3c9d242d97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.904715 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8a00e664-c0b8-4a72-96f0-213b639c1a37 req-f930351f-2779-4a8c-aced-da3c9d242d97 service nova] Creating event network-changed:27b779bf-381d-42fc-bf71-abf3a668b19e for instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 on n-h2-845775-3 Jul 25 20:21:52.916998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8a00e664-c0b8-4a72-96f0-213b639c1a37 req-f930351f-2779-4a8c-aced-da3c9d242d97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078459 Jul 25 20:21:52.919334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1611/3242] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:52.931381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:52.932589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:52.943470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.943947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:52.944798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:52.945452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:54.236502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:54.259535 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afcd79c7-ac9a-4c48-90bd-f0bc98d20934 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1507 microversion: 2.1 time: 1.336787 Jul 25 20:21:54.273377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1612/3243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:52 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1507 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:54.281266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:54.281911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:54.290510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:54.291215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:54.292120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:54.296938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:55.248215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:55.260062 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2042e4b1-88e1-4529-8831-0c9596de2f42 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1308 microversion: 2.1 time: 0.984982 Jul 25 20:21:55.261056 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1613/3244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:54 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1308 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:55.283818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:55.284727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:55.292476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:55.293664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:55.294703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:55.295359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:55.525916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:55.542414 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b60c216f-6f16-416b-bb1c-81586a6efe96 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1283 microversion: 2.1 time: 0.267066 Jul 25 20:21:55.561029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1614/3245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:55 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1283 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:55.582095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0a350799-c64c-481f-9402-14ddac960e52 req-e2f5d9b4-b706-4dfc-9978-cb895d198d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74", "tag": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:55.602284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0a350799-c64c-481f-9402-14ddac960e52 req-e2f5d9b4-b706-4dfc-9978-cb895d198d41 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:55.603253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0a350799-c64c-481f-9402-14ddac960e52 req-e2f5d9b4-b706-4dfc-9978-cb895d198d41 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:55.628979 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0a350799-c64c-481f-9402-14ddac960e52 req-e2f5d9b4-b706-4dfc-9978-cb895d198d41 service nova] Creating event network-changed:8f3dfd10-a53e-45c6-a2da-1d16960ce32c for instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 on n-h2-845775-3 Jul 25 20:21:55.642678 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0a350799-c64c-481f-9402-14ddac960e52 req-e2f5d9b4-b706-4dfc-9978-cb895d198d41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078695 Jul 25 20:21:55.644950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1615/3246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:21:55.659853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:55.661856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:55.675924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:55.677641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:55.679369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:55.680804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:56.656286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Updating instance_info_cache with network_info: [{"id": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c", "address": "fa:16:3e:52:3a:07", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f3dfd10-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:21:56.689878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Releasing lock "refresh_cache-1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:21:56.691415 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d194288a-f9bc-4610-87ed-c7165d429fd3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74/action" status: 202 len: 0 microversion: 2.1 time: 16.508651 Jul 25 20:21:56.693869 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1632/3247] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:40 2022] POST /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74/action => generated 0 bytes in 16512 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:21:56.705276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:56.706615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:56.716400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:56.717261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:56.719081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:56.719781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:57.745807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:57.765319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-992e9cac-33c7-44e9-9177-ceef38e81e40 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1487 microversion: 2.1 time: 2.115710 Jul 25 20:21:57.767337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1616/3248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:55 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1487 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:57.810153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:57.812606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:57.851426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:57.855857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:57.858464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:57.858937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:58.481519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:58.499546 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67d31fc8-7669-4bc3-951e-a95ecbba44a5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1308 microversion: 2.1 time: 1.804004 Jul 25 20:21:58.500607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1633/3249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:56 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1308 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:58.516932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:58.886270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:58.949647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:59.061517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:21:59.101004 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e44d484b-d308-4a96-8a99-aad14f2451c5 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 1.314029 Jul 25 20:21:59.103034 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1617/3250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:57 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:21:59.113918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:21:59.115484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:59.148834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.150832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:59.152707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.155468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:59.215742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:59.229226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lazy-loading 'flavor' on Instance uuid 74d0ef59-28b3-42dc-a048-17ec0a3213bf {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:21:59.232559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.236814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:59.247802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.249628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:59.395563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:21:59.767040 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09e3eb2f-6c49-483e-b541-5e06a3186eec tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf/action" status: 202 len: 0 microversion: 2.1 time: 0.661153 Jul 25 20:21:59.774410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1618/3251] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:59 2022] POST /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:21:59.788711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:21:59.790220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:21:59.812219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.813384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:21:59.815443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:21:59.816136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:00.788929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] HTTP exception thrown: Floating IP 172.25.3.123 is not associated with instance 02648f0e-2a29-44e4-9ec0-075cdc17823a. Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Request method failure captured: Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action HTTP/1.1 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 49 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vsHAXhGsLLgPDkZ9t10bf6PdFxS0D_vpVOfK41QfaO4X1IkXjMSoaqbfa1PXP7jkn1HllL94KllbgunLAJAjZsKHdQ14CtUVGrzKzxHTmMnxnwWOQg5NokINe8ZvpczQnLdMrWoAUmj9End_Tkm-hgsc92ryTnukA7vRCskUef5r6w Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}] Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 80a1f178785743e0a8f55cf2653a13e5 Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: {"removeFloatingIp": {"address": "172.25.3.123"}} Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: exception: Floating IP 172.25.3.123 is not associated with instance 02648f0e-2a29-44e4-9ec0-075cdc17823a. Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '02648f0e-2a29-44e4-9ec0-075cdc17823a', 'body': {'removeFloatingIp': {'address': '172.25.3.123'}}} Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.123 is not associated with instance 02648f0e-2a29-44e4-9ec0-075cdc17823a. Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.123 is not associated with instance 02648f0e-2a29-44e4-9ec0-075cdc17823a. Jul 25 20:22:00.793382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:22:00.801676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Returning 409 to user: Floating IP 172.25.3.123 is not associated with instance 02648f0e-2a29-44e4-9ec0-075cdc17823a. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:00.803014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60307efc-7be7-4643-bf6b-9f20acb481e1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action" status: 409 len: 146 microversion: 2.1 time: 2.301036 Jul 25 20:22:00.810443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1634/3252] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:21:58 2022] POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action => generated 146 bytes in 2309 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:22:00.820051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:00.826449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:00.843303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:00.846253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:00.849070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:00.849739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:01.702071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:01.714073 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55c30135-72cb-46ee-964d-c3ceab90a0b5 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1308 microversion: 2.1 time: 1.937226 Jul 25 20:22:01.714780 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1619/3253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:21:59 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1308 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:01.728782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:01.729797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:01.738639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:01.739611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:01.740748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:01.741466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:01.760322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:01.771021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-41bea682-6475-426b-9446-6ca9878fa184 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1514 microversion: 2.1 time: 0.958852 Jul 25 20:22:01.778656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1635/3254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:00 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1514 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:01.789165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6bcdb507-f111-4c6c-9ee0-9bbf804ab29e req-789faef2-5775-475f-b569-942481ccec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61", "name": "network-vif-plugged", "status": "completed", "tag": "27b779bf-381d-42fc-bf71-abf3a668b19e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:01.815040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6bcdb507-f111-4c6c-9ee0-9bbf804ab29e req-789faef2-5775-475f-b569-942481ccec2d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:01.815535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6bcdb507-f111-4c6c-9ee0-9bbf804ab29e req-789faef2-5775-475f-b569-942481ccec2d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:01.832524 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6bcdb507-f111-4c6c-9ee0-9bbf804ab29e req-789faef2-5775-475f-b569-942481ccec2d service nova] Creating event network-vif-plugged:27b779bf-381d-42fc-bf71-abf3a668b19e for instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 on n-h2-845775-3 Jul 25 20:22:01.838425 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6bcdb507-f111-4c6c-9ee0-9bbf804ab29e req-789faef2-5775-475f-b569-942481ccec2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057810 Jul 25 20:22:01.839356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1636/3255] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:01.844804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:02.707688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:02.722183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.723320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:02.724671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.725452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:02.726488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:02.757077 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-248e2a08-2fbc-4eff-86fe-3d648fe0df1f tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 1.040498 Jul 25 20:22:02.759451 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1620/3256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:01 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:02.769596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:02.771102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:02.785329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.786467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:02.788637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.790420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:02.813999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] HTTP exception thrown: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Request method failure captured: Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 HTTP/1.1 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlfuZ9s_YRNniSVZHmJz1pE90gKqrpkfeMq0U-N7Obvoj8gBqtBRvcUqrAHKL59rEhIyvJosN9LnNFr22v5a8-CbUj0PZ1aqmpECmV2dlyaaWg8AOdq-D7fEOedCCLD7BoZ1EtogpTxZJcAMFxVNDxEVdfRxGNr5br7LguVCJQ8FeM Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dca617b4772e4aa0a186e3538b185797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}] Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: bc3fd947993e42919723d0a83baba88a Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '435399fe-5008-4c4d-8758-6091b6325271'} Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:02.822972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Returning 404 to user: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e38f95fa-eb4d-40ee-8b67-056d4817adb3 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "DELETE /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 404 len: 111 microversion: 2.42 time: 0.067202 Jul 25 20:22:02.838061 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1621/3257] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:22:02 2022] DELETE /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:22:02.843253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:02.844863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:02.862511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.863601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:02.863996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:02.864753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:03.914355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Acquired lock "refresh_cache-1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:22:04.107098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:04.119367 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0b5e681-05fa-4458-b0a4-966c58994467 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1308 microversion: 2.1 time: 1.287490 Jul 25 20:22:04.129530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1622/3258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:02 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1308 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:04.143271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:04.145801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:04.163094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:04.164476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:04.165495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:04.166338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:05.967925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:05.988850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36599055-fb18-4c41-a9c3-8fdec2610f5e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 1.857727 Jul 25 20:22:05.990085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1623/3259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:04 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:06.025090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:06.026869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] [instance: 435399fe-5008-4c4d-8758-6091b6325271] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:06.038318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:06.038789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:06.040150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:06.050682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:06.071103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] HTTP exception thrown: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Request method failure captured: Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 HTTP/1.1 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vlfuZ9s_YRNniSVZHmJz1pE90gKqrpkfeMq0U-N7Obvoj8gBqtBRvcUqrAHKL59rEhIyvJosN9LnNFr22v5a8-CbUj0PZ1aqmpECmV2dlyaaWg8AOdq-D7fEOedCCLD7BoZ1EtogpTxZJcAMFxVNDxEVdfRxGNr5br7LguVCJQ8FeM Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.42 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dca617b4772e4aa0a186e3538b185797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dca617b4772e4aa0a186e3538b185797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dca617b4772e4aa0a186e3538b185797"}]}] Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: dca617b4772e4aa0a186e3538b185797 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89613702 Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: bc3fd947993e42919723d0a83baba88a Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89613702-project Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '435399fe-5008-4c4d-8758-6091b6325271'} Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:06.086388 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. Jul 25 20:22:06.095300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:06.100158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] Returning 404 to user: Instance 435399fe-5008-4c4d-8758-6091b6325271 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:06.100158 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-40ee939d-7ab8-4eb2-b121-01c9539099a8 tempest-TaggedBootDevicesTest_v242-89613702 tempest-TaggedBootDevicesTest_v242-89613702-project] 10.222.0.48 "GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271" status: 404 len: 111 microversion: 2.42 time: 0.107951 Jul 25 20:22:06.101394 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1624/3260] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:22:05 2022] GET /compute/v2.1/servers/435399fe-5008-4c4d-8758-6091b6325271 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:22:06.108922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-25cf050c-0f11-4656-87a0-29b32f7de646 req-9caf777f-fb71-4934-83f2-d39196ef9f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91390391-3a15-4332-b749-eed010f1bf8e", "tag": "98f83cf7-395c-42ae-93f9-48846b070a00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:06.140825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25cf050c-0f11-4656-87a0-29b32f7de646 req-9caf777f-fb71-4934-83f2-d39196ef9f04 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:06.142361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25cf050c-0f11-4656-87a0-29b32f7de646 req-9caf777f-fb71-4934-83f2-d39196ef9f04 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:06.165656 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-25cf050c-0f11-4656-87a0-29b32f7de646 req-9caf777f-fb71-4934-83f2-d39196ef9f04 service nova] Creating event network-changed:98f83cf7-395c-42ae-93f9-48846b070a00 for instance 91390391-3a15-4332-b749-eed010f1bf8e on n-h1-845775-3 Jul 25 20:22:06.175728 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-25cf050c-0f11-4656-87a0-29b32f7de646 req-9caf777f-fb71-4934-83f2-d39196ef9f04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071202 Jul 25 20:22:06.177212 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1625/3261] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:06.187614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:06.189252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:06.204111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:06.205200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:06.207330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:06.208629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:07.641764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:07.687283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aad162ee-d6ce-4d13-8693-eee6508fbf4b tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 1.508043 Jul 25 20:22:07.702571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1626/3262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:06 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:07.716158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-46a23088-cd75-4338-abcb-f7349d13a816 req-c7873b29-4800-4815-ad86-a0bbca6f4158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d0ef59-28b3-42dc-a048-17ec0a3213bf", "name": "network-vif-plugged", "status": "completed", "tag": "61248526-caa9-4009-bf65-128a4c475db0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:07.747700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-46a23088-cd75-4338-abcb-f7349d13a816 req-c7873b29-4800-4815-ad86-a0bbca6f4158 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:07.760817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-46a23088-cd75-4338-abcb-f7349d13a816 req-c7873b29-4800-4815-ad86-a0bbca6f4158 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:07.793363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-46a23088-cd75-4338-abcb-f7349d13a816 req-c7873b29-4800-4815-ad86-a0bbca6f4158 service nova] Creating event network-vif-plugged:61248526-caa9-4009-bf65-128a4c475db0 for instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf on n-h1-845775-3 Jul 25 20:22:07.811170 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-46a23088-cd75-4338-abcb-f7349d13a816 req-c7873b29-4800-4815-ad86-a0bbca6f4158 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106816 Jul 25 20:22:07.812318 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1627/3263] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:07.827033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:07.829182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:07.847397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:07.848266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:07.849596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:07.853435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:08.754889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:08.771815 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28ebae29-af58-4cd4-8c3f-7e355f670edc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1490 microversion: 2.1 time: 0.957878 Jul 25 20:22:08.772458 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1628/3264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:07 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1490 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:09.613458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:22:09.667919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:09.669108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:09.717324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:09.718036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:09.727407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:09.727971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:12.056327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:12.103178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94d39a14-b9ec-4c83-bbe4-ba9d12325fa1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 3.294040 Jul 25 20:22:12.110634 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1629/3265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:08 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 3303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:12.134629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:12.135753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:12.196811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:12.197599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:12.208528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:12.211948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:12.720010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.780517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:13.826708 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0ed3a8b4-9e85-40c7-98ab-fef5096ae0c0 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 1.701898 Jul 25 20:22:13.826708 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1630/3266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:12 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:13.848871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:13.850605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:13.870247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:13.894370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:13.908050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:13.909965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:13.911872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:14.114703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Updating instance_info_cache with network_info: [{"id": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c", "address": "fa:16:3e:52:3a:07", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8f3dfd10-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:22:14.154753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Releasing lock "refresh_cache-1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:22:14.159488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0b5a470b-6354-48f9-a0fa-beabdc90baac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74/action" status: 202 len: 0 microversion: 2.1 time: 12.318532 Jul 25 20:22:14.167257 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1637/3267] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:22:01 2022] POST /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74/action => generated 0 bytes in 12327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:22:14.205471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b114b9b9-b3bc-49f9-a565-463d4ace2478 req-d7ab8597-de8f-4e38-b959-638b57ad8dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74", "tag": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:14.252257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b114b9b9-b3bc-49f9-a565-463d4ace2478 req-d7ab8597-de8f-4e38-b959-638b57ad8dd4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:14.261226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b114b9b9-b3bc-49f9-a565-463d4ace2478 req-d7ab8597-de8f-4e38-b959-638b57ad8dd4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:14.300198 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b114b9b9-b3bc-49f9-a565-463d4ace2478 req-d7ab8597-de8f-4e38-b959-638b57ad8dd4 service nova] Creating event network-changed:8f3dfd10-a53e-45c6-a2da-1d16960ce32c for instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 on n-h2-845775-3 Jul 25 20:22:14.349113 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b114b9b9-b3bc-49f9-a565-463d4ace2478 req-d7ab8597-de8f-4e38-b959-638b57ad8dd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171645 Jul 25 20:22:14.354731 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1638/3268] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:14.385213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:14.395053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:14.428530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:14.431111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:14.435199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:14.436082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:15.466169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:15.510773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-70386b9c-e040-4dba-8967-d9c62acf4979 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1490 microversion: 2.1 time: 1.678142 Jul 25 20:22:15.512790 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1631/3269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:13 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1490 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:15.565595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:15.566403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:15.617928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:15.621884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:15.622922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:15.623519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:15.734811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:22:15.914592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:15.964119 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8cd7ae46-d25f-43a3-bd63-331ba75e9d2c tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 1.594721 Jul 25 20:22:15.981827 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1639/3270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:14 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:16.040858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:16.045653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:16.082507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:16.089083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:16.095486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:16.097935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:16.285592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed933989-3ac3-4913-ae51-f431ba26e369 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 204 len: 0 microversion: 2.1 time: 0.732263 Jul 25 20:22:16.316485 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1632/3271] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:22:15 2022] DELETE /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:16.380226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:16.381311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:16.394485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:16.394857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:16.395667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:16.405569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:17.719589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:17.762552 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-202d413d-7b17-44b5-b280-e0c34cdd9c4a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 1.777771 Jul 25 20:22:17.774341 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1640/3272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:15 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:17.828060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:17.841823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:17.902125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:17.902896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:17.923863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:17.924829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:17.975330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:18.021505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Acquired lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:22:18.049614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7857743d-2f4c-487b-a842-bc6b23a4e59c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1490 microversion: 2.1 time: 1.729591 Jul 25 20:22:18.058675 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1633/3273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:16 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1490 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:18.071033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:18.088909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:18.103026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:18.112924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:18.114450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:18.121030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:21.519666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:21.558940 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-40bfb6f9-d8f9-4772-9211-f1a6ebdd84b6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 3.494644 Jul 25 20:22:21.566917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1634/3274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:18 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 3508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:21.581827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f4e051d9-4683-4d32-93c1-1f4dafafd4c9 req-6b8f0e4c-2598-4da1-85bc-20cdb29a5a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91390391-3a15-4332-b749-eed010f1bf8e", "name": "network-vif-plugged", "status": "completed", "tag": "98f83cf7-395c-42ae-93f9-48846b070a00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:21.632198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f4e051d9-4683-4d32-93c1-1f4dafafd4c9 req-6b8f0e4c-2598-4da1-85bc-20cdb29a5a73 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:21.633035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f4e051d9-4683-4d32-93c1-1f4dafafd4c9 req-6b8f0e4c-2598-4da1-85bc-20cdb29a5a73 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:21.708908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f4e051d9-4683-4d32-93c1-1f4dafafd4c9 req-6b8f0e4c-2598-4da1-85bc-20cdb29a5a73 service nova] Creating event network-vif-plugged:98f83cf7-395c-42ae-93f9-48846b070a00 for instance 91390391-3a15-4332-b749-eed010f1bf8e on n-h1-845775-3 Jul 25 20:22:21.733597 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f4e051d9-4683-4d32-93c1-1f4dafafd4c9 req-6b8f0e4c-2598-4da1-85bc-20cdb29a5a73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163600 Jul 25 20:22:21.734652 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1635/3275] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:21.766081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:21.768611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:21.795090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:21.795764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:21.797169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:21.797898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:21.929665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:22:22.025305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:22.265028 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0783264f-276c-4117-bb29-eeede066e40b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 204 len: 0 microversion: 2.1 time: 0.522884 Jul 25 20:22:22.269089 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1636/3276] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:22:21 2022] DELETE /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:22.292352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:22.300413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:22.317183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:22.317803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:22.319136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:22.319852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:23.215126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:23.245182 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e61fee9-ba96-4865-9287-736618ab7318 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1351 microversion: 2.1 time: 0.973751 Jul 25 20:22:23.250900 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1637/3277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:22 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1351 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:23.282500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5d22e992-44cb-404c-891a-9f2518dad4a1 req-fe1e489b-1dba-44ee-b075-69b62464ef3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74", "name": "network-vif-deleted", "tag": "8f3dfd10-a53e-45c6-a2da-1d16960ce32c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:23.319154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d22e992-44cb-404c-891a-9f2518dad4a1 req-fe1e489b-1dba-44ee-b075-69b62464ef3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:23.319607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d22e992-44cb-404c-891a-9f2518dad4a1 req-fe1e489b-1dba-44ee-b075-69b62464ef3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:23.386097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5d22e992-44cb-404c-891a-9f2518dad4a1 req-fe1e489b-1dba-44ee-b075-69b62464ef3b service nova] Creating event network-vif-deleted:8f3dfd10-a53e-45c6-a2da-1d16960ce32c for instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 on n-h2-845775-3 Jul 25 20:22:23.405439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5d22e992-44cb-404c-891a-9f2518dad4a1 req-fe1e489b-1dba-44ee-b075-69b62464ef3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148192 Jul 25 20:22:23.409115 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1638/3278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:23.424256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:23.425227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:23.440938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:23.441837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:23.447564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:23.451499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:25.557893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:25.575397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7066b6f-88fa-4292-8038-b957b100ed83 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1496 microversion: 2.1 time: 2.164618 Jul 25 20:22:25.577188 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1639/3279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:23 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1496 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:25.623628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:25.625664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:25.643684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:25.644689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:25.647111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:25.648805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:27.464736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:27.489941 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad7e1496-1f6f-4601-927f-2e3015869dc1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 1.910424 Jul 25 20:22:27.508755 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1640/3280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:25 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:27.528250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:27.529065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:27.569274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:27.613736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:27.613736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:27.613736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:27.890854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:27.992690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=53,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:29.446402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:29.460049 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84078a13-26bc-4510-9a55-226bc1648001 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1541 microversion: 2.1 time: 1.949981 Jul 25 20:22:29.475096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1641/3281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:27 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1541 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:29.481176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:29.508698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:29.527849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:29.533543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:29.534731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:29.535551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:29.813195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:29.837851 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4818663d-0c10-4124-8c5b-4d941483e4a6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 200 len: 1454 microversion: 2.1 time: 0.360144 Jul 25 20:22:29.838810 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1642/3282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:29 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 1454 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:29.871890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:29.881113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:29.896324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:29.904669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:29.907766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:29.918918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:30.423914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:22:31.093324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:31.107535 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bab0fb90-c206-43e0-a9d0-091ad3ba5ab6 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 1.252162 Jul 25 20:22:31.113033 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1643/3283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:29 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:31.152260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:31.154076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:31.197301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:31.198115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:31.203079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:31.205982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:31.668867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0960400a-753d-4a21-b7ea-f0d333ca32da tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.548485 Jul 25 20:22:31.670047 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1644/3284] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:22:31 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e/os-interface => generated 285 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:31.675235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-580f9a83-acdb-4bad-8a44-7bac53c1e3d9 req-72bbceb1-b26c-463e-8c1f-9358dc658a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61", "name": "network-vif-deleted", "tag": "27b779bf-381d-42fc-bf71-abf3a668b19e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:31.708221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-580f9a83-acdb-4bad-8a44-7bac53c1e3d9 req-72bbceb1-b26c-463e-8c1f-9358dc658a0c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:31.708743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-580f9a83-acdb-4bad-8a44-7bac53c1e3d9 req-72bbceb1-b26c-463e-8c1f-9358dc658a0c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:31.744683 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-580f9a83-acdb-4bad-8a44-7bac53c1e3d9 req-72bbceb1-b26c-463e-8c1f-9358dc658a0c service nova] Creating event network-vif-deleted:27b779bf-381d-42fc-bf71-abf3a668b19e for instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 on n-h2-845775-3 Jul 25 20:22:31.768131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-580f9a83-acdb-4bad-8a44-7bac53c1e3d9 req-72bbceb1-b26c-463e-8c1f-9358dc658a0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096543 Jul 25 20:22:31.769060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1645/3285] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:31.774502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:31.776931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:31.795286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:31.796202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:31.797210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:31.798065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:31.830396 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 HTTP/1.1 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61'} Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:31.833358 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:22:31.838938 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:31.849719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:31.851233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0326e2af-479d-4ac6-918b-8508f3ca6bef tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 404 len: 111 microversion: 2.1 time: 0.080764 Jul 25 20:22:31.853833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1646/3286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:31 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:22:32.167807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1cf6138a-4a0b-4837-aef6-645b1f61360b tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Action: 'create', calling method: .version_select at 0x7f1969863790>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:33.379704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Updating instance_info_cache with network_info: [{"id": "76255d5c-ea94-4ec7-be12-1f33caf97bcf", "address": "fa:16:3e:d4:fe:37", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76255d5c-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:22:33.399364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Releasing lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:22:33.404424 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82e765dc-d3bb-438f-bf9d-8b295c396fac tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action" status: 202 len: 0 microversion: 2.1 time: 15.610917 Jul 25 20:22:33.413048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1641/3287] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:22:17 2022] POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action => generated 0 bytes in 15631 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:22:33.455384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:33.462737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:33.496159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:33.498734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:33.514361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:33.515410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:33.607847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:22:33.838712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33dbaa2e-9ac0-46ae-b79a-5d8d9fadf90c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 204 len: 0 microversion: 2.1 time: 0.421169 Jul 25 20:22:33.839714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1642/3288] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:22:33 2022] DELETE /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:33.854812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:33.855426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:33.875484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:33.876792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:33.880231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:33.880711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:34.724253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:34.734639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c50c816-542d-45be-a88b-c006638a1adc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1509 microversion: 2.1 time: 0.890753 Jul 25 20:22:34.738463 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1643/3289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:33 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1509 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:34.752011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b34b1c0f-1356-4f55-85e9-0023610e7df4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '.version_select at 0x7f196a06bf70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:37.608199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b34b1c0f-1356-4f55-85e9-0023610e7df4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/925e76ff-ed5c-475a-9aaa-c69e8a1a1462" status: 200 len: 185 microversion: 2.1 time: 2.868246 Jul 25 20:22:37.609137 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1644/3290] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:22:34 2022] GET /compute/v2.1/os-floating-ips/925e76ff-ed5c-475a-9aaa-c69e8a1a1462 => generated 185 bytes in 2870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:37.614142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3d78bfa9-cb90-4920-bf89-61adc8022252 req-580a7dc4-0865-4492-81d3-c075a544ab59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:37.636194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3d78bfa9-cb90-4920-bf89-61adc8022252 req-580a7dc4-0865-4492-81d3-c075a544ab59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:37.636649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3d78bfa9-cb90-4920-bf89-61adc8022252 req-580a7dc4-0865-4492-81d3-c075a544ab59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:37.662347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3d78bfa9-cb90-4920-bf89-61adc8022252 req-580a7dc4-0865-4492-81d3-c075a544ab59 service nova] Creating event network-changed:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:22:37.671662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3d78bfa9-cb90-4920-bf89-61adc8022252 req-580a7dc4-0865-4492-81d3-c075a544ab59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061240 Jul 25 20:22:37.672331 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1645/3291] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:37.684514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:37.687235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:37.694429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:37.695863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:37.696900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:37.697644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:38.821530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:38.836997 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8c3459e-bcfc-4945-9365-94262a50d983 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1496 microversion: 2.1 time: 1.161373 Jul 25 20:22:38.852443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1646/3292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:37 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1496 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:38.858986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:38.860020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:38.871724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:38.877373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:38.878522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:38.879146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:39.594133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:39.610579 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d74925c2-9511-4cc7-94a3-5edf6b190913 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1506 microversion: 2.1 time: 0.756431 Jul 25 20:22:39.611842 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1647/3293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:38 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1506 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:39.617269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c084f2ec-6b0e-4ddb-886b-62ec3a4fa830 req-7ff0f797-a8f4-48f6-8adb-fe293143dfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91390391-3a15-4332-b749-eed010f1bf8e", "tag": "98f83cf7-395c-42ae-93f9-48846b070a00"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:39.631327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c084f2ec-6b0e-4ddb-886b-62ec3a4fa830 req-7ff0f797-a8f4-48f6-8adb-fe293143dfba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:39.632298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c084f2ec-6b0e-4ddb-886b-62ec3a4fa830 req-7ff0f797-a8f4-48f6-8adb-fe293143dfba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:39.650595 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c084f2ec-6b0e-4ddb-886b-62ec3a4fa830 req-7ff0f797-a8f4-48f6-8adb-fe293143dfba service nova] Creating event network-changed:98f83cf7-395c-42ae-93f9-48846b070a00 for instance 91390391-3a15-4332-b749-eed010f1bf8e on n-h1-845775-3 Jul 25 20:22:39.660692 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c084f2ec-6b0e-4ddb-886b-62ec3a4fa830 req-7ff0f797-a8f4-48f6-8adb-fe293143dfba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047278 Jul 25 20:22:39.661997 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1648/3294] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:39.669404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.123"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:40.816112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:40.837918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:40.838735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:40.850040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:40.850884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.558008 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1cf6138a-4a0b-4837-aef6-645b1f61360b tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.702788 Jul 25 20:22:41.558902 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1647/3295] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:22:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:41.564114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:41.565036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:41.572216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.573327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.574352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.575764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.629140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.630157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.630735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lazy-loading 'fault' on Instance uuid dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:22:41.768317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:41.782143 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80c95510-df96-4c1e-82e9-f63871fcf759 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 200 len: 1298 microversion: 2.1 time: 0.222120 Jul 25 20:22:41.783526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1648/3296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:41 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:41.789215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-48f66e71-3844-4bc1-9459-62c64976a0be req-18108f78-42d3-41b4-afc4-60d9eeafc7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d0ef59-28b3-42dc-a048-17ec0a3213bf", "name": "network-vif-unplugged", "status": "completed", "tag": "61248526-caa9-4009-bf65-128a4c475db0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:41.799951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-48f66e71-3844-4bc1-9459-62c64976a0be req-18108f78-42d3-41b4-afc4-60d9eeafc7dc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.800702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-48f66e71-3844-4bc1-9459-62c64976a0be req-18108f78-42d3-41b4-afc4-60d9eeafc7dc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.816182 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-48f66e71-3844-4bc1-9459-62c64976a0be req-18108f78-42d3-41b4-afc4-60d9eeafc7dc service nova] Creating event network-vif-unplugged:61248526-caa9-4009-bf65-128a4c475db0 for instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf on n-h1-845775-3 Jul 25 20:22:41.823150 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-48f66e71-3844-4bc1-9459-62c64976a0be req-18108f78-42d3-41b4-afc4-60d9eeafc7dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037956 Jul 25 20:22:41.824334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1649/3297] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:41.830326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Acquired lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:22:41.832325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:41.833222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:41.842938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.844705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:41.845829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:41.846454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:42.250625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:42.281978 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5194bd2-d750-4869-a7f7-ce4cfcb4a27d tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1506 microversion: 2.1 time: 0.454256 Jul 25 20:22:42.291692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1650/3298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:41 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:42.299607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-dd224747-e5e2-470a-89d7-030d79eb828e req-5165ffe1-8974-4ef4-8ca1-051a82fe617e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0", "name": "network-vif-deleted", "tag": "673a2a09-8fe8-4032-8844-8e9b6baf6c79"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:42.321080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd224747-e5e2-470a-89d7-030d79eb828e req-5165ffe1-8974-4ef4-8ca1-051a82fe617e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:42.321603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dd224747-e5e2-470a-89d7-030d79eb828e req-5165ffe1-8974-4ef4-8ca1-051a82fe617e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:42.350790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dd224747-e5e2-470a-89d7-030d79eb828e req-5165ffe1-8974-4ef4-8ca1-051a82fe617e service nova] Creating event network-vif-deleted:673a2a09-8fe8-4032-8844-8e9b6baf6c79 for instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 on n-h2-845775-3 Jul 25 20:22:42.358304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-dd224747-e5e2-470a-89d7-030d79eb828e req-5165ffe1-8974-4ef4-8ca1-051a82fe617e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064274 Jul 25 20:22:42.359576 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1651/3299] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:42.367741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d3520a3-6fb3-479e-b91e-dced3880a268 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f19698e14c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:43.742455 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d3520a3-6fb3-479e-b91e-dced3880a268 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/dcb17c39-aea1-4290-9e0b-c4adf320d54e" status: 200 len: 142 microversion: 2.1 time: 1.380190 Jul 25 20:22:43.744651 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1652/3300] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:22:42 2022] GET /compute/v2.1/os-floating-ips/dcb17c39-aea1-4290-9e0b-c4adf320d54e => generated 142 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:43.752445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:43.758902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:43.771309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:43.772455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:43.773947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:43.774749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:43.792999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 HTTP/1.1 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0'} Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:43.795002 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:43.802465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:43.803153 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-caf348e8-5f6c-4857-85c9-1579718a48db tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 404 len: 111 microversion: 2.1 time: 0.055542 Jul 25 20:22:43.804851 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1653/3301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:43 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:22:43.825937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:43.826976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:43.835823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:43.836448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:43.837549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:43.838473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:44.212736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:44.230291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3cd6f988-2bcf-4fe2-a949-436c280ba4bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 200 len: 1449 microversion: 2.1 time: 0.423651 Jul 25 20:22:44.233122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1654/3302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:43 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 1449 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:44.238111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d1436c6-00b1-4f9b-a66d-9ea9886477d9 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f19698c3280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:44.791430 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d1436c6-00b1-4f9b-a66d-9ea9886477d9 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.556987 Jul 25 20:22:44.792949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1655/3303] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:22:44 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:44.806703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-959137474", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:44.832119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:44.926899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:22:45.734182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:22:47.392428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:22:47.392972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:22:47.393701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:22:47.394697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:22:47.395371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:22:47.413012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:47.415087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:47.416471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:47.417238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:47.464430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:22:47.473449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:22:47.496480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:22:47.501519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:22:47.602233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-092b77ed-997e-4346-9364-8cb451222671 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.799526 Jul 25 20:22:47.611996 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1656/3304] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:22:47.617875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:47.618926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:47.634730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:47.636707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:47.637867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:47.647296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:47.854628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Updating instance_info_cache with network_info: [{"id": "76255d5c-ea94-4ec7-be12-1f33caf97bcf", "address": "fa:16:3e:d4:fe:37", "network": {"id": "c441f576-3b14-43c7-9126-13e4c642602e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-884560566-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ba72bf5485d140b3b643d4061a0b870a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap76255d5c-ea", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:22:47.869822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Releasing lock "refresh_cache-02648f0e-2a29-44e4-9ec0-075cdc17823a" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:22:47.870896 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79eab84f-d5b9-49c7-9e06-78173e61f1a9 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action" status: 202 len: 0 microversion: 2.1 time: 8.207305 Jul 25 20:22:47.875083 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1649/3305] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:22:39 2022] POST /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a/action => generated 0 bytes in 8212 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:22:47.889510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ccd446a-5f8d-4e41-883f-0e763a9504a8 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f196a06bf70>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:48.048578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:48.058636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da5c3b51-2c8e-4543-a000-bb95d262e9b1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.445168 Jul 25 20:22:48.059248 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1657/3306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:47 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:48.355722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1e228e71-62f2-4302-a421-8bbe0d069ca3 req-e455f8d7-0dd2-42eb-877a-ff8bddbd2858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:48.403980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e228e71-62f2-4302-a421-8bbe0d069ca3 req-e455f8d7-0dd2-42eb-877a-ff8bddbd2858 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:48.410670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e228e71-62f2-4302-a421-8bbe0d069ca3 req-e455f8d7-0dd2-42eb-877a-ff8bddbd2858 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:48.445716 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1e228e71-62f2-4302-a421-8bbe0d069ca3 req-e455f8d7-0dd2-42eb-877a-ff8bddbd2858 service nova] Creating event network-changed:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:22:48.454116 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1e228e71-62f2-4302-a421-8bbe0d069ca3 req-e455f8d7-0dd2-42eb-877a-ff8bddbd2858 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392708 Jul 25 20:22:48.455814 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1658/3307] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:48.467737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-054a8f21-5b20-4c0e-b229-5f0a79458359 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:48.471215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-054a8f21-5b20-4c0e-b229-5f0a79458359 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:48.642411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-054a8f21-5b20-4c0e-b229-5f0a79458359 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:48.652415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-054a8f21-5b20-4c0e-b229-5f0a79458359 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1208 microversion: 2.1 time: 0.194511 Jul 25 20:22:48.663437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1659/3308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:48 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1208 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:48.670097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:48.670727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:48.679970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:48.685074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:48.687801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:48.689236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:48.720023 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] HTTP exception thrown: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Request method failure captured: Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 HTTP/1.1 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vsHAXhGsLLgPDkZ9t10bf6PdFxS0D_vpVOfK41QfaO4X1IkXjMSoaqbfa1PXP7jkn1HllL94KllbgunLAJAjZsKHdQ14CtUVGrzKzxHTmMnxnwWOQg5NokINe8ZvpczQnLdMrWoAUmj9End_Tkm-hgsc92ryTnukA7vRCskUef5r6w Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}] Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 80a1f178785743e0a8f55cf2653a13e5 Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74'} Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:48.721854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Returning 404 to user: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:48.728937 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-496dea98-aeb6-47f7-8f6d-63e84ad3c2b3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 404 len: 111 microversion: 2.1 time: 0.058613 Jul 25 20:22:48.730166 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1660/3309] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:22:48 2022] DELETE /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:22:48.737140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:48.738018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:48.745983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:48.746348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:48.747146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:48.747598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:49.957441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:49.974300 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97be6311-9c75-4222-acaf-59b912f583f9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.243045 Jul 25 20:22:49.978926 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1661/3310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:48 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:49.993557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:49.994482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:50.021994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.023435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.024866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.025625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.046980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:50.049663 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] HTTP exception thrown: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Request method failure captured: Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 HTTP/1.1 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vsHAXhGsLLgPDkZ9t10bf6PdFxS0D_vpVOfK41QfaO4X1IkXjMSoaqbfa1PXP7jkn1HllL94KllbgunLAJAjZsKHdQ14CtUVGrzKzxHTmMnxnwWOQg5NokINe8ZvpczQnLdMrWoAUmj9End_Tkm-hgsc92ryTnukA7vRCskUef5r6w Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}] Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 80a1f178785743e0a8f55cf2653a13e5 Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74'} Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:50.052169 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. Jul 25 20:22:50.059954 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:22:50.062603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Returning 404 to user: Instance 1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:22:50.064132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42b75757-6059-4292-9064-afdd28ecf8ed tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74" status: 404 len: 111 microversion: 2.1 time: 0.083632 Jul 25 20:22:50.065176 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1662/3311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:49 2022] GET /compute/v2.1/servers/1cbfa1e3-4ff9-4f48-bb73-bdf99d5dee74 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:22:50.074300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:50.075663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:50.090745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.092086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.093408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.094529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.291988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:50.310712 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1bfcee6-b70e-4457-b090-982f70e4a385 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1266 microversion: 2.1 time: 0.243695 Jul 25 20:22:50.315066 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1663/3312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:50 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:50.329793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:50.330657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:50.381864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.383218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.385836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:50.388253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:50.830572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:51.312843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:51.329602 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81dd00bf-bf54-422c-920c-17088ba70116 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.013075 Jul 25 20:22:51.355578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1664/3313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:50 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:51.355578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1390d43b-2f3b-4831-9e74-7f197a58b0f1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '.version_select at 0x7f1969863ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:51.739464 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ccd446a-5f8d-4e41-883f-0e763a9504a8 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/dcb17c39-aea1-4290-9e0b-c4adf320d54e" status: 202 len: 0 microversion: 2.1 time: 3.862140 Jul 25 20:22:51.740499 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1650/3314] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:22:47 2022] DELETE /compute/v2.1/os-floating-ips/dcb17c39-aea1-4290-9e0b-c4adf320d54e => generated 0 bytes in 3864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:22:51.748090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:51.748919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:51.760389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:51.760704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:51.761944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:51.762573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:51.916860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:51.927513 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ce05f96-b319-4b4f-8b0c-c6781f60112e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1266 microversion: 2.1 time: 0.185098 Jul 25 20:22:51.928253 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1651/3315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:51 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:51.934391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:51.939566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:51.948856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:51.949655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:51.950751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:51.951405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:52.342421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:52.358010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b36da01a-041c-4fe1-937b-a1fe2c86a9a5 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.427561 Jul 25 20:22:52.358892 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1652/3316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:51 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:52.369163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-866f8d47-b5d1-4f96-a228-6f71ea7bc19b tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Action: 'create', calling method: .version_select at 0x7f196ea78f70>, body: {"pool": null} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:53.577976 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1390d43b-2f3b-4831-9e74-7f197a58b0f1 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/925e76ff-ed5c-475a-9aaa-c69e8a1a1462" status: 202 len: 0 microversion: 2.1 time: 2.229661 Jul 25 20:22:53.578557 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1665/3317] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:22:51 2022] DELETE /compute/v2.1/os-floating-ips/925e76ff-ed5c-475a-9aaa-c69e8a1a1462 => generated 0 bytes in 2231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:22:53.584229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63ca96e4-6ee1-441d-85dc-72399384be2f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:53.592941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ca96e4-6ee1-441d-85dc-72399384be2f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:53.594063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63ca96e4-6ee1-441d-85dc-72399384be2f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:53.620511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63ca96e4-6ee1-441d-85dc-72399384be2f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Going to try to stop instance {{(pid=119723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:22:53.680431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63ca96e4-6ee1-441d-85dc-72399384be2f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.099760 Jul 25 20:22:53.681681 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1666/3318] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:22:53 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:22:53.716104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:53.717506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:53.728593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:53.729055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:53.731645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:53.732147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:54.147265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:54.158141 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e8c99adf-a545-4339-a9f4-a3d0b474c4fe tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.474754 Jul 25 20:22:54.173923 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1667/3319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:53 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:54.185046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:54.185518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:54.192657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:54.192920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:54.194021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:54.195294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:54.253044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:22:54.405284 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41eba31a-31ce-4430-96db-7d35de7cb497 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "DELETE /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 204 len: 0 microversion: 2.1 time: 0.230414 Jul 25 20:22:54.405899 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1668/3320] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:22:54 2022] DELETE /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:22:54.417258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:54.418255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:54.429888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:54.436622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:54.438690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:54.439344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:55.430814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:55.446253 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ed527ab-b62f-4f6f-aeb4-0791e8fa02a1 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 1.038610 Jul 25 20:22:55.448400 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1669/3321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:54 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:55.453970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:55.454843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:55.462896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:55.464057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:55.465146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:55.465870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:55.982251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:56.007839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-210a65ce-f6b1-49ef-83b6-61310b123948 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1525 microversion: 2.1 time: 0.557519 Jul 25 20:22:56.009790 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1670/3322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:55 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1525 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:56.017154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:56.018078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:56.041574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:56.048777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:56.056850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:56.057515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:56.740002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:56.748481 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3dde8e98-5f21-45e3-9338-85356884a45d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.736723 Jul 25 20:22:56.754013 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1671/3323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:56 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:56.758843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1c7d052c-9cdb-42b8-882e-c35e46c5e6bd req-407cf2ed-fdb9-42ed-8ad5-115b5aaa87d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b44c56-fbc0-4090-89bd-c44ea7335d56", "tag": "4663e1d7-302d-4f9c-aeb2-a0ba390cc810"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:22:56.780023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1c7d052c-9cdb-42b8-882e-c35e46c5e6bd req-407cf2ed-fdb9-42ed-8ad5-115b5aaa87d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:56.780876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1c7d052c-9cdb-42b8-882e-c35e46c5e6bd req-407cf2ed-fdb9-42ed-8ad5-115b5aaa87d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:56.811504 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1c7d052c-9cdb-42b8-882e-c35e46c5e6bd req-407cf2ed-fdb9-42ed-8ad5-115b5aaa87d2 service nova] Creating event network-changed:4663e1d7-302d-4f9c-aeb2-a0ba390cc810 for instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 on n-h2-845775-3 Jul 25 20:22:56.825207 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1c7d052c-9cdb-42b8-882e-c35e46c5e6bd req-407cf2ed-fdb9-42ed-8ad5-115b5aaa87d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066318 Jul 25 20:22:56.826287 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1672/3324] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:56.840120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:56.841149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:56.849194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:56.850393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:56.851451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:56.852919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:57.445104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:57.618986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-866f8d47-b5d1-4f96-a228-6f71ea7bc19b tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.256765 Jul 25 20:22:57.620301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1653/3325] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:22:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:22:57.629796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:57.632160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:57.648853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:57.650429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:57.651980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:57.652825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:57.703391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:57.720610 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f37928b-16a6-4853-84c5-501b71c64e3a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.888093 Jul 25 20:22:57.722575 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1673/3326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:56 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:57.743104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b2e3bc1-2404-4c3d-b2ec-abb9cc510be5 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f1969844b80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:58.651888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:58.656891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1f178785743e0a8f55cf2653a13e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba72bf5485d140b3b643d4061a0b870a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:58.661302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=65,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:22:58.676309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9b6d0d9-3e41-4525-8fc3-f03faab240d3 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 200 len: 1525 microversion: 2.1 time: 1.055819 Jul 25 20:22:58.677877 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1654/3327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:57 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 1525 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:58.698018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:58.699556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:58.718076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:58.723234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:58.724809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:58.730353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:59.458129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:59.482638 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e6bbcfa-dc2a-470a-8c88-2eab4b4b0a51 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.794061 Jul 25 20:22:59.494939 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1655/3328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:58 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:22:59.504404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:22:59.506272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:22:59.517223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:59.518489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:59.520221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:22:59.521036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:22:59.989756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:22:59.999738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4276c206-812f-4220-a9f1-afc935ad46b9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.503380 Jul 25 20:23:00.012819 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1656/3329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:22:59 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:00.020959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f881c02b-833c-4f86-82cc-b57eb552b4d2 req-207b2e58-95f6-473c-973e-5c1f6ce338ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02648f0e-2a29-44e4-9ec0-075cdc17823a", "name": "network-vif-deleted", "tag": "76255d5c-ea94-4ec7-be12-1f33caf97bcf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:00.033262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f881c02b-833c-4f86-82cc-b57eb552b4d2 req-207b2e58-95f6-473c-973e-5c1f6ce338ec service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:00.034033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f881c02b-833c-4f86-82cc-b57eb552b4d2 req-207b2e58-95f6-473c-973e-5c1f6ce338ec service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:00.047658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f881c02b-833c-4f86-82cc-b57eb552b4d2 req-207b2e58-95f6-473c-973e-5c1f6ce338ec service nova] Creating event network-vif-deleted:76255d5c-ea94-4ec7-be12-1f33caf97bcf for instance 02648f0e-2a29-44e4-9ec0-075cdc17823a on n-h1-845775-3 Jul 25 20:23:00.056148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f881c02b-833c-4f86-82cc-b57eb552b4d2 req-207b2e58-95f6-473c-973e-5c1f6ce338ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041706 Jul 25 20:23:00.056776 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1657/3330] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:00.062765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:00.063842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] [instance: 02648f0e-2a29-44e4-9ec0-075cdc17823a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:00.072951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:00.074109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:00.074970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:00.075697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:00.092667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] HTTP exception thrown: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Request method failure captured: Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a HTTP/1.1 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vsHAXhGsLLgPDkZ9t10bf6PdFxS0D_vpVOfK41QfaO4X1IkXjMSoaqbfa1PXP7jkn1HllL94KllbgunLAJAjZsKHdQ14CtUVGrzKzxHTmMnxnwWOQg5NokINe8ZvpczQnLdMrWoAUmj9End_Tkm-hgsc92ryTnukA7vRCskUef5r6w Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba72bf5485d140b3b643d4061a0b870a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba72bf5485d140b3b643d4061a0b870a"}]}] Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ba72bf5485d140b3b643d4061a0b870a Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-198875842 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 80a1f178785743e0a8f55cf2653a13e5 Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-198875842-project Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '02648f0e-2a29-44e4-9ec0-075cdc17823a'} Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:00.094411 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. Jul 25 20:23:00.100543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:00.104790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] Returning 404 to user: Instance 02648f0e-2a29-44e4-9ec0-075cdc17823a could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:00.106351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a00dcdd4-887d-45ea-b219-446a283a44a4 tempest-FloatingIPsAssociationTestJSON-198875842 tempest-FloatingIPsAssociationTestJSON-198875842-project] 10.222.0.48 "GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a" status: 404 len: 111 microversion: 2.1 time: 0.048244 Jul 25 20:23:00.107169 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1658/3331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:00 2022] GET /compute/v2.1/servers/02648f0e-2a29-44e4-9ec0-075cdc17823a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:00.505327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:00.506031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:00.520106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:00.520564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:00.521418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:00.521895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:00.899117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:00.913928 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b2e3bc1-2404-4c3d-b2ec-abb9cc510be5 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6" status: 202 len: 0 microversion: 2.1 time: 3.185406 Jul 25 20:23:00.914437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-258705c0-85e6-42d2-84fb-8f7f7d857b66 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.411796 Jul 25 20:23:00.915185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1659/3332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:00 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:00.918895 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1674/3333] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:22:57 2022] DELETE /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6 => generated 0 bytes in 3196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:00.923710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f1968ba73a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:00.989009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35704240-23dd-4a7a-9d23-5678d07e1be6 could not be found", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:23:00.993632 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] HTTP exception thrown: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Request method failure captured: Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6 HTTP/1.1 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vuHP9MCrzq0CrxvHHf_L82Z1xGRlooxlJ1vVhzJx1O1KTKynURHSJbqZHKDiLWKESSxJ7UjDc2TV4SzXVJ8K6A46txZFkT1OEyqQhBJNZcrwNaHQCEnn_ZAv48lkrsb_WCGYBjEnXpT9vcadmWATqgyliIrbSnrH-cd_tcJquCGcIo Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 52595e45daef422e94c158bb6a33f7b7 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52595e45daef422e94c158bb6a33f7b7"}]}] Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 52595e45daef422e94c158bb6a33f7b7 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPsTestJSON-937394145-project Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7b2576cb2f3c4eb795b327dc4dca2b72 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPsTestJSON-937394145-project Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: exception: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '35704240-23dd-4a7a-9d23-5678d07e1be6'} Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35704240-23dd-4a7a-9d23-5678d07e1be6 could not be found Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-691f8f59-644a-464b-8b89-6b5bac346e0b'] Jul 25 20:23:00.997745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6. Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Returning 404 to user: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b358410-461e-40b8-bb50-3177c4dc556f tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6" status: 404 len: 111 microversion: 2.1 time: 0.085315 Jul 25 20:23:01.006134 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1660/3334] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:23:00 2022] GET /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:23:01.015497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Calling method '.version_select at 0x7f1969821a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:01.025745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:01.026627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:01.035968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:01.036413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:01.037333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:01.037782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:01.128223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 35704240-23dd-4a7a-9d23-5678d07e1be6 could not be found", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:23:01.129077 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] HTTP exception thrown: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Request method failure captured: Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6 HTTP/1.1 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vuHP9MCrzq0CrxvHHf_L82Z1xGRlooxlJ1vVhzJx1O1KTKynURHSJbqZHKDiLWKESSxJ7UjDc2TV4SzXVJ8K6A46txZFkT1OEyqQhBJNZcrwNaHQCEnn_ZAv48lkrsb_WCGYBjEnXpT9vcadmWATqgyliIrbSnrH-cd_tcJquCGcIo Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 52595e45daef422e94c158bb6a33f7b7 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52595e45daef422e94c158bb6a33f7b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52595e45daef422e94c158bb6a33f7b7"}]}] Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 52595e45daef422e94c158bb6a33f7b7 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-FloatingIPsTestJSON-937394145 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-FloatingIPsTestJSON-937394145-project Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7b2576cb2f3c4eb795b327dc4dca2b72 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-FloatingIPsTestJSON-937394145-project Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: exception: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '35704240-23dd-4a7a-9d23-5678d07e1be6'} Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 35704240-23dd-4a7a-9d23-5678d07e1be6 could not be found Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-756ec53c-db27-414d-b904-23058e7077a7'] Jul 25 20:23:01.131441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6. Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:01.137042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] Returning 404 to user: Floating IP not found for ID 35704240-23dd-4a7a-9d23-5678d07e1be6 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:01.146080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21500a0b-023b-48aa-93e7-e87909e48738 tempest-FloatingIPsTestJSON-937394145 tempest-FloatingIPsTestJSON-937394145-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6" status: 404 len: 111 microversion: 2.1 time: 0.126163 Jul 25 20:23:01.146080 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1675/3335] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:23:01 2022] DELETE /compute/v2.1/os-floating-ips/35704240-23dd-4a7a-9d23-5678d07e1be6 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:01.538292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:01.550366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0ec0d2d8-50d5-46bf-893a-91b932fed9a0 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.529760 Jul 25 20:23:01.551841 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1661/3336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:01 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:01.941398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:01.942265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:01.949034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:01.949781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:01.950740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:01.951186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:02.576687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:02.582423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:02.599398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:02.599978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:02.605097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:02.610658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:02.726301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:02.736434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a42a9259-e562-4ad1-a8f3-8207ac6f8b0f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.799844 Jul 25 20:23:02.752877 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1676/3337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:01 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:02.994808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:03.005112 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e078b9fb-b651-43bd-aac8-54476597d844 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.435994 Jul 25 20:23:03.006089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1662/3338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:02 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:03.766982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:03.768321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:03.798711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:03.802246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:03.803075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:03.804710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.039832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:04.043997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:04.061841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:04.065390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.067981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:04.068772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.229967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:04.243129 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-deca7262-42b9-421c-8254-95c8e3183e8d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.487411 Jul 25 20:23:04.245693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1677/3339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:03 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:04.260087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:04.261710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:04.317228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:04.319261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.324497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:04.327810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.378262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:04.465649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:04.516751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5df1e107-8ee0-4a91-9e55-9ef3739aaada tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "DELETE /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 204 len: 0 microversion: 2.1 time: 0.268180 Jul 25 20:23:04.518233 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1678/3340] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:04 2022] DELETE /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:04.846473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d8e6b878-b3a6-47f3-9f0c-a7ebc9a57fc0 req-e4881dc4-9bc7-4a79-b8a2-80b0883d2ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b44c56-fbc0-4090-89bd-c44ea7335d56", "name": "network-vif-plugged", "status": "completed", "tag": "4663e1d7-302d-4f9c-aeb2-a0ba390cc810"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:04.869159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d8e6b878-b3a6-47f3-9f0c-a7ebc9a57fc0 req-e4881dc4-9bc7-4a79-b8a2-80b0883d2ac4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:04.869882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d8e6b878-b3a6-47f3-9f0c-a7ebc9a57fc0 req-e4881dc4-9bc7-4a79-b8a2-80b0883d2ac4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:04.903402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d8e6b878-b3a6-47f3-9f0c-a7ebc9a57fc0 req-e4881dc4-9bc7-4a79-b8a2-80b0883d2ac4 service nova] Creating event network-vif-plugged:4663e1d7-302d-4f9c-aeb2-a0ba390cc810 for instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 on n-h2-845775-3 Jul 25 20:23:04.905256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:04.919376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d8e6b878-b3a6-47f3-9f0c-a7ebc9a57fc0 req-e4881dc4-9bc7-4a79-b8a2-80b0883d2ac4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399376 Jul 25 20:23:04.925254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1679/3341] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:04.932155 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9048420-3803-4044-abec-3c5eee4e3f81 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1681 microversion: 2.1 time: 0.899438 Jul 25 20:23:04.936088 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1663/3342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:04 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1681 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:04.980098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:04.983149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:04.998679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:05.001936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:05.004994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:05.007757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:05.267507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:05.268730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:05.286869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:05.287565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:05.289115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:05.292302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:05.581287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:05.592989 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-714cf641-6499-4646-97d3-1c4a440708a3 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1665 microversion: 2.1 time: 0.665781 Jul 25 20:23:05.593834 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1680/3343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:04 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1665 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:05.850936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:05.860310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b60a84c1-895e-4e42-a4c6-b8222865741f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1308 microversion: 2.1 time: 0.597571 Jul 25 20:23:05.860925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1664/3344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:05 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1308 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:05.963298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:05.964696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:05.984383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:05.986279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:06.000020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:06.000880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:06.617587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:06.618225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:06.631689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:06.632494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:06.635007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:06.636314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:07.507894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:07.522287 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76bc503a-0287-4540-b620-4789803ecf54 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1658 microversion: 2.1 time: 1.565251 Jul 25 20:23:07.536895 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1681/3345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:05 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1658 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:07.548550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:07.549960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:07.559742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:07.560546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:07.561788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:07.562421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:07.758834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:07.773718 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df37d6c1-0763-4d87-859d-a38ac2a8a4f8 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1665 microversion: 2.1 time: 1.162308 Jul 25 20:23:07.792653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1665/3346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:06 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1665 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:07.797767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ee72654-d0b7-4164-aeaa-aff3277eb996 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:07.804095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ee72654-d0b7-4164-aeaa-aff3277eb996 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:07.804760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ee72654-d0b7-4164-aeaa-aff3277eb996 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:07.866630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ee72654-d0b7-4164-aeaa-aff3277eb996 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Going to try to start instance {{(pid=119724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 20:23:07.935450 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ee72654-d0b7-4164-aeaa-aff3277eb996 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.139633 Jul 25 20:23:07.936988 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1666/3347] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:23:07 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:07.951238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:07.953562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:07.969015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:07.972462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:07.976591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:07.977305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:08.891791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:08.911818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bacb564f-eeca-4e80-8c3b-6592eb5dc85b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1490 microversion: 2.1 time: 1.368974 Jul 25 20:23:08.925339 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1682/3348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:07 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1490 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:08.932700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-17b83fd5-8057-44ac-8013-994aabea98a2 req-a8548d96-8649-411e-abd4-1ee1e764f390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91390391-3a15-4332-b749-eed010f1bf8e", "name": "network-vif-unplugged", "status": "completed", "tag": "98f83cf7-395c-42ae-93f9-48846b070a00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:08.954219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-17b83fd5-8057-44ac-8013-994aabea98a2 req-a8548d96-8649-411e-abd4-1ee1e764f390 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:08.954744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-17b83fd5-8057-44ac-8013-994aabea98a2 req-a8548d96-8649-411e-abd4-1ee1e764f390 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:08.984140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-17b83fd5-8057-44ac-8013-994aabea98a2 req-a8548d96-8649-411e-abd4-1ee1e764f390 service nova] Creating event network-vif-unplugged:98f83cf7-395c-42ae-93f9-48846b070a00 for instance 91390391-3a15-4332-b749-eed010f1bf8e on n-h1-845775-3 Jul 25 20:23:08.991468 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-17b83fd5-8057-44ac-8013-994aabea98a2 req-a8548d96-8649-411e-abd4-1ee1e764f390 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073824 Jul 25 20:23:09.000452 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1683/3349] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:09.005939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:09.007253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:09.024507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.025059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.025806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.026184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.491794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:09.508433 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44c54f75-a9a3-474f-b911-cae897e6937f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1667 microversion: 2.1 time: 1.566698 Jul 25 20:23:09.510661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1667/3350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:07 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1667 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:09.518738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:09.529784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:09.544320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.546223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.549486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.550493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.646612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43924336-fd62-430a-88f4-b7f9554eaf57 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "PUT /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1085 microversion: 2.1 time: 0.134485 Jul 25 20:23:09.648439 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1668/3351] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:23:09 2022] PUT /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1085 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:09.679344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:09.681134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:09.694961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.696762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.697889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:09.698568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:09.892661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:09.907812 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4880bec4-ea6c-4d7b-ad49-998a03b7f6e6 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1665 microversion: 2.1 time: 0.905493 Jul 25 20:23:09.909077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1684/3352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:09 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1665 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:10.539020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:10.539568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:10.559077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:10.564704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:10.565163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:10.568144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d92705f3-42ff-4d72-9a8e-698684981e6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1511 microversion: 2.1 time: 0.899050 Jul 25 20:23:10.586753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:10.586883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1669/3353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:09 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1511 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:10.586991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:10.589885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:10.590586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:10.603943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:10.604437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:10.605553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:10.605692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:11.160249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:11.173867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71307885-8fa0-4f2e-bf2f-9a00fec42775 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1511 microversion: 2.1 time: 0.587869 Jul 25 20:23:11.190020 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1670/3354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:10 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:11.199898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:11.200782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:11.209415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:11.210910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:11.212166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:11.212911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:11.871584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f45a8a701254c609d48a49ceb85c170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d467e77a15c41c48542d0f1e67c94f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:11.916816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04477699-cab0-45b7-896b-842ed3352a0a tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 200 len: 1597 microversion: 2.1 time: 0.715741 Jul 25 20:23:11.921728 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1671/3355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:11 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 1597 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:11.936836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:11.937611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:11.958672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:11.960150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:11.961154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:11.961763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:11.965154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:11.970853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:11.989092 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-66e99ef0-4bac-4376-9e0b-9f44cafafa55 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1667 microversion: 2.1 time: 1.458061 Jul 25 20:23:11.998262 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1685/3356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:10 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1667 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:12.017003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-992f9e71-5565-4dfb-96cf-895d65879c2b req-03537a46-4eb8-4e45-9af0-507669da8ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91390391-3a15-4332-b749-eed010f1bf8e", "name": "network-vif-deleted", "tag": "98f83cf7-395c-42ae-93f9-48846b070a00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:12.044374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:12.065343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-992f9e71-5565-4dfb-96cf-895d65879c2b req-03537a46-4eb8-4e45-9af0-507669da8ae2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:12.065882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-992f9e71-5565-4dfb-96cf-895d65879c2b req-03537a46-4eb8-4e45-9af0-507669da8ae2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:12.121351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-992f9e71-5565-4dfb-96cf-895d65879c2b req-03537a46-4eb8-4e45-9af0-507669da8ae2 service nova] Creating event network-vif-deleted:98f83cf7-395c-42ae-93f9-48846b070a00 for instance 91390391-3a15-4332-b749-eed010f1bf8e on n-h1-845775-3 Jul 25 20:23:12.134211 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-992f9e71-5565-4dfb-96cf-895d65879c2b req-03537a46-4eb8-4e45-9af0-507669da8ae2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134218 Jul 25 20:23:12.135487 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1686/3357] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:12.374636 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b584908-796d-401a-b0c4-9e6d7fb471f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 204 len: 0 microversion: 2.1 time: 0.446615 Jul 25 20:23:12.398367 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1672/3358] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:11 2022] DELETE /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:12.405456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:12.409396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:12.431900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:12.434791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:12.439205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:12.440949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:12.948383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:12.949356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] [instance: 91390391-3a15-4332-b749-eed010f1bf8e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:12.966734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:12.967529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:12.968605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:12.969055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:13.001679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:13.003902 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] HTTP exception thrown: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Request method failure captured: Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e HTTP/1.1 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vtKvmWmFCoJwPodGGDfqiASOz-PfRgz_lI-MtcsJHP-IzvneqJcNrrji7Ole4RrNjcf9ok4ra2MAQzss2UviJTlN0DI_MzrjxkB1z9DpH1Vnf9hShRBwRL0_2vwOcMYdvUvEixG2mPti2GN-MyTwhtgQHyzlsD_PwIiZI_7Oxr6AWE Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 5d467e77a15c41c48542d0f1e67c94f0 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestFqdnHostnames-892171226 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d467e77a15c41c48542d0f1e67c94f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d467e77a15c41c48542d0f1e67c94f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d467e77a15c41c48542d0f1e67c94f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d467e77a15c41c48542d0f1e67c94f0"}]}] Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestFqdnHostnames-892171226 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 5d467e77a15c41c48542d0f1e67c94f0 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-892171226 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestFqdnHostnames-892171226-project Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 4f45a8a701254c609d48a49ceb85c170 Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestFqdnHostnames-892171226-project Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '91390391-3a15-4332-b749-eed010f1bf8e'} Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:13.012743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. Jul 25 20:23:13.019646 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:13.022048 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ac23415-76f2-42ec-9d18-768245389f43 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1517 microversion: 2.1 time: 0.615373 Jul 25 20:23:13.022048 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1687/3359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:12 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:13.032591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Returning 404 to user: Instance 91390391-3a15-4332-b749-eed010f1bf8e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:13.033792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-367d937d-cceb-4d38-8358-dfcfa35f52fa tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e" status: 404 len: 111 microversion: 2.1 time: 0.090647 Jul 25 20:23:13.034689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:13.035076 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1673/3360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:12 2022] GET /compute/v2.1/servers/91390391-3a15-4332-b749-eed010f1bf8e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:13.035424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:13.043830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b15e5a49-5135-4465-8b18-202b3ecfd768 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] Calling method '.version_select at 0x7f196eb5d1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:13.050547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:13.055086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:13.056057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:13.056520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:13.090684 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b15e5a49-5135-4465-8b18-202b3ecfd768 tempest-ServersTestFqdnHostnames-892171226 tempest-ServersTestFqdnHostnames-892171226-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268178717" status: 202 len: 0 microversion: 2.1 time: 0.050482 Jul 25 20:23:13.092004 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1674/3361] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268178717 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:13.587275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:13.622019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3afd098b-bd92-4194-aa29-a290d715ec4e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.597630 Jul 25 20:23:13.626991 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1688/3362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:13 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:13.654606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:13.655257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:13.672723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:13.673188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:13.674001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:13.674453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:14.038613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:14.040018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:14.047237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:14.048253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:14.049641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:14.050350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:14.935111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:14.955781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82b78d15-5e4e-46d1-b470-dc0700a55137 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.305110 Jul 25 20:23:14.957119 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1675/3363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:13 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:14.983702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:14.985518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:14.998142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:14.998606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:14.999660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:15.002374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:15.822041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:15.848910 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5c0e2b09-0622-4bc6-9b46-a5c6d6403d11 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 200 len: 1517 microversion: 2.1 time: 1.813736 Jul 25 20:23:15.869982 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1689/3364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:14 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 1517 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:15.955716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:15.983046 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0730ae31-aedb-4b9e-978d-d1d9b62fb134 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.000112 Jul 25 20:23:15.985880 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1676/3365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:14 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:16.017149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:16.019614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:16.053019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:16.054754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:16.057777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:16.058602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:16.488490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-29522439", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "3b659f50-1658-4c4d-897c-1a77d51d675d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:16.508790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:16.588696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:16.598793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bbc3069b-0198-45c2-8ecc-095d0fd54a92 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.596431 Jul 25 20:23:16.608543 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1677/3366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:16 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:16.641632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:16.642270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] validate_networks() for [('3b659f50-1658-4c4d-897c-1a77d51d675d', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:23:16.642649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:16.659543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:16.660714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:16.664854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:16.665228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:17.758667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:17.769126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62111e9d-158c-4fe4-9847-673564db5e71 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.142345 Jul 25 20:23:17.783237 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1678/3367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:16 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:17.789184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:17.791926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:17.820332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:17.825937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:17.827516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:17.831701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:17.871362 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 HTTP/1.1 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '99b44c56-fbc0-4090-89bd-c44ea7335d56'} Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:17.876527 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:17.881537 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-037187df-789f-401d-a161-5d4c4ce5a2ec tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 404 len: 111 microversion: 2.1 time: 0.095413 Jul 25 20:23:17.898414 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1679/3368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:17 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:17.911748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-adefdefa-be06-4779-b93f-decbca06ed3b req-0367fea8-37e0-4de4-80ae-58f84f3c7e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b44c56-fbc0-4090-89bd-c44ea7335d56", "name": "network-vif-deleted", "tag": "4663e1d7-302d-4f9c-aeb2-a0ba390cc810"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:17.940820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-adefdefa-be06-4779-b93f-decbca06ed3b req-0367fea8-37e0-4de4-80ae-58f84f3c7e69 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:17.941284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-adefdefa-be06-4779-b93f-decbca06ed3b req-0367fea8-37e0-4de4-80ae-58f84f3c7e69 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:17.972624 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-adefdefa-be06-4779-b93f-decbca06ed3b req-0367fea8-37e0-4de4-80ae-58f84f3c7e69 service nova] Creating event network-vif-deleted:4663e1d7-302d-4f9c-aeb2-a0ba390cc810 for instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 on n-h2-845775-3 Jul 25 20:23:17.987745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-adefdefa-be06-4779-b93f-decbca06ed3b req-0367fea8-37e0-4de4-80ae-58f84f3c7e69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088331 Jul 25 20:23:17.994531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1680/3369] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:18.000925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:18.005294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:18.023530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:18.024305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:18.025295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:18.025925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:18.101560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lazy-loading 'flavor' on Instance uuid 1a904b9c-0421-417a-8862-a93b4ea610b8 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:23:18.217130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25059092-a0de-4298-b622-04d656d607ad tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.217989 Jul 25 20:23:18.223382 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1681/3370] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:23:17 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:18.646489 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86923fdc-8d2c-4303-b301-c821427af7d6 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.420788 Jul 25 20:23:18.647887 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1682/3371] 10.222.0.48 () {58 vars in 1128 bytes} [Mon Jul 25 20:23:18 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 20:23:18.662129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-959889764", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f3e7a2a0-723a-4c1a-85dc-cb5597503d10"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:18.762223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] validate_networks() for [('f3e7a2a0-723a-4c1a-85dc-cb5597503d10', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:23:19.415766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:23:19.416271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:23:19.416598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:23:19.417014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:23:19.417433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:23:19.437924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:19.438384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:19.439190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:19.439639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:19.521742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Getting quotas for project 946945c1c52040979f3bf05772b54c05. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:23:19.555293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Getting quotas for user 0e8b976187f24670b2aba13f35babbbe and project 946945c1c52040979f3bf05772b54c05. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:23:19.590482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:23:19.593501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:23:19.697922 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-229b62d6-4ccb-4f6b-811a-49ac465387d6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.822528 Jul 25 20:23:19.700955 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1690/3372] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:23:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:23:19.716689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:19.719550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:19.730980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:19.731905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:19.733930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:19.734767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.202505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:23:20.202932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:23:20.203710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:23:20.204191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:23:20.204619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:23:20.223310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.223833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.224725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.225202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.270826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:23:20.282363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Getting quotas for user ad9ab00c8ccf42dc9713e7d7978a4477 and project ee16388ed1904a278ef6daa569f52678. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:23:20.314947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:23:20.337328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:23:20.372507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:20.389459 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5752a5fc-4407-49e3-be4b-d61d5af5e738 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1662 microversion: 2.1 time: 0.685963 Jul 25 20:23:20.407436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1691/3373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:19 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1662 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:20.431103 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a05d7b37-a39f-4b12-9c69-c9c58409c5f3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781200 Jul 25 20:23:20.448224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1683/3374] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:23:20.452340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f6d960-3440-4e3e-ba82-191c912816a1 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Calling method '.version_select at 0x7f196a11c8b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.454671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8d8bb8e-454e-4fc4-a606-0401869ca851 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.455530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8d8bb8e-454e-4fc4-a606-0401869ca851 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:20.497874 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-75f6d960-3440-4e3e-ba82-191c912816a1 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] HTTP exception thrown: Image not found. Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f6d960-3440-4e3e-ba82-191c912816a1 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Request method failure captured: Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vu19NUEtPuT0R2Tuz7Vm4ndxolLLXtAhR1GjGDmlQsjKrpdphets7CCQKDsNla5vGtsQ3rZ2rv3IGrRERl6cUjPBJJrhCz65P1yB4Zzxa5itFkGRRXSLIK5mF1VhRxGaqB5_c7HlI21x0WzROnQF645XhdRYS6Z4wRgAylgw7B8Q5Y Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}] Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9b3861a4eeae4edfae611a3a6799f682 Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '-1'} Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.500125 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75f6d960-3440-4e3e-ba82-191c912816a1 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75f6d960-3440-4e3e-ba82-191c912816a1 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089485 Jul 25 20:23:20.508625 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1692/3375] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Jul 25 20:23:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:23:20.519172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:20.519791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:20.540062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.540542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.541345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.541792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.632420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8d8bb8e-454e-4fc4-a606-0401869ca851 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:20.651911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8d8bb8e-454e-4fc4-a606-0401869ca851 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1215 microversion: 2.1 time: 0.199144 Jul 25 20:23:20.655055 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1684/3376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:20 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:20.680324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-841e098a-3872-4974-b528-6008de93527a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.681321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-841e098a-3872-4974-b528-6008de93527a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:20.730243 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-86cb25a1-6f46-4a16-832a-50becc1a3580 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action" status: 202 len: 0 microversion: 2.1 time: 0.220193 Jul 25 20:23:20.737685 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1693/3377] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:23:20 2022] POST /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:20.743229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e27bb2f4-b107-4b44-bbed-8dc25440b1b5 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Calling method '.version_select at 0x7f196a0354c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.787854 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e27bb2f4-b107-4b44-bbed-8dc25440b1b5 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] HTTP exception thrown: Image not found. Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e27bb2f4-b107-4b44-bbed-8dc25440b1b5 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Request method failure captured: Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/images/e4959e0a-c612-4aca-be57-06ea10f17ddj HTTP/1.1 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vu19NUEtPuT0R2Tuz7Vm4ndxolLLXtAhR1GjGDmlQsjKrpdphets7CCQKDsNla5vGtsQ3rZ2rv3IGrRERl6cUjPBJJrhCz65P1yB4Zzxa5itFkGRRXSLIK5mF1VhRxGaqB5_c7HlI21x0WzROnQF645XhdRYS6Z4wRgAylgw7B8Q5Y Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}] Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9b3861a4eeae4edfae611a3a6799f682 Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: exception: Image not found. Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'e4959e0a-c612-4aca-be57-06ea10f17ddj'} Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e4959e0a-c612-4aca-be57-06ea10f17ddj to delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e4959e0a-c612-4aca-be57-06ea10f17ddj could not be found. Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.797472 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e27bb2f4-b107-4b44-bbed-8dc25440b1b5 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Returning 404 to user: Image not found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:20.803817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e27bb2f4-b107-4b44-bbed-8dc25440b1b5 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/e4959e0a-c612-4aca-be57-06ea10f17ddj" status: 404 len: 62 microversion: 2.1 time: 0.065053 Jul 25 20:23:20.806246 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1694/3378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:20 2022] DELETE /compute/v2.1/images/e4959e0a-c612-4aca-be57-06ea10f17ddj => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:23:20.818604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-841e098a-3872-4974-b528-6008de93527a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:20.827617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.829565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:20.832796 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-841e098a-3872-4974-b528-6008de93527a tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1208 microversion: 2.1 time: 0.163078 Jul 25 20:23:20.833404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1685/3379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:20 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1208 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:20.851746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9177af73-ba85-4093-9d2b-a9db665a5304 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Calling method '.version_select at 0x7f196944ae50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.879561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.880152 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9177af73-ba85-4093-9d2b-a9db665a5304 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] HTTP exception thrown: Image not found. Jul 25 20:23:20.882820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.883725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9177af73-ba85-4093-9d2b-a9db665a5304 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Request method failure captured: Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/dc1925aa-e2f5-4b48-bf25-dbde751b38e51 HTTP/1.1 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vu19NUEtPuT0R2Tuz7Vm4ndxolLLXtAhR1GjGDmlQsjKrpdphets7CCQKDsNla5vGtsQ3rZ2rv3IGrRERl6cUjPBJJrhCz65P1yB4Zzxa5itFkGRRXSLIK5mF1VhRxGaqB5_c7HlI21x0WzROnQF645XhdRYS6Z4wRgAylgw7B8Q5Y Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}] Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9b3861a4eeae4edfae611a3a6799f682 Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'dc1925aa-e2f5-4b48-bf25-dbde751b38e51'} Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dc1925aa-e2f5-4b48-bf25-dbde751b38e51 to delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dc1925aa-e2f5-4b48-bf25-dbde751b38e51 could not be found. Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.884437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:23:20.891041 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.895713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:20.895833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9177af73-ba85-4093-9d2b-a9db665a5304 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:20.895833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9177af73-ba85-4093-9d2b-a9db665a5304 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/dc1925aa-e2f5-4b48-bf25-dbde751b38e51" status: 404 len: 62 microversion: 2.1 time: 0.048268 Jul 25 20:23:20.900499 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1686/3380] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:20 2022] DELETE /compute/v2.1/images/dc1925aa-e2f5-4b48-bf25-dbde751b38e51 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:23:20.914148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1014aa1b-8288-40bf-bef8-c1ef286ae1d2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Calling method '.version_select at 0x7f196eb6d790>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.946475 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1014aa1b-8288-40bf-bef8-c1ef286ae1d2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] HTTP exception thrown: Image not found. Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1014aa1b-8288-40bf-bef8-c1ef286ae1d2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Request method failure captured: Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/tempest-invalid-1814079882 HTTP/1.1 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vu19NUEtPuT0R2Tuz7Vm4ndxolLLXtAhR1GjGDmlQsjKrpdphets7CCQKDsNla5vGtsQ3rZ2rv3IGrRERl6cUjPBJJrhCz65P1yB4Zzxa5itFkGRRXSLIK5mF1VhRxGaqB5_c7HlI21x0WzROnQF645XhdRYS6Z4wRgAylgw7B8Q5Y Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}] Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9b3861a4eeae4edfae611a3a6799f682 Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'tempest-invalid-1814079882'} Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1814079882 to delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1814079882 could not be found. Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.948458 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1014aa1b-8288-40bf-bef8-c1ef286ae1d2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1014aa1b-8288-40bf-bef8-c1ef286ae1d2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/tempest-invalid-1814079882" status: 404 len: 62 microversion: 2.1 time: 0.043742 Jul 25 20:23:20.957254 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1687/3381] 10.222.0.48 () {58 vars in 1206 bytes} [Mon Jul 25 20:23:20 2022] DELETE /compute/v2.1/images/tempest-invalid-1814079882 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 20:23:20.963754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb0b46d2-4513-4f4d-a2a1-79da75f54cf2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Calling method '.version_select at 0x7f196eaa5d30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:20.993044 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cb0b46d2-4513-4f4d-a2a1-79da75f54cf2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] HTTP exception thrown: Image not found. Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb0b46d2-4513-4f4d-a2a1-79da75f54cf2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Request method failure captured: Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/images/19d4891a-74e1-4dcf-9e3f-ed32d6116c83 HTTP/1.1 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vu19NUEtPuT0R2Tuz7Vm4ndxolLLXtAhR1GjGDmlQsjKrpdphets7CCQKDsNla5vGtsQ3rZ2rv3IGrRERl6cUjPBJJrhCz65P1yB4Zzxa5itFkGRRXSLIK5mF1VhRxGaqB5_c7HlI21x0WzROnQF645XhdRYS6Z4wRgAylgw7B8Q5Y Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8ccf5429d3f64427bea91d5ce621d021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8ccf5429d3f64427bea91d5ce621d021"}]}] Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 8ccf5429d3f64427bea91d5ce621d021 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9b3861a4eeae4edfae611a3a6799f682 Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1382019401-project Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: exception: Image not found. Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '19d4891a-74e1-4dcf-9e3f-ed32d6116c83'} Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 19d4891a-74e1-4dcf-9e3f-ed32d6116c83 to delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19d4891a-74e1-4dcf-9e3f-ed32d6116c83 could not be found. Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:20.995183 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb0b46d2-4513-4f4d-a2a1-79da75f54cf2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] Returning 404 to user: Image not found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb0b46d2-4513-4f4d-a2a1-79da75f54cf2 tempest-ImagesDeleteNegativeTestJSON-1382019401 tempest-ImagesDeleteNegativeTestJSON-1382019401-project] 10.222.0.48 "DELETE /compute/v2.1/images/19d4891a-74e1-4dcf-9e3f-ed32d6116c83" status: 404 len: 62 microversion: 2.1 time: 0.037761 Jul 25 20:23:21.003457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1688/3382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:20 2022] DELETE /compute/v2.1/images/19d4891a-74e1-4dcf-9e3f-ed32d6116c83 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 20:23:21.502666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:21.510322 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9940e8ca-a54b-4fbc-b6c1-7d5f517c31bf tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1668 microversion: 2.1 time: 0.701488 Jul 25 20:23:21.511155 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1695/3383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:20 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1668 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:21.677004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:21.679293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:21.683717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:21.689468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:21.690467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:21.692746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:21.693540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:21.860022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:21.876215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:21.897385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:21.898034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:21.901346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:21.904856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:22.676984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:22.687599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-087175db-00d6-4a46-9476-651dac45e07b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1204 microversion: 2.1 time: 0.837308 Jul 25 20:23:22.690954 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1696/3384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:21 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1204 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:22.710751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:22.711382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:22.720717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:22.727871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:22.728830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:22.731027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:22.731663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:22.731853 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-537d8df0-c65b-4653-8596-e19007b551a2 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1275 microversion: 2.1 time: 1.059730 Jul 25 20:23:22.732592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1689/3385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:21 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1275 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:23.430806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:23.439217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0bc92bb-e24f-4579-9d9b-625b68158f76 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1668 microversion: 2.1 time: 0.746891 Jul 25 20:23:23.464397 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1697/3386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:22 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1668 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:23.713312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:23.713953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:23.727140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:23.727758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:23.728405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:23.729056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:23.764430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:23.765096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:23.771785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:23.772371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:23.773435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:23.774052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:24.123857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:24.141922 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57ad6d37-10bc-4794-9206-7b13aab2a852 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1266 microversion: 2.1 time: 0.432310 Jul 25 20:23:24.143141 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1690/3387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:23 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1266 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:24.213456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:24.223755 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75516f7e-0fbe-400c-b9b2-bab0a070c051 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1273 microversion: 2.1 time: 0.463520 Jul 25 20:23:24.225788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1698/3388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:23 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:24.475932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:24.478569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:24.497853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:24.499555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:24.502155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:24.504775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.081791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] Calling method '.version_select at 0x7f19694c7940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:25.112736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.115366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.119254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.119787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.156626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:25.224247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7195c8de-b9aa-4788-8eaa-ba795adcf5d4 tempest-AbsoluteLimitsTestJSON-1524023179 tempest-AbsoluteLimitsTestJSON-1524023179-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.385790 Jul 25 20:23:25.238463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1699/3389] 10.222.0.48 () {58 vars in 1122 bytes} [Mon Jul 25 20:23:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:25.254940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:25.256218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:25.306707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.308877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.309711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.310353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.754614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:25.767803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a83ebee1-8cba-4bc5-a6a0-eb1a20f47377 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1668 microversion: 2.1 time: 1.304557 Jul 25 20:23:25.778160 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1691/3390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:24 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1668 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:25.799369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:25.799993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:25.810603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.812356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:25.813459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:25.814613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:26.469110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:26.489029 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09bc3408-e92e-4b6a-8379-96b32af2e22c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1273 microversion: 2.1 time: 0.708074 Jul 25 20:23:26.491700 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1692/3391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:25 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1273 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:26.654572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:26.667815 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d8f35ed4-2645-42c3-8d84-3169d1fa8ebd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 1.427454 Jul 25 20:23:26.669261 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1700/3392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:25 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:26.820959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:26.823645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:26.843686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:26.845297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:26.857313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:26.858570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:27.265419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bddf9ae8-fe57-431e-9e34-9cb4fa6b963c req-1e4db775-0e6a-49c5-8773-9156b7f8b957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c358aba3-5002-4a94-8a82-08469a527390", "tag": "20816290-566e-4f82-93bf-81ca5c776948"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:27.287330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bddf9ae8-fe57-431e-9e34-9cb4fa6b963c req-1e4db775-0e6a-49c5-8773-9156b7f8b957 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:27.296594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bddf9ae8-fe57-431e-9e34-9cb4fa6b963c req-1e4db775-0e6a-49c5-8773-9156b7f8b957 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:27.344429 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bddf9ae8-fe57-431e-9e34-9cb4fa6b963c req-1e4db775-0e6a-49c5-8773-9156b7f8b957 service nova] Creating event network-changed:20816290-566e-4f82-93bf-81ca5c776948 for instance c358aba3-5002-4a94-8a82-08469a527390 on n-h1-845775-3 Jul 25 20:23:27.355938 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bddf9ae8-fe57-431e-9e34-9cb4fa6b963c req-1e4db775-0e6a-49c5-8773-9156b7f8b957 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401531 Jul 25 20:23:27.361917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1701/3393] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:27.511734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:27.512482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:27.534293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:27.535027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:27.536026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:27.536666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:27.629145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:27.640554 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c3e87eb2-6c07-468c-a666-931d2536fe8a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 0.843204 Jul 25 20:23:27.657045 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1693/3394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:26 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:27.688207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:27.688829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:27.701921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:27.702374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:27.703181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:27.703625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:28.163802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:28.189759 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-535d11a9-d356-40a7-a638-70e59ebb4b39 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.682839 Jul 25 20:23:28.196867 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1702/3395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:27 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:28.203264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:28.208735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:28.226559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:28.227357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:28.228666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:28.229386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:29.181374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:29.192822 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61e08c67-3261-4120-a9d3-11533d9cd9ea tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1671 microversion: 2.1 time: 1.532730 Jul 25 20:23:29.194087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1694/3396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:27 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1671 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:29.212455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:29.214095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:29.234264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:29.235430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:29.236969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:29.237754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:29.252783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:29.411315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:29.429246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0836ca5-d742-4698-8fad-e5e213770eee tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 1.230114 Jul 25 20:23:29.431203 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1703/3397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:28 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:29.436632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:29.437287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:29.446282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:29.448874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:29.452171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:29.453555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:29.489698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:29.497940 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Working on deleting snapshot 5d791d3a-e9a5-4cc3-b63d-2dbb1fb5f0b5 from shelved instance... Jul 25 20:23:29.913116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:29.924389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0439dea-593f-4975-a34f-04d0b9b5a5b9 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.716584 Jul 25 20:23:29.939544 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1695/3398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:29 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:30.459078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:30.463921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:30.474548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:30.480382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:30.481046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:30.482003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:30.482747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:30.649185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Doing local delete in cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119723) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 20:23:30.650180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:30.651128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:30.652066 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 20:23:30.659455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] deallocate_for_instance() {{(pid=119723) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 20:23:30.824983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:31.394376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:31.403673 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3354e41b-42c3-4ede-82d3-25d488eabf6b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 0.951460 Jul 25 20:23:31.416936 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1696/3399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:30 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:31.424766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:31.425626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:31.432003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:31.432733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:31.433724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:31.434338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:32.118910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:32.138566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-255da7b4-1eb2-48f2-956f-06863708e150 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.719426 Jul 25 20:23:32.140784 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1697/3400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:31 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:32.430654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:32.431814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:32.440193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:32.441271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:32.442580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:32.444243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:33.300449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Updating instance_info_cache with network_info: [] {{(pid=119723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:23:33.330962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:33.341804 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71fd6804-ce6d-4b2e-bbf7-b4e8de2ee963 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 0.917269 Jul 25 20:23:33.356752 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1698/3401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:32 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:33.374444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-38d23310-24b5-4311-aade-b4edde8580a9 req-d325466a-7fe1-4aaf-9bb1-d15be7f15375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c358aba3-5002-4a94-8a82-08469a527390", "name": "network-vif-plugged", "status": "completed", "tag": "20816290-566e-4f82-93bf-81ca5c776948"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:33.413695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-38d23310-24b5-4311-aade-b4edde8580a9 req-d325466a-7fe1-4aaf-9bb1-d15be7f15375 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:33.414632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-38d23310-24b5-4311-aade-b4edde8580a9 req-d325466a-7fe1-4aaf-9bb1-d15be7f15375 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:33.431816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-38d23310-24b5-4311-aade-b4edde8580a9 req-d325466a-7fe1-4aaf-9bb1-d15be7f15375 service nova] Creating event network-vif-plugged:20816290-566e-4f82-93bf-81ca5c776948 for instance c358aba3-5002-4a94-8a82-08469a527390 on n-h1-845775-3 Jul 25 20:23:33.458623 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-38d23310-24b5-4311-aade-b4edde8580a9 req-d325466a-7fe1-4aaf-9bb1-d15be7f15375 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084932 Jul 25 20:23:33.460934 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1699/3402] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:33.472600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f700e66a-a9f3-4cd9-8d23-e688261cd607 req-64bbf433-aeb9-4f46-8298-663a2c52ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b191fbdf-8734-47af-acd2-69b6e1535269", "tag": "05aba578-1a8c-46c2-987d-267ebb26ef26"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:33.519691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f700e66a-a9f3-4cd9-8d23-e688261cd607 req-64bbf433-aeb9-4f46-8298-663a2c52ad59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:33.520712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f700e66a-a9f3-4cd9-8d23-e688261cd607 req-64bbf433-aeb9-4f46-8298-663a2c52ad59 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:33.547730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f700e66a-a9f3-4cd9-8d23-e688261cd607 req-64bbf433-aeb9-4f46-8298-663a2c52ad59 service nova] Creating event network-changed:05aba578-1a8c-46c2-987d-267ebb26ef26 for instance b191fbdf-8734-47af-acd2-69b6e1535269 on n-h1-845775-3 Jul 25 20:23:33.557894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f700e66a-a9f3-4cd9-8d23-e688261cd607 req-64bbf433-aeb9-4f46-8298-663a2c52ad59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091772 Jul 25 20:23:33.559948 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1700/3403] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:33.577956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:33.578859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:33.588725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:33.589300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:33.590764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:33.591216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.244175 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f3f68380-cf18-4753-a84e-78ab7011eb17 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 204 len: 0 microversion: 2.1 time: 4.811441 Jul 25 20:23:34.244959 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1704/3404] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:29 2022] DELETE /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 0 bytes in 4813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:34.262355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:34.263270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 74d0ef59-28b3-42dc-a048-17ec0a3213bf] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:34.273769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.274235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.277857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.278672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.305506 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf HTTP/1.1 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '74d0ef59-28b3-42dc-a048-17ec0a3213bf'} Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:34.308847 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 404 to user: Instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df352be8-97d1-401c-b46e-17468cc852d8 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf" status: 404 len: 111 microversion: 2.1 time: 0.063102 Jul 25 20:23:34.319458 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1705/3405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:34 2022] GET /compute/v2.1/servers/74d0ef59-28b3-42dc-a048-17ec0a3213bf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:34.329861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:34.330380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:34.349014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.349762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.351799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.352294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.420506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:34.551166 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98b06409-b3f3-49db-9383-d71c84d628f3 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 204 len: 0 microversion: 2.1 time: 0.229482 Jul 25 20:23:34.554144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1706/3406] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:34 2022] DELETE /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:23:34.562643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:34.563668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:34.572828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.573631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.574661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:34.575545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:34.980221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:34.989838 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b7d180a-9f4d-4761-95b1-0bde1a2901ee tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 1.427505 Jul 25 20:23:34.997193 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1701/3407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:33 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:35.002219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:35.005127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:35.023154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:35.023936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:35.024955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:35.025565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:35.110831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:35.155053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:35.218092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:35.231040 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7498d537-331b-41b6-b310-818ee911c1c9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 0.674873 Jul 25 20:23:35.246392 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1707/3408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:34 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:35.274561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:35.290753 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-588dfdda-59ab-4330-ad49-5c78ced0bd89 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1465 microversion: 2.1 time: 0.291750 Jul 25 20:23:35.292780 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1702/3409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:34 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1465 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:35.627789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a0a9d00f-06b2-4517-ad13-696cbdff71b9 req-fd16ad45-a415-4eef-864a-c1b7422c111e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74d0ef59-28b3-42dc-a048-17ec0a3213bf", "name": "network-vif-deleted", "tag": "61248526-caa9-4009-bf65-128a4c475db0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:35.662233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a0a9d00f-06b2-4517-ad13-696cbdff71b9 req-fd16ad45-a415-4eef-864a-c1b7422c111e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:35.662573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a0a9d00f-06b2-4517-ad13-696cbdff71b9 req-fd16ad45-a415-4eef-864a-c1b7422c111e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:35.726754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.server_external_events [req-a0a9d00f-06b2-4517-ad13-696cbdff71b9 req-fd16ad45-a415-4eef-864a-c1b7422c111e service nova] Unable to find a host for instance 74d0ef59-28b3-42dc-a048-17ec0a3213bf. Dropping event network-vif-deleted {{(pid=119723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 20:23:35.727760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a0a9d00f-06b2-4517-ad13-696cbdff71b9 req-fd16ad45-a415-4eef-864a-c1b7422c111e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.107589 Jul 25 20:23:35.737415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1708/3410] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 20:23:35.986965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] Calling method '.version_select at 0x7f1968c14430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:36.019786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:36.022436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:36.036329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.041655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.045917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.052115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.176286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6e90608e-a838-449d-bb57-dee795f5cb5b could not be found", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:23:36.177247 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] HTTP exception thrown: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] Request method failure captured: Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-floating-ips/6e90608e-a838-449d-bb57-dee795f5cb5b HTTP/1.1 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvH_FjttHmnumwNDtEzOAEPRxPWnnHMfiDyh_Lfg4DO2r2uAADtnzvKW9Oj8En5eozBbkpELuvB6YslQ3HQwFY3QHGx8Rekw_eVCgI7F5JMPS6IKA7weyiSZlwnrNj0KWquoC10pOuOhk9zkoIw5XeQbKp1gaWI-uELLcWZyIb9H1M Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 930f36a88d8e41cfa86aed8c56fc46af Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1193074506 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/930f36a88d8e41cfa86aed8c56fc46af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_930f36a88d8e41cfa86aed8c56fc46af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/930f36a88d8e41cfa86aed8c56fc46af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/930f36a88d8e41cfa86aed8c56fc46af"}]}] Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1193074506 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 930f36a88d8e41cfa86aed8c56fc46af Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1193074506 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c8192b8ad328407b954cb90ab4da6c72 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: exception: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6e90608e-a838-449d-bb57-dee795f5cb5b'} Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6e90608e-a838-449d-bb57-dee795f5cb5b could not be found Jul 25 20:23:36.179994 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20cb9602-2c8a-416e-b796-e9c7c1de18ef'] Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b. Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] Returning 404 to user: Floating IP not found for ID 6e90608e-a838-449d-bb57-dee795f5cb5b {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98a3bb6a-ef35-425a-a8ca-e4913ea288eb tempest-FloatingIPDetailsNegativeTestJSON-1193074506 tempest-FloatingIPDetailsNegativeTestJSON-1193074506-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/6e90608e-a838-449d-bb57-dee795f5cb5b" status: 404 len: 111 microversion: 2.1 time: 0.477575 Jul 25 20:23:36.186695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1703/3411] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Jul 25 20:23:35 2022] GET /compute/v2.1/os-floating-ips/6e90608e-a838-449d-bb57-dee795f5cb5b => generated 111 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:36.255115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:36.255115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:36.266365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.266831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.267645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.268115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.861154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:36.872068 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3ae9992-2690-47aa-9573-ae4482c877c8 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.857662 Jul 25 20:23:36.873198 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1709/3412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:36 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:36.899122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:36.899667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:36.917269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.920235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.921100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:36.921714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:36.924690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:36.937534 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0cac18a1-a024-40e8-887e-2460fa2eab9b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1308 microversion: 2.1 time: 0.687480 Jul 25 20:23:36.944382 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1704/3413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:36 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:36.952343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:37.187395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:37.203589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39d03bf8-4910-4616-acf7-00550ce4f1d9 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1465 microversion: 2.1 time: 0.313927 Jul 25 20:23:37.206981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1710/3414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:36 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1465 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:37.895160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:37.895988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:37.914490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:37.915526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:37.916685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:37.917356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:37.988688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:37.989326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:38.012459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.013218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.020496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.021146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.382265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:38.414372 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-834de838-7243-44f7-80ac-656e16495e6e tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.523093 Jul 25 20:23:38.416814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1705/3415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:37 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:38.424178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:38.425819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:38.436565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.438338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.441538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.442543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.759068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:38.770339 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ab3a5b64-9dbf-4c26-92bf-b2d2febd6339 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1489 microversion: 2.1 time: 0.806668 Jul 25 20:23:38.775453 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1711/3416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:37 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1489 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:38.807205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2016995671"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:38.809862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:38.827045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.827468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.828371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:38.828818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:38.923861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:38.942809 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e125150-d3bc-4c0b-bc25-7304f09b7f48 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 200 len: 1465 microversion: 2.1 time: 0.524581 Jul 25 20:23:38.943793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1706/3417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:38 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 1465 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:39.009170 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e22a0b74-0bcc-40fd-837a-71cfae4cd874 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "PUT /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1075 microversion: 2.1 time: 0.216643 Jul 25 20:23:39.012771 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1712/3418] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:23:38 2022] PUT /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1075 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:39.030021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:39.030903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:39.041454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:39.049478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:39.050692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:39.051500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:39.440402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:39.441031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:39.471934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:39.478788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:39.481146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:39.488214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.494740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:40.508697 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33fe0d6c-e8dd-4088-9861-2665911231f6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1501 microversion: 2.1 time: 1.479102 Jul 25 20:23:40.509384 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1707/3419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:39 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1501 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:40.517727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-08773b4f-e3d4-419b-a2c4-c7fcc2eaf408 req-2bbd24f4-e42a-4c7a-aece-251b58d4d442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc29e8e9-e7c4-4844-b01d-729b44dc5201", "name": "network-vif-deleted", "tag": "9eae7015-c528-4622-982d-387dafcee800"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:40.548026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08773b4f-e3d4-419b-a2c4-c7fcc2eaf408 req-2bbd24f4-e42a-4c7a-aece-251b58d4d442 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.550660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08773b4f-e3d4-419b-a2c4-c7fcc2eaf408 req-2bbd24f4-e42a-4c7a-aece-251b58d4d442 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.579993 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-08773b4f-e3d4-419b-a2c4-c7fcc2eaf408 req-2bbd24f4-e42a-4c7a-aece-251b58d4d442 service nova] Creating event network-vif-deleted:9eae7015-c528-4622-982d-387dafcee800 for instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 on n-h1-845775-3 Jul 25 20:23:40.597980 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-08773b4f-e3d4-419b-a2c4-c7fcc2eaf408 req-2bbd24f4-e42a-4c7a-aece-251b58d4d442 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087007 Jul 25 20:23:40.601850 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1708/3420] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:40.614878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:40.615634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: cc29e8e9-e7c4-4844-b01d-729b44dc5201] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:40.632746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.634186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.637624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.638447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.684802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 HTTP/1.1 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'cc29e8e9-e7c4-4844-b01d-729b44dc5201'} Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:40.688889 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. Jul 25 20:23:40.695046 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:40.697274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 404 to user: Instance cc29e8e9-e7c4-4844-b01d-729b44dc5201 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:40.698589 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7f55c71-01c2-4149-86ef-e22504fd0c9a tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201" status: 404 len: 111 microversion: 2.1 time: 0.095268 Jul 25 20:23:40.699691 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1709/3421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:40 2022] GET /compute/v2.1/servers/cc29e8e9-e7c4-4844-b01d-729b44dc5201 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:40.705691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:40.706798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:40.715712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.716549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.717527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.718147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.915679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:40.929179 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05880ac4-a353-4de5-b531-6a748900242f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 1.494653 Jul 25 20:23:40.930326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1713/3422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:39 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:40.939445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:40.939953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:40.958256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.959922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:40.960993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:40.964113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.020898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:41.161388 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ca8d2197-62ae-4d09-8443-84eb05e0ec41 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 204 len: 0 microversion: 2.1 time: 0.229522 Jul 25 20:23:41.162941 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1714/3423] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:40 2022] DELETE /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:41.172400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:41.173915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:41.182983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.183748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.185305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.186236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.358796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:41.372672 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd54574a-2418-48ae-984b-0d3a8da92445 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1501 microversion: 2.1 time: 0.671528 Jul 25 20:23:41.388064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1710/3424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:40 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1501 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:41.395507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4414336-36a2-437e-a4c9-599d434c8a6f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:41.403942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4414336-36a2-437e-a4c9-599d434c8a6f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.404852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4414336-36a2-437e-a4c9-599d434c8a6f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.434826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4414336-36a2-437e-a4c9-599d434c8a6f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:23:41.495517 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4414336-36a2-437e-a4c9-599d434c8a6f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "POST /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390/action" status: 202 len: 0 microversion: 2.1 time: 0.103847 Jul 25 20:23:41.507546 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1711/3425] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:23:41 2022] POST /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:41.515297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:41.516572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:41.525514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.526556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.528476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.529275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.810017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:41.821173 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36132a9d-21f5-45db-abf7-63f0083b91bc tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1508 microversion: 2.1 time: 0.650821 Jul 25 20:23:41.822460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1715/3426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:41 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1508 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:41.951572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:41.952348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:41.982069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.988376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:41.991476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:41.993017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:42.434373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:42.449606 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-756a3e39-64bb-4d70-9b81-a80ac3222b69 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.938510 Jul 25 20:23:42.467219 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1712/3427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:41 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:42.660923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:42.676788 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-de124dcc-5e22-4017-a378-1d846d959bde tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 0.730269 Jul 25 20:23:42.677682 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1716/3428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:41 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:42.846615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:42.847238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:42.870775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:42.871538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:42.872579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:42.873213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:42.957607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2dce2b07-d6b0-4d10-9db6-d1ac0c6cc83e req-2f9e405e-1b98-4657-b817-583eeee306f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191fbdf-8734-47af-acd2-69b6e1535269", "name": "network-vif-plugged", "status": "completed", "tag": "05aba578-1a8c-46c2-987d-267ebb26ef26"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:42.976078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2dce2b07-d6b0-4d10-9db6-d1ac0c6cc83e req-2f9e405e-1b98-4657-b817-583eeee306f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:42.976522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2dce2b07-d6b0-4d10-9db6-d1ac0c6cc83e req-2f9e405e-1b98-4657-b817-583eeee306f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:43.023839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2dce2b07-d6b0-4d10-9db6-d1ac0c6cc83e req-2f9e405e-1b98-4657-b817-583eeee306f6 service nova] Creating event network-vif-plugged:05aba578-1a8c-46c2-987d-267ebb26ef26 for instance b191fbdf-8734-47af-acd2-69b6e1535269 on n-h1-845775-3 Jul 25 20:23:43.042525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2dce2b07-d6b0-4d10-9db6-d1ac0c6cc83e req-2f9e405e-1b98-4657-b817-583eeee306f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088486 Jul 25 20:23:43.043563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1717/3429] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:23:43.486047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:43.487087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:43.507039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:43.507487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:43.511350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:43.511592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:43.608962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:43.627376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d2d2ac7-369d-4a35-bb29-45bb5f7f6c32 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1508 microversion: 2.1 time: 0.784581 Jul 25 20:23:43.628500 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1713/3430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:42 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1508 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:43.705460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:43.707481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:43.718902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:43.719850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:43.722593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:43.724885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:43.745040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:44.738088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:44.747890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9883c6df-4cdc-4a3e-96a2-b038a65f3dcd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 1.269674 Jul 25 20:23:44.750872 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1718/3431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:43 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:44.769581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:44.770499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:44.789518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:44.796915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:44.799440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:44.800792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:45.017001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:45.042096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bb3a18fe-8b5d-49f3-86e9-14724b7f02fe tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1315 microversion: 2.1 time: 1.335432 Jul 25 20:23:45.046064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1714/3432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:43 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1315 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:45.071161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-bde7bd27-6311-48d1-9ffe-abd42214f4c8 req-d61cc0dd-dd4f-4717-81ac-c34ddcec9a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8c3c8-798e-417c-ab99-94b1f55413d2", "name": "network-vif-deleted", "tag": "6c1f336e-78fe-49e7-ac27-d119bafe0146"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:45.119364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bde7bd27-6311-48d1-9ffe-abd42214f4c8 req-d61cc0dd-dd4f-4717-81ac-c34ddcec9a90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:45.123136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bde7bd27-6311-48d1-9ffe-abd42214f4c8 req-d61cc0dd-dd4f-4717-81ac-c34ddcec9a90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:45.166763 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-bde7bd27-6311-48d1-9ffe-abd42214f4c8 req-d61cc0dd-dd4f-4717-81ac-c34ddcec9a90 service nova] Creating event network-vif-deleted:6c1f336e-78fe-49e7-ac27-d119bafe0146 for instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 on n-h1-845775-3 Jul 25 20:23:45.187049 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-bde7bd27-6311-48d1-9ffe-abd42214f4c8 req-d61cc0dd-dd4f-4717-81ac-c34ddcec9a90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138685 Jul 25 20:23:45.192722 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1715/3433] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:45.208591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-30dddcca-58d5-47b0-bd46-0cc0544910b2 req-b55f101e-3b64-48fc-b1a9-14fa4f5c30ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e8c3c8-798e-417c-ab99-94b1f55413d2", "name": "network-vif-unplugged", "status": "completed", "tag": "6c1f336e-78fe-49e7-ac27-d119bafe0146"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:45.238336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-30dddcca-58d5-47b0-bd46-0cc0544910b2 req-b55f101e-3b64-48fc-b1a9-14fa4f5c30ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:45.243254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-30dddcca-58d5-47b0-bd46-0cc0544910b2 req-b55f101e-3b64-48fc-b1a9-14fa4f5c30ce service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:45.274111 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-30dddcca-58d5-47b0-bd46-0cc0544910b2 req-b55f101e-3b64-48fc-b1a9-14fa4f5c30ce service nova] Creating event network-vif-unplugged:6c1f336e-78fe-49e7-ac27-d119bafe0146 for instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 on n-h1-845775-3 Jul 25 20:23:45.279991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-30dddcca-58d5-47b0-bd46-0cc0544910b2 req-b55f101e-3b64-48fc-b1a9-14fa4f5c30ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083981 Jul 25 20:23:45.281201 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1716/3434] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:45.288722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:45.309708 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68c8fdc3-795f-4eae-afa9-77197dde6e09 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 200 len: 1300 microversion: 2.1 time: 0.552078 Jul 25 20:23:45.311776 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1719/3435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:44 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 1300 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:45.774852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:45.775757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:45.802332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:45.805392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:45.809270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:45.814987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.069336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:46.070505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:46.090362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.092288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.093559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.095320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.392457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:46.408581 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e2f2960-a5a4-41f9-8327-faab5d6cf8a6 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1504 microversion: 2.1 time: 0.344587 Jul 25 20:23:46.409191 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1720/3436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:46 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:46.447719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:46.457954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: a9e8c3c8-798e-417c-ab99-94b1f55413d2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:46.474244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.478328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.479579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.482956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.518842 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 HTTP/1.1 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a9e8c3c8-798e-417c-ab99-94b1f55413d2'} Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:46.527930 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. Jul 25 20:23:46.534160 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:46.534992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:46.536930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 404 to user: Instance a9e8c3c8-798e-417c-ab99-94b1f55413d2 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:46.540673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15d2c6e3-e44c-4bdf-80b3-f8d623771d8e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2" status: 404 len: 111 microversion: 2.1 time: 0.130205 Jul 25 20:23:46.541271 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1721/3437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:46 2022] GET /compute/v2.1/servers/a9e8c3c8-798e-417c-ab99-94b1f55413d2 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:46.550687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:46.559269 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cdb6736b-b0dc-4ad3-b222-180e3aff571c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.791784 Jul 25 20:23:46.559765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:46.559912 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1717/3438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:45 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:46.586590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:46.588176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:46.595272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.595931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.596422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.597047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.597210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.598561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.599084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.602645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.682277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:46.697189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:46.700923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0ceb880b-b5eb-408d-8704-05e5c2383d07 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/os-instance-actions/req-229b62d6-4ccb-4f6b-811a-49ac465387d6" status: 200 len: 313 microversion: 2.1 time: 0.154744 Jul 25 20:23:46.705417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1722/3439] 10.222.0.48 () {58 vars in 1419 bytes} [Mon Jul 25 20:23:46 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/os-instance-actions/req-229b62d6-4ccb-4f6b-811a-49ac465387d6 => generated 313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:46.718746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:46.733505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:46.743173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:46.755229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.769889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.773115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:46.773646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:46.993638 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f254b775-d753-4c58-bdb3-ccf8c295b609 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 204 len: 0 microversion: 2.1 time: 0.432357 Jul 25 20:23:46.994239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1718/3440] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:46 2022] DELETE /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:47.011314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:47.016020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:47.035168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:47.043721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:47.049463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:47.050282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:47.083205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec344dd6-cfc1-4789-98fc-27f65b571ac4 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "POST /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/action" status: 202 len: 0 microversion: 2.1 time: 0.368447 Jul 25 20:23:47.089311 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1723/3441] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:23:46 2022] POST /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:23:47.102661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:47.104483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:47.126009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:47.126840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:47.128652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:47.130823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:48.189533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:48.197524 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e0210e7-e010-4269-b406-25c47f0d4c58 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1496 microversion: 2.1 time: 1.197791 Jul 25 20:23:48.212625 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1719/3442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:46 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1496 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:48.288358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:48.299800 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00ea79dd-b1b1-4136-a783-860462f23740 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1506 microversion: 2.1 time: 1.208782 Jul 25 20:23:48.304228 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1724/3443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:47 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1506 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:48.315987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:48.323965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:48.357979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:48.358692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:48.359684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:48.364363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:48.459548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:48.511978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9ec707d-57d3-44ed-a1cf-7cce8bfd536f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1969292af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-156023957", "description": "tempest-description-1481478964"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:50.095190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:50.107911 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3899ecb5-a35a-45d1-bdd6-5ccc285bb725 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 1.801328 Jul 25 20:23:50.108635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1725/3444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:48 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:50.117236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:50.119038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:50.129270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:50.129972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:50.135600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:50.137234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:50.434256 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9ec707d-57d3-44ed-a1cf-7cce8bfd536f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.219369 Jul 25 20:23:50.436556 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1720/3445] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:23:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:50.451927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:50.453211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:50.470206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:50.472920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:50.478328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:50.479535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:50.797675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:50.808062 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-874c7626-08bf-4eac-9592-5bd5a1f34204 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 200 len: 1496 microversion: 2.1 time: 0.697495 Jul 25 20:23:50.809668 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1726/3446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:50 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 1496 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:50.906172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2131794213", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:51.008803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:23:51.106766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:51.121671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24070902-2b3b-4b76-878c-8f03358f63a5 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1504 microversion: 2.1 time: 0.683275 Jul 25 20:23:51.137433 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1721/3447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:50 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1504 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:51.149004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b4da6cbb-d367-4270-b0b2-bd1b281fd6c0 req-11f71cf6-ee92-47ca-9728-3674a9292059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dc091f-7a2b-430b-96b6-983128b82e85", "name": "network-vif-unplugged", "status": "completed", "tag": "646be811-53a7-4e4c-9252-cc907ed4a466"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:51.161881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b4da6cbb-d367-4270-b0b2-bd1b281fd6c0 req-11f71cf6-ee92-47ca-9728-3674a9292059 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:51.162717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b4da6cbb-d367-4270-b0b2-bd1b281fd6c0 req-11f71cf6-ee92-47ca-9728-3674a9292059 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:51.202345 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b4da6cbb-d367-4270-b0b2-bd1b281fd6c0 req-11f71cf6-ee92-47ca-9728-3674a9292059 service nova] Creating event network-vif-unplugged:646be811-53a7-4e4c-9252-cc907ed4a466 for instance 56dc091f-7a2b-430b-96b6-983128b82e85 on n-h2-845775-3 Jul 25 20:23:51.210871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b4da6cbb-d367-4270-b0b2-bd1b281fd6c0 req-11f71cf6-ee92-47ca-9728-3674a9292059 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071537 Jul 25 20:23:51.211506 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1722/3448] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:51.219986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b50ab65-60af-48ff-b32d-9f6e11ad00c7 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968c3bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2116518156", "description": "tempest-description-1062174845"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:51.801798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b50ab65-60af-48ff-b32d-9f6e11ad00c7 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.588588 Jul 25 20:23:51.805735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1723/3449] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:23:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:51.818140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:51.847408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:51.874202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:51.885613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:51.887898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:51.892048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:51.892581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.555184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:52.575172 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0cfef06b-6055-46bb-97cc-717e583fb4b1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.767979 Jul 25 20:23:52.578791 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1724/3450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:51 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:52.595176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '.version_select at 0x7f1968c145e0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:52.596025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:52.606426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.607282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.609180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.610682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.689719 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6333623b-d5e0-40f6-909d-3254b8a68364 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.109185 Jul 25 20:23:52.691005 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1725/3451] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Jul 25 20:23:52 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269/os-instance-actions => generated 611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:52.698951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ea188709-a1ba-454d-8a17-8354e205ee95 req-8b22bfb8-0a44-4bb7-8c52-f470f99ea640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dc091f-7a2b-430b-96b6-983128b82e85", "name": "network-vif-deleted", "tag": "646be811-53a7-4e4c-9252-cc907ed4a466"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:52.740069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ea188709-a1ba-454d-8a17-8354e205ee95 req-8b22bfb8-0a44-4bb7-8c52-f470f99ea640 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.741644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ea188709-a1ba-454d-8a17-8354e205ee95 req-8b22bfb8-0a44-4bb7-8c52-f470f99ea640 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.756564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:23:52.757611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:23:52.758262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:23:52.758867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:23:52.759448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:23:52.764175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ea188709-a1ba-454d-8a17-8354e205ee95 req-8b22bfb8-0a44-4bb7-8c52-f470f99ea640 service nova] Creating event network-vif-deleted:646be811-53a7-4e4c-9252-cc907ed4a466 for instance 56dc091f-7a2b-430b-96b6-983128b82e85 on n-h2-845775-3 Jul 25 20:23:52.772095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.774871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ea188709-a1ba-454d-8a17-8354e205ee95 req-8b22bfb8-0a44-4bb7-8c52-f470f99ea640 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082387 Jul 25 20:23:52.776671 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1726/3452] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:52.782820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.784218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.786748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:52.787759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.787897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 56dc091f-7a2b-430b-96b6-983128b82e85] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:52.800349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.801546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.805052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:52.806229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:52.831792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. Jul 25 20:23:52.838243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 HTTP/1.1 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '56dc091f-7a2b-430b-96b6-983128b82e85'} Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:52.839601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. Jul 25 20:23:52.853940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:23:52.859028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:23:52.861659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 404 to user: Instance 56dc091f-7a2b-430b-96b6-983128b82e85 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:52.864603 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0072118-dc1b-48be-a58a-047b164dc78f tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85" status: 404 len: 111 microversion: 2.1 time: 0.083228 Jul 25 20:23:52.869917 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1727/3453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:52 2022] GET /compute/v2.1/servers/56dc091f-7a2b-430b-96b6-983128b82e85 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:52.879738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1710638889", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f82035ec-96d9-4a09-a1a5-a01f90aecb53"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:52.916980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:23:52.942508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:23:53.055240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] validate_networks() for [('f82035ec-96d9-4a09-a1a5-a01f90aecb53', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:23:53.139959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ff08e26-aa5a-4808-b795-6375b4d14eab tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328779 Jul 25 20:23:53.143712 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1727/3454] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:23:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:23:53.156903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:53.159665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:53.170634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:53.171726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:53.173019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:53.173654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:53.282186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:53.551870 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1d04f3c-1f22-419f-b27b-763b60c9ca42 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 204 len: 0 microversion: 2.1 time: 0.404632 Jul 25 20:23:53.552541 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1728/3455] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:53 2022] DELETE /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:53.565767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:53.566323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:53.583174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:53.583537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:53.585983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:53.586956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:53.667562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:23:53.885621 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19058ca7-adeb-4cdb-84d7-00d154d48991 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 204 len: 0 microversion: 2.1 time: 0.326439 Jul 25 20:23:53.888390 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1729/3456] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:23:53 2022] DELETE /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:23:53.902638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e26eb446-a4ef-4c24-94db-cceffd9a3691 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:53.910271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e26eb446-a4ef-4c24-94db-cceffd9a3691 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:54.114731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e26eb446-a4ef-4c24-94db-cceffd9a3691 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:54.142561 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e26eb446-a4ef-4c24-94db-cceffd9a3691 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1215 microversion: 2.1 time: 0.245859 Jul 25 20:23:54.143758 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1730/3457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:53 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:54.155103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:54.161438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:54.181217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.181711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.190192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.190864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.534053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:54.550079 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d12cec1-80e8-4a3c-8bf4-901f0e06354c tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1510 microversion: 2.1 time: 0.398342 Jul 25 20:23:54.550758 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1731/3458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:54 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:54.562114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:54.562741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:54.571984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:23:54.573216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:23:54.574549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:23:54.575238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:23:54.575857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:23:54.576123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.576589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.577401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.577845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.589546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.590569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.592387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.593017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.617051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Getting quotas for project 06f45177fa1945c19753fb626d95ddef. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:23:54.624624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Getting quotas for user 9eca7dcff9ae44b8ad0760c3621d1025 and project 06f45177fa1945c19753fb626d95ddef. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:23:54.671593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:23:54.684411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:23:54.821731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f213930-254f-4311-97cc-9fba73a9eb22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948808 Jul 25 20:23:54.828669 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1728/3459] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:23:54.837746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:54.839025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:54.859994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.861617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:54.864920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:54.865650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:55.201608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:55.217900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c9a9074f-90d2-4651-90cc-4520940a8233 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.664516 Jul 25 20:23:55.219292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1732/3460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:54 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:55.250767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bef4be07-9e44-4cab-872f-5da87ffe3b72 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:55.251851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bef4be07-9e44-4cab-872f-5da87ffe3b72 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:55.397823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bef4be07-9e44-4cab-872f-5da87ffe3b72 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:55.419586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bef4be07-9e44-4cab-872f-5da87ffe3b72 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1216 microversion: 2.1 time: 0.179552 Jul 25 20:23:55.421455 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1733/3461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:55 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:55.430575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:55.431447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:55.440139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:55.441107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:55.442132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:55.442925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:55.773279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:55.787961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-65fcde0f-83ee-487e-9783-24d31f6aa183 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1677 microversion: 2.1 time: 0.961743 Jul 25 20:23:55.801896 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1729/3462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:54 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1677 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:55.807062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:55.811620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:55.816062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:55.816258 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94998f20-f6cc-4c33-ba70-851662812f10 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1267 microversion: 2.1 time: 0.392673 Jul 25 20:23:55.817263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1734/3463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:55 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:55.836919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:55.837783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:55.838745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:55.839194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.246350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:56.247724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:56.262250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.262989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.264157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.268280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.550008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:56.567848 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d177afc8-5ae2-4764-885a-753f76b4513d tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1510 microversion: 2.1 time: 0.760284 Jul 25 20:23:56.569418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1730/3464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:55 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:56.574163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:56.574780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:56.590094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.590566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.594773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.595334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.784635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:56.797158 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b1b0277-0474-45b2-9f35-4a503d9c3053 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1268 microversion: 2.1 time: 0.226596 Jul 25 20:23:56.797786 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1731/3465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:56 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1268 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:56.811745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:56.816650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:56.825282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.825712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.826851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:56.827655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:56.986404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:57.008007 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32192c62-1284-40fc-a44c-97adb8f48170 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.769349 Jul 25 20:23:57.022488 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1735/3466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:56 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:57.031152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:57.032777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:57.040557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.041608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.042995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.044026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.219243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:57.231967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21bb0bae-090b-4c8a-87d0-54feaa89ab3d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1273 microversion: 2.1 time: 0.205568 Jul 25 20:23:57.232739 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1736/3467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:57 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:57.273840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:57.285156 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-baec9e43-72a8-42d4-bbaa-ca9e598a7a45 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1677 microversion: 2.1 time: 0.478107 Jul 25 20:23:57.289451 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1732/3468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:56 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1677 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:57.591230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:57.593643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:57.603308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.603779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.604676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.605215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.805096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-51f0676f-aa80-4cff-8878-f3b309c4ebc3 req-f917d094-aeef-43dd-9407-1597b1d2c743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b191fbdf-8734-47af-acd2-69b6e1535269", "name": "network-vif-deleted", "tag": "05aba578-1a8c-46c2-987d-267ebb26ef26"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:57.805633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8b976187f24670b2aba13f35babbbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946945c1c52040979f3bf05772b54c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:57.839364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51f0676f-aa80-4cff-8878-f3b309c4ebc3 req-f917d094-aeef-43dd-9407-1597b1d2c743 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.839664 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d294ea63-1ce3-4a9d-af31-a3179945c573 tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 200 len: 1468 microversion: 2.1 time: 0.252918 Jul 25 20:23:57.839819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-51f0676f-aa80-4cff-8878-f3b309c4ebc3 req-f917d094-aeef-43dd-9407-1597b1d2c743 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.842006 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1737/3469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:57 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:57.849004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:57.850530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:57.862954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.864593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.866224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:57.868014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:57.881722 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-51f0676f-aa80-4cff-8878-f3b309c4ebc3 req-f917d094-aeef-43dd-9407-1597b1d2c743 service nova] Creating event network-vif-deleted:05aba578-1a8c-46c2-987d-267ebb26ef26 for instance b191fbdf-8734-47af-acd2-69b6e1535269 on n-h1-845775-3 Jul 25 20:23:57.895887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-51f0676f-aa80-4cff-8878-f3b309c4ebc3 req-f917d094-aeef-43dd-9407-1597b1d2c743 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099790 Jul 25 20:23:57.898833 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1733/3470] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:58.033250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:58.034403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:58.037367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:58.049457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78debd5e-7dad-46ec-bc77-0a5dff61c26e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1274 microversion: 2.1 time: 0.205380 Jul 25 20:23:58.050835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.052073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.052295 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1738/3471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:57 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:58.061950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.062764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.256586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:58.257367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:58.265767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.266609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.267613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.268407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.635698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:58.679302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b88aac2e-2192-40a1-a1cf-50a0c4737ff1 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.647429 Jul 25 20:23:58.681698 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1734/3472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:58 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:23:58.703976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:58.704701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:58.724407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.725066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.725881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.726330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.758305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:58.773767 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8653ded8-4af3-4a0b-8673-ad459b5ea99e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.523820 Jul 25 20:23:58.774780 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1739/3473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:58 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:58.781306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b181dbdf-ed29-48c3-beda-a7caebc75bb3 req-d3a32a34-2f23-4e0a-abb1-d13279f21d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a904b9c-0421-417a-8862-a93b4ea610b8", "name": "network-vif-deleted", "tag": "2e6289b3-c154-4336-ba43-a1d273b607f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:23:58.790270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.791618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.792458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lazy-loading 'fault' on Instance uuid 1a904b9c-0421-417a-8862-a93b4ea610b8 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:23:58.836025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b181dbdf-ed29-48c3-beda-a7caebc75bb3 req-d3a32a34-2f23-4e0a-abb1-d13279f21d3c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.837397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b181dbdf-ed29-48c3-beda-a7caebc75bb3 req-d3a32a34-2f23-4e0a-abb1-d13279f21d3c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.870360 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b181dbdf-ed29-48c3-beda-a7caebc75bb3 req-d3a32a34-2f23-4e0a-abb1-d13279f21d3c service nova] Creating event network-vif-deleted:2e6289b3-c154-4336-ba43-a1d273b607f9 for instance 1a904b9c-0421-417a-8862-a93b4ea610b8 on n-h2-845775-3 Jul 25 20:23:58.880902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7cd8e51e2c740088fbe9c4d804c1a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afce26d0d3e546a082c76cba1ca213e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:58.883839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b181dbdf-ed29-48c3-beda-a7caebc75bb3 req-d3a32a34-2f23-4e0a-abb1-d13279f21d3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106755 Jul 25 20:23:58.888587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:58.894357 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa93b6b5-84c5-45ca-a894-1436a2df7b3e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 200 len: 1329 microversion: 2.1 time: 0.209498 Jul 25 20:23:58.894575 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1740/3474] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:23:58.908775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:58.909497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] [instance: b191fbdf-8734-47af-acd2-69b6e1535269] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:58.911602 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1735/3475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:58 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 1329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:58.925334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.928057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.936425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:58.936901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:58.979333 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] HTTP exception thrown: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Request method failure captured: Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 HTTP/1.1 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vuzHyrs2sOxCoElM2WPFjpx-1vWYbgwwRKa-yNiojAOb-MDLJ65wMJkllN6-OXg_C7Am9QdaK6visxH33imoi1iYLVNTdtYk2GAOmu3Yh9ch2XI-tncrxW_UqrndxAun5G0TNMdmYP9ydBFWVvL2Zviff0aXx5zGFSiSm-0YY24gjw Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 946945c1c52040979f3bf05772b54c05 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceActionsTestJSON-35730045 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/946945c1c52040979f3bf05772b54c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_946945c1c52040979f3bf05772b54c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/946945c1c52040979f3bf05772b54c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/946945c1c52040979f3bf05772b54c05"}]}] Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceActionsTestJSON-35730045 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 946945c1c52040979f3bf05772b54c05 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceActionsTestJSON-35730045 Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceActionsTestJSON-35730045-project Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 0e8b976187f24670b2aba13f35babbbe Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceActionsTestJSON-35730045-project Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b191fbdf-8734-47af-acd2-69b6e1535269'} Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:23:58.984623 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] Returning 404 to user: Instance b191fbdf-8734-47af-acd2-69b6e1535269 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-feb9a762-b60d-49c0-892d-c3ca87f6422f tempest-InstanceActionsTestJSON-35730045 tempest-InstanceActionsTestJSON-35730045-project] 10.222.0.48 "GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269" status: 404 len: 111 microversion: 2.1 time: 0.090720 Jul 25 20:23:58.989237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1741/3476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:58 2022] GET /compute/v2.1/servers/b191fbdf-8734-47af-acd2-69b6e1535269 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:23:59.074395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:59.075018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:59.085521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.096960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:59.098352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.099145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:59.312525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:23:59.328991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-75fc9320-34ec-4422-876d-8b08ea9ceeb1 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1274 microversion: 2.1 time: 0.258378 Jul 25 20:23:59.329915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1736/3477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:59 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:23:59.706484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:59.707952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:59.722688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.723345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:59.732967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.733427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:59.782946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:23:59.798398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:23:59.799533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:23:59.816561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.821217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:23:59.822244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:23:59.822849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:00.388838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:00.399258 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-320bc315-8b16-414a-a00a-4579a990d524 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.607836 Jul 25 20:24:00.417737 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1737/3478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:59 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:00.424508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:00.425645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] [instance: 1a904b9c-0421-417a-8862-a93b4ea610b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:00.433088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:00.434553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:00.435274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:00.436324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:00.436977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:00.440701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-325f7dab-12cc-44fd-83e2-cf08f02c988c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.739416 Jul 25 20:24:00.441303 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1742/3479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:23:59 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:00.452835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:00.452835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:00.471958 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] HTTP exception thrown: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. Jul 25 20:24:00.473737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:00.474209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Request method failure captured: Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 HTTP/1.1 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vkWZDBRPsMFzqcZdeTifIYs32dckcsPLWw2HEQ6BbY3OVi8MJwh5-X4zvFqrUqecgQNT3xSu4GDN6rQV5KLZniBLjQVeL9CA_Nmi0qD0tX9igzGPNiR2PJU1rJMOo44Nxz3z2ThjGYIMPfGfFkpG7gveQ3EaZBYAYVH4tPgfqcYW3Y Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/afce26d0d3e546a082c76cba1ca213e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/afce26d0d3e546a082c76cba1ca213e2"}]}] Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: afce26d0d3e546a082c76cba1ca213e2 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-1707638744 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c7cd8e51e2c740088fbe9c4d804c1a72 Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-1707638744-project Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1a904b9c-0421-417a-8862-a93b4ea610b8'} Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:00.475784 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. Jul 25 20:24:00.480942 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:00.481466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:00.481466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:00.485663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Returning 404 to user: Instance 1a904b9c-0421-417a-8862-a93b4ea610b8 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:00.486917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e4691729-0cd6-4957-b4a4-91cdfc63643e tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8" status: 404 len: 111 microversion: 2.1 time: 0.067659 Jul 25 20:24:00.487715 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1738/3480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:00 2022] GET /compute/v2.1/servers/1a904b9c-0421-417a-8862-a93b4ea610b8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:00.510114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-946af06f-25dd-4925-9117-c20d5e173086 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] Calling method '.version_select at 0x7f1968ba73a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:00.561244 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-946af06f-25dd-4925-9117-c20d5e173086 tempest-ServerActionsTestJSON-1707638744 tempest-ServerActionsTestJSON-1707638744-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812693343" status: 202 len: 0 microversion: 2.1 time: 0.066901 Jul 25 20:24:00.562312 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1739/3481] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812693343 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:24:01.096982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:01.111404 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2518fcc2-e4eb-4b60-b9b1-abbe5ed3bb32 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.669020 Jul 25 20:24:01.113423 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1743/3482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:00 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:01.426052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:01.427740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:01.441917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:01.442769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:01.444423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:01.447446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:01.471536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:01.472277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:01.483327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:01.485022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:01.489148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:01.489621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:02.003393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:02.013907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16fc94a0-d662-4753-b4c1-594aa10169c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.591781 Jul 25 20:24:02.028843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1740/3483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:01 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:02.038950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-96c3bec5-9b06-4aa5-969e-970964972d1d req-a4e0fc5b-b894-437e-9baf-a67c1ab11bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fec4a0-205d-4e51-aeb4-a29ed52eac47", "tag": "0ee70d77-6071-4bca-9664-41148a53fc9d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:02.053204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:02.063723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ca4712f-b71b-4069-b267-5739cbc9fae9 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.600854 Jul 25 20:24:02.069223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1744/3484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:01 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:02.085536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-96c3bec5-9b06-4aa5-969e-970964972d1d req-a4e0fc5b-b894-437e-9baf-a67c1ab11bdb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:02.087545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-96c3bec5-9b06-4aa5-969e-970964972d1d req-a4e0fc5b-b894-437e-9baf-a67c1ab11bdb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:02.106386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-96c3bec5-9b06-4aa5-969e-970964972d1d req-a4e0fc5b-b894-437e-9baf-a67c1ab11bdb service nova] Creating event network-changed:0ee70d77-6071-4bca-9664-41148a53fc9d for instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 on n-h2-845775-3 Jul 25 20:24:02.113838 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-96c3bec5-9b06-4aa5-969e-970964972d1d req-a4e0fc5b-b894-437e-9baf-a67c1ab11bdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083349 Jul 25 20:24:02.117256 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1741/3485] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:02.136024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:02.137323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:02.150180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:02.151537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:02.154331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:02.158940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:02.780140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:02.790046 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6d358ab-3971-48f8-a767-b11d3f30813f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.657755 Jul 25 20:24:02.793462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1745/3486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:02 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:03.044152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:03.045880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:03.056590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.058725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:03.059925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.060839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:03.102285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:03.103276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:03.109961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:03.111999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.112667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:03.113721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.114331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:03.585511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:03.605357 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffb4c6d4-06c0-4041-8483-ea877b799e70 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.515323 Jul 25 20:24:03.606462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1746/3487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:03 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:03.689097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:03.699325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e8fbcbe-e0b1-47f1-99d4-bdaf7a20b135 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.663654 Jul 25 20:24:03.700523 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1742/3488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:03 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:03.811852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:03.812499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:03.821439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.821893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:03.822882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:03.823496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:04.182128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9f22ce70-e500-477b-ab7c-7aabf14c938e req-14b9a95b-bc41-4776-ba3b-58678e964ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b366bad-5fb1-463c-82ca-00d6bd913e61", "tag": "c503bc3e-3b69-483a-a82c-c392c3116419"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:04.197972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9f22ce70-e500-477b-ab7c-7aabf14c938e req-14b9a95b-bc41-4776-ba3b-58678e964ec7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:04.199020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9f22ce70-e500-477b-ab7c-7aabf14c938e req-14b9a95b-bc41-4776-ba3b-58678e964ec7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:04.231523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:04.239175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9f22ce70-e500-477b-ab7c-7aabf14c938e req-14b9a95b-bc41-4776-ba3b-58678e964ec7 service nova] Creating event network-changed:c503bc3e-3b69-483a-a82c-c392c3116419 for instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 on n-h2-845775-3 Jul 25 20:24:04.240824 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51dd6042-6e3b-4fe7-bb04-6b36dbde58f8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.432989 Jul 25 20:24:04.241432 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1747/3489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:03 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:04.262319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9f22ce70-e500-477b-ab7c-7aabf14c938e req-14b9a95b-bc41-4776-ba3b-58678e964ec7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092159 Jul 25 20:24:04.264648 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1743/3490] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:24:04.627186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:04.627792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:04.636350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:04.636812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:04.637619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:04.638068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:04.725033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:04.726095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:04.739003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:04.740833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:04.744226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:04.745037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:04.746275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:04.746917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:05.412632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:05.489725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:05.503139 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-11a73019-d246-463f-83c1-58415d476e1e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.783669 Jul 25 20:24:05.503817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1744/3491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:04 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:05.512008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:05.517003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:05.528811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:05.533897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:05.535000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:05.538821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:05.656539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:05.674246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-acef2e37-5eeb-4a5a-9e5a-34e42df6d5ea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 1.049725 Jul 25 20:24:05.677349 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1748/3492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:04 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:06.024968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:06.054326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ec711ab-5a32-48e1-ba58-189a752c657d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.547311 Jul 25 20:24:06.056107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1745/3493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:05 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:06.529806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:06.530847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:06.541470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:06.541943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:06.542783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:06.543227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:06.700124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:06.701822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:06.712893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:06.713749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:06.715422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:06.716097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:07.290768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:07.312316 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2983be6c-84e8-4ef7-b4eb-97e0e64ffb71 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 0.787040 Jul 25 20:24:07.313781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1749/3494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:06 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:07.357914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:07.358644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:07.371140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:07.372084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:07.374144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:07.377158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:07.402966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:07.420472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed22162f-9a8a-4401-9801-c746fb2c0929 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1511 microversion: 2.1 time: 0.725376 Jul 25 20:24:07.422900 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1746/3495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:06 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1511 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:08.209846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-479f6236-501e-4ad9-9906-d5278066e900 req-05733ae3-0e3b-4ac0-923f-e9769dca0d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fec4a0-205d-4e51-aeb4-a29ed52eac47", "name": "network-vif-plugged", "status": "completed", "tag": "0ee70d77-6071-4bca-9664-41148a53fc9d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:08.237944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-479f6236-501e-4ad9-9906-d5278066e900 req-05733ae3-0e3b-4ac0-923f-e9769dca0d47 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:08.238803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-479f6236-501e-4ad9-9906-d5278066e900 req-05733ae3-0e3b-4ac0-923f-e9769dca0d47 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:08.258453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-479f6236-501e-4ad9-9906-d5278066e900 req-05733ae3-0e3b-4ac0-923f-e9769dca0d47 service nova] Creating event network-vif-plugged:0ee70d77-6071-4bca-9664-41148a53fc9d for instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 on n-h2-845775-3 Jul 25 20:24:08.269310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-479f6236-501e-4ad9-9906-d5278066e900 req-05733ae3-0e3b-4ac0-923f-e9769dca0d47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070501 Jul 25 20:24:08.272470 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1747/3496] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:08.340451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:08.342011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:08.373596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:08.375144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:08.376675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:08.377290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:08.670391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:08.679900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-06a8b139-3f8a-4ef7-8a4d-072050e8b210 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 1.364001 Jul 25 20:24:08.681152 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1750/3497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:07 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:08.691548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:08.693558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:08.703090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:08.703982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:08.705175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:08.706373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.351574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:09.362358 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f16d975f-5a33-4901-b71b-1fd4fe2c9bcb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1315 microversion: 2.1 time: 1.029547 Jul 25 20:24:09.366630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1748/3498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:08 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:09.601694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:09.615954 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-366c9523-dfcb-49e5-b5bf-9834847a6636 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1488 microversion: 2.1 time: 0.930883 Jul 25 20:24:09.617478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1751/3499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:08 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1488 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:09.646636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-603535497"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:09.649866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:09.665954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.672883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.674245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.674968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.710081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:09.710939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:09.737616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.739264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.745656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.745656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.837973 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49269a65-f63d-4652-976d-280b69bae704 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "PUT /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1060 microversion: 2.1 time: 0.195886 Jul 25 20:24:09.838808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1749/3500] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:24:09 2022] PUT /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1060 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:09.859540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:09.860349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:09.867883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.868754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:09.869848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:09.870543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:10.538920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:10.555453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:10.559633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dba272a7-b32d-474e-84fe-6ec754144eea tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1487 microversion: 2.1 time: 0.704474 Jul 25 20:24:10.575174 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1750/3501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:09 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1487 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:10.575418 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c15f90f-2f3e-4929-b591-0a4a4fa66b18 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.865395 Jul 25 20:24:10.575418 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1752/3502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:09 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:10.577773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:10.578298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:10.581180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:10.581817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:10.598672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:10.599678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:10.599846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:10.600512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:10.600663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:10.600992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:10.601945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:10.603012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.132354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:11.148372 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4299c710-a833-4f81-84a5-e781b81b615b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1501 microversion: 2.1 time: 0.581655 Jul 25 20:24:11.150185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1751/3503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:10 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1501 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:11.172525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:11.197158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:11.202686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:11.204521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e628d7c-64de-499c-b27d-535d565645b3 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1487 microversion: 2.1 time: 0.621532 Jul 25 20:24:11.205666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1753/3504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:10 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1487 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:11.218733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.221277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.223595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.225149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.233728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:11.234555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:11.251792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.252516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.262864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.264076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.310821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:24:11.342513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:24:11.528018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e534a261-3585-4a36-b900-d550a5092516 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 204 len: 0 microversion: 2.1 time: 0.345505 Jul 25 20:24:11.539339 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1752/3505] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:11 2022] DELETE /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:24:11.547167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:11.547889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:11.588099 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c27b1b3-4046-4955-ae59-be99a9b0bcfc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 204 len: 0 microversion: 2.1 time: 0.358034 Jul 25 20:24:11.589027 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1754/3506] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:11 2022] DELETE /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:24:11.600700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.601232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.602073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.602515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.603123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:11.603861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:11.609957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:11.624144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.624597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:11.625385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:11.625824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:12.222291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:12.225293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:12.233120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:12.241960 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c73e7ff7-0af4-4fea-86ae-d37c489c54b0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1507 microversion: 2.1 time: 0.701030 Jul 25 20:24:12.244365 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1753/3507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:11 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:12.285495 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4761307d-1f3d-42b9-93c2-f375afc4b15f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.691700 Jul 25 20:24:12.286471 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1755/3508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:11 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:12.314933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-7198562d-0b9e-4940-846d-4a8b58797b90 req-66a45a8c-4dd5-4a98-bd2e-1ed7b6684189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b366bad-5fb1-463c-82ca-00d6bd913e61", "name": "network-vif-plugged", "status": "completed", "tag": "c503bc3e-3b69-483a-a82c-c392c3116419"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:12.339978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7198562d-0b9e-4940-846d-4a8b58797b90 req-66a45a8c-4dd5-4a98-bd2e-1ed7b6684189 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:12.340476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7198562d-0b9e-4940-846d-4a8b58797b90 req-66a45a8c-4dd5-4a98-bd2e-1ed7b6684189 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:12.390619 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-7198562d-0b9e-4940-846d-4a8b58797b90 req-66a45a8c-4dd5-4a98-bd2e-1ed7b6684189 service nova] Creating event network-vif-plugged:c503bc3e-3b69-483a-a82c-c392c3116419 for instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 on n-h2-845775-3 Jul 25 20:24:12.419899 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-7198562d-0b9e-4940-846d-4a8b58797b90 req-66a45a8c-4dd5-4a98-bd2e-1ed7b6684189 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113244 Jul 25 20:24:12.425073 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1756/3509] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:12.683308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:12.684258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:12.700301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:12.701035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:12.702055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:12.702674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:13.180300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:13.197615 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e67dfdf1-ee30-45f9-9363-a3cc21d185d6 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1493 microversion: 2.1 time: 0.952055 Jul 25 20:24:13.199058 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1754/3510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:12 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1493 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:13.263867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:13.265006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:13.273646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:13.274299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:13.275172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:13.275748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:13.312799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:13.315329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:13.323913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:13.325166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:13.326135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:13.326758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:13.607866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:13.632751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a60b87ee-9f94-42b7-8bb7-8a58f6ad8a1d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1507 microversion: 2.1 time: 0.373448 Jul 25 20:24:13.649911 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1757/3511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:13 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:13.679117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:13.688983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61f782f3-c15c-4591-9e2d-d6d9eb939a5f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1316 microversion: 2.1 time: 0.380874 Jul 25 20:24:13.690629 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1755/3512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:13 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:14.011260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-430043942", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "135ea7c3-5dc4-4456-9cf2-700c9ed78428"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:14.078758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] validate_networks() for [('135ea7c3-5dc4-4456-9cf2-700c9ed78428', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:14.220800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:14.221433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:14.233211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:14.233211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:14.233799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:14.234312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.239122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:15.240764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:15.241430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:15.242011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:15.242594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:15.259365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:15.286076 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-11739034-0a7e-4358-9f2e-0edcf9518332 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 200 len: 1493 microversion: 2.1 time: 1.064245 Jul 25 20:24:15.291302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1756/3513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:14 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 1493 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:15.296161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.300724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.305951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.308136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.314009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:15.323786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:15.361014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:15.363987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.368247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.371253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.378958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.441608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Getting quotas for project 03e338dff2cd4eab8d125f63fb4b031b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:15.468349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Getting quotas for user 082aa08f7f434ff7932ef775b50ecceb and project 03e338dff2cd4eab8d125f63fb4b031b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:15.538015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:15.547111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:15.665105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:15.679245 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f405d452-7d6d-430f-b69b-a703420a2002 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.851310 Jul 25 20:24:15.681410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1273b92f-f1c1-4897-857a-b3b9ac7d510d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 200 len: 1300 microversion: 2.1 time: 0.385952 Jul 25 20:24:15.682037 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1757/3514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:15 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 1300 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:15.683588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1758/3515] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:15.697693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0069e53d-53df-4ee4-8fa2-d9b2156ffca9 req-27295c21-1a5a-4077-8a45-2530073c61a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fec4a0-205d-4e51-aeb4-a29ed52eac47", "name": "network-vif-deleted", "tag": "0ee70d77-6071-4bca-9664-41148a53fc9d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:15.718689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:15.718689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:15.727724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0069e53d-53df-4ee4-8fa2-d9b2156ffca9 req-27295c21-1a5a-4077-8a45-2530073c61a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.728280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0069e53d-53df-4ee4-8fa2-d9b2156ffca9 req-27295c21-1a5a-4077-8a45-2530073c61a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.730740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.731197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.731995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:15.732472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:15.761840 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0069e53d-53df-4ee4-8fa2-d9b2156ffca9 req-27295c21-1a5a-4077-8a45-2530073c61a5 service nova] Creating event network-vif-deleted:0ee70d77-6071-4bca-9664-41148a53fc9d for instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 on n-h2-845775-3 Jul 25 20:24:15.775165 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0069e53d-53df-4ee4-8fa2-d9b2156ffca9 req-27295c21-1a5a-4077-8a45-2530073c61a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088133 Jul 25 20:24:15.779906 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1759/3516] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:15.794177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6304517-e966-4aa7-9cd8-ebe01f214954 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:15.798739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6304517-e966-4aa7-9cd8-ebe01f214954 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:15.945399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6304517-e966-4aa7-9cd8-ebe01f214954 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:15.954905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6304517-e966-4aa7-9cd8-ebe01f214954 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1215 microversion: 2.1 time: 0.173218 Jul 25 20:24:15.960159 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1760/3517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:15 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:16.319074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:16.323342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.352300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.352954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.361908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.375464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.414246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 HTTP/1.1 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c358aba3-5002-4a94-8a82-08469a527390'} Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.417536 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.423507 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.430422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:16.434556 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ea80f664-2f55-43e9-83b4-e12743fe0605 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 404 len: 111 microversion: 2.1 time: 0.121196 Jul 25 20:24:16.439571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1761/3518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:16 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:24:16.470574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:16.473922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.495833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.497141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.501525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.520235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.618493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 HTTP/1.1 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c358aba3-5002-4a94-8a82-08469a527390'} Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:16.633504 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.638359 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.640598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:16.645375 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2c0c183a-7f59-454e-8be3-87b6ce1779a2 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 404 len: 111 microversion: 2.1 time: 0.187364 Jul 25 20:24:16.648292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1762/3519] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:16 2022] DELETE /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:16.655671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:16.658241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:16.659143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c358aba3-5002-4a94-8a82-08469a527390] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.675507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.676815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.681805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.684513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.688340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f2c5b91f-3d98-4b62-a626-bcc82ffc7db9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1504 microversion: 2.1 time: 0.981938 Jul 25 20:24:16.710094 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1758/3520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:15 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1504 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:16.758990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:16.764565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.817206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.817716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.825746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.828610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.833634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 HTTP/1.1 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c358aba3-5002-4a94-8a82-08469a527390'} Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.838588 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c358aba3-5002-4a94-8a82-08469a527390 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc11203c-813f-4961-9e7b-8b4558f47c5d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390" status: 404 len: 111 microversion: 2.1 time: 0.188205 Jul 25 20:24:16.846854 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1763/3521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:16 2022] GET /compute/v2.1/servers/c358aba3-5002-4a94-8a82-08469a527390 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:24:16.861770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-156023957"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:16.862447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.890229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:24:16.894050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.894604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.899238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.899790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 HTTP/1.1 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd1fec4a0-205d-4e51-aeb4-a29ed52eac47'} Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:16.901570 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:16.906753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:16.908786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6817a30c-d187-4a51-8a45-3f67947da19c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 404 len: 111 microversion: 2.1 time: 0.194018 Jul 25 20:24:16.910217 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1759/3522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:16 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:16.935005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:16.937369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:16.955816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.958863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:16.965432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:16.966864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:17.007637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 HTTP/1.1 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '99b44c56-fbc0-4090-89bd-c44ea7335d56'} Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:17.012078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:17.025973 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf6b64f2-ac82-47ba-8ab8-552696d4bb1c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 404 len: 111 microversion: 2.1 time: 0.109351 Jul 25 20:24:17.051691 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1760/3523] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:16 2022] DELETE /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:17.083454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:17.084647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:17.144861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:17.145639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:17.147079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:17.147851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:17.455079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:17.482612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b963f07f-c630-4b1e-8b28-471ab7055f97 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1219 microversion: 2.1 time: 0.428464 Jul 25 20:24:17.503857 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1761/3524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:17 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1219 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:17.510285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:17.511256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 99b44c56-fbc0-4090-89bd-c44ea7335d56] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:17.517344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Adding security group 2dea45f0-7322-4ffb-9d49-2fcc86b00fb7 to port c503bc3e-3b69-483a-a82c-c392c3116419 Jul 25 20:24:17.526687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:17.530147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:17.531143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:17.532621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:17.533336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:17.554969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 HTTP/1.1 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '99b44c56-fbc0-4090-89bd-c44ea7335d56'} Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.557382 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:17.562615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 99b44c56-fbc0-4090-89bd-c44ea7335d56 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:17.565565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab6071d8-9c3a-4bb2-8e94-2154693864be tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56" status: 404 len: 111 microversion: 2.1 time: 0.059926 Jul 25 20:24:17.566535 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1762/3525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:17 2022] GET /compute/v2.1/servers/99b44c56-fbc0-4090-89bd-c44ea7335d56 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:17.572340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1670333077", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:17.679137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:18.954515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d3f5c6f-aebd-4bd4-98bc-590921c728e9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/action" status: 202 len: 0 microversion: 2.1 time: 2.106980 Jul 25 20:24:18.955237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1764/3526] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:24:16 2022] POST /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/action => generated 0 bytes in 2108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:24:18.961352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:18.962777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:18.963559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:18.964327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:18.964999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:18.965530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:18.966541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:18.984634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:18.985076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:18.986011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:18.986478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.001426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.003434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.006696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.007165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.020810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 HTTP/1.1 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61'} Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:19.023988 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:19.030023 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-778f9520-3163-425c-93f5-065be6952a1b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 404 len: 111 microversion: 2.1 time: 0.064388 Jul 25 20:24:19.044671 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1765/3527] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:18 2022] DELETE /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:19.050144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b5e926f1-9245-4de6-8f6d-73de2a0fabec req-afe29a3e-9aa8-4acf-b38f-421fbf4b54bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c358aba3-5002-4a94-8a82-08469a527390", "name": "network-vif-deleted", "tag": "20816290-566e-4f82-93bf-81ca5c776948"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:19.052244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:19.060369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:19.072325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b5e926f1-9245-4de6-8f6d-73de2a0fabec req-afe29a3e-9aa8-4acf-b38f-421fbf4b54bb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.072751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b5e926f1-9245-4de6-8f6d-73de2a0fabec req-afe29a3e-9aa8-4acf-b38f-421fbf4b54bb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.093909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:19.096919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b5e926f1-9245-4de6-8f6d-73de2a0fabec req-afe29a3e-9aa8-4acf-b38f-421fbf4b54bb service nova] Creating event network-vif-deleted:20816290-566e-4f82-93bf-81ca5c776948 for instance c358aba3-5002-4a94-8a82-08469a527390 on n-h1-845775-3 Jul 25 20:24:19.108412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:19.111312 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b5e926f1-9245-4de6-8f6d-73de2a0fabec req-afe29a3e-9aa8-4acf-b38f-421fbf4b54bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065062 Jul 25 20:24:19.124746 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1766/3528] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:19.135082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:19.135941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.151151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.153915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.155078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.160263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.199802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0431caea-dab1-464c-960f-fb78bb67f18e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631923 Jul 25 20:24:19.200730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1763/3529] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:19.207646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2116518156"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:19.209593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.253599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.253599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.258353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.258818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.355751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:19.367309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b157d660-51f9-404b-afba-d74129fecba4 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1273 microversion: 2.1 time: 0.238736 Jul 25 20:24:19.368208 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1767/3530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:19 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:19.374501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ae39453a-5cff-4e8d-8af2-ad1bb90ceb1c req-5f130ba1-cecb-4782-8162-835da8b7dbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b366bad-5fb1-463c-82ca-00d6bd913e61", "tag": "c503bc3e-3b69-483a-a82c-c392c3116419"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:19.400536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ae39453a-5cff-4e8d-8af2-ad1bb90ceb1c req-5f130ba1-cecb-4782-8162-835da8b7dbcc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.402024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ae39453a-5cff-4e8d-8af2-ad1bb90ceb1c req-5f130ba1-cecb-4782-8162-835da8b7dbcc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.478106 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ae39453a-5cff-4e8d-8af2-ad1bb90ceb1c req-5f130ba1-cecb-4782-8162-835da8b7dbcc service nova] Creating event network-changed:c503bc3e-3b69-483a-a82c-c392c3116419 for instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 on n-h2-845775-3 Jul 25 20:24:19.489184 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ae39453a-5cff-4e8d-8af2-ad1bb90ceb1c req-5f130ba1-cecb-4782-8162-835da8b7dbcc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119112 Jul 25 20:24:19.490289 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1768/3531] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:19.499367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:19.500263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.511277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.512479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.514689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.515686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.540275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 HTTP/1.1 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61'} Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.544910 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. Jul 25 20:24:19.550957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.575490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:19.578416 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f6a6f71-1a16-4874-b115-91dfc5d4b8a4 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61" status: 404 len: 111 microversion: 2.1 time: 0.086625 Jul 25 20:24:19.579951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1769/3532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:19 2022] GET /compute/v2.1/servers/5ba516f4-5f18-4fac-a4e3-a8f09e9b5c61 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:19.599073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44009899-d653-42c7-81a9-c8ebfbe6d292 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:19.601019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-44009899-d653-42c7-81a9-c8ebfbe6d292 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.666959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.security_group_api [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Adding security group 4c0a49df-bfc8-412c-a661-628cdd1b7c5c to port c503bc3e-3b69-483a-a82c-c392c3116419 Jul 25 20:24:19.842000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-44009899-d653-42c7-81a9-c8ebfbe6d292 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:19.851966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44009899-d653-42c7-81a9-c8ebfbe6d292 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1215 microversion: 2.1 time: 0.270387 Jul 25 20:24:19.852987 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1770/3533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:19 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:19.858173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:19.858990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.876541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.878161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.883589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.884390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.916470 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 HTTP/1.1 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0'} Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:19.924433 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.929961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:19.931981 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58f8f68b-40b1-48e7-8af0-3306d2020c47 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 404 len: 111 microversion: 2.1 time: 0.076882 Jul 25 20:24:19.933311 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1771/3534] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:19 2022] DELETE /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:19.948490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:19.949148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:19.961104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.961729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.969488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:19.970023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:19.991809 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 HTTP/1.1 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0'} Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:19.996403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. Jul 25 20:24:20.002122 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.005122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.006338 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df42dc3b-2093-4c10-a62c-53016e0269dc tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0" status: 404 len: 111 microversion: 2.1 time: 0.068933 Jul 25 20:24:20.008354 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1772/3535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:19 2022] GET /compute/v2.1/servers/dc7dd42f-4cf7-4663-9fb4-241fe1fb75c0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.019608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.025258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.034494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.037981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.042032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.042907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.095717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 HTTP/1.1 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c0c26498-720c-4998-8207-5a9f9c6a4a26'} Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.101333 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.106928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.110400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.114454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c3f3a92-8f47-41c9-a735-382ac40a787e tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 404 len: 111 microversion: 2.1 time: 0.101466 Jul 25 20:24:20.116635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1773/3536] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:20 2022] DELETE /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.131379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.133598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: c0c26498-720c-4998-8207-5a9f9c6a4a26] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.150968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.151714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.155082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.156018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.174781 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 HTTP/1.1 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c0c26498-720c-4998-8207-5a9f9c6a4a26'} Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.176403 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. Jul 25 20:24:20.182264 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.184078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance c0c26498-720c-4998-8207-5a9f9c6a4a26 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.185189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07545814-b5d2-41f3-907d-c08bf19a1238 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26" status: 404 len: 111 microversion: 2.1 time: 0.064682 Jul 25 20:24:20.186523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1774/3537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/c0c26498-720c-4998-8207-5a9f9c6a4a26 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.197150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.198060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.210066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.210789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.211999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.212723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.231813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb HTTP/1.1 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '5dcffe15-71ea-45b3-a197-6f381f61a4eb'} Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.234744 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.240702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.244532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.246550 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bd5ca91e-ed0b-48a5-aa65-9bb80b4325cd tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 404 len: 111 microversion: 2.1 time: 0.053962 Jul 25 20:24:20.247783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1775/3538] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:20 2022] DELETE /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.262660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.263801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 5dcffe15-71ea-45b3-a197-6f381f61a4eb] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.279315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.281757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.283880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.286069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.324231 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb HTTP/1.1 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '5dcffe15-71ea-45b3-a197-6f381f61a4eb'} Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.327485 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. Jul 25 20:24:20.333197 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.335709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 5dcffe15-71ea-45b3-a197-6f381f61a4eb could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.337012 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f7aea02-bb7a-49de-834f-1ec4d2c6b60f tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb" status: 404 len: 111 microversion: 2.1 time: 0.085258 Jul 25 20:24:20.338105 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1776/3539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/5dcffe15-71ea-45b3-a197-6f381f61a4eb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.348357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.349836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.359138 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a HTTP/1.1 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b983ba4b-e616-415b-a8de-52a9c092c26a'} Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.361580 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.367295 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.368841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.371348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-47b8d314-69cd-40d0-b41c-e41daa1fa20b tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a" status: 404 len: 111 microversion: 2.1 time: 0.026870 Jul 25 20:24:20.372787 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1777/3540] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:20 2022] DELETE /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.382589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.383232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: b983ba4b-e616-415b-a8de-52a9c092c26a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.420613 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a HTTP/1.1 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b983ba4b-e616-415b-a8de-52a9c092c26a'} Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:20.422720 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:20.428675 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:20.428675 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:20.428675 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. Jul 25 20:24:20.428675 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:20.431734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance b983ba4b-e616-415b-a8de-52a9c092c26a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:20.431734 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18b356a6-7a99-4398-bebc-caa5ea91016c tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a" status: 404 len: 111 microversion: 2.1 time: 0.053980 Jul 25 20:24:20.432316 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1778/3541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/b983ba4b-e616-415b-a8de-52a9c092c26a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:20.444797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.445695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.453522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.454422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.455528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.456237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.602235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:20.612735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f7d5c43f-ca83-4257-a607-ab1c0cfb43f9 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1273 microversion: 2.1 time: 0.179098 Jul 25 20:24:20.616642 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1779/3542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:20.621544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.630147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.646736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.647406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.648376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.649139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.753015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:24:20.943049 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7fbb165-8c70-4aaa-9e06-4cf7937aaf86 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/action" status: 202 len: 0 microversion: 2.1 time: 1.739697 Jul 25 20:24:20.944430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1764/3543] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:24:19 2022] POST /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/action => generated 0 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:24:20.957108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.961024 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09ef0b4e-0ea6-4fe9-87aa-5f482c7e7901 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "DELETE /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 204 len: 0 microversion: 2.1 time: 0.342563 Jul 25 20:24:20.961776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.967554 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1780/3544] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:20 2022] DELETE /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:24:20.975992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:20.976966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:20.986094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.988533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:20.991240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:20.994540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:21.004680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:21.006429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:21.007866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:21.008579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:21.412882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:21.441482 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb67216d-67e3-404c-a39a-b1d1a161e935 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1267 microversion: 2.1 time: 0.495476 Jul 25 20:24:21.442193 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1765/3545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1267 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:21.447920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:21.449681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:21.468274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:21.469141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:21.470213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:21.471015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:22.089438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:22.111951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6af956ae-b915-4e00-b3a8-849ebe1e665d tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1480 microversion: 2.1 time: 0.667672 Jul 25 20:24:22.116163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1766/3546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:21 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1480 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:22.122172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:22.123793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:22.133054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:22.133730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:22.136296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:22.136960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:22.148152 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc7d8a5c-401a-4f60-ae09-04b7141c6709 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.182539 Jul 25 20:24:22.148777 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1781/3547] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Jul 25 20:24:20 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61/os-security-groups => generated 1158 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:22.161402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-26fb6e3f-ce0f-40ed-97d8-4503f352e611 req-2d540cbe-faf2-423e-9c5c-918e18b2f209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b366bad-5fb1-463c-82ca-00d6bd913e61", "tag": "c503bc3e-3b69-483a-a82c-c392c3116419"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:22.203218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-26fb6e3f-ce0f-40ed-97d8-4503f352e611 req-2d540cbe-faf2-423e-9c5c-918e18b2f209 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:22.203726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-26fb6e3f-ce0f-40ed-97d8-4503f352e611 req-2d540cbe-faf2-423e-9c5c-918e18b2f209 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:22.248972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-26fb6e3f-ce0f-40ed-97d8-4503f352e611 req-2d540cbe-faf2-423e-9c5c-918e18b2f209 service nova] Creating event network-changed:c503bc3e-3b69-483a-a82c-c392c3116419 for instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 on n-h2-845775-3 Jul 25 20:24:22.265821 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-26fb6e3f-ce0f-40ed-97d8-4503f352e611 req-2d540cbe-faf2-423e-9c5c-918e18b2f209 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115736 Jul 25 20:24:22.266839 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1782/3548] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:22.271540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:22.294317 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a1be937b-c044-4a1f-a199-44f756e87153 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1273 microversion: 2.1 time: 0.174476 Jul 25 20:24:22.297712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1767/3549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:22 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:22.305102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51e5e222-8b3e-4daa-9bf6-1f178d7e0dfc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968c14280>, body: {"security_group": {"name": " tempest-securitygroup -1927710807 ", "description": "tempest-description-179744904"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:22.608582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1709774660", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "c663bed0-3058-4bb1-a61e-92fa2cc0a2df"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:22.733702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] validate_networks() for [('c663bed0-3058-4bb1-a61e-92fa2cc0a2df', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:22.978939 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51e5e222-8b3e-4daa-9bf6-1f178d7e0dfc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.680023 Jul 25 20:24:22.979548 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1768/3550] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:22 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:23.102052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1428470150", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:23.221428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:23.222729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:23.223228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:23.223650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:23.226914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:23.252731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:23.253192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:23.254020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:23.260348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:23.295171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Getting quotas for project d2a7e61320f646debc583d1265c03d9a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:23.303976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Getting quotas for user b298ea92920f49df9c7c1e9d3d258e61 and project d2a7e61320f646debc583d1265c03d9a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:23.329392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:23.331921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:23.390448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a787f27-065e-4635-93c1-41247d540b8a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.409483 Jul 25 20:24:23.392011 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1769/3551] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:24:23.403835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:23.404550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:23.420748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:23.421945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:23.423130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:23.423835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:23.854181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:23.864852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6144e82b-bfae-45dd-9960-c545c84aae76 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 0.471037 Jul 25 20:24:23.871302 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1770/3552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:23 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:23.879798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-abd5fba7-925f-4797-a2f2-ef7bc760fdc4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c59a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:24.095261 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-abd5fba7-925f-4797-a2f2-ef7bc760fdc4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8" status: 200 len: 223 microversion: 2.1 time: 0.222390 Jul 25 20:24:24.096584 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1771/3553] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:24:23 2022] GET /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 => generated 223 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:24.102255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:24.103296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:24.120224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.122984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.123921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.124458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.187116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:24.187643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:24.188014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:24.188524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:24.188948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:24.214254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.214989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.216659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.217300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.249689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:24.267988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for user 7311833a2c604219a02c4c8d6760c2f2 and project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:24.303740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:24.308589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:24.396572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6870eb9b-bfc3-4b7a-a8c3-6959f1b576fd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.128102 Jul 25 20:24:24.397560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1783/3554] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:24.413341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:24.413964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:24.436457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.437550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.442507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.444320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.657747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:24.674409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2a0c6b13-61a6-447b-8962-26b43d521358 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1480 microversion: 2.1 time: 0.576393 Jul 25 20:24:24.675179 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1772/3555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:24 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1480 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:24.688700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:24.689524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:24.709064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.709684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:24.710802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:24.711212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:25.268565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:25.284350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:25.285953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:25.294255 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33384d13-7677-40d0-be24-16046c23dbb3 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1333 microversion: 2.47 time: 0.610007 Jul 25 20:24:25.297831 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1773/3556] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:24 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1333 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:25.319102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-928fa0a1-3d29-4063-ad49-53269f0366f9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f19689b2820>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:25.445837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:25.554203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b6b9270-42e9-43ec-8294-6edaf205307e tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1315 microversion: 2.1 time: 1.143121 Jul 25 20:24:25.556331 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1784/3557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:24 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1315 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:25.586074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-65573674", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "c663bed0-3058-4bb1-a61e-92fa2cc0a2df"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:25.708137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] validate_networks() for [('c663bed0-3058-4bb1-a61e-92fa2cc0a2df', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:26.072730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-928fa0a1-3d29-4063-ad49-53269f0366f9 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8" status: 202 len: 0 microversion: 2.1 time: 0.773340 Jul 25 20:24:26.073857 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1774/3558] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:24:25 2022] DELETE /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:24:26.080968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:26.081863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:26.097521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:26.099604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:26.100825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:26.101458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.175842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:27.182298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:27.183505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:27.184599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:27.185689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:27.194014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:27.207261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.207794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.209259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.216100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.246983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:27.253859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for user 7311833a2c604219a02c4c8d6760c2f2 and project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:27.275775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:27.279860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:27.348214 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1024e65a-7192-4e90-9d0d-947719f314aa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789607 Jul 25 20:24:27.350722 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1785/3559] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:27.369662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:27.371380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:27.372344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:27.390195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.390688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.393658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.400738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.414851 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1843b0f7-628c-4192-bf24-9db646c3ece6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 1.338427 Jul 25 20:24:27.416430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1775/3560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:26 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:27.434205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968998160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:27.562658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.566795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.567520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lazy-loading 'fault' on Instance uuid 281a4f84-cd59-4e8e-9a34-65745e2def6d {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:24:27.845774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:24:27.846682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:24:27.848645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.848645 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 HTTP/1.1 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6337c6e1-2e48-42f4-a4a1-2fa481937fb8'} Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:24:27.851608 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-92f1ade5-acab-4f27-8c98-580f0d1f3d02'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94020d3b-72f2-4b32-9ed8-c99ecdbcd503 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8" status: 404 len: 194 microversion: 2.1 time: 0.434780 Jul 25 20:24:27.860772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1776/3561] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:24:27 2022] GET /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 => generated 194 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:27.882331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:27.882720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:27.893194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.894004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.895067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.895757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:27.927034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad9ab00c8ccf42dc9713e7d7978a4477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee16388ed1904a278ef6daa569f52678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:27.946362 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5c521ad4-5daa-4fca-98cb-83c4e4787ad8 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 200 len: 1283 microversion: 2.1 time: 0.593504 Jul 25 20:24:27.949386 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1786/3562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:27 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 1283 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:27.957230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-69a2c3cc-b124-449a-827a-0f83d2a83d96 req-d8ca0402-0257-4c08-b42b-a8109494b876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281a4f84-cd59-4e8e-9a34-65745e2def6d", "name": "network-vif-deleted", "tag": "585d2d18-98d5-4a14-87dd-d9108630ff32"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:27.980594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-69a2c3cc-b124-449a-827a-0f83d2a83d96 req-d8ca0402-0257-4c08-b42b-a8109494b876 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:27.982814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-69a2c3cc-b124-449a-827a-0f83d2a83d96 req-d8ca0402-0257-4c08-b42b-a8109494b876 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:28.007743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-69a2c3cc-b124-449a-827a-0f83d2a83d96 req-d8ca0402-0257-4c08-b42b-a8109494b876 service nova] Creating event network-vif-deleted:585d2d18-98d5-4a14-87dd-d9108630ff32 for instance 281a4f84-cd59-4e8e-9a34-65745e2def6d on n-h2-845775-3 Jul 25 20:24:28.018235 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-69a2c3cc-b124-449a-827a-0f83d2a83d96 req-d8ca0402-0257-4c08-b42b-a8109494b876 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066810 Jul 25 20:24:28.020503 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1787/3563] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:28.026861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:28.028134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:28.050941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:28.052225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:28.054167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:28.055347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:28.400103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:28.423738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:28.426411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:28.428945 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8f2a7698-02ae-484a-a596-587c7d6b2002 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1339 microversion: 2.47 time: 0.551658 Jul 25 20:24:28.430528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1777/3564] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:27 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1339 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:28.439036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3e4ad2ed-d2b4-4577-8f72-47c197e4e4a7 req-b5974e6a-f359-4962-b17b-6ec5c9bb754d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6b4b2c-7d19-4c22-9f3e-be787ef70598", "tag": "b54dd955-30d4-4911-baea-7a5ca17d217e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:28.456196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3e4ad2ed-d2b4-4577-8f72-47c197e4e4a7 req-b5974e6a-f359-4962-b17b-6ec5c9bb754d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:28.457169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3e4ad2ed-d2b4-4577-8f72-47c197e4e4a7 req-b5974e6a-f359-4962-b17b-6ec5c9bb754d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:28.478073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:28.481752 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3e4ad2ed-d2b4-4577-8f72-47c197e4e4a7 req-b5974e6a-f359-4962-b17b-6ec5c9bb754d service nova] Creating event network-changed:b54dd955-30d4-4911-baea-7a5ca17d217e for instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 on n-h1-845775-3 Jul 25 20:24:28.490963 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3e4ad2ed-d2b4-4577-8f72-47c197e4e4a7 req-b5974e6a-f359-4962-b17b-6ec5c9bb754d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058233 Jul 25 20:24:28.492393 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1778/3565] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:28.500522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-54140294", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "451", "networks": [{"uuid": "c663bed0-3058-4bb1-a61e-92fa2cc0a2df"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:28.578121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] validate_networks() for [('c663bed0-3058-4bb1-a61e-92fa2cc0a2df', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:28.711382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:28.726257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03891b05-cf70-4061-974a-593b26013826 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1315 microversion: 2.1 time: 0.703701 Jul 25 20:24:28.727220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1788/3566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:28 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:28.768852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5b0e9c0-ca70-45cf-89e9-9f696b8fa201 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968ce1700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-564819840", "description": "tempest-description-1373606249"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:29.738208 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5b0e9c0-ca70-45cf-89e9-9f696b8fa201 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.007733 Jul 25 20:24:29.742080 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1789/3567] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:29.759159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:29.762203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:29.785929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:29.787281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:29.788626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:29.789096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:29.855597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:29.857165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:29.858018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:29.858763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:29.859734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:29.880662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:29.881125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:29.886172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:29.889137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:29.953843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:29.968101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Getting quotas for user 7311833a2c604219a02c4c8d6760c2f2 and project a2a91995d4354fbc804b17d2c810942a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:29.989020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:29.992247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:30.034730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:30.046237 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5efc5187-6a9e-4000-8926-b9aacd9bb2ff tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 0.297111 Jul 25 20:24:30.048339 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1790/3568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:29 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:30.057255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:30.059195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] [instance: 281a4f84-cd59-4e8e-9a34-65745e2def6d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:30.079306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.081751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.082914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.084163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.095871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:30.107237 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] HTTP exception thrown: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Request method failure captured: Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d HTTP/1.1 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vrAwDwgfYAUcQStokkFtb03Gi4YVlMLGlFihIjyTLWFIAyEkHUrg2qmxgEKXkh2LG_CU-rRMv9YKkxNkck-1MwyfmsryAhxNErine5yTMvZZDRDZeoLWPWX2AG-iuWmo1LBMJpYIcEHXuOfZbAQkykPaXa2IGyt8dX--z9cJfaJbHI Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ee16388ed1904a278ef6daa569f52678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ee16388ed1904a278ef6daa569f52678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ee16388ed1904a278ef6daa569f52678"}]}] Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestJSON-399153122 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ee16388ed1904a278ef6daa569f52678 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestJSON-399153122 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestJSON-399153122-project Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ad9ab00c8ccf42dc9713e7d7978a4477 Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestJSON-399153122-project Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '281a4f84-cd59-4e8e-9a34-65745e2def6d'} Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:30.109841 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. Jul 25 20:24:30.114960 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:30.116777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] Returning 404 to user: Instance 281a4f84-cd59-4e8e-9a34-65745e2def6d could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:30.118765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8852ecb5-1c28-4ba7-a989-e0aa249e7d65 tempest-ServersTestJSON-399153122 tempest-ServersTestJSON-399153122-project] 10.222.0.48 "GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d" status: 404 len: 111 microversion: 2.1 time: 0.069273 Jul 25 20:24:30.119862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1791/3569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:30 2022] GET /compute/v2.1/servers/281a4f84-cd59-4e8e-9a34-65745e2def6d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:30.129042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:30.129302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-56c2eaf3-8811-4647-9bc3-131ca930a87c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635269 Jul 25 20:24:30.130723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:30.130856 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1779/3570] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:30.138410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:30.139129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:30.139355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.140021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.141043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.141694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.150879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.151879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.167287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.169371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.518972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:30.546848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:30.549360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:30.555115 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e20b0edc-9ea2-4b0b-8068-551fb0881271 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1360 microversion: 2.47 time: 0.433622 Jul 25 20:24:30.568677 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1792/3571] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:30 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1360 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:30.587479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97faca0e-f7c4-4d35-a30a-43fb60d6b30f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968ce1670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-602891986", "description": "tempest-description-292194945"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:30.842852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:30.861950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7907cafd-5a7f-42f8-ad74-498f2ff034ff tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1315 microversion: 2.1 time: 0.729331 Jul 25 20:24:30.865631 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1780/3572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:30 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:30.882616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2fa3ebcc-041e-43e0-b42a-79b3fa619f76 req-e67dd3b9-d988-41db-98a6-f15f5fcde45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354112a-b807-4329-a034-d147d28a03ae", "tag": "b0c2f208-d012-4c6c-8920-7e38daaf5553"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:30.913726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2fa3ebcc-041e-43e0-b42a-79b3fa619f76 req-e67dd3b9-d988-41db-98a6-f15f5fcde45f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:30.914900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2fa3ebcc-041e-43e0-b42a-79b3fa619f76 req-e67dd3b9-d988-41db-98a6-f15f5fcde45f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:30.955817 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2fa3ebcc-041e-43e0-b42a-79b3fa619f76 req-e67dd3b9-d988-41db-98a6-f15f5fcde45f service nova] Creating event network-changed:b0c2f208-d012-4c6c-8920-7e38daaf5553 for instance 6354112a-b807-4329-a034-d147d28a03ae on n-h1-845775-3 Jul 25 20:24:30.968676 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2fa3ebcc-041e-43e0-b42a-79b3fa619f76 req-e67dd3b9-d988-41db-98a6-f15f5fcde45f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098427 Jul 25 20:24:30.970312 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1781/3573] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:30.986599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71ca5797-2d44-48fb-b5ee-b6d169cfef4c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:30.988844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71ca5797-2d44-48fb-b5ee-b6d169cfef4c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:31.531556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71ca5797-2d44-48fb-b5ee-b6d169cfef4c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:31.551744 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71ca5797-2d44-48fb-b5ee-b6d169cfef4c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1219 microversion: 2.1 time: 0.577711 Jul 25 20:24:31.595943 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1782/3574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:30 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1219 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:31.602023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-376806377"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:31.604975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:31.628349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:31.629988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:31.633874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:31.635209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:32.001907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c16be04c-d947-43af-8c7a-96e2200648c5 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "POST /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3/action" status: 202 len: 52 microversion: 2.47 time: 0.403402 Jul 25 20:24:32.006692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1783/3575] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:24:31 2022] POST /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3/action => generated 52 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:24:32.023630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:32.024404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:32.037070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:32.040765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:32.041764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:32.042811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:32.079041 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97faca0e-f7c4-4d35-a30a-43fb60d6b30f tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.508798 Jul 25 20:24:32.080284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1793/3576] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:32.085605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:32.086225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:32.104570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:32.105731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:32.106283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:32.106924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:33.040287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:33.052409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7fae1337-afed-4f5f-a499-7894082dba1a tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1315 microversion: 2.1 time: 0.970583 Jul 25 20:24:33.056755 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1794/3577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:32 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:33.083393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:33.086057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:33.118017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:33.119918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:33.123802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:33.125435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:33.164343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:33.183163 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b344d351-74e1-4cc6-b5bd-26c04eb5c685 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 1.175059 Jul 25 20:24:33.184768 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1784/3578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:32 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:33.190530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0ff88f47-94e5-49a3-813e-808023e6572a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f196898b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1813772431", "description": "tempest-description-82557048"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:33.269061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:24:33.407125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-adf7d962-1cc2-4d7a-8f06-43b87129dc9a tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 204 len: 0 microversion: 2.47 time: 0.346936 Jul 25 20:24:33.409610 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1795/3579] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:24:33 2022] DELETE /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:24:33.417703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:33.418773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:33.427951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:33.428787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:33.429877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:33.430541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:34.227541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:34.244026 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cab20555-7864-4b69-bf56-f2ac134f1e62 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1277 microversion: 2.1 time: 0.831455 Jul 25 20:24:34.246080 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1796/3580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:33 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1277 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:34.251972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:34.252804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:34.285319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:34.286397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:34.287415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:34.288178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:34.535935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:34.556006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:34.557927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:34.559313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-caeac933-f55b-4e62-9bdc-885ab7e06c3e tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1366 microversion: 2.47 time: 0.312087 Jul 25 20:24:34.561308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1797/3581] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:34 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:34.572810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0c123439-7de6-4415-bd66-69ae96520baf req-9a73bbe6-f4b9-42c0-b922-c1194982b002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6354112a-b807-4329-a034-d147d28a03ae", "name": "network-vif-plugged", "status": "completed", "tag": "b0c2f208-d012-4c6c-8920-7e38daaf5553"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:34.604745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0c123439-7de6-4415-bd66-69ae96520baf req-9a73bbe6-f4b9-42c0-b922-c1194982b002 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:34.608103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0c123439-7de6-4415-bd66-69ae96520baf req-9a73bbe6-f4b9-42c0-b922-c1194982b002 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:34.636629 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0c123439-7de6-4415-bd66-69ae96520baf req-9a73bbe6-f4b9-42c0-b922-c1194982b002 service nova] Creating event network-vif-plugged:b0c2f208-d012-4c6c-8920-7e38daaf5553 for instance 6354112a-b807-4329-a034-d147d28a03ae on n-h1-845775-3 Jul 25 20:24:34.642806 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0c123439-7de6-4415-bd66-69ae96520baf req-9a73bbe6-f4b9-42c0-b922-c1194982b002 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079988 Jul 25 20:24:34.643969 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1798/3582] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:34.649569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:34.663364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:34.672699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:34.673492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:34.674565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:34.675186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:35.453531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0ff88f47-94e5-49a3-813e-808023e6572a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.267123 Jul 25 20:24:35.455922 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1785/3583] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:35.463252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:35.464136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:35.490350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:35.491241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:35.492341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:35.500523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:35.657064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:35.699885 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82bfc9bd-750e-44d9-876e-5181c23cb7dd tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1315 microversion: 2.1 time: 1.047714 Jul 25 20:24:35.724711 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1799/3584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:34 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1315 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:35.730153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:35.731098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:35.738798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:35.739513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:35.740555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:35.741157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:35.888979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:35.904263 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f33f5fc3-5d67-4dd0-91b1-06fa69fcc2b9 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1277 microversion: 2.1 time: 0.177860 Jul 25 20:24:35.904865 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1800/3585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:35 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:35.920096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04483744-0df6-4f5f-97e7-e90a18986cae tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968cd6700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:36.118301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:36.149271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6caadd08-8ef4-4875-bc3e-f0b6f49a6bb5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 0.690908 Jul 25 20:24:36.150951 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1786/3586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:35 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:36.157797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:36.158816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:36.185912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.187130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:36.209193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.217762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:36.445982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:36.454603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:36.461455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:36.466108 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29303b2b-d465-406d-8382-b4fbb095f164 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1366 microversion: 2.47 time: 0.313688 Jul 25 20:24:36.469046 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1787/3587] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:36 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:36.475826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e6191f18-2cb7-4f52-9076-66def504b524 req-41c410d4-e9bc-4f0a-b0af-85e1a9763fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ae4509-8e28-43c7-a89c-aea36f0f7fe7", "tag": "aefb233a-b9ce-47bb-acee-734b819a91e9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:36.531527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e6191f18-2cb7-4f52-9076-66def504b524 req-41c410d4-e9bc-4f0a-b0af-85e1a9763fb8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.533156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e6191f18-2cb7-4f52-9076-66def504b524 req-41c410d4-e9bc-4f0a-b0af-85e1a9763fb8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:36.562789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e6191f18-2cb7-4f52-9076-66def504b524 req-41c410d4-e9bc-4f0a-b0af-85e1a9763fb8 service nova] Creating event network-changed:aefb233a-b9ce-47bb-acee-734b819a91e9 for instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 on n-h2-845775-3 Jul 25 20:24:36.573887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e6191f18-2cb7-4f52-9076-66def504b524 req-41c410d4-e9bc-4f0a-b0af-85e1a9763fb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101941 Jul 25 20:24:36.582814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1788/3588] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:36.706316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3a8d0727-190c-40c6-85b8-954b39b719db req-c0c8f673-5dea-4233-a416-50569a1aa300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b4b2c-7d19-4c22-9f3e-be787ef70598", "name": "network-vif-plugged", "status": "completed", "tag": "b54dd955-30d4-4911-baea-7a5ca17d217e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:36.734223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3a8d0727-190c-40c6-85b8-954b39b719db req-c0c8f673-5dea-4233-a416-50569a1aa300 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.735105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3a8d0727-190c-40c6-85b8-954b39b719db req-c0c8f673-5dea-4233-a416-50569a1aa300 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:36.767100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3a8d0727-190c-40c6-85b8-954b39b719db req-c0c8f673-5dea-4233-a416-50569a1aa300 service nova] Creating event network-vif-plugged:b54dd955-30d4-4911-baea-7a5ca17d217e for instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 on n-h1-845775-3 Jul 25 20:24:36.782860 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3a8d0727-190c-40c6-85b8-954b39b719db req-c0c8f673-5dea-4233-a416-50569a1aa300 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085101 Jul 25 20:24:36.783830 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1789/3589] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:36.833974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:36.835056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:36.853129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.854017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:36.855151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:36.865345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:37.234171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:37.266229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=22 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:37.304155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04483744-0df6-4f5f-97e7-e90a18986cae tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 1.398077 Jul 25 20:24:37.309368 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1801/3590] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:24:35 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:37.334801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:37.354849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:37.399301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:37.399301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:37.400367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:37.400839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:37.655553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:37.676952 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34a4220e-c4a8-42eb-9d51-8b90e033d562 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1502 microversion: 2.1 time: 0.888431 Jul 25 20:24:37.677564 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1790/3591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:36 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1502 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:37.689837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:37.690650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:37.705900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:37.712512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:37.713444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:37.716522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.087288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:38.097382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff12562a-a188-41f1-8693-552ba60c9b16 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 0.786050 Jul 25 20:24:38.097989 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1802/3592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:37 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:38.103779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9743ca0f-0b05-4342-93e2-8322190edeb0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196eae5160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:38.173670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:38.183614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c714b71-cdc1-4052-837a-bfa1bf02e104 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1315 microversion: 2.1 time: 0.501683 Jul 25 20:24:38.196138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1791/3593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:37 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:38.196138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-13929c48-7b33-4277-aac7-666c7155e017 req-66b723ef-a70f-4d2e-84f0-a8c2bacf9f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "741b436b-ed3b-4d45-84fd-12d03706e5ae", "tag": "6da77912-575c-42c8-a187-c71a9a000300"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:38.219808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-13929c48-7b33-4277-aac7-666c7155e017 req-66b723ef-a70f-4d2e-84f0-a8c2bacf9f65 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.220812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-13929c48-7b33-4277-aac7-666c7155e017 req-66b723ef-a70f-4d2e-84f0-a8c2bacf9f65 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.248124 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-13929c48-7b33-4277-aac7-666c7155e017 req-66b723ef-a70f-4d2e-84f0-a8c2bacf9f65 service nova] Creating event network-changed:6da77912-575c-42c8-a187-c71a9a000300 for instance 741b436b-ed3b-4d45-84fd-12d03706e5ae on n-h1-845775-3 Jul 25 20:24:38.263124 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-13929c48-7b33-4277-aac7-666c7155e017 req-66b723ef-a70f-4d2e-84f0-a8c2bacf9f65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075676 Jul 25 20:24:38.266886 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1792/3594] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:38.273539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:38.274971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:38.283675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.284435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.285808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.287048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.357316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.357662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.358575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lazy-loading 'fault' on Instance uuid af807fca-2f49-4fc9-9805-27062c73fbd3 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:24:38.453469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:38.476484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:38.478518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b298ea92920f49df9c7c1e9d3d258e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a7e61320f646debc583d1265c03d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:38.480278 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fae91b94-5618-4b85-bfc5-4ff04dd6cd9c tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 200 len: 1371 microversion: 2.47 time: 0.211964 Jul 25 20:24:38.486227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1793/3595] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:38 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:24:38.499695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:38.501805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:38.515363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:38.535360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.537783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.539831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.540353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.604463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:24:38.797909 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc5f3f6e-1507-4875-beb2-13aa1962eddc tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 204 len: 0 microversion: 2.1 time: 0.309903 Jul 25 20:24:38.799244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1794/3596] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:38 2022] DELETE /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:24:38.820790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:38.826444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:38.839040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.841923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:38.842947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:38.843541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.207955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9743ca0f-0b05-4342-93e2-8322190edeb0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1" status: 202 len: 0 microversion: 2.1 time: 1.108055 Jul 25 20:24:39.209899 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1803/3597] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:24:38 2022] DELETE /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:24:39.215233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:39.216188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:39.231415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.233243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.234291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.234845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.275235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:39.284531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d06e7d2e-1ac3-4521-9177-59ba9a872302 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1508 microversion: 2.1 time: 0.479768 Jul 25 20:24:39.292463 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1795/3598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:38 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1508 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:39.303476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:39.304123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:39.313981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.319992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.332148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.333098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.574886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:39.592692 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a60a955f-d108-4cce-99f7-66122e243e01 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 0.381399 Jul 25 20:24:39.593524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1804/3599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:39 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:39.596115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:39.598605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969772940>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:39.617970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c460f4f9-aed8-4dd9-9e6c-e4819af6a3d0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1501 microversion: 2.1 time: 0.321078 Jul 25 20:24:39.620985 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1796/3600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:39 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:39.627740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:39.628407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] [instance: af807fca-2f49-4fc9-9805-27062c73fbd3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:39.652877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.653394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.654161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:39.654612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:39.657517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:24:39.658309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:24:39.658983 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.658983 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1 HTTP/1.1 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '22d39a2e-0e77-416f-b341-2a585f7c25c1'} Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:24:39.662183 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] Jul 25 20:24:39.665913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.669011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:24:39.669011 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-288f0c95-4517-4fb2-8b0d-4a29a51ec13a'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:39.670087 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bcf26635-9c6c-4179-9394-0efce70724b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1" status: 404 len: 194 microversion: 2.1 time: 0.075504 Jul 25 20:24:39.670793 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1805/3601] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:24:39 2022] GET /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:39.679505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e5e39ed-f86a-4383-86cf-6600b2864caf tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c03a60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:39.689934 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] HTTP exception thrown: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Request method failure captured: Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 HTTP/1.1 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vv1SfjcUGimSZ1KjNdxW7lYQ_1MjqSwYf9zb55oWvRGWmrO9ofwg1V-Iy48tvOzhhwM2FVC-gdB15KKXvDbtFhoIILvhc-CHQd9j4AbvhP3ft8UaNgXbZX3STfcFui1MzM7RzuwOy-oxV7BHMw1vLRokdc4lSco3X4YUpGmaWfS9BU Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.47 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d2a7e61320f646debc583d1265c03d9a Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAaction247Test-589143357 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d2a7e61320f646debc583d1265c03d9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d2a7e61320f646debc583d1265c03d9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d2a7e61320f646debc583d1265c03d9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d2a7e61320f646debc583d1265c03d9a"}]}] Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAaction247Test-589143357 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d2a7e61320f646debc583d1265c03d9a Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAaction247Test-589143357 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAaction247Test-589143357-project Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b298ea92920f49df9c7c1e9d3d258e61 Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAaction247Test-589143357-project Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'af807fca-2f49-4fc9-9805-27062c73fbd3'} Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:39.692119 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] Returning 404 to user: Instance af807fca-2f49-4fc9-9805-27062c73fbd3 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34f0a54a-c336-4e8f-bc1f-9e73e33807c8 tempest-ServersAaction247Test-589143357 tempest-ServersAaction247Test-589143357-project] 10.222.0.48 "GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3" status: 404 len: 111 microversion: 2.47 time: 0.071623 Jul 25 20:24:39.696494 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1797/3602] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:24:39 2022] GET /compute/v2.1/servers/af807fca-2f49-4fc9-9805-27062c73fbd3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:24:40.200083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-39f4deb5-e50f-4c11-842a-ba0cf77bcdf1 req-34b5ca6b-b757-4728-ba2e-7afc915a43a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d6e47a-a490-434c-8bb1-846a3c8fcd7b", "tag": "d57ca4df-a46f-4eac-80b7-8055dd562ce5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:40.235933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:40.256855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-39f4deb5-e50f-4c11-842a-ba0cf77bcdf1 req-34b5ca6b-b757-4728-ba2e-7afc915a43a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:40.260695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-39f4deb5-e50f-4c11-842a-ba0cf77bcdf1 req-34b5ca6b-b757-4728-ba2e-7afc915a43a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:40.286403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:40.401379 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-39f4deb5-e50f-4c11-842a-ba0cf77bcdf1 req-34b5ca6b-b757-4728-ba2e-7afc915a43a0 service nova] Creating event network-changed:d57ca4df-a46f-4eac-80b7-8055dd562ce5 for instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b on n-h2-845775-3 Jul 25 20:24:40.401771 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e5e39ed-f86a-4383-86cf-6600b2864caf tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394" status: 202 len: 0 microversion: 2.1 time: 0.726447 Jul 25 20:24:40.403553 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1806/3603] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:24:39 2022] DELETE /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:24:40.433582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:40.441031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:40.450147 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-39f4deb5-e50f-4c11-842a-ba0cf77bcdf1 req-34b5ca6b-b757-4728-ba2e-7afc915a43a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258571 Jul 25 20:24:40.451223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1798/3604] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:24:40.470146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:40.471271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:40.476191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:40.476936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:40.508792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c1b1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:40.675416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:24:40.676560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:24:40.677998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.677998 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394 HTTP/1.1 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '57f8a5e4-11d5-48dd-a1e5-24263dbb6394'} Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:24:40.682937 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] Jul 25 20:24:40.686061 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:40.693405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:24:40.693405 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-859302ea-9b1d-4c47-8f52-d3437621abb1'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:40.699910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e70ec121-04cf-4349-b66d-a6d4dcdce75d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394" status: 404 len: 194 microversion: 2.1 time: 0.241561 Jul 25 20:24:40.702303 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1799/3605] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:24:40 2022] GET /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394 => generated 194 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:40.726631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:40.736311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:40.753731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:40.755119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:40.756966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:40.758157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:41.032641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:41.050070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e92d4e52-992c-4ef3-918e-1e4a6d097cfa tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1508 microversion: 2.1 time: 0.644835 Jul 25 20:24:41.053285 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1807/3606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:40 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:41.062149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3db87114-cb61-47d5-93b9-f094dfa6cf06 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c66160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:41.154293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:41.172637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-450a5004-5277-4174-bc4f-4ef7e77fc248 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 0.460773 Jul 25 20:24:41.173504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1800/3607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:40 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:41.978355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3db87114-cb61-47d5-93b9-f094dfa6cf06 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e" status: 202 len: 0 microversion: 2.1 time: 0.923149 Jul 25 20:24:41.981689 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1808/3608] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:24:41 2022] DELETE /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:24:41.991056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c59a60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:42.019960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:42.083408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:42.088633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:42.110143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:42.111148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:42.112372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:42.113235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:42.274708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:24:42.279584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 04769f76-69a8-4308-8b33-d64a0202dc0e not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:24:42.280816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.280816 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e HTTP/1.1 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '04769f76-69a8-4308-8b33-d64a0202dc0e'} Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:24:42.285558 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] Jul 25 20:24:42.289565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:42.294734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:24:42.294734 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-2730db27-d92b-41aa-bbab-6e16aa6798c9'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:42.296798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0d3839c-7021-47fc-8b62-50339234bd1e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e" status: 404 len: 194 microversion: 2.1 time: 0.309598 Jul 25 20:24:42.298039 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1801/3609] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:24:41 2022] GET /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e => generated 194 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:42.306495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:42.307407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:42.331714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:42.332539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:42.336762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:42.339646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:42.995661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:43.020938 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6514b41-a838-4227-9096-1e99fcbd6636 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1508 microversion: 2.1 time: 0.943722 Jul 25 20:24:43.026636 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1809/3610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:42 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1508 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:43.092858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4dc0f5d0-e163-4826-a79a-05ec89094553 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969772160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:43.410201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:43.420412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb272b36-789a-4fdb-ab54-160c7a4169b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 1.119922 Jul 25 20:24:43.430160 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1802/3611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:42 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:43.762412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f993033e-6e3e-4645-a0f6-472dcbb0f830"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:43.767311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:43.778858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:43.780146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:43.781581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:43.782587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.446851 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ecaa817-0483-4ee6-959d-4c52ad4bacaa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693272 Jul 25 20:24:44.456626 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1803/3612] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:24:43 2022] POST /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:44.475735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:44.476597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:44.510213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.511196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.513808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.514784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.540657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4dc0f5d0-e163-4826-a79a-05ec89094553 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.490237 Jul 25 20:24:44.554422 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1810/3613] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:24:43 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:44.562630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6e99b517-97b7-4b07-bff8-2c14edd09bad req-0e585413-dedb-455a-81e9-4c574e3d4981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6354112a-b807-4329-a034-d147d28a03ae", "name": "network-vif-deleted", "tag": "b0c2f208-d012-4c6c-8920-7e38daaf5553"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:44.588508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6e99b517-97b7-4b07-bff8-2c14edd09bad req-0e585413-dedb-455a-81e9-4c574e3d4981 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.590981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6e99b517-97b7-4b07-bff8-2c14edd09bad req-0e585413-dedb-455a-81e9-4c574e3d4981 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.614199 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6e99b517-97b7-4b07-bff8-2c14edd09bad req-0e585413-dedb-455a-81e9-4c574e3d4981 service nova] Creating event network-vif-deleted:b0c2f208-d012-4c6c-8920-7e38daaf5553 for instance 6354112a-b807-4329-a034-d147d28a03ae on n-h1-845775-3 Jul 25 20:24:44.627499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6e99b517-97b7-4b07-bff8-2c14edd09bad req-0e585413-dedb-455a-81e9-4c574e3d4981 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070215 Jul 25 20:24:44.638058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1811/3614] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:44.641696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.642203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.642725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lazy-loading 'fault' on Instance uuid 6354112a-b807-4329-a034-d147d28a03ae {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:24:44.664670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:44.667510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:44.684381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.685460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:44.687684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:44.690530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:45.254052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082aa08f7f434ff7932ef775b50ecceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e338dff2cd4eab8d125f63fb4b031b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:45.279983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f40bd9b4-8bc8-4d4c-82c9-e50e4905c4d7 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 200 len: 1305 microversion: 2.1 time: 0.820252 Jul 25 20:24:45.280700 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1804/3615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:44 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 1305 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:45.290065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-579ee968-4329-441b-8078-17857fb7e636 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968998040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1072810709", "description": "tempest-description-1123276276"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.223199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-579ee968-4329-441b-8078-17857fb7e636 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.929481 Jul 25 20:24:46.231970 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1805/3616] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:45 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:46.238794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9ad7d45e-e058-4881-95dd-5d0f2cf21306 req-c19ae007-3224-4daf-af93-84e8af5ef784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741b436b-ed3b-4d45-84fd-12d03706e5ae", "name": "network-vif-plugged", "status": "completed", "tag": "6da77912-575c-42c8-a187-c71a9a000300"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.247178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:46.282352 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-484b3529-b9e0-4e30-9194-ad6be1fd1e88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 1.642864 Jul 25 20:24:46.286693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1812/3617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:44 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:46.310963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e79e9370-5549-4a1f-9b26-766fc015fec7 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f1968cf9820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-995627680", "description": "tempest-description-1315177795"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.313652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9ad7d45e-e058-4881-95dd-5d0f2cf21306 req-c19ae007-3224-4daf-af93-84e8af5ef784 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.320749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9ad7d45e-e058-4881-95dd-5d0f2cf21306 req-c19ae007-3224-4daf-af93-84e8af5ef784 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.349184 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9ad7d45e-e058-4881-95dd-5d0f2cf21306 req-c19ae007-3224-4daf-af93-84e8af5ef784 service nova] Creating event network-vif-plugged:6da77912-575c-42c8-a187-c71a9a000300 for instance 741b436b-ed3b-4d45-84fd-12d03706e5ae on n-h1-845775-3 Jul 25 20:24:46.355577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9ad7d45e-e058-4881-95dd-5d0f2cf21306 req-c19ae007-3224-4daf-af93-84e8af5ef784 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129228 Jul 25 20:24:46.357781 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1806/3618] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:46.373758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:46.376075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:46.398369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.401349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.403339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.405446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.452111 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae HTTP/1.1 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6354112a-b807-4329-a034-d147d28a03ae'} Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.461331 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.464664 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.468243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.470263 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cdf22241-0a32-4720-837f-ecf20300ad6b tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 404 len: 111 microversion: 2.1 time: 0.110395 Jul 25 20:24:46.472794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1807/3619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:46 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:46.487721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-998829723", "metadata": {"image_type": "test"}}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.495814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:46.513541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.515648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.519636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.522430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.562562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae/action HTTP/1.1 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 111 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-998829723", "metadata": {"image_type": "test"}}} Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6354112a-b807-4329-a034-d147d28a03ae', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-998829723', 'metadata': {'image_type': 'test'}}}} Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:24:46.568092 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.571392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.576566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.579317 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd08286d-b512-4adb-9097-6890c6f8ec35 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "POST /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae/action" status: 404 len: 111 microversion: 2.1 time: 0.100891 Jul 25 20:24:46.580359 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1808/3620] 10.222.0.48 () {60 vars in 1279 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:46.594445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1973798652", "metadata": {"image_type": "test"}}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.598444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Failed to fetch instance by id tempest-invalid-1492098700 {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:24:46.599370 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance tempest-invalid-1492098700 could not be found. Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/tempest-invalid-1492098700/action HTTP/1.1 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 112 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1973798652", "metadata": {"image_type": "test"}}} Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance tempest-invalid-1492098700 could not be found. Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'tempest-invalid-1492098700', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1973798652', 'metadata': {'image_type': 'test'}}}} Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1492098700 could not be found. Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.602213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1492098700 could not be found. Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1492098700 could not be found. Jul 25 20:24:46.606488 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.610800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance tempest-invalid-1492098700 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.613785 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df54c285-7eaf-4bf5-9233-f8bffede19b5 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "POST /compute/v2.1/servers/tempest-invalid-1492098700/action" status: 404 len: 101 microversion: 2.1 time: 0.023680 Jul 25 20:24:46.616593 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1809/3621] 10.222.0.48 () {60 vars in 1249 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/servers/tempest-invalid-1492098700/action => generated 101 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:24:46.636117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-237868114"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.638682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:24:46.639210 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 56 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-test-snap-237868114"}} Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-237868114'}}} Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.656986 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.661034 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.662913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.664200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45b36225-bc50-42dc-b3bb-43fccdc3e4f3 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.041391 Jul 25 20:24:46.667817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1810/3622] 10.222.0.48 () {60 vars in 1275 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:46.678112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-777866996"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:46.683769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:24:46.684947 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 56 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: {"createImage": {"name": "tempest-test-snap-777866996"}} Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-777866996'}}} Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.689023 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 25 20:24:46.692922 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.695842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.697513 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1697beec-f024-4e62-b8d3-daa5b8034533 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.024534 Jul 25 20:24:46.699923 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1811/3623] 10.222.0.48 () {60 vars in 1281 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:46.710495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:46.711398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:46.735533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.739607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.742150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.744573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.802963 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae HTTP/1.1 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6354112a-b807-4329-a034-d147d28a03ae'} Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.823934 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.827202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.830992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6896f79f-bb97-4488-89f6-dcdfdf1ad9e0 tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 404 len: 111 microversion: 2.1 time: 0.124693 Jul 25 20:24:46.834857 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1812/3624] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:24:46 2022] DELETE /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:46.865337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:46.867584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] [instance: 6354112a-b807-4329-a034-d147d28a03ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:46.903992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.905129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.921923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:46.929334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:46.977630 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] HTTP exception thrown: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Request method failure captured: Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae HTTP/1.1 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvtQopRJmxoD4J30tDzzry3ehPJmMmek52x01SSjKZxL0K6JYtfeqh2BEDPF7JrUkRE-fP2WKwxID0k6Vp3-V6warCOhX0-ZxS4qEP8PzXd1JvFZBnbGEfAfusICUbGZxA_-U4AW3qjYSEbWT82AijVCrPDisReuh7oIvCrc9_iJ-U Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03e338dff2cd4eab8d125f63fb4b031b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03e338dff2cd4eab8d125f63fb4b031b"}]}] Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03e338dff2cd4eab8d125f63fb4b031b Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-146081240 Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 082aa08f7f434ff7932ef775b50ecceb Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ImagesNegativeTestJSON-146081240-project Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6354112a-b807-4329-a034-d147d28a03ae'} Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:46.985662 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] Returning 404 to user: Instance 6354112a-b807-4329-a034-d147d28a03ae could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-263f8a3d-df22-4aed-b0d3-ee1254ea948c tempest-ImagesNegativeTestJSON-146081240 tempest-ImagesNegativeTestJSON-146081240-project] 10.222.0.48 "GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae" status: 404 len: 111 microversion: 2.1 time: 0.146731 Jul 25 20:24:46.994705 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1813/3625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:46 2022] GET /compute/v2.1/servers/6354112a-b807-4329-a034-d147d28a03ae => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:47.315170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:47.316722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:47.335284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:47.346811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:47.347796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:47.348311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:48.110648 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e79e9370-5549-4a1f-9b26-766fc015fec7 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.815670 Jul 25 20:24:48.111245 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1813/3626] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:24:46 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:48.433092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:48.453360 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf3b24e1-1a65-4b32-9af6-0fbb29d17633 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 1.142147 Jul 25 20:24:48.454176 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1814/3627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:47 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:48.457962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1037312785", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f82035ec-96d9-4a09-a1a5-a01f90aecb53"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:48.563297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] validate_networks() for [('f82035ec-96d9-4a09-a1a5-a01f90aecb53', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:24:48.889514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e29a4b06-1bd1-4a70-97f3-60ef427e8b42 req-056c725f-8772-4025-9c03-1ebe732c4cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ae4509-8e28-43c7-a89c-aea36f0f7fe7", "name": "network-vif-plugged", "status": "completed", "tag": "aefb233a-b9ce-47bb-acee-734b819a91e9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:48.916166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e29a4b06-1bd1-4a70-97f3-60ef427e8b42 req-056c725f-8772-4025-9c03-1ebe732c4cee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:48.916696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e29a4b06-1bd1-4a70-97f3-60ef427e8b42 req-056c725f-8772-4025-9c03-1ebe732c4cee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:48.957656 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e29a4b06-1bd1-4a70-97f3-60ef427e8b42 req-056c725f-8772-4025-9c03-1ebe732c4cee service nova] Creating event network-vif-plugged:aefb233a-b9ce-47bb-acee-734b819a91e9 for instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 on n-h2-845775-3 Jul 25 20:24:48.978847 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e29a4b06-1bd1-4a70-97f3-60ef427e8b42 req-056c725f-8772-4025-9c03-1ebe732c4cee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093012 Jul 25 20:24:48.979481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1815/3628] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:49.498062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:49.502864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:49.539620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:49.541084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:49.542119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:49.542817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:50.613102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:50.627413 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a60fc72-155f-4793-9558-34e75ed0b5b3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 1.151641 Jul 25 20:24:50.640653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1816/3629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:49 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:50.746664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:24:50.747537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:24:50.748154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:24:50.748694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:24:50.749404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:24:50.818393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:50.823781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:50.826405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:50.827357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:50.923974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Getting quotas for project 06f45177fa1945c19753fb626d95ddef. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:24:50.948851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Getting quotas for user 9eca7dcff9ae44b8ad0760c3621d1025 and project 06f45177fa1945c19753fb626d95ddef. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:24:51.001552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:24:51.007470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:24:51.380131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-62d1e208-85ee-4151-9d3b-ed3f7f6d920d req-170241c1-df78-4900-a343-54f8e26a81d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d6e47a-a490-434c-8bb1-846a3c8fcd7b", "name": "network-vif-plugged", "status": "completed", "tag": "d57ca4df-a46f-4eac-80b7-8055dd562ce5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:51.411599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-177e98f5-f151-4137-b381-4c11a53677c0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.953769 Jul 25 20:24:51.421557 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1814/3630] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:24:51.433495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-62d1e208-85ee-4151-9d3b-ed3f7f6d920d req-170241c1-df78-4900-a343-54f8e26a81d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:51.434450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-62d1e208-85ee-4151-9d3b-ed3f7f6d920d req-170241c1-df78-4900-a343-54f8e26a81d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:51.437017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:51.438149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:51.477907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-62d1e208-85ee-4151-9d3b-ed3f7f6d920d req-170241c1-df78-4900-a343-54f8e26a81d4 service nova] Creating event network-vif-plugged:d57ca4df-a46f-4eac-80b7-8055dd562ce5 for instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b on n-h2-845775-3 Jul 25 20:24:51.505590 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-62d1e208-85ee-4151-9d3b-ed3f7f6d920d req-170241c1-df78-4900-a343-54f8e26a81d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129347 Jul 25 20:24:51.508268 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1817/3631] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:51.668844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:51.675771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:51.727881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:51.728390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:51.729196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:51.729636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:51.898906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:51.938273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1216 microversion: 2.1 time: 0.508804 Jul 25 20:24:51.939526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1815/3632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:51 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1216 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:52.330059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:52.357453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 0.699493 Jul 25 20:24:52.360702 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1818/3633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:51 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:52.864794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:52.867542 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003860 Jul 25 20:24:52.880732 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1816/3634] 10.222.0.48 () {56 vars in 886 bytes} [Mon Jul 25 20:24:52 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 20:24:52.883244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:52.885097 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002886 Jul 25 20:24:52.889477 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1819/3635] 10.222.0.48 () {54 vars in 1035 bytes} [Mon Jul 25 20:24:52 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 25 20:24:52.896143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:52.897402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a1f77d9-3c66-477b-9608-ad94e9c8bb99 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001823 Jul 25 20:24:52.898539 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1817/3636] 10.222.0.48 () {54 vars in 1041 bytes} [Mon Jul 25 20:24:52 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:24:52.907238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:52.909116 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3ac89c8-398d-4e15-a646-9b5f2e8fa307 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001981 Jul 25 20:24:52.909569 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1820/3637] 10.222.0.48 () {56 vars in 886 bytes} [Mon Jul 25 20:24:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 20:24:52.966721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:52.967409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:53.005845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:53.006375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:53.007225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:53.007665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:53.294303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:53.330744 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25452599-c767-4b98-b9eb-fd134960466c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1220 microversion: 2.1 time: 0.369589 Jul 25 20:24:53.349753 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1818/3638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:52 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1220 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:53.385918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:53.390157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:53.428191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:53.434076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:53.435665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:53.436160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:53.951408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:53.977687 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7d1366f-624a-40bc-99cf-0cbd50c26f88 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1319 microversion: 2.1 time: 0.599247 Jul 25 20:24:53.996632 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1821/3639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:53 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:54.363200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:54.365440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:54.395915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:54.398418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:54.402011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:54.404661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:54.830018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:54.834257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:54.862837 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfa7e080-8302-483d-97a5-274043140b6b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1286 microversion: 2.1 time: 0.504292 Jul 25 20:24:54.869688 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1819/3640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:54 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1286 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:55.014670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:55.024400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:55.051129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.065682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:55.077562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.078663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:55.867109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:55.880405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da853ec7-059a-44e4-a2a7-98c3756ef30c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1509 microversion: 2.1 time: 0.871675 Jul 25 20:24:55.883750 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1822/3641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:55 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1509 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:55.906375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:55.907931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:55.918701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:55.922081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:55.941285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.942104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:55.942415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.943741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.944441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:55.945644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:55.946493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:55.947569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:56.312916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:56.375648 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-229a529d-0eb7-4291-a677-f8b411a2b34d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1274 microversion: 2.1 time: 0.462108 Jul 25 20:24:56.377631 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1820/3642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:55 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1274 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:56.496377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:56.510416 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-245d1a9e-c76d-4e38-9e7b-742d076b07d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1511 microversion: 2.1 time: 0.599025 Jul 25 20:24:56.528670 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1823/3643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:55 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1511 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:56.560373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:56.563187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:56.596483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:56.597348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:56.601476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:56.602449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:56.944245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:56.953912 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-192f2727-02a7-4949-851d-e53d3980270e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1509 microversion: 2.1 time: 0.404819 Jul 25 20:24:56.955408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1821/3644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:56 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:56.980007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:56.986691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:56.988245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:24:57.010795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.011251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.012089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.012522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.250087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:24:57.394486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:57.402987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:57.404077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:57.406250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:57.406370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.406771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.424817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.425821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.430808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.433211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.587071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:57.595716 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ec8dba9-4500-4807-a0a1-b7b158380ddb tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1274 microversion: 2.1 time: 0.197066 Jul 25 20:24:57.610155 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1822/3645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:57 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:57.620059 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa5d056f-e5bb-4f2f-8c89-0a09a49e4076 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1512 microversion: 2.1 time: 0.646303 Jul 25 20:24:57.621635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1824/3646] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Jul 25 20:24:56 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:57.646510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:57.652805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:57.654806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1709774660', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:24:57.663672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.664383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.666318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:57.666932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:57.884051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f94afc6-b0b5-46e6-ab8f-4c31f2dc9f88 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Action: 'create', calling method: .version_select at 0x7f1968bae940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-40559911", "metadata": {"Type": "work"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f94afc6-b0b5-46e6-ab8f-4c31f2dc9f88 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 120 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-40559911", "metadata": {"Type": "work"}}} Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-40559911', 'metadata': {'Type': 'work'}}}} Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:24:57.888553 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f94afc6-b0b5-46e6-ab8f-4c31f2dc9f88 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f94afc6-b0b5-46e6-ab8f-4c31f2dc9f88 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.278885 Jul 25 20:24:57.899729 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1823/3647] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Jul 25 20:24:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:24:57.904972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc2d4b4b-714a-44ae-acea-39f6cb8d63fe tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Action: 'create', calling method: .version_select at 0x7f1968c22670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303874242", "metadata": {"Type": "work"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc2d4b4b-714a-44ae-acea-39f6cb8d63fe tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 119 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303874242", "metadata": {"Type": "work"}}} Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-303874242', 'metadata': {'Type': 'work'}}}} Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '0' Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:24:57.910622 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc2d4b4b-714a-44ae-acea-39f6cb8d63fe tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc2d4b4b-714a-44ae-acea-39f6cb8d63fe tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016537 Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1824/3648] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Jul 25 20:24:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:24:57.932551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43372598-2c08-491a-9f4b-e79ef5a38419 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Action: 'create', calling method: .version_select at 0x7f1968c0e3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-306561483", "metadata": {"Type": "work"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43372598-2c08-491a-9f4b-e79ef5a38419 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 118 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-306561483", "metadata": {"Type": "work"}}} Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-306561483', 'metadata': {'Type': 'work'}}}} Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '' Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:24:57.937279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43372598-2c08-491a-9f4b-e79ef5a38419 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-43372598-2c08-491a-9f4b-e79ef5a38419 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011677 Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1825/3649] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Jul 25 20:24:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:24:57.953669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be98a8cb-8baa-434e-a13c-873e2546c7e2 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Calling method '.version_select at 0x7f1968baeaf0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:57.973166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:24:57.995714 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-be98a8cb-8baa-434e-a13c-873e2546c7e2 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] HTTP exception thrown: Volume tempest-invalid-30650591 could not be found. Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be98a8cb-8baa-434e-a13c-873e2546c7e2 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-30650591 HTTP/1.1 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume tempest-invalid-30650591 could not be found. Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'tempest-invalid-30650591'} Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-30650591 could not be found. (HTTP 404) (Request-ID: req-efdaf5f3-42a2-4dce-9053-1fa68cfe36b6) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:57.999265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-30650591 could not be found. Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-30650591 could not be found. Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-30650591 could not be found. Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be98a8cb-8baa-434e-a13c-873e2546c7e2 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 404 to user: Volume tempest-invalid-30650591 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:58.008755 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be98a8cb-8baa-434e-a13c-873e2546c7e2 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-30650591" status: 404 len: 97 microversion: 2.1 time: 0.057135 Jul 25 20:24:58.017833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1826/3650] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Jul 25 20:24:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-30650591 => generated 97 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:24:58.026418 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22966ea4-2d02-4046-aed0-06cc5169407e tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013558 Jul 25 20:24:58.026967 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1827/3651] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Jul 25 20:24:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 20:24:58.037687 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e529f485-3745-4c4c-a437-d43598467938 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004685 Jul 25 20:24:58.043759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1828/3652] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:24:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 20:24:58.049243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-364557c1-8e04-4b28-bacc-87f793c574d3 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Calling method '.version_select at 0x7f1968c0eb80>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:58.087281 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-364557c1-8e04-4b28-bacc-87f793c574d3 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] HTTP exception thrown: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-364557c1-8e04-4b28-bacc-87f793c574d3 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-volumes/11fba748-3c47-411f-8057-32ab3cb92ac0 HTTP/1.1 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '11fba748-3c47-411f-8057-32ab3cb92ac0'} Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. (HTTP 404) (Request-ID: req-5ac0ca54-0102-4ebf-ab37-1d5619b784d0) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:24:58.089711 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-364557c1-8e04-4b28-bacc-87f793c574d3 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 404 to user: Volume 11fba748-3c47-411f-8057-32ab3cb92ac0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:58.095406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-364557c1-8e04-4b28-bacc-87f793c574d3 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/11fba748-3c47-411f-8057-32ab3cb92ac0" status: 404 len: 109 microversion: 2.1 time: 0.047153 Jul 25 20:24:58.102079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1829/3653] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:24:58 2022] DELETE /compute/v2.1/os-volumes/11fba748-3c47-411f-8057-32ab3cb92ac0 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:58.105046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4e6edcc-d682-495a-a077-721c13c0db25 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Calling method '.version_select at 0x7f1968bae1f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:58.107804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:24:58.124732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:58.133385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.133840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.151429 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e4e6edcc-d682-495a-a077-721c13c0db25 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] HTTP exception thrown: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4e6edcc-d682-495a-a077-721c13c0db25 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Request method failure captured: Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/os-volumes/1b5c005f-6067-46dc-bbb2-3ba56f35d478 HTTP/1.1 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwZ7Y_aXGH7IkMzd_sqXzwuNmoTcu_O2c2RxJd3mefVveGYa8b49FkuuuJ5mYOgSeuof5u0c589TZt_HOLuw4Gzt5Vzq7y5kb7lAMlyDBePdb7jQ5Tqz55F393b4N-qLoOl3bssfh8fppoDAH11pymmw4qCpxFYChaqWjPVO_SwUag Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb3bb1753e4f44a5920af7e27e580fe7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb3bb1753e4f44a5920af7e27e580fe7"}]}] Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: eb3bb1753e4f44a5920af7e27e580fe7 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesNegativeTest-339433481 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b05ad3de6cae4441bda0992a4b17d460 Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesNegativeTest-339433481-project Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: exception: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1b5c005f-6067-46dc-bbb2-3ba56f35d478'} Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. (HTTP 404) (Request-ID: req-5059b9b8-1e0c-4b90-a865-e7adef4d04a8) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 20:24:58.155781 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. Jul 25 20:24:58.159176 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:24:58.164391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4e6edcc-d682-495a-a077-721c13c0db25 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] Returning 404 to user: Volume 1b5c005f-6067-46dc-bbb2-3ba56f35d478 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:24:58.165457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4e6edcc-d682-495a-a077-721c13c0db25 tempest-VolumesNegativeTest-339433481 tempest-VolumesNegativeTest-339433481-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1b5c005f-6067-46dc-bbb2-3ba56f35d478" status: 404 len: 109 microversion: 2.1 time: 0.066835 Jul 25 20:24:58.166245 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1830/3654] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Jul 25 20:24:58 2022] GET /compute/v2.1/os-volumes/1b5c005f-6067-46dc-bbb2-3ba56f35d478 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:24:58.339591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0fef3da6-2442-4a6e-8ef9-b52fa50be02f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1709774660" status: 200 len: 1514 microversion: 2.1 time: 0.697111 Jul 25 20:24:58.341702 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1825/3655] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:24:57 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1709774660 => generated 1514 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:58.387198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:58.407641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:58.410310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:24:58.423809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.430489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.431668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.432661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.565194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:24:58.622224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:58.625395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:58.642826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.643669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.647651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.648273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.683682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:58.694363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:58.695107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:58.782882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:58.796421 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6d96dc7-68f6-4098-9edf-4403b93617a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1274 microversion: 2.1 time: 0.178431 Jul 25 20:24:58.814440 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1826/3656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:58 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:59.000981 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07687762-a371-4e4d-b008-64250ac8e2c4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4512 microversion: 2.1 time: 0.619604 Jul 25 20:24:59.002281 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1831/3657] 10.222.0.48 () {58 vars in 1173 bytes} [Mon Jul 25 20:24:58 2022] GET /compute/v2.1/servers/detail?status=active => generated 4512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:59.033560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:59.040629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:59.041495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.servers [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Removing options 'limit' from query {{(pid=119724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 20:24:59.042497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:24:59.057683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.058497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.059595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.060449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.146982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:59.170382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.172824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.612747 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f2a7e0d-9e53-41ff-a56b-305728ed87d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1658 microversion: 2.1 time: 0.585214 Jul 25 20:24:59.614378 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1827/3658] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:24:59 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1658 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:24:59.647624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:59.667437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:24:59.669175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:24:59.698377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.701596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.707978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.710511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.825336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:24:59.828365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:24:59.830506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:24:59.859722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.860704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.862783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:24:59.866723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:24:59.963893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85b49ad8-e7bb-4a62-ad5a-6ec096fec4fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?status=active" status: 200 len: 1008 microversion: 2.1 time: 0.322153 Jul 25 20:24:59.968803 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1832/3659] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:24:59 2022] GET /compute/v2.1/servers?status=active => generated 1008 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:24:59.998895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:00.021595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:00.023074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.servers [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Removing options 'limit' from query {{(pid=119723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 20:25:00.024341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:00.033005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.034014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:00.035290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.036622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:00.108779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:00.164140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83c6e5a9-a134-4dc5-a7bb-c1bafba6cd86 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1008 microversion: 2.1 time: 0.174558 Jul 25 20:25:00.165070 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1833/3660] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Jul 25 20:24:59 2022] GET /compute/v2.1/servers?limit=100000 => generated 1008 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:00.191902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:00.201902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:00.203650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:00.209296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:00.215735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.216817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:00.218508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.219343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:00.220732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd922f1b-9386-4c18-a703-51fa982cda8e tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 0.397844 Jul 25 20:25:00.224171 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1828/3661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:24:59 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:00.308522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:00.358869 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1935ecf1-cc8b-4e08-9d14-653942c20d7d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1008 microversion: 2.1 time: 0.183697 Jul 25 20:25:00.362396 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1834/3662] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:25:00 2022] GET /compute/v2.1/servers => generated 1008 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:00.380704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:00.391008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:00.392822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:00.424785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.426358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:00.428267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:00.429473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.249682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:01.250967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:01.260986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.268389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:01.276168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.278922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.280754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.566395 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33ca75aa-53bb-44fe-bc6c-bd319701c66c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 1.194967 Jul 25 20:25:01.579041 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1829/3663] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:25:00 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:01.594075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:01.613270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:01.615892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.servers [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Removing options 'limit' from query {{(pid=119724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 20:25:01.617300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:01.647795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.653289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.657848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.659287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.731000 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-756b71c9-a8e0-4938-a230-2e7993fc5228 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.149047 Jul 25 20:25:01.741346 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1830/3664] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Jul 25 20:25:01 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:01.757873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:01.779523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:01.782732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1709774660', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:01.810525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.823717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:01.829794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:01.836418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:02.016010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:02.260661 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f06ab640-bd66-4c05-b02a-b6497c08ddf8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1709774660" status: 200 len: 346 microversion: 2.1 time: 0.510836 Jul 25 20:25:02.261717 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1831/3665] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:25:01 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1709774660 => generated 346 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:02.276522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0eacef22-ca13-47cd-9723-ecafe11e8923 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:02.290548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eacef22-ca13-47cd-9723-ecafe11e8923 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:02.297150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0eacef22-ca13-47cd-9723-ecafe11e8923 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:02.383081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0eacef22-ca13-47cd-9723-ecafe11e8923 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:25:02.556636 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0eacef22-ca13-47cd-9723-ecafe11e8923 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "POST /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.283943 Jul 25 20:25:02.560568 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1832/3666] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:25:02 2022] POST /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:25:02.589518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:02.595665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:02.630047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:02.631179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:02.632980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:02.634501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:03.100926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:03.130033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9c233d7f-0829-43cf-9765-2a7390b10030 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 1.884015 Jul 25 20:25:03.145061 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1835/3667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:01 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:03.542268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:03.542268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:03.546620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:03.547279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:03.548643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:03.548935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:03.671626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:03.941594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:03.944837 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-27bf843a-71fa-4b3e-984b-ed8c240dbd2c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 204 len: 0 microversion: 2.1 time: 0.412891 Jul 25 20:25:03.949736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1836/3668] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:03 2022] DELETE /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:25:03.959597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d56c0c0d-e035-4fc8-98bc-e0bf6f263c60 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 1.389122 Jul 25 20:25:03.980738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1833/3669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:02 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:03.994221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:03.997615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:04.036396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:04.037190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:04.039984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:04.053413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:04.175651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:04.176858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:04.186067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:04.186948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:04.193643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:04.194545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:05.532526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:05.555881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b91df26-3b30-473c-aabc-64a1894906c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1553 microversion: 2.1 time: 1.590953 Jul 25 20:25:05.560325 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1837/3670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:03 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1553 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:05.566500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:05.567794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:05.583471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:05.584197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:05.585199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:05.585827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:05.606871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:05.648738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd1d0b60-f820-442b-95b7-0aed4b825d2c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 1.478062 Jul 25 20:25:05.679464 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1834/3671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:04 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:05.700271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3718ff5a-e36b-49bd-861c-181d06a98fcc req-ed4c23bc-dd2b-4026-a1c5-7875ce82dff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfd19a0-8579-4394-9db0-9e937548330b", "tag": "a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:05.749023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3718ff5a-e36b-49bd-861c-181d06a98fcc req-ed4c23bc-dd2b-4026-a1c5-7875ce82dff7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:05.751264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3718ff5a-e36b-49bd-861c-181d06a98fcc req-ed4c23bc-dd2b-4026-a1c5-7875ce82dff7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:05.785766 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3718ff5a-e36b-49bd-861c-181d06a98fcc req-ed4c23bc-dd2b-4026-a1c5-7875ce82dff7 service nova] Creating event network-changed:a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 for instance 1bfd19a0-8579-4394-9db0-9e937548330b on n-h1-845775-3 Jul 25 20:25:05.799599 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3718ff5a-e36b-49bd-861c-181d06a98fcc req-ed4c23bc-dd2b-4026-a1c5-7875ce82dff7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117075 Jul 25 20:25:05.802880 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1835/3672] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:05.932753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:05.952892 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c2bfa77e-ea98-437a-8f8a-671b629901f5 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 0.391266 Jul 25 20:25:05.959984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1838/3673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:05 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:06.578900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:06.579578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:06.602717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:06.605113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:06.608310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:06.619791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: .version_select at 0x7f1968a05ee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1374641731", "policies": ["affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:06.625667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:06.680284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:06.702580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:06.737871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:06.786358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:06.793265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:06.812921 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2fe88801-c3c9-43c4-97bf-3574e13c8adb tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.617946 Jul 25 20:25:06.814969 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1836/3674] 10.222.0.48 () {60 vars in 1174 bytes} [Mon Jul 25 20:25:06 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:25:06.820426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:06.821564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:06.849044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:06.853454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:06.855404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:06.858477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:07.349506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:07.362174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-934cfce0-0bbb-494e-af49-7488901f2ed8 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 0.545702 Jul 25 20:25:07.392192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:07.392674 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1837/3675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:06 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:07.420194 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2827f8ec-b98b-4d5a-8659-7b8a4f23e576 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1553 microversion: 2.1 time: 0.846637 Jul 25 20:25:07.440940 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1839/3676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:06 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1553 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:07.449992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:07.457350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: .version_select at 0x7f196ebaa160>, body: {"server_group": {"name": "tempest-server-group-759817998", "policies": ["affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:07.470380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:07.493913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:07.494722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:07.497285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:07.498649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:07.502882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:07.511311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:07.659160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:07.671481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:07.722527 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cbb18a89-87a0-43c3-9751-040d9f592387 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.322130 Jul 25 20:25:07.724467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1838/3677] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:25:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:07.746343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: .version_select at 0x7f196ebb65e0>, body: {"server_group": {"name": "tempest-server-group-759817998", "policies": ["affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:07.803746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:07.822563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:07.933264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:07.941541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:07.962520 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9389804b-7b01-4401-a13c-ee858ea3b49e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.230498 Jul 25 20:25:07.963465 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1839/3678] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:25:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:07.974122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a69ba7f9-3451-457e-a830-67361f188e5e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.019340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a69ba7f9-3451-457e-a830-67361f188e5e tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/73261b97-d23d-48e8-99ee-bc8dba4245ea" status: 204 len: 0 microversion: 2.1 time: 0.048693 Jul 25 20:25:08.029236 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1840/3679] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:07 2022] DELETE /compute/v2.1/os-server-groups/73261b97-d23d-48e8-99ee-bc8dba4245ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:25:08.066181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-83a77c39-c4cc-411d-b350-db1b6d68bc3a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.124581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-83a77c39-c4cc-411d-b350-db1b6d68bc3a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.092508 Jul 25 20:25:08.132105 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1841/3680] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:08 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:08.146424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2403dd7-bfe8-485c-8963-a7b4a59c74cc tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.210127 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2403dd7-bfe8-485c-8963-a7b4a59c74cc tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/b3e97595-4c53-440b-81c9-d17fc962b347" status: 204 len: 0 microversion: 2.1 time: 0.073227 Jul 25 20:25:08.210737 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1842/3681] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:08 2022] DELETE /compute/v2.1/os-server-groups/b3e97595-4c53-440b-81c9-d17fc962b347 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:08.232638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6d1b37c-0b2c-4bcd-ac5b-202ffad04416 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.261013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6d1b37c-0b2c-4bcd-ac5b-202ffad04416 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044941 Jul 25 20:25:08.262235 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1843/3682] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:25:08.282956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: .version_select at 0x7f196ebaaca0>, body: {"server_group": {"name": "tempest-server-group-1178597431", "policies": ["affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:08.358759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:08.394421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:08.483817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.503956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:08.553152 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37374d9a-9f4a-4a2c-82d4-33db5bb9b82e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 1.109813 Jul 25 20:25:08.556860 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1840/3683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:07 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:08.590743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.591420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:08.625582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:08.629103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:08.630804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:08.633655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:08.682319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.684727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:08.694082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:08.709956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:08.768787 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb7c066a-b4e0-4bbc-a82a-522f627efb82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.483676 Jul 25 20:25:08.769703 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1844/3684] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:25:08 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:25:08.809568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:08.811048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:08.839570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:08.841999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:08.843383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:08.846982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:09.211369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:09.230996 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a845eebc-7d65-45f3-9a5e-cb06ae238ce0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.454200 Jul 25 20:25:09.232536 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1845/3685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:08 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:09.246906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-759e3bf8-0642-4121-855d-a9e01e76cfb4 req-7475426b-39f7-4fd3-925b-cbe0b7704cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6b4b2c-7d19-4c22-9f3e-be787ef70598", "name": "network-vif-deleted", "tag": "b54dd955-30d4-4911-baea-7a5ca17d217e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:09.282162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-759e3bf8-0642-4121-855d-a9e01e76cfb4 req-7475426b-39f7-4fd3-925b-cbe0b7704cfb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:09.282950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-759e3bf8-0642-4121-855d-a9e01e76cfb4 req-7475426b-39f7-4fd3-925b-cbe0b7704cfb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:09.335003 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-759e3bf8-0642-4121-855d-a9e01e76cfb4 req-7475426b-39f7-4fd3-925b-cbe0b7704cfb service nova] Creating event network-vif-deleted:b54dd955-30d4-4911-baea-7a5ca17d217e for instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 on n-h1-845775-3 Jul 25 20:25:09.354409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-759e3bf8-0642-4121-855d-a9e01e76cfb4 req-7475426b-39f7-4fd3-925b-cbe0b7704cfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120228 Jul 25 20:25:09.355304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1846/3686] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:09.373384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0420b6ac-b84e-4a2c-acc9-eb2033844c82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:09.427324 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0420b6ac-b84e-4a2c-acc9-eb2033844c82 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/257c0034-d3a8-46eb-9a10-b670e058da4f" status: 204 len: 0 microversion: 2.1 time: 0.070938 Jul 25 20:25:09.430409 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1847/3687] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:09 2022] DELETE /compute/v2.1/os-server-groups/257c0034-d3a8-46eb-9a10-b670e058da4f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:09.439240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e8a6f4b-e357-4388-b9f8-b8dd1409e96a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:09.475085 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e8a6f4b-e357-4388-b9f8-b8dd1409e96a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037986 Jul 25 20:25:09.475931 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1848/3688] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:09.515201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: .version_select at 0x7f196ebb6700>, body: {"server_group": {"name": "tempest-server-group-1124538950", "policies": ["anti-affinity"]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:09.593369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:09.618806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:09.757379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:09.765911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_groups'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:09.773014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:09.786488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3cd626aa-349a-445d-82e6-9e86387357a8 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.288954 Jul 25 20:25:09.787701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1040604c-e54b-45e5-b4d0-f9db416373b4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 1.229267 Jul 25 20:25:09.787850 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1849/3689] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:25:09 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:09.788676 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1841/3690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:08 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:09.796313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:09.797536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:09.813531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:09.814533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:09.816728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:09.818330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:09.818749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c562a2db-0410-48d3-9cab-f74be6981ec0 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:09.890299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c562a2db-0410-48d3-9cab-f74be6981ec0 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a90454fb-63eb-4bb7-a133-659dc6192592" status: 204 len: 0 microversion: 2.1 time: 0.095505 Jul 25 20:25:09.899346 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1842/3691] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:09 2022] DELETE /compute/v2.1/os-server-groups/a90454fb-63eb-4bb7-a133-659dc6192592 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:25:09.915994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1aaab8f-ce66-42fe-ab19-0d2a627f718a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:09.974745 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1aaab8f-ce66-42fe-ab19-0d2a627f718a tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.069216 Jul 25 20:25:10.005635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1843/3692] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:10.284410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:10.293390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:10.326150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:10.352191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:10.355145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:10.356063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:10.356853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:11.258546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:11.276801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11336fa7-5e5a-4eb5-ac1e-188c26dbfef5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 1.009865 Jul 25 20:25:11.283694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1844/3693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:10 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:11.294068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1010120827", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "49d38717-3a2b-4236-a325-dbc381088e03"}]}, "os:scheduler_hints": {"group": "0b3dcf32-8220-4534-8c04-1d66a45617ca"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:11.439332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] validate_networks() for [('49d38717-3a2b-4236-a325-dbc381088e03', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:25:11.538267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:11.577970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-502add6d-be10-4ac4-961f-d8cfae66e3eb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 1.785768 Jul 25 20:25:11.579776 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1850/3694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:09 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:11.597086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:11.605110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:11.631667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:11.637207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:11.639441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:11.641238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:11.956507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:12.870996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:12.889840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-094d7a7f-a46d-423b-938c-76c42f60bb41 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 1.307725 Jul 25 20:25:12.913177 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1851/3695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:11 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:12.947450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:12.948771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:12.964193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:12.970847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:12.973627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:12.974482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:13.553068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:13.609825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e37ab87-bd0c-4dbd-82e4-5848ebcb9c04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.676209 Jul 25 20:25:13.613039 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1852/3696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:12 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:13.621631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:13.632279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:13.668144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:13.680250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:13.681630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:13.683619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:13.696520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:15.684747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:25:15.685582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:25:15.686172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:25:15.686672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:25:15.687106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:25:15.742548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:15.743085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:15.743925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:15.746308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:15.825975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:15.852456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:15.874728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:15.890211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:25:15.900431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:25:15.905633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a0b3c9e2-992e-49e4-94f0-2a7a5c43b6b2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 2.291156 Jul 25 20:25:15.906237 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1853/3697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:13 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:15.937238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:15.953870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:15.975713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:15.978339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:15.981727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:15.985065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:16.050392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:16.077495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:16.251513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:16.273374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Getting quotas for user 231efac612a9434c96a76fbfe7f52b39 and project b0c7324d9d8d4e478078053046dd1246. Resources: {'server_group_members'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:16.424579 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df0ff891-84de-4174-8e71-48f74a8157ec tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.139045 Jul 25 20:25:16.428210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1845/3698] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:25:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:25:16.448589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:16.450123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:16.478948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:16.480060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:16.481697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:16.483057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:16.750105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:16.758811 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e47d314-728a-4d6b-807d-6f4e8c163a25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.327687 Jul 25 20:25:16.764090 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1846/3699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:16 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:16.776982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-14678747-7138-4d1c-87d4-710433bd92c3 req-79997048-8703-49f0-bdff-33bf75e7ca7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfd19a0-8579-4394-9db0-9e937548330b", "name": "network-vif-plugged", "status": "completed", "tag": "a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:16.794155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-14678747-7138-4d1c-87d4-710433bd92c3 req-79997048-8703-49f0-bdff-33bf75e7ca7f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:16.794626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-14678747-7138-4d1c-87d4-710433bd92c3 req-79997048-8703-49f0-bdff-33bf75e7ca7f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:16.829532 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-14678747-7138-4d1c-87d4-710433bd92c3 req-79997048-8703-49f0-bdff-33bf75e7ca7f service nova] Creating event network-vif-plugged:a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 for instance 1bfd19a0-8579-4394-9db0-9e937548330b on n-h1-845775-3 Jul 25 20:25:16.845577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-14678747-7138-4d1c-87d4-710433bd92c3 req-79997048-8703-49f0-bdff-33bf75e7ca7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068556 Jul 25 20:25:16.846178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1847/3700] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:16.869757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-06a1651a-70e8-4ea9-8881-a3fb5875fcaa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:16.870660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-06a1651a-70e8-4ea9-8881-a3fb5875fcaa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:17.029112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:17.051454 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f97f162-1a9b-415a-98fa-98aacff94c8a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 1.125089 Jul 25 20:25:17.054517 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1854/3701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:15 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:17.075845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:17.079894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:17.120467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:17.124688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:17.126511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:17.131777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:17.194494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-06a1651a-70e8-4ea9-8881-a3fb5875fcaa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:17.220550 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-06a1651a-70e8-4ea9-8881-a3fb5875fcaa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1213 microversion: 2.1 time: 0.372748 Jul 25 20:25:17.227956 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1848/3702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:16 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1213 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:17.667136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:17.690341 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60447c7e-5562-4231-9025-9200d773abff tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1521 microversion: 2.1 time: 0.631789 Jul 25 20:25:17.694186 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1855/3703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:17 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:17.791579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:17.792243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:17.813664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:17.814202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:17.817806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:17.818208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:17.927759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:17.950365 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f599926-a92c-4a36-aaec-6be7069f1275 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.170998 Jul 25 20:25:17.951834 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1849/3704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:17 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:18.092362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:18.094625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:18.107930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.108584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.109580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.110174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.288089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:18.289099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:18.348697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.356016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.372471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.380529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.540971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:18.556435 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f918dad6-ec5e-42dd-8b68-2315e7e72286 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1316 microversion: 2.1 time: 0.467864 Jul 25 20:25:18.557903 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1856/3705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:18 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:18.621019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:18.633370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a1e62a6c-22f0-4414-8c13-bc6a9e518290 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1209 microversion: 2.1 time: 0.359687 Jul 25 20:25:18.641637 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1850/3706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:18 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1209 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:18.720530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:18.721800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:18.741924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.742924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.743942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:18.744633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:18.992371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:18.993142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:19.002715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.011893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.027113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.029197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.304189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:19.325023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:19.345192 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-886f37cf-2b3b-4015-a6f3-2ccf41c6be25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.357071 Jul 25 20:25:19.350388 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09255fa1-f008-4058-966f-321e37888bc0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1498 microversion: 2.1 time: 0.620188 Jul 25 20:25:19.350894 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1851/3707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:18 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:19.351572 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1857/3708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:18 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:19.376525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:19.405992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:19.413867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:19.419331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:19.430547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.431304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.432364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.435026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.531692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:19.590510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:19.592496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:19.609528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.633068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.637418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.644415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.711627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-baf776b7-b6d8-4407-838f-65e7c7ee09ef tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.338868 Jul 25 20:25:19.716423 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1852/3709] 10.222.0.48 () {58 vars in 1154 bytes} [Mon Jul 25 20:25:19 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:25:19.731730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:19.733350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:19.779569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.782397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=46 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:19.795285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:19.799276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:19.801119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.237116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:20.251609 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-783365d7-9a76-460a-a939-85262b73f883 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1265 microversion: 2.1 time: 0.533796 Jul 25 20:25:20.279697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1853/3710] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:19 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1265 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:20.321166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ee6d35d-380d-46ed-a7c3-e9619969e809 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:20.346279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ee6d35d-380d-46ed-a7c3-e9619969e809 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.354862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ee6d35d-380d-46ed-a7c3-e9619969e809 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.440916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ee6d35d-380d-46ed-a7c3-e9619969e809 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Going to try to start instance {{(pid=119723) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 20:25:20.475076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:20.516022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e54772a-1127-4266-822c-e4aa10f3773b tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1504 microversion: 2.1 time: 0.914439 Jul 25 20:25:20.534649 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1858/3711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:19 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1504 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:20.549056 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ee6d35d-380d-46ed-a7c3-e9619969e809 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "POST /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.246358 Jul 25 20:25:20.552528 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1854/3712] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:25:20 2022] POST /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:20.578361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:20.585543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:20.585927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1072810709"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:20.586891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:20.607742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.611583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.614493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.615677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.616418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.617126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.623289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.624872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.737119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:20.766183 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-505eb0a2-7ff6-4cc1-8738-0966181b8723 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.210369 Jul 25 20:25:20.767084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1859/3713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:20 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:20.785443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:20.786954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:20.807829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.813827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:20.815763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:20.816415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:21.072834 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Adding security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 to port a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 Jul 25 20:25:21.419866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:21.432926 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3b78051-ad49-453d-a1ff-d3e9d2ee1240 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1507 microversion: 2.1 time: 0.659137 Jul 25 20:25:21.433747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1860/3714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:20 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:21.446604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:21.446604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:21.466767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:21.468018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:21.469333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:21.470009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:21.734110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:21.764122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f42a6e8-5ba7-4c63-9b72-cf6812313f86 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1271 microversion: 2.1 time: 0.323401 Jul 25 20:25:21.770127 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1861/3715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:21 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:21.796772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:21.808073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:21.826139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:21.827352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:21.828944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:21.830150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:22.054659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:22.072946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58e2f7e5-f260-45c0-ab6e-1b32938077cb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 200 len: 1346 microversion: 2.1 time: 0.284957 Jul 25 20:25:22.082567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1862/3716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:21 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 1346 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:22.468185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:22.469504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:22.509723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:22.511055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:22.512064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:22.513187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:22.652318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef49e0fc-b04f-4903-8443-dd82c702524d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action" status: 202 len: 0 microversion: 2.1 time: 2.095846 Jul 25 20:25:22.655899 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1855/3717] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:25:20 2022] POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action => generated 0 bytes in 2102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:22.670756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6927d979-8ab6-4d5f-bdd3-73c1822f0f02 req-0ac7c022-697e-47cb-b748-79773abd4071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfd19a0-8579-4394-9db0-9e937548330b", "tag": "a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:22.702236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6927d979-8ab6-4d5f-bdd3-73c1822f0f02 req-0ac7c022-697e-47cb-b748-79773abd4071 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:22.712749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6927d979-8ab6-4d5f-bdd3-73c1822f0f02 req-0ac7c022-697e-47cb-b748-79773abd4071 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:22.747362 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6927d979-8ab6-4d5f-bdd3-73c1822f0f02 req-0ac7c022-697e-47cb-b748-79773abd4071 service nova] Creating event network-changed:a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 for instance 1bfd19a0-8579-4394-9db0-9e937548330b on n-h1-845775-3 Jul 25 20:25:22.757409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6927d979-8ab6-4d5f-bdd3-73c1822f0f02 req-0ac7c022-697e-47cb-b748-79773abd4071 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092233 Jul 25 20:25:22.761227 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1856/3718] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:22.797771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c161f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:22.982049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:23.009404 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77d4b719-7b98-4ea4-9223-2ff4c0163ac7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1507 microversion: 2.1 time: 0.545108 Jul 25 20:25:23.012158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1863/3719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:22 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:23.025249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:23.027382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:23.047390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.050450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.054452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.055643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.282359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:23.294959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc4ffd7f-8299-496c-8f70-ef6e3629e775 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1271 microversion: 2.1 time: 0.278059 Jul 25 20:25:23.297868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1864/3720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:23 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:23.317129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:23.318015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:23.354172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.355090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.357611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.358781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.389538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use.", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:23.390244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.390244 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816 HTTP/1.1 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: exception: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '57a2380e-b9ef-4524-b2a1-52300d6cf816'} Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:23.392561 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] Jul 25 20:25:23.396856 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.404812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 400 to user: Security Group 57a2380e-b9ef-4524-b2a1-52300d6cf816 in use. Jul 25 20:25:23.404812 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-21c77d37-86d9-4e63-aec1-5806c03faa1f'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:23.406247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0e8d690-ef5d-401b-bb6c-c41b839ebdef tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816" status: 400 len: 185 microversion: 2.1 time: 0.628423 Jul 25 20:25:23.406671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.407490 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1857/3721] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:22 2022] DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816 => generated 185 bytes in 645 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 HTTP/1.1 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4f6b4b2c-7d19-4c22-9f3e-be787ef70598'} Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.417306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:23.420939 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd1ab5a6-acdd-436b-a0cc-159e9bb16010 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 404 len: 111 microversion: 2.1 time: 0.119120 Jul 25 20:25:23.427150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:23.428372 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1865/3722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:23 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:23.439243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:23.459128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.461057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.464730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.465686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.693513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:23.702665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:23.732577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.737730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.739452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.740278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.819475 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598/os-volume_attachments HTTP/1.1 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '4f6b4b2c-7d19-4c22-9f3e-be787ef70598'} Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:23.832561 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:25:23.846904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:23.852679 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1066ee0f-2560-43cf-8f6d-c34ebd6fb407 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action" status: 202 len: 0 microversion: 2.1 time: 0.417147 Jul 25 20:25:23.852679 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1858/3723] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:25:23 2022] POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:25:23.856263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:23.856263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:23.878019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:23.884121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.884805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.886750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:23.889103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:23.892900 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10149ba8-c05c-4654-a435-fdbb885e116a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.200738 Jul 25 20:25:23.903726 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1866/3724] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:25:23 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598/os-volume_attachments => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:24.042458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:24.043655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:24.066439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:24.079423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:24.092762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:24.099355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:24.408791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:24.423275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2022cf2-c2e4-4ef2-803c-19a5683a43e4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1575 microversion: 2.1 time: 0.579336 Jul 25 20:25:24.425779 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1859/3725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:23 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1575 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:24.440143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:24.441017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:24.463177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:24.463641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:24.464499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:24.464944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:24.703320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:24.728957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:24.739705 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9bb8c48a-2ea2-4be0-b997-17207ece372b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1271 microversion: 2.1 time: 0.311293 Jul 25 20:25:24.743792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9dfff25b-41aa-4dbf-974c-036bd249c72f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1507 microversion: 2.1 time: 0.706076 Jul 25 20:25:24.759685 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1860/3727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:24 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:24.760763 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1867/3727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:24 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1507 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:24.766113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1940279825", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:24.947127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:25:25.453558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:25.454683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:25.484679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:25.485418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:25.486865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:25.487535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:26.945059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:26.965842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:25:26.966832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:25:26.967450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:25:26.968242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:25:26.969165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:25:26.982662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dcc60489-f573-4388-b8c0-5ea6def56775 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1575 microversion: 2.1 time: 1.537687 Jul 25 20:25:27.010836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.011553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.014118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.016227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1868/3728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:25 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1575 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:27.035165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.045130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:27.046792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:27.077386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.085849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.097025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.099304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.162488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:27.175676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:27.207068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:25:27.244811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:25:27.431958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-854cce98-d8a3-4b43-be6f-bdf4ac018031 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670820 Jul 25 20:25:27.434744 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1861/3729] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:25:27.461213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:27.461863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:27.479775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.480286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.481104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:27.481623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:27.526266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:28.176628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:28.188700 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b6283f5-e290-4291-877e-dc7ed80c4906 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 1.166583 Jul 25 20:25:28.200241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1869/3730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:27 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:28.226329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6e51b5b-8366-47a4-959c-bc48cc630b92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:28.227082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6e51b5b-8366-47a4-959c-bc48cc630b92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:28.249441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:28.527349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:28.547742 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45657393-509a-4ca2-91e1-8ba0e77b8ef4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1511 microversion: 2.1 time: 1.102238 Jul 25 20:25:28.557712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d6e51b5b-8366-47a4-959c-bc48cc630b92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:28.568000 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1862/3731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:27 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1511 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:28.579294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6e51b5b-8366-47a4-959c-bc48cc630b92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608" status: 200 len: 1215 microversion: 2.1 time: 0.372263 Jul 25 20:25:28.584018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1870/3732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:28 2022] GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:28.584412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:28.588786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:28.590399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:28.597891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:28.598732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.servers [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Removing options 'limit' from query {{(pid=119724) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 20:25:28.599683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:28.601743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:28.604454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:28.605661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:28.606616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:28.610047 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54a7459a-7d54-410d-b9bd-42382a6a5c34 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.024112 Jul 25 20:25:28.610852 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1871/3733] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Jul 25 20:25:28 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:25:28.635234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:28.636397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:28.648449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:28.656634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:28.657497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:28.658040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:28.693862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:28.759851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:28.762123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:28.811283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'flavor' on Instance uuid 6180b647-b34b-43df-b06a-ac4076836608 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:25:28.831392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'system_metadata' on Instance uuid 6180b647-b34b-43df-b06a-ac4076836608 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:25:28.941256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:28.965139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'metadata' on Instance uuid 6180b647-b34b-43df-b06a-ac4076836608 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:25:29.042671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:29.064852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28886165-04dd-40ec-a55c-c3db966fbd1d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1573 microversion: 2.1 time: 0.489129 Jul 25 20:25:29.065945 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1863/3734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:28 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1573 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:29.084962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:29.086196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:29.103147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.104238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:29.105408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.108273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:29.582839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:29.598645 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3f6e6472-2943-4593-ba39-b737d3ac659b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1511 microversion: 2.1 time: 0.528276 Jul 25 20:25:29.602319 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1864/3735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:29 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:29.620482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-995627680"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:29.620482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:29.643102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.648577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:29.656216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.657280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:29.786578 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.scheduler.client.report [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Deleted allocations for instance 6180b647-b34b-43df-b06a-ac4076836608 Jul 25 20:25:29.826902 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f4fdea0-a440-47a2-b65c-97ba17704c14 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608" status: 204 len: 0 microversion: 2.1 time: 1.214617 Jul 25 20:25:29.828148 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1872/3736] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:28 2022] DELETE /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:29.835381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:29.836070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:29.844213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.845255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:29.847070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:29.847070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:30.124440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Adding security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 to port a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 Jul 25 20:25:30.172878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:30.190743 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-95dd1187-5324-4e6f-9d01-4181b2abddfa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.361074 Jul 25 20:25:30.191759 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1873/3737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:29 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:30.201860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:30.202817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:30.218659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:30.219808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:30.220904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:30.225822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:30.842678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:30.866593 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cec9c340-156e-4a6d-8fc6-c3dae3722a61 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1509 microversion: 2.1 time: 0.673176 Jul 25 20:25:30.867458 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1874/3738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:30 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:30.874311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:30.877792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:30.896468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:30.897159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:30.898352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:30.899034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:30.947024 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 HTTP/1.1 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6180b647-b34b-43df-b06a-ac4076836608'} Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:30.950269 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:25:30.958459 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:30.968198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:30.969407 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22b19d78-c142-4892-8107-654057dacf74 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608" status: 404 len: 111 microversion: 2.1 time: 0.100778 Jul 25 20:25:30.970434 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1875/3739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:30 2022] GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:30.989294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:30.990432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:31.013923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:31.014897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:31.016629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:31.017487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:32.273907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:32.301182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c5b846d-f9b1-4bf2-9422-78b3ff642771 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1509 microversion: 2.1 time: 1.327362 Jul 25 20:25:32.301182 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1876/3740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:30 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1509 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:32.320744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:32.321584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:32.341241 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d3795f45-457e-4b0d-99f7-b87a1040ffd4 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action" status: 202 len: 0 microversion: 2.1 time: 2.730311 Jul 25 20:25:32.343778 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1865/3741] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:25:29 2022] POST /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b/action => generated 0 bytes in 2735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:32.352588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:32.353394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1082869810", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:32.354100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:32.363356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:32.365579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:32.538992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:25:33.088312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:33.115974 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9eefdd29-d6c6-48f8-b1ea-66d36bc01660 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.806813 Jul 25 20:25:33.116766 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1877/3742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:32 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:33.125408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-29d04125-bd4b-4349-ab09-5a981def3ade req-097d6b8d-6499-443b-b370-417ef0785978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0069193d-946e-4bf7-b5e5-55cee4155aa9", "tag": "6223f99b-8eec-448f-8bdd-458baeaba918"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:33.167311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-29d04125-bd4b-4349-ab09-5a981def3ade req-097d6b8d-6499-443b-b370-417ef0785978 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:33.168005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-29d04125-bd4b-4349-ab09-5a981def3ade req-097d6b8d-6499-443b-b370-417ef0785978 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:33.214753 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-29d04125-bd4b-4349-ab09-5a981def3ade req-097d6b8d-6499-443b-b370-417ef0785978 service nova] Creating event network-changed:6223f99b-8eec-448f-8bdd-458baeaba918 for instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 on n-h2-845775-3 Jul 25 20:25:33.242361 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-29d04125-bd4b-4349-ab09-5a981def3ade req-097d6b8d-6499-443b-b370-417ef0785978 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122128 Jul 25 20:25:33.251610 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1878/3743] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:33.263309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:33.282039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:33.288780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:33.472008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:33.472509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:33.473448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:33.473901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:33.620257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:33.764391 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31803782-7978-4a09-98ea-2e6c651de3a2 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 344 microversion: 2.1 time: 0.510626 Jul 25 20:25:33.765312 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1879/3744] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:33 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 344 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:33.784549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969aa90d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:34.453229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:25:34.454455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:25:34.455588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:25:34.456427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:25:34.457331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:25:34.487065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.492472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.496931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.497996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.507551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use.", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:34.508793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.508793 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7 HTTP/1.1 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: exception: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3fd4cfc6-54c1-494c-b298-7131e36ca6d7'} Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:34.511883 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] Jul 25 20:25:34.518307 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:34.526990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 400 to user: Security Group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 in use. Jul 25 20:25:34.526990 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-cddfb00c-9cbf-4d0b-8cf2-8fdd7e1328e8'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:34.526990 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca6f0b73-0367-4f2a-b5ab-9e4c5f2d60dc tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7" status: 400 len: 185 microversion: 2.1 time: 0.747479 Jul 25 20:25:34.533652 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1880/3745] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:33 2022] DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7 => generated 185 bytes in 751 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:25:34.539601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9963ec47-bf76-410e-80ef-7f8d6b7cfc04 req-e594b832-07b8-4199-81e5-7f1ce6f22b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfd19a0-8579-4394-9db0-9e937548330b", "tag": "a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:34.565191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:25:34.576702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9963ec47-bf76-410e-80ef-7f8d6b7cfc04 req-e594b832-07b8-4199-81e5-7f1ce6f22b99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.577409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9963ec47-bf76-410e-80ef-7f8d6b7cfc04 req-e594b832-07b8-4199-81e5-7f1ce6f22b99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.583644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:25:34.598298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9963ec47-bf76-410e-80ef-7f8d6b7cfc04 req-e594b832-07b8-4199-81e5-7f1ce6f22b99 service nova] Creating event network-changed:a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 for instance 1bfd19a0-8579-4394-9db0-9e937548330b on n-h1-845775-3 Jul 25 20:25:34.632706 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9963ec47-bf76-410e-80ef-7f8d6b7cfc04 req-e594b832-07b8-4199-81e5-7f1ce6f22b99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083505 Jul 25 20:25:34.633736 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1881/3746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:34.639943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:25:34.646916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:25:34.655134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:34.659656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:34.671125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.672945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.677152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.680616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.771760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31c0ebd6-c49b-4b10-9d9d-5aca0ce0d929 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.426195 Jul 25 20:25:34.774079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1866/3747] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:25:34.790547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:34.791763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:34.802072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.803207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:34.804596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:34.805621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:35.211964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:35.240157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b189bb3e-e58a-4665-9ea1-3950bdcab7fa tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1511 microversion: 2.1 time: 0.598641 Jul 25 20:25:35.244145 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1882/3748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:34 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:35.251636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:35.271117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:35.292996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:35.293381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:35.294350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:35.294991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:35.421413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:35.617428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:35.646492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35ae4752-680e-42cb-8ad2-8039207bf97b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.866183 Jul 25 20:25:35.677401 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1867/3749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:34 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:35.679518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-599932d3-7189-45a9-9dba-7b07f3b03bf0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 204 len: 0 microversion: 2.1 time: 0.431873 Jul 25 20:25:35.685958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff2c49b9-ed57-44f9-9cec-c111c93c586e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:35.686635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1883/3750] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:35 2022] DELETE /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:35.697317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff2c49b9-ed57-44f9-9cec-c111c93c586e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:35.708820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:35.711530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:35.752406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:35.755233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:35.760099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:35.763050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:35.957665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ff2c49b9-ed57-44f9-9cec-c111c93c586e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:35.974405 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff2c49b9-ed57-44f9-9cec-c111c93c586e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1215 microversion: 2.1 time: 0.293142 Jul 25 20:25:35.984893 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1868/3751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:35 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1215 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:36.009026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:36.012551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:36.043728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.047440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:36.048108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.060562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:36.414132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:36.434606 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28f453a3-a08a-4710-aabc-573b37c82296 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1509 microversion: 2.1 time: 0.745061 Jul 25 20:25:36.435506 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1884/3752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:35 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:36.469834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:36.472199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:36.489350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.490663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:36.492083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.493065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:36.900553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:36.948753 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65576d8a-9fc2-4772-8e0f-9bb7534f5ef6 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1647 microversion: 2.1 time: 0.962145 Jul 25 20:25:36.950402 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1869/3753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:35 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1647 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:36.956372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:36.960364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:36.972069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.976628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:36.978676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:36.979621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.117013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:37.130776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dfd9d918-bff0-4b54-9c00-e49dac4eb29c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1509 microversion: 2.1 time: 0.672160 Jul 25 20:25:37.131965 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1885/3754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:36 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1509 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:37.154963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:37.155884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:37.167986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:37.169155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.170279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:37.172397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.539497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:37.573269 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8c5d37a-87d6-41b4-9d4a-d0e63826302c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1219 microversion: 2.1 time: 0.439631 Jul 25 20:25:37.580742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1886/3755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:37 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1219 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:37.599551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:37.606422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:37.625319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:37.652052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:37.652959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.654787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:37.655598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.729006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:37.736761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:37.824851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:37.854466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:37.858256 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99d6b1b7-457c-493f-8473-98b2877130be tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.905998 Jul 25 20:25:37.858913 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1870/3756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:36 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:37.874086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:37.874549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:37.981273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:37.983793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:38.016341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:38.024807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:38.026857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:38.027931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:39.271735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-283d7ea2-2adc-4f1a-a0a3-6a464bb3c1c0 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 4512 microversion: 2.1 time: 1.686829 Jul 25 20:25:39.273107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1887/3757] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:25:37 2022] GET /compute/v2.1/servers/detail => generated 4512 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:39.299821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:39.305075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:39.332683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:39.334298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:39.336137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:39.339572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:39.587355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:39.616417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2387cf2-50ba-4589-95e5-47bad5c8e5e5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1647 microversion: 2.1 time: 1.638852 Jul 25 20:25:39.630151 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1871/3758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:37 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1647 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:39.646881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:39.648002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:39.656907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:39.663031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:39.667294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:39.668830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:39.771973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:39.816333 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f0b5694-0868-4a0c-8edc-4a6f90464345 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1273 microversion: 2.1 time: 0.541440 Jul 25 20:25:39.818980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1888/3759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:39 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1273 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:39.829381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:39.838770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:39.840422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:40.235235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.236170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.237158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.237608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.306210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:40.324828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b82aea7a-cbfa-4972-ba2b-d3252f3eecc7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.692676 Jul 25 20:25:40.350838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1872/3760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:39 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:40.364305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-375da9b5-6843-4f01-90fb-c7bf040d651e req-8f2c1480-73de-4267-abf1-717928f483cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfd19a0-8579-4394-9db0-9e937548330b", "name": "network-vif-deleted", "tag": "a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:40.369032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:40.417117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-375da9b5-6843-4f01-90fb-c7bf040d651e req-8f2c1480-73de-4267-abf1-717928f483cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.420639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-375da9b5-6843-4f01-90fb-c7bf040d651e req-8f2c1480-73de-4267-abf1-717928f483cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.444003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-375da9b5-6843-4f01-90fb-c7bf040d651e req-8f2c1480-73de-4267-abf1-717928f483cb service nova] Creating event network-vif-deleted:a3b90c14-dc76-4a2a-9fe0-3c0174f4ded2 for instance 1bfd19a0-8579-4394-9db0-9e937548330b on n-h1-845775-3 Jul 25 20:25:40.460319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-375da9b5-6843-4f01-90fb-c7bf040d651e req-8f2c1480-73de-4267-abf1-717928f483cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106570 Jul 25 20:25:40.461307 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1873/3761] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:40.535257 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f5c2c66-7abe-440d-9d2f-6ffacb9d322a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1008 microversion: 2.1 time: 0.713823 Jul 25 20:25:40.546861 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1889/3762] 10.222.0.48 () {58 vars in 1150 bytes} [Mon Jul 25 20:25:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1008 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:40.571173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:40.605065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:40.609847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:40.628561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.639304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.641075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.641961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.647834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:40.648601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:40.663999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.664588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.665400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.665959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.776796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=9 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:40.840529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:40.842717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:40.846274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lazy-loading 'fault' on Instance uuid 1bfd19a0-8579-4394-9db0-9e937548330b {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:25:40.979118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:41.195187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c3241836-a5a5-45a7-9e0b-23765f9d69bd tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1008 microversion: 2.1 time: 0.633045 Jul 25 20:25:41.210598 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1874/3763] 10.222.0.48 () {58 vars in 1212 bytes} [Mon Jul 25 20:25:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1008 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:41.230010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:41.231123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:41.251049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.252596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.254393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.255797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.306707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:41.330830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f4701f0-27f7-46bf-9536-23cac6cce7fd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 200 len: 1306 microversion: 2.1 time: 0.685085 Jul 25 20:25:41.338126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1890/3764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:40 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 1306 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:41.353537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:41.375255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:41.381422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:41.403934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.408468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.409838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.410483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.424252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:41.442779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77e537f2-2477-4c86-b9db-8520c3dcccbb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1273 microversion: 2.1 time: 0.227036 Jul 25 20:25:41.443718 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1875/3765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:41 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:41.459349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:41.459998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:41.476206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.476674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.477472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.477918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.633578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:41.745721 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62835356-620f-4a4a-b1f0-9471e422532c tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1008 microversion: 2.1 time: 0.405962 Jul 25 20:25:41.756209 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1891/3766] 10.222.0.48 () {58 vars in 1196 bytes} [Mon Jul 25 20:25:41 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1008 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:41.775065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-377550a9-bdd0-45d9-b5cf-9776440eb8e3 req-1781f3e0-15be-423c-81ba-b9c6bbac69cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069193d-946e-4bf7-b5e5-55cee4155aa9", "name": "network-vif-plugged", "status": "completed", "tag": "6223f99b-8eec-448f-8bdd-458baeaba918"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:41.802096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-377550a9-bdd0-45d9-b5cf-9776440eb8e3 req-1781f3e0-15be-423c-81ba-b9c6bbac69cc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.803273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-377550a9-bdd0-45d9-b5cf-9776440eb8e3 req-1781f3e0-15be-423c-81ba-b9c6bbac69cc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.824503 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-377550a9-bdd0-45d9-b5cf-9776440eb8e3 req-1781f3e0-15be-423c-81ba-b9c6bbac69cc service nova] Creating event network-vif-plugged:6223f99b-8eec-448f-8bdd-458baeaba918 for instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 on n-h2-845775-3 Jul 25 20:25:41.830651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-377550a9-bdd0-45d9-b5cf-9776440eb8e3 req-1781f3e0-15be-423c-81ba-b9c6bbac69cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063519 Jul 25 20:25:41.831727 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1892/3767] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:41.839281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:41.853345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:41.861815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': '1709774660', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:41.879275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.879275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:41.880241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:41.880718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.048706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:42.082606 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7ce5b84-364d-45ae-9020-5eddd5754b6c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 0.636363 Jul 25 20:25:42.087818 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1876/3768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:41 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:42.117753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:42.255957 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9ebf530-8011-4c83-92ce-1ef660892562 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=1709774660" status: 200 len: 346 microversion: 2.1 time: 0.421897 Jul 25 20:25:42.257198 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1893/3769] 10.222.0.48 () {58 vars in 1156 bytes} [Mon Jul 25 20:25:41 2022] GET /compute/v2.1/servers?name=1709774660 => generated 346 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:42.283003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:42.293610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:42.294583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:42.303796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.304537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.305557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.306170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.360536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:42.362009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:42.390625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.397483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.402569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.405717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.448256 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b HTTP/1.1 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1bfd19a0-8579-4394-9db0-9e937548330b'} Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:42.453351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:42.463929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-47fddf27-4079-41fa-b392-8d61f1a87e87 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 404 len: 111 microversion: 2.1 time: 0.104213 Jul 25 20:25:42.470705 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1894/3770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:42 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:42.486378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e555f792-aa5f-4b7a-bbf9-9fbe13237d64 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196ebba0d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:42.837978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:42.949893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-763fcbe4-3f5a-4df6-8afd-fbac56ebd988 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1008 microversion: 2.1 time: 0.678625 Jul 25 20:25:42.951461 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1877/3771] 10.222.0.48 () {58 vars in 1154 bytes} [Mon Jul 25 20:25:42 2022] GET /compute/v2.1/servers?name=-instance => generated 1008 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:42.958992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:42.959975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:42.971224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.971835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:42.973581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:42.974158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:43.861208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:43.875208 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44a9086a-f8e5-4fdf-a565-26628b701397 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 0.919551 Jul 25 20:25:43.876159 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1878/3772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:42 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:43.890452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:43.901462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:43.902211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-170977466', 'deleted': False, 'project_id': 'a2a91995d4354fbc804b17d2c810942a'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:25:43.917888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:43.918575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:43.921650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:43.921856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:44.159371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:25:44.381101 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1a2f846d-25f7-4846-9dfc-f3ecf4eb9de6 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170977466" status: 200 len: 346 microversion: 2.1 time: 0.500254 Jul 25 20:25:44.381817 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1879/3773] 10.222.0.48 () {58 vars in 1228 bytes} [Mon Jul 25 20:25:43 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170977466 => generated 346 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:44.387934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:44.391101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:44.420371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:44.421044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:44.422055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:44.422796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:44.571175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e555f792-aa5f-4b7a-bbf9-9fbe13237d64 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816" status: 202 len: 0 microversion: 2.1 time: 2.098718 Jul 25 20:25:44.573132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1895/3774] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:42 2022] DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816 => generated 0 bytes in 2102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:44.585633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:44.591119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:44.610617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:44.613125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:44.622177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:44.622885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:44.697530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:44.904265 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8209447-44dc-42cf-84af-e85cdcbc5fe3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "DELETE /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 204 len: 0 microversion: 2.1 time: 0.328961 Jul 25 20:25:44.905437 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1896/3775] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:44 2022] DELETE /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:44.913390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bbc98ad3-c123-4310-bc61-ec524c1ad644 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969706af0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:45.964756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=30 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:46.561009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:46.564917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:46.592131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5bcf6e90-fb38-42f3-9f0d-d876b0e65910 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1313 microversion: 2.1 time: 2.208538 Jul 25 20:25:46.592952 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1880/3776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:44 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1313 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:46.618751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:46.620006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:46.639574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:46.645081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:46.646602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:46.647279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:47.455997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:47.479447 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e57d7279-1068-4285-93f6-fd4fb815b176 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 0.884497 Jul 25 20:25:47.486120 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1881/3777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:46 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:47.513428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:47.520067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:47.531611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:47.533585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:47.538698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:47.539705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:47.851149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:48.183291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:48.192123 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8222413-ed91-4e57-81d8-54e4585b461d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1515 microversion: 2.1 time: 0.704492 Jul 25 20:25:48.192718 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1882/3778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:47 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1515 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:48.211313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:48.212204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:48.218831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:48.219569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:48.220529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:48.221119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:48.426841 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bbc98ad3-c123-4310-bc61-ec524c1ad644 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7" status: 202 len: 0 microversion: 2.1 time: 3.519794 Jul 25 20:25:48.428111 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1897/3779] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:44 2022] DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7 => generated 0 bytes in 3522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:48.443258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dcb31397-166e-4ed9-b299-bf10855926a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'create', calling method: .version_select at 0x7f196991fd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-718659086", "description": "tempest-description-1709524810"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:48.776880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:48.795923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4c555e7-0d67-4219-a9c3-a32dec2a700c tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1499 microversion: 2.1 time: 0.588840 Jul 25 20:25:48.821232 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1883/3780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:48 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1499 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:48.826228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:48.826748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:48.859388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:48.862035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:48.862962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:48.864482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.574506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:49.594301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41ede335-4a13-4689-9090-9581caca4f21 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 0.771405 Jul 25 20:25:49.595966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1884/3781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:48 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:49.601476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96f08d89-90a6-426c-903c-d09806af2c10 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:49.618084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:49.631126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.server_groups [None req-96f08d89-90a6-426c-903c-d09806af2c10 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Querying cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) for 1 instances {{(pid=119723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 20:25:49.642280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f08d89-90a6-426c-903c-d09806af2c10 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.643398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-96f08d89-90a6-426c-903c-d09806af2c10 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.706259 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96f08d89-90a6-426c-903c-d09806af2c10 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca" status: 200 len: 222 microversion: 2.1 time: 0.108785 Jul 25 20:25:49.707668 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1885/3782] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:25:49 2022] GET /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca => generated 222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:49.727540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:49.728738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:49.747268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.748024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.749055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.749666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.760971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dcb31397-166e-4ed9-b299-bf10855926a5 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.322038 Jul 25 20:25:49.762684 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1898/3783] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:25:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:49.768764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-91c6ae59-c6bf-44af-887e-ceb21e31950b req-3b71a8f3-67f9-4413-b80f-e45079441193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48238f1-bc52-4345-a19c-5fe0d5adf5f0", "tag": "8e3d81ce-a989-4c11-82eb-ec9c8359a6ad"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:49.804334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-91c6ae59-c6bf-44af-887e-ceb21e31950b req-3b71a8f3-67f9-4413-b80f-e45079441193 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.807762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-91c6ae59-c6bf-44af-887e-ceb21e31950b req-3b71a8f3-67f9-4413-b80f-e45079441193 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.847116 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-91c6ae59-c6bf-44af-887e-ceb21e31950b req-3b71a8f3-67f9-4413-b80f-e45079441193 service nova] Creating event network-changed:8e3d81ce-a989-4c11-82eb-ec9c8359a6ad for instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 on n-h1-845775-3 Jul 25 20:25:49.864785 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-91c6ae59-c6bf-44af-887e-ceb21e31950b req-3b71a8f3-67f9-4413-b80f-e45079441193 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095894 Jul 25 20:25:49.866342 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1899/3784] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:49.881109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:49.884783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:49.902699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.903437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.905426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:49.905873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:49.967157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:50.034624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:50.056738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2283542d-9c29-46e8-b385-65c7ac9bb37a tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1473 microversion: 2.1 time: 0.341407 Jul 25 20:25:50.079047 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1886/3785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:49 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:50.099121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-02f251ee-dbd4-44b9-bfed-c242501ea04a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Action: 'update', calling method: .version_select at 0x7f196e905790>, body: {"security_group": {"name": "tempest-sg-hth-2061527007", "description": "tempest-description-hth-310110962"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:50.146275 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5c7ef24-6204-4e5f-9ba1-48fc51d8a8de tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 204 len: 0 microversion: 2.1 time: 0.275320 Jul 25 20:25:50.147253 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1900/3786] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:49 2022] DELETE /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:50.158605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:50.160523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:50.171027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:50.171827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:50.172693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:50.173361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:50.583578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-02f251ee-dbd4-44b9-bfed-c242501ea04a tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421" status: 200 len: 217 microversion: 2.1 time: 0.499498 Jul 25 20:25:50.586303 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1887/3787] 10.222.0.48 () {60 vars in 1290 bytes} [Mon Jul 25 20:25:50 2022] PUT /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421 => generated 217 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:50.602104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ee81e08c-da99-4b0b-9254-9de4f8fa77ce req-e7c88845-d5d9-4975-b43e-fc5557523262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d6e47a-a490-434c-8bb1-846a3c8fcd7b", "name": "network-vif-deleted", "tag": "d57ca4df-a46f-4eac-80b7-8055dd562ce5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:50.640084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ee81e08c-da99-4b0b-9254-9de4f8fa77ce req-e7c88845-d5d9-4975-b43e-fc5557523262 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:50.640988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ee81e08c-da99-4b0b-9254-9de4f8fa77ce req-e7c88845-d5d9-4975-b43e-fc5557523262 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:50.693999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ee81e08c-da99-4b0b-9254-9de4f8fa77ce req-e7c88845-d5d9-4975-b43e-fc5557523262 service nova] Creating event network-vif-deleted:d57ca4df-a46f-4eac-80b7-8055dd562ce5 for instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b on n-h2-845775-3 Jul 25 20:25:50.715088 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ee81e08c-da99-4b0b-9254-9de4f8fa77ce req-e7c88845-d5d9-4975-b43e-fc5557523262 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126785 Jul 25 20:25:50.716477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1888/3788] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:50.726070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b2d0fae-7963-48b4-ad60-16d04cf38000 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1968c22ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:51.523130 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b2d0fae-7963-48b4-ad60-16d04cf38000 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421" status: 200 len: 217 microversion: 2.1 time: 0.803331 Jul 25 20:25:51.526346 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1889/3789] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:25:50 2022] GET /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421 => generated 217 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:51.550214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:51.553631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:51.572255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:51.573050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:51.575441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:51.576022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:51.619601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:51.632397 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9232264d-8c64-4b42-901a-da544f03c3f7 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1505 microversion: 2.1 time: 1.479815 Jul 25 20:25:51.643899 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1901/3790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:50 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1505 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:51.650812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:51.653498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:51.681763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:51.684721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:51.689331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:51.690148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:51.964755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:52.077322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:52.120822 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18cf9333-4266-433e-a4ed-42b5628c776f tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 200 len: 1473 microversion: 2.1 time: 0.476752 Jul 25 20:25:52.137285 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1902/3791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:51 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:52.167778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c103fa59-2b98-4bc5-a61b-9c5534eb5f6c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969fb6ee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:52.322085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:52.338711 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1fb8d63f-63df-45f1-a302-2e7349f6b508 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 0.809149 Jul 25 20:25:52.371132 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1890/3792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:51 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:52.668150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:52.670024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:52.687377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:52.688150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:52.690467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:52.692844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.014665 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c103fa59-2b98-4bc5-a61b-9c5534eb5f6c tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421" status: 202 len: 0 microversion: 2.1 time: 0.875624 Jul 25 20:25:53.016519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1903/3793] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:52 2022] DELETE /compute/v2.1/os-security-groups/5a1c9a90-4c0e-4025-b25d-f1c0d71f8421 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:25:53.026628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.027140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.045752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:53.047546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.048015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.050017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.053037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.065418 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f3bc208a-683f-4a08-a496-980f63af077b tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1505 microversion: 2.1 time: 0.403609 Jul 25 20:25:53.066797 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1891/3794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:52 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:53.089151 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b HTTP/1.1 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1bfd19a0-8579-4394-9db0-9e937548330b'} Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:53.127618 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.132344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:53.140405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb985a99-9ad7-45d8-9e25-0bb61fcf0bde tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 404 len: 111 microversion: 2.1 time: 0.108440 Jul 25 20:25:53.146823 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1904/3795] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:53 2022] DELETE /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:53.151817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.152822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 1bfd19a0-8579-4394-9db0-9e937548330b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.163379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.164111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.165131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.165732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.167425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.171230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 92d6e47a-a490-434c-8bb1-846a3c8fcd7b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.189102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b HTTP/1.1 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1bfd19a0-8579-4394-9db0-9e937548330b'} Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.191639 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. Jul 25 20:25:53.196133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.198181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Instance 1bfd19a0-8579-4394-9db0-9e937548330b could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:53.199492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35d6211d-bf66-4409-be78-bb0330547417 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b" status: 404 len: 111 microversion: 2.1 time: 0.053441 Jul 25 20:25:53.200648 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1892/3796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:53 2022] GET /compute/v2.1/servers/1bfd19a0-8579-4394-9db0-9e937548330b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:53.204662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.205116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.205910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.206355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.210206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196eacd8b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.224958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:53.259822 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] HTTP exception thrown: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Request method failure captured: Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b HTTP/1.1 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vv029Q4yl84NVwZoWbcKpzDGMSMBSALjLRMP4xduKYcJC3fLuyQwA_glPU0oHfANne7HOrXN9WEVRBjLFHj01f1BPHZ3XSAqbW8tbRtDbvSEBN7NG9JCvy4guIKwouMPa8kZBoPLC4fvXNguOFGUJxM55FU_pcf0nQUw6uszIn87DE Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}] Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7311833a2c604219a02c4c8d6760c2f2 Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '92d6e47a-a490-434c-8bb1-846a3c8fcd7b'} Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.262213 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. Jul 25 20:25:53.266771 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.267258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Returning 404 to user: Instance 92d6e47a-a490-434c-8bb1-846a3c8fcd7b could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:53.268153 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5eba798e-3fda-4953-be23-c9211bbecc76 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b" status: 404 len: 111 microversion: 2.1 time: 0.106784 Jul 25 20:25:53.272407 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1905/3797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:53 2022] GET /compute/v2.1/servers/92d6e47a-a490-434c-8bb1-846a3c8fcd7b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:25:53.277656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.278418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.297084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.297531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.298352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.298796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.337285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:53.340653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:53.341464 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.341464 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7 HTTP/1.1 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3fd4cfc6-54c1-494c-b298-7131e36ca6d7'} Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:53.347743 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] Jul 25 20:25:53.351441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.357134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 3fd4cfc6-54c1-494c-b298-7131e36ca6d7 does not exist Jul 25 20:25:53.357134 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a4075513-234a-43e2-b219-53872f9f34c8'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:53.357134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bffdabef-4e5f-48a3-a240-24b4468e2752 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7" status: 404 len: 194 microversion: 2.1 time: 0.151887 Jul 25 20:25:53.358558 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1893/3798] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:53 2022] DELETE /compute/v2.1/os-security-groups/3fd4cfc6-54c1-494c-b298-7131e36ca6d7 => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:53.362145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:53.373860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.374496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.397899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.398360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.399155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.399599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.552972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b5840ee-31ba-4e19-a037-779a589913a3 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 204 len: 0 microversion: 2.1 time: 0.278448 Jul 25 20:25:53.554561 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1906/3799] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:53 2022] DELETE /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:25:53.563384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196c7ecee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.770814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:53.771434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:53.771978 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.771978 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816 HTTP/1.1 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '57a2380e-b9ef-4524-b2a1-52300d6cf816'} Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:53.773984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 57a2380e-b9ef-4524-b2a1-52300d6cf816 does not exist Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-e8e1c724-9f4d-42c2-b492-46dae5ffdd1c'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a29a7743-eeef-4207-8880-878029f389dd tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816" status: 404 len: 194 microversion: 2.1 time: 0.219887 Jul 25 20:25:53.777416 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1907/3800] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:53 2022] DELETE /compute/v2.1/os-security-groups/57a2380e-b9ef-4524-b2a1-52300d6cf816 => generated 194 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:53.789329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:53.791107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:53.794485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:53.813493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.814295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.815934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:53.817270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:53.999722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:25:54.546103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:54.598637 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a37a009-a2fd-4cae-ac74-f37ddd870461 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 1.233297 Jul 25 20:25:54.601417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1894/3801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:53 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:54.609445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196eaf3160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:54.755767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:54.756633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 04769f76-69a8-4308-8b33-d64a0202dc0e not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:54.757320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.757320 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e HTTP/1.1 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '04769f76-69a8-4308-8b33-d64a0202dc0e'} Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:54.760255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 04769f76-69a8-4308-8b33-d64a0202dc0e does not exist Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-a0b78a86-9082-46bc-bc69-b0a726d33e7c'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:54.768546 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a34c9a20-c637-4c60-8de3-0d1937b769f0 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e" status: 404 len: 194 microversion: 2.1 time: 0.164473 Jul 25 20:25:54.774581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1895/3802] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:54 2022] DELETE /compute/v2.1/os-security-groups/04769f76-69a8-4308-8b33-d64a0202dc0e => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:54.817098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:54.817867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:54.833926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:54.834710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:54.838684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:54.841113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:55.221582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '231efac612a9434c96a76fbfe7f52b39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c7324d9d8d4e478078053046dd1246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:55.234483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79ec1042-1a20-42ec-983b-b9f70d7942aa tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 200 len: 1463 microversion: 2.1 time: 0.460463 Jul 25 20:25:55.236130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1896/3803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:54 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:55.250329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196a4eaa60>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:55.418516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:55.429982 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d847b1ab-eac5-4007-b233-43972762a1b4 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1515 microversion: 2.1 time: 1.652055 Jul 25 20:25:55.431274 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1908/3804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:53 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1515 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:55.471141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-95af87c2-52ce-4c05-81ff-9fa0ee819972 req-91d0452e-4493-4616-8e4c-0de6b2618e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0069193d-946e-4bf7-b5e5-55cee4155aa9", "name": "network-vif-deleted", "tag": "6223f99b-8eec-448f-8bdd-458baeaba918"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:55.520357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-95af87c2-52ce-4c05-81ff-9fa0ee819972 req-91d0452e-4493-4616-8e4c-0de6b2618e1e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:55.524083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-95af87c2-52ce-4c05-81ff-9fa0ee819972 req-91d0452e-4493-4616-8e4c-0de6b2618e1e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:55.569991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-95af87c2-52ce-4c05-81ff-9fa0ee819972 req-91d0452e-4493-4616-8e4c-0de6b2618e1e service nova] Creating event network-vif-deleted:6223f99b-8eec-448f-8bdd-458baeaba918 for instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 on n-h2-845775-3 Jul 25 20:25:55.594108 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-95af87c2-52ce-4c05-81ff-9fa0ee819972 req-91d0452e-4493-4616-8e4c-0de6b2618e1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122033 Jul 25 20:25:55.594449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG neutronclient.v2_0.client [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist", "detail": ""}} {{(pid=119723) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:55.595663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.security_group_api [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 not found {{(pid=119723) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:55.596100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1909/3805] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:55.596531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.596531 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394 HTTP/1.1 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: exception: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '57f8a5e4-11d5-48dd-a1e5-24263dbb6394'} Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:55.600140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 57f8a5e4-11d5-48dd-a1e5-24263dbb6394 does not exist Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: Neutron server returns request_ids: ['req-d4bbc2b7-ec3d-40ac-ad3e-c3e5f112d3a6'] {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c9d1930-8306-432a-8673-f2772d6e687d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394" status: 404 len: 194 microversion: 2.1 time: 0.364595 Jul 25 20:25:55.607279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1897/3806] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:55 2022] DELETE /compute/v2.1/os-security-groups/57f8a5e4-11d5-48dd-a1e5-24263dbb6394 => generated 194 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:55.630304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:55.631611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:55.637063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f1969a6b3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:55.671771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:55.672273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:55.676306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:55.678314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:55.801711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:55.803046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:55.803774 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.803774 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1 HTTP/1.1 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '22d39a2e-0e77-416f-b341-2a585f7c25c1'} Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:55.806625 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 22d39a2e-0e77-416f-b341-2a585f7c25c1 does not exist Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f4d6f465-ddf2-4021-8248-5ce4f8295762'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7a30c62-5274-4def-887c-83ed4acd0d93 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1" status: 404 len: 194 microversion: 2.1 time: 0.189320 Jul 25 20:25:55.810427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1910/3807] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:55 2022] DELETE /compute/v2.1/os-security-groups/22d39a2e-0e77-416f-b341-2a585f7c25c1 => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:55.823699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196949d940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:56.006756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG neutronclient.v2_0.client [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist", "detail": ""}} {{(pid=119724) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 25 20:25:56.007741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Neutron security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 not found {{(pid=119724) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 25 20:25:56.008675 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.008675 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 HTTP/1.1 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: method: Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: exception: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6337c6e1-2e48-42f4-a4a1-2fa481937fb8'} Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 25 20:25:56.011373 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] Jul 25 20:25:56.016193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.029242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Security group 6337c6e1-2e48-42f4-a4a1-2fa481937fb8 does not exist Jul 25 20:25:56.029242 n-d-845775-3 devstack@n-api.service[119724]: Neutron server returns request_ids: ['req-f3ffab9d-731e-4fd7-adfc-f31541e33236'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:56.033422 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bc3197e6-9460-4d27-ba46-4979ed880809 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8" status: 404 len: 194 microversion: 2.1 time: 0.217932 Jul 25 20:25:56.043558 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1911/3808] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:25:55 2022] DELETE /compute/v2.1/os-security-groups/6337c6e1-2e48-42f4-a4a1-2fa481937fb8 => generated 194 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:56.054995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:56.055591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:56.070048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.070505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:56.101162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.103681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:56.198582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:25:56.433988 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7a4b6cb0-ef68-4252-b456-b5f11629f269 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 204 len: 0 microversion: 2.1 time: 0.385810 Jul 25 20:25:56.442726 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1912/3809] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:56 2022] DELETE /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:56.449108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:56.453241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:56.468330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.472981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:56.474291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.474905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:56.529670 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 HTTP/1.1 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '0069193d-946e-4bf7-b5e5-55cee4155aa9'} Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:56.531420 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:56.535385 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:56.536211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:56.537929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92c16540-d8e5-47e8-b921-5444f41b27bd tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 404 len: 111 microversion: 2.1 time: 0.093199 Jul 25 20:25:56.541244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1913/3810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:56 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:56.560295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:56.564880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:56.587898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.588322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:56.589111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:56.589560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.065759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:57.075479 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8bd160a2-13d3-49dc-b7f6-e1a4b82c04bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 1.454273 Jul 25 20:25:57.076108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1898/3811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:55 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:25:57.085224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.086170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:57.093406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.094015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.095059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.095528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.286815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:57.309890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f3eafd9-7a6c-4cb9-85b2-fc600e1dd2cb tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1473 microversion: 2.1 time: 0.228584 Jul 25 20:25:57.311224 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1899/3812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:57 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:57.347691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61f876f2-3280-45d1-8c0e-5a80f13a998d tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.370070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.server_groups [None req-61f876f2-3280-45d1-8c0e-5a80f13a998d tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Querying cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) for 1 instances {{(pid=119723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 20:25:57.371106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61f876f2-3280-45d1-8c0e-5a80f13a998d tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.371743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61f876f2-3280-45d1-8c0e-5a80f13a998d tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.399781 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61f876f2-3280-45d1-8c0e-5a80f13a998d tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.072469 Jul 25 20:25:57.400609 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1900/3813] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:25:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:57.437557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aef660c3-5f99-4003-b561-85176ae88d45 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.482029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.server_groups [None req-aef660c3-5f99-4003-b561-85176ae88d45 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Querying cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) for 1 instances {{(pid=119723) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 25 20:25:57.483111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aef660c3-5f99-4003-b561-85176ae88d45 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.485222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aef660c3-5f99-4003-b561-85176ae88d45 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.512837 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aef660c3-5f99-4003-b561-85176ae88d45 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca" status: 200 len: 184 microversion: 2.1 time: 0.089305 Jul 25 20:25:57.513633 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1901/3814] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:25:57 2022] GET /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca => generated 184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:57.529275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.529784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:57.549628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.550561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.552967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.553767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.593175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:57.607083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-762477f7-af2a-49d1-b823-efe52b5cdaba tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1647 microversion: 2.1 time: 1.061996 Jul 25 20:25:57.607735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1914/3815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:56 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1647 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:57.610403 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 HTTP/1.1 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '0069193d-946e-4bf7-b5e5-55cee4155aa9'} Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.612310 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.617012 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.619209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.620467 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e40dc57a-d06e-4b38-b053-cdefac1fe955 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 404 len: 111 microversion: 2.1 time: 0.095462 Jul 25 20:25:57.621672 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1902/3816] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:25:57.629699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.630337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] [instance: 0069193d-946e-4bf7-b5e5-55cee4155aa9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:57.643657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.644278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.645617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.646388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.671406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c5fcaa86-71b8-4368-a928-b68b71cc8b3e req-95622747-b986-4e8d-b157-1093951c7cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ae4509-8e28-43c7-a89c-aea36f0f7fe7", "name": "network-vif-deleted", "tag": "aefb233a-b9ce-47bb-acee-734b819a91e9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:57.702766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c5fcaa86-71b8-4368-a928-b68b71cc8b3e req-95622747-b986-4e8d-b157-1093951c7cb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:57.703371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c5fcaa86-71b8-4368-a928-b68b71cc8b3e req-95622747-b986-4e8d-b157-1093951c7cb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:57.708873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 HTTP/1.1 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '0069193d-946e-4bf7-b5e5-55cee4155aa9'} Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.710447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. Jul 25 20:25:57.714324 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.719190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance 0069193d-946e-4bf7-b5e5-55cee4155aa9 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.725022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25fe9750-3f68-4074-af31-cde443378f52 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9" status: 404 len: 111 microversion: 2.1 time: 0.099165 Jul 25 20:25:57.735927 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1915/3817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:57 2022] GET /compute/v2.1/servers/0069193d-946e-4bf7-b5e5-55cee4155aa9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:57.742416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2e29e87-cdeb-431d-9982-da32373502ab tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.742988 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c5fcaa86-71b8-4368-a928-b68b71cc8b3e req-95622747-b986-4e8d-b157-1093951c7cb2 service nova] Creating event network-vif-deleted:aefb233a-b9ce-47bb-acee-734b819a91e9 for instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 on n-h2-845775-3 Jul 25 20:25:57.762261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c5fcaa86-71b8-4368-a928-b68b71cc8b3e req-95622747-b986-4e8d-b157-1093951c7cb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100012 Jul 25 20:25:57.764363 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c2e29e87-cdeb-431d-9982-da32373502ab tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. Jul 25 20:25:57.764993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1903/3818] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2e29e87-cdeb-431d-9982-da32373502ab tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-server-groups/a90454fb-63eb-4bb7-a133-659dc6192592 HTTP/1.1 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a90454fb-63eb-4bb7-a133-659dc6192592'} Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.778513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. Jul 25 20:25:57.782531 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.784169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2e29e87-cdeb-431d-9982-da32373502ab tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance group a90454fb-63eb-4bb7-a133-659dc6192592 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.786385 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2e29e87-cdeb-431d-9982-da32373502ab tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a90454fb-63eb-4bb7-a133-659dc6192592" status: 404 len: 117 microversion: 2.1 time: 0.048178 Jul 25 20:25:57.792213 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1916/3819] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/os-server-groups/a90454fb-63eb-4bb7-a133-659dc6192592 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:57.808020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b092649-7315-4280-845b-4ef149b37c26 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.832429 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5b092649-7315-4280-845b-4ef149b37c26 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b092649-7315-4280-845b-4ef149b37c26 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-server-groups/257c0034-d3a8-46eb-9a10-b670e058da4f HTTP/1.1 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '257c0034-d3a8-46eb-9a10-b670e058da4f'} Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.842970 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. Jul 25 20:25:57.847846 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.855257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b092649-7315-4280-845b-4ef149b37c26 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance group 257c0034-d3a8-46eb-9a10-b670e058da4f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.857379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b092649-7315-4280-845b-4ef149b37c26 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/257c0034-d3a8-46eb-9a10-b670e058da4f" status: 404 len: 117 microversion: 2.1 time: 0.063955 Jul 25 20:25:57.859374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1904/3820] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/os-server-groups/257c0034-d3a8-46eb-9a10-b670e058da4f => generated 117 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:25:57.867150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fac08bde-719f-4dad-a0b4-27c97b74ce74 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.885969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fac08bde-719f-4dad-a0b4-27c97b74ce74 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fac08bde-719f-4dad-a0b4-27c97b74ce74 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/os-server-groups/b3e97595-4c53-440b-81c9-d17fc962b347 HTTP/1.1 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'b3e97595-4c53-440b-81c9-d17fc962b347'} Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.888611 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fac08bde-719f-4dad-a0b4-27c97b74ce74 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance group b3e97595-4c53-440b-81c9-d17fc962b347 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fac08bde-719f-4dad-a0b4-27c97b74ce74 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/b3e97595-4c53-440b-81c9-d17fc962b347" status: 404 len: 117 microversion: 2.1 time: 0.028058 Jul 25 20:25:57.892347 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1917/3821] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/os-server-groups/b3e97595-4c53-440b-81c9-d17fc962b347 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:57.904942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e79ad45-0a20-4992-a8ba-2a5f0aaba11f tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.919606 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5e79ad45-0a20-4992-a8ba-2a5f0aaba11f tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] HTTP exception thrown: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e79ad45-0a20-4992-a8ba-2a5f0aaba11f tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Request method failure captured: Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-server-groups/73261b97-d23d-48e8-99ee-bc8dba4245ea HTTP/1.1 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vwidAnEraWhiWK07Q5X0CkdtSmfXDbQuAOhCHxW0MxIRQDHM9I34kQv60_2iZcezsB6U3TORPK-8zD9skRTOKGk3ISA-Hnz0opbQNkCWqk9XAMngAv30FLqqe5TGEpyKOBNpFRaKbXsl2PpPRmJh7elKwiWp0mheykpNSzVguFz8Wc Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0c7324d9d8d4e478078053046dd1246"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0c7324d9d8d4e478078053046dd1246"}]}] Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: b0c7324d9d8d4e478078053046dd1246 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerGroupTestJSON-46694247 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 231efac612a9434c96a76fbfe7f52b39 Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerGroupTestJSON-46694247-project Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '73261b97-d23d-48e8-99ee-bc8dba4245ea'} Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.921759 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. Jul 25 20:25:57.925402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:57.930152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e79ad45-0a20-4992-a8ba-2a5f0aaba11f tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Returning 404 to user: Instance group 73261b97-d23d-48e8-99ee-bc8dba4245ea could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:25:57.931752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e79ad45-0a20-4992-a8ba-2a5f0aaba11f tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/73261b97-d23d-48e8-99ee-bc8dba4245ea" status: 404 len: 117 microversion: 2.1 time: 0.032015 Jul 25 20:25:57.932939 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1905/3822] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/os-server-groups/73261b97-d23d-48e8-99ee-bc8dba4245ea => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:25:57.942724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19fb957e-3aa6-4f57-bef7-aaaf91717142 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:57.992386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19fb957e-3aa6-4f57-bef7-aaaf91717142 tempest-ServerGroupTestJSON-46694247 tempest-ServerGroupTestJSON-46694247-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca" status: 204 len: 0 microversion: 2.1 time: 0.054198 Jul 25 20:25:58.016143 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1918/3823] 10.222.0.48 () {58 vars in 1266 bytes} [Mon Jul 25 20:25:57 2022] DELETE /compute/v2.1/os-server-groups/0b3dcf32-8220-4534-8c04-1d66a45617ca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:25:58.102608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:58.103648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:58.117877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.119834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.123155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.123843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.346174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:58.352918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:58.361580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.362627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.363695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.364339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.435724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.436357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.436846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lazy-loading 'fault' on Instance uuid 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:25:58.915218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:58.923068 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5392fb2-dabf-4d79-983a-47ff0833e618 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 200 len: 1309 microversion: 2.1 time: 0.580717 Jul 25 20:25:58.924506 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1919/3824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:58 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 1309 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:58.930489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d0c8902e-426f-4d7e-ac4e-c6076da4bd3c req-5bbc2538-fda6-4b95-8ec9-2d295f61b673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48238f1-bc52-4345-a19c-5fe0d5adf5f0", "name": "network-vif-plugged", "status": "completed", "tag": "8e3d81ce-a989-4c11-82eb-ec9c8359a6ad"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:25:58.941380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d0c8902e-426f-4d7e-ac4e-c6076da4bd3c req-5bbc2538-fda6-4b95-8ec9-2d295f61b673 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:58.942172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d0c8902e-426f-4d7e-ac4e-c6076da4bd3c req-5bbc2538-fda6-4b95-8ec9-2d295f61b673 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:58.957301 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d0c8902e-426f-4d7e-ac4e-c6076da4bd3c req-5bbc2538-fda6-4b95-8ec9-2d295f61b673 service nova] Creating event network-vif-plugged:8e3d81ce-a989-4c11-82eb-ec9c8359a6ad for instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 on n-h1-845775-3 Jul 25 20:25:58.964730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d0c8902e-426f-4d7e-ac4e-c6076da4bd3c req-5bbc2538-fda6-4b95-8ec9-2d295f61b673 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037901 Jul 25 20:25:58.966388 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1920/3825] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:25:59.002402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:59.004941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:59.029839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:59.032986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:59.038668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:59.039778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:59.452796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:59.476009 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6edb1299-f52f-4eec-bfd1-c814e1e4cb6b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 1.379610 Jul 25 20:25:59.492135 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1906/3826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:58 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:59.709272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eca7dcff9ae44b8ad0760c3621d1025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06f45177fa1945c19753fb626d95ddef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:25:59.719690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9cb4caa4-d0d0-41ea-a01a-34b454147ea2 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 200 len: 1647 microversion: 2.1 time: 0.751627 Jul 25 20:25:59.720707 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1921/3827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:58 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 1647 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:25:59.951250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:25:59.952066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 20ae4509-8e28-43c7-a89c-aea36f0f7fe7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:25:59.965116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:59.965579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:59.966364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:25:59.966809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:25:59.994628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] HTTP exception thrown: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Request method failure captured: Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 HTTP/1.1 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vv029Q4yl84NVwZoWbcKpzDGMSMBSALjLRMP4xduKYcJC3fLuyQwA_glPU0oHfANne7HOrXN9WEVRBjLFHj01f1BPHZ3XSAqbW8tbRtDbvSEBN7NG9JCvy4guIKwouMPa8kZBoPLC4fvXNguOFGUJxM55FU_pcf0nQUw6uszIn87DE Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}] Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7311833a2c604219a02c4c8d6760c2f2 Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '20ae4509-8e28-43c7-a89c-aea36f0f7fe7'} Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:25:59.997864 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Returning 404 to user: Instance 20ae4509-8e28-43c7-a89c-aea36f0f7fe7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:26:00.004718 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ce25603e-d1f0-4dbe-b5b6-d115b8bd8f67 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7" status: 404 len: 111 microversion: 2.1 time: 0.053442 Jul 25 20:26:00.021183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1907/3828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:25:59 2022] GET /compute/v2.1/servers/20ae4509-8e28-43c7-a89c-aea36f0f7fe7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:26:00.028014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:00.028871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:00.038991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.044873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.046897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.048828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.107228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:26:00.178053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-97ad6370-ee6a-4535-b8ad-3b138c40a0b5 req-e842826f-32aa-4e21-929a-ab01cd26c460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b366bad-5fb1-463c-82ca-00d6bd913e61", "name": "network-vif-deleted", "tag": "c503bc3e-3b69-483a-a82c-c392c3116419"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:00.224267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-97ad6370-ee6a-4535-b8ad-3b138c40a0b5 req-e842826f-32aa-4e21-929a-ab01cd26c460 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.224749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-97ad6370-ee6a-4535-b8ad-3b138c40a0b5 req-e842826f-32aa-4e21-929a-ab01cd26c460 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.267937 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-97ad6370-ee6a-4535-b8ad-3b138c40a0b5 req-e842826f-32aa-4e21-929a-ab01cd26c460 service nova] Creating event network-vif-deleted:c503bc3e-3b69-483a-a82c-c392c3116419 for instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 on n-h2-845775-3 Jul 25 20:26:00.289741 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91c7e892-a6be-452f-9ab4-df3f29a5244d tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "DELETE /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 204 len: 0 microversion: 2.1 time: 0.265903 Jul 25 20:26:00.299743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-97ad6370-ee6a-4535-b8ad-3b138c40a0b5 req-e842826f-32aa-4e21-929a-ab01cd26c460 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138224 Jul 25 20:26:00.307232 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1908/3830] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:26:00.326436 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1922/3830] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:26:00 2022] DELETE /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:26:00.345898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:00.347544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:00.366970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.371162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.373435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.374462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.507625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:00.512452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:00.535806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.536862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:00.539065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:00.543868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:01.172338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:01.200948 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-faa92c59-3eb7-4530-b2ae-896425a0a60b tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1517 microversion: 2.1 time: 0.877253 Jul 25 20:26:01.204205 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1909/3831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:00 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1517 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:01.235555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:01.236340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] [instance: 8b366bad-5fb1-463c-82ca-00d6bd913e61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:01.247106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:01.247653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:01.249009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:01.249527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:01.270628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:01.274804 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] HTTP exception thrown: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Request method failure captured: Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 HTTP/1.1 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvTHYxRuKnr5yl_-Vpu7MtwK8_PdrtUOuQhtNkc-aX6Erup0fPeUxS_rrY6vOQiZhPHei7X1Au6XHqkEzRda1Fdi2F49_sLNHki_TeALjvDNuMMkmNJR3F8OVJjU73Y-0XHunnDLy9vK3If4pFtnqVy2njUNS2ynmbTkE3PFXxVy5E Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06f45177fa1945c19753fb626d95ddef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06f45177fa1945c19753fb626d95ddef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06f45177fa1945c19753fb626d95ddef"}]}] Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 06f45177fa1945c19753fb626d95ddef Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-374717925 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9eca7dcff9ae44b8ad0760c3621d1025 Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-SecurityGroupsTestJSON-374717925-project Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8b366bad-5fb1-463c-82ca-00d6bd913e61'} Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:01.276843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. Jul 25 20:26:01.289522 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:26:01.291823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Returning 404 to user: Instance 8b366bad-5fb1-463c-82ca-00d6bd913e61 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:26:01.294223 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f61ae79f-9f53-4b88-8f50-7e0f1b3fb77d tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61" status: 404 len: 111 microversion: 2.1 time: 0.072032 Jul 25 20:26:01.295526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1910/3832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:01 2022] GET /compute/v2.1/servers/8b366bad-5fb1-463c-82ca-00d6bd913e61 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:26:01.313257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d39e6bb-a220-413c-a4df-b62a00096d22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f19694e74c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:01.632011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:01.642614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4e8c29a-d2c8-484b-9759-6429d29396e7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1315 microversion: 2.1 time: 1.146496 Jul 25 20:26:01.664141 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1923/3833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:00 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:02.233157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:02.234136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:02.252824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:02.256116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:02.261467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:02.263459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:02.397146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d39e6bb-a220-413c-a4df-b62a00096d22 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/4c0a49df-bfc8-412c-a661-628cdd1b7c5c" status: 202 len: 0 microversion: 2.1 time: 1.090226 Jul 25 20:26:02.401992 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1911/3834] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:26:01 2022] DELETE /compute/v2.1/os-security-groups/4c0a49df-bfc8-412c-a661-628cdd1b7c5c => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:26:02.421676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0d464c0-df47-4388-aac7-9d587d6b8480 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] Calling method '.version_select at 0x7f196ea5f8b0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:03.374033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:03.389515 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc2714d7-cb11-4046-ba22-bd7340d5c7a8 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1517 microversion: 2.1 time: 1.161523 Jul 25 20:26:03.390146 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1924/3835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:02 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1517 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:03.410749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:03.420604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:03.453435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:03.454094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:03.457540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:03.458204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.185387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:04.189435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0d464c0-df47-4388-aac7-9d587d6b8480 tempest-SecurityGroupsTestJSON-374717925 tempest-SecurityGroupsTestJSON-374717925-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/2dea45f0-7322-4ffb-9d49-2fcc86b00fb7" status: 202 len: 0 microversion: 2.1 time: 1.786239 Jul 25 20:26:04.197751 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1912/3836] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:26:02 2022] DELETE /compute/v2.1/os-security-groups/2dea45f0-7322-4ffb-9d49-2fcc86b00fb7 => generated 0 bytes in 1792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:26:04.241216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:04.248144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-989cc425-8488-47df-992a-9f7354cd28c2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1501 microversion: 2.1 time: 0.852145 Jul 25 20:26:04.249782 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1925/3837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:03 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1501 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:04.272855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:04.273596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:04.289572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.298962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.300978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.301539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.424191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:04.426838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:04.453083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.454821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.463071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.463870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.511633 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2af0604b-d277-4a29-832f-bd9da8f4fda8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.225853 Jul 25 20:26:04.518832 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1913/3838] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:26:04 2022] POST /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:26:04.565125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:04.574189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:04.613939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.617174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:04.618241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:04.621019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:05.432962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:05.463919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-70d305c2-0d34-452f-a019-c3801e07fb7f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1506 microversion: 2.1 time: 0.936870 Jul 25 20:26:05.466172 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1914/3839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:04 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1506 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:06.353563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c0e23c1a-8e54-476b-bcdd-74d97e4c7106 req-a6dae81a-41d8-46b4-94e9-5cda70631869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "741b436b-ed3b-4d45-84fd-12d03706e5ae", "name": "network-vif-deleted", "tag": "6da77912-575c-42c8-a187-c71a9a000300"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:06.379014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7311833a2c604219a02c4c8d6760c2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a91995d4354fbc804b17d2c810942a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:06.383288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0e23c1a-8e54-476b-bcdd-74d97e4c7106 req-a6dae81a-41d8-46b4-94e9-5cda70631869 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:06.388155 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3207a07f-75b8-4d97-a133-a8764def280e tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 200 len: 1517 microversion: 2.1 time: 1.981137 Jul 25 20:26:06.389144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0e23c1a-8e54-476b-bcdd-74d97e4c7106 req-a6dae81a-41d8-46b4-94e9-5cda70631869 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:06.396721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1926/3840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:04 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 1517 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:06.430233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c0e23c1a-8e54-476b-bcdd-74d97e4c7106 req-a6dae81a-41d8-46b4-94e9-5cda70631869 service nova] Creating event network-vif-deleted:6da77912-575c-42c8-a187-c71a9a000300 for instance 741b436b-ed3b-4d45-84fd-12d03706e5ae on n-h1-845775-3 Jul 25 20:26:06.446723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c0e23c1a-8e54-476b-bcdd-74d97e4c7106 req-a6dae81a-41d8-46b4-94e9-5cda70631869 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095585 Jul 25 20:26:06.449315 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1915/3841] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:26:06.487341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:06.490510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:06.519717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:06.521705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:06.524065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:06.526494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.212071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:07.234837 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b39d5d73-e532-460d-9ba1-6904ea629a36 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1486 microversion: 2.1 time: 0.746487 Jul 25 20:26:07.238120 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1927/3842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:06 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1486 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:07.270207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:07.271717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:07.305024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.307889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.307889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.307889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.418331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:07.419171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] [instance: 741b436b-ed3b-4d45-84fd-12d03706e5ae] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:07.442683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.443485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.444340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.444788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.453495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:26:07.488948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] HTTP exception thrown: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Request method failure captured: Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae HTTP/1.1 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vv029Q4yl84NVwZoWbcKpzDGMSMBSALjLRMP4xduKYcJC3fLuyQwA_glPU0oHfANne7HOrXN9WEVRBjLFHj01f1BPHZ3XSAqbW8tbRtDbvSEBN7NG9JCvy4guIKwouMPa8kZBoPLC4fvXNguOFGUJxM55FU_pcf0nQUw6uszIn87DE Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2a91995d4354fbc804b17d2c810942a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2a91995d4354fbc804b17d2c810942a"}]}] Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a2a91995d4354fbc804b17d2c810942a Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110578955 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 7311833a2c604219a02c4c8d6760c2f2 Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListServerFiltersTestJSON-110578955-project Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '741b436b-ed3b-4d45-84fd-12d03706e5ae'} Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:07.495513 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:07.500546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] Returning 404 to user: Instance 741b436b-ed3b-4d45-84fd-12d03706e5ae could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:26:07.513217 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-958394c1-badd-4617-8686-bf0517ffa4d7 tempest-ListServerFiltersTestJSON-110578955 tempest-ListServerFiltersTestJSON-110578955-project] 10.222.0.48 "GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae" status: 404 len: 111 microversion: 2.1 time: 0.087003 Jul 25 20:26:07.514995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1928/3843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:07 2022] GET /compute/v2.1/servers/741b436b-ed3b-4d45-84fd-12d03706e5ae => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:26:07.733873 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68acb8ae-c206-4a83-9388-a049c9bd79bb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 204 len: 0 microversion: 2.1 time: 0.469042 Jul 25 20:26:07.736968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1916/3844] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:26:07 2022] DELETE /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:26:07.755432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:07.760652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:07.776128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.778708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:07.783091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:07.789438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:08.252527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:08.264250 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c3266c3-dace-4aaa-9810-98223600b51d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1492 microversion: 2.1 time: 0.519104 Jul 25 20:26:08.265747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1929/3845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:07 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1492 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:09.287813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:09.288717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:09.321318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:09.328987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:09.329926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:09.330387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:10.052621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:10.065957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ddc424e3-51dd-43cb-8b7f-712b38576c3a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1492 microversion: 2.1 time: 0.781436 Jul 25 20:26:10.066732 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1917/3846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:09 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1492 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:11.095178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:11.095811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:11.111915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:11.112645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:11.116191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:11.117726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:11.647492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:11.665919 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa2e1070-3a85-44bd-addb-ea8493223c69 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 200 len: 1450 microversion: 2.1 time: 0.577395 Jul 25 20:26:11.671723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1930/3847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:11 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 1450 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:11.795968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e008706e-4c32-4b6e-a672-5bd378f68634 req-5b8c1b26-7b34-47b9-bb06-08bfffc6b366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48238f1-bc52-4345-a19c-5fe0d5adf5f0", "name": "network-vif-deleted", "tag": "8e3d81ce-a989-4c11-82eb-ec9c8359a6ad"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:11.822110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e008706e-4c32-4b6e-a672-5bd378f68634 req-5b8c1b26-7b34-47b9-bb06-08bfffc6b366 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:11.842896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e008706e-4c32-4b6e-a672-5bd378f68634 req-5b8c1b26-7b34-47b9-bb06-08bfffc6b366 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:11.859971 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e008706e-4c32-4b6e-a672-5bd378f68634 req-5b8c1b26-7b34-47b9-bb06-08bfffc6b366 service nova] Creating event network-vif-deleted:8e3d81ce-a989-4c11-82eb-ec9c8359a6ad for instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 on n-h1-845775-3 Jul 25 20:26:11.869731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e008706e-4c32-4b6e-a672-5bd378f68634 req-5b8c1b26-7b34-47b9-bb06-08bfffc6b366 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079730 Jul 25 20:26:11.874051 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1918/3848] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:12.696503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:12.697182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:12.708714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:12.711765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:12.714913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:12.716700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:12.741556 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 HTTP/1.1 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f48238f1-bc52-4345-a19c-5fe0d5adf5f0'} Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:26:12.743867 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:26:12.748167 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:26:12.753498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:26:12.755137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e4c6fa5-1d07-4f70-a0bf-fcf46a4a3803 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 404 len: 111 microversion: 2.1 time: 0.064179 Jul 25 20:26:12.756243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1931/3849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:12 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:26:13.030251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-488089009", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:13.187248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:26:15.488676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:26:15.492511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:26:15.493967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:26:15.495931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:26:15.496737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:26:15.536705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:15.544639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:15.547150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:15.555877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:15.596222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:15.611345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:15.634556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:26:15.638460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:26:15.705916 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8857b58-b210-45b4-a344-290ea348d88e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681693 Jul 25 20:26:15.707950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1919/3850] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:26:15.720290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c245214-e9e0-4e64-9c78-75de36393e25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:15.721013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c245214-e9e0-4e64-9c78-75de36393e25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:15.923446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c245214-e9e0-4e64-9c78-75de36393e25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:15.946029 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c245214-e9e0-4e64-9c78-75de36393e25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1214 microversion: 2.1 time: 0.218146 Jul 25 20:26:15.953218 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1932/3851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:15 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:16.967782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:16.969138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:16.983920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:17.006216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:17.007183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:17.007651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:17.198519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:17.215042 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a2babd80-56a0-4b2d-9a6b-bf4fdf73ccc0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1210 microversion: 2.1 time: 0.252049 Jul 25 20:26:17.226098 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1920/3852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:16 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1210 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:18.247548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:18.248723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:18.260666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:18.261179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:18.268190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:18.269242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:18.457490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:18.474449 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee93d4e8-7a79-4eac-9b49-66bd65f52db0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1272 microversion: 2.1 time: 0.230959 Jul 25 20:26:18.481851 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1933/3853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:18 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:19.507459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:19.509062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:19.535454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:19.536182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:19.538919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:19.539601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:20.205718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:20.215537 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a50a227b-9480-4000-8dd6-74e48a276363 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 0.712345 Jul 25 20:26:20.246538 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1921/3854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:19 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:21.268426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:21.271308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:21.301298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:21.301762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:21.302577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:21.303052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:22.696415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:22.764747 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7dc9a94a-600d-464d-aafc-e99520a5fc63 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 1.504233 Jul 25 20:26:22.771932 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1934/3855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:21 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:23.790244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:23.791461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:23.799713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:23.813386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:23.814119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:23.825180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:23.825886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:24.382211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cb71096b-e74f-44ed-9667-cd42177ddca6 req-5e386714-316b-4394-934a-d6afec3e1ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d934e47-af93-46e3-ab11-8ddfa0d11155", "tag": "d4240364-2825-448a-90c4-3cbbb3cdbb17"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:24.404306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:24.408898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cb71096b-e74f-44ed-9667-cd42177ddca6 req-5e386714-316b-4394-934a-d6afec3e1ba1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:24.409902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cb71096b-e74f-44ed-9667-cd42177ddca6 req-5e386714-316b-4394-934a-d6afec3e1ba1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:24.458734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cb71096b-e74f-44ed-9667-cd42177ddca6 req-5e386714-316b-4394-934a-d6afec3e1ba1 service nova] Creating event network-changed:d4240364-2825-448a-90c4-3cbbb3cdbb17 for instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 on n-h1-845775-3 Jul 25 20:26:24.470640 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cb71096b-e74f-44ed-9667-cd42177ddca6 req-5e386714-316b-4394-934a-d6afec3e1ba1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092928 Jul 25 20:26:24.478671 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1935/3856] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:24.765104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:24.779536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07612884-ab8c-482f-99c0-d7a40f353a5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 0.993575 Jul 25 20:26:24.781140 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1922/3857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:23 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:25.806599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:25.807325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:25.824269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:25.828766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:25.828766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:25.828766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:25.940588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:26.934396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:26.953428 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9c8e39a-a19f-4202-b1ef-2480261d6216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 1.149338 Jul 25 20:26:26.955818 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1936/3858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:25 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:27.978801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:27.983657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:27.992676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:27.996111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:28.019208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:28.022119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:28.032362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:28.033697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:30.653574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:30.666047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb85f448-544d-47b1-a802-295be30bfdfb tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 2.691576 Jul 25 20:26:30.667759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1923/3859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:27 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:31.688948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:31.689820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:31.701798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:31.705837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:31.713590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:31.714502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:32.576279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:32.592975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1236b5b-4b8c-4be2-b2e0-fd238978533d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 0.908244 Jul 25 20:26:32.593983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1937/3860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:31 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:33.565327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1741801233", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "24de87be-c9f6-4c14-b46b-366b2c7e4b6e"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:33.616319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:33.617041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:33.635532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:33.636446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:33.638212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:33.639765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:33.664154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] validate_networks() for [('24de87be-c9f6-4c14-b46b-366b2c7e4b6e', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:26:34.678935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:34.690311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5570c240-c0e5-44fc-9752-bbdd21b5b68f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 1.079436 Jul 25 20:26:34.694887 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1938/3861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:33 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:35.720658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:35.721309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:35.738980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:35.739450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:35.740346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:35.740788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:35.759254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=61 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:37.061261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:26:37.061954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:26:37.062755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:26:37.063460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:26:37.064229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:26:37.100223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:37.100958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:37.102329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:37.103077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:37.138243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:37.179104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Getting quotas for project 03f264f37aa748d88cf598bde016e098. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:37.197682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Getting quotas for user ef7f975b2d084cc48722a7fceabc0e89 and project 03f264f37aa748d88cf598bde016e098. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:37.237214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:26:37.244926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:26:37.389649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dab5a505-50aa-4346-9d25-417fcf3ce734 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.028319 Jul 25 20:26:37.413359 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1924/3862] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:26:37.674272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:37.721451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ca927e3-a832-448a-be03-0997b6c4b507 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 2.004869 Jul 25 20:26:37.737025 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1939/3863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:35 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:26:37.775105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-aee1dc2e-8a90-42b0-9443-7ef9ca25b6b8 req-fc3f8f20-694d-4ec8-85c9-10a3adaf0c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d934e47-af93-46e3-ab11-8ddfa0d11155", "name": "network-vif-plugged", "status": "completed", "tag": "d4240364-2825-448a-90c4-3cbbb3cdbb17"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:37.789283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1380021988", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "a34035ad-2504-4035-8994-0758915a6997"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:37.841002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aee1dc2e-8a90-42b0-9443-7ef9ca25b6b8 req-fc3f8f20-694d-4ec8-85c9-10a3adaf0c34 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:37.841808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aee1dc2e-8a90-42b0-9443-7ef9ca25b6b8 req-fc3f8f20-694d-4ec8-85c9-10a3adaf0c34 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:37.922317 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-aee1dc2e-8a90-42b0-9443-7ef9ca25b6b8 req-fc3f8f20-694d-4ec8-85c9-10a3adaf0c34 service nova] Creating event network-vif-plugged:d4240364-2825-448a-90c4-3cbbb3cdbb17 for instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 on n-h1-845775-3 Jul 25 20:26:37.951929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-aee1dc2e-8a90-42b0-9443-7ef9ca25b6b8 req-fc3f8f20-694d-4ec8-85c9-10a3adaf0c34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211890 Jul 25 20:26:37.964096 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1940/3864] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:37.986573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] validate_networks() for [('a34035ad-2504-4035-8994-0758915a6997', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:26:38.063015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d4afc2c-8573-434c-9281-12ef4abf0f48 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:38.072333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d4afc2c-8573-434c-9281-12ef4abf0f48 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:38.788136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d4afc2c-8573-434c-9281-12ef4abf0f48 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:38.799197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d4afc2c-8573-434c-9281-12ef4abf0f48 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1225 microversion: 2.1 time: 0.819605 Jul 25 20:26:38.800180 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1941/3865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:37 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1225 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:38.831593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:38.835682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:38.859839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:38.860584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:38.862538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:38.863206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:41.077160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:41.112887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04a27e1f-c972-4ab0-862d-724dce3b2566 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1314 microversion: 2.1 time: 2.298316 Jul 25 20:26:41.113393 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1942/3866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:38 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1314 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:41.182133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:41.198755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:41.239519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:41.240271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:41.243402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:41.243945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:41.662134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:41.677549 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55560abd-3b11-42ce-ac5f-f0158d5ce2e2 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1283 microversion: 2.1 time: 0.546731 Jul 25 20:26:41.694692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1943/3867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:41 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1283 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:41.725978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:26:41.727356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:26:41.728023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:26:41.728609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:26:41.729179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:26:41.763109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:41.764101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:41.767497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:41.769680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:41.824765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Getting quotas for project 5991e108646740419e04e1f198788f34. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:41.855978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Getting quotas for user ac0c2e5eba484dfb9dbabaceb9c7b29a and project 5991e108646740419e04e1f198788f34. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:41.910002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:26:41.918025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:26:42.113068 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-04434196-0c0c-4e0c-9d3f-b84ba8016235 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.674163 Jul 25 20:26:42.121824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:42.122446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:42.124799 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1925/3868] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:26:42.145783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:42.150857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:42.173279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:42.177313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:42.197777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:42.200189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:42.373418 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:26:42.373747 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 20:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 (ip 10.222.0.48) !!! Jul 25 20:26:42.708842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:42.720203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:42.722905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:42.728698 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e986273-5a04-47a6-9349-04358479d6b8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1262 microversion: 2.26 time: 0.610888 Jul 25 20:26:42.733522 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1944/3869] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:42 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1262 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:42.748058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:42.750991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:42.783073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:42.789543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:42.797254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:42.800216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:43.289072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:43.319793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7bab555-5b47-4931-ab79-040cecf76fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1500 microversion: 2.1 time: 1.188274 Jul 25 20:26:43.326571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1926/3870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:42 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1500 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:43.366250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:43.367229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:43.382138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:43.388086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:43.389475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:43.390092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:43.435871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'flavor' on Instance uuid 0d934e47-af93-46e3-ab11-8ddfa0d11155 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:26:43.855647 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-029f7b75-b73b-4fef-80a4-9a1cc0b7699a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155/action" status: 202 len: 0 microversion: 2.1 time: 0.502357 Jul 25 20:26:43.858605 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1927/3871] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:26:43 2022] POST /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:26:43.876275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:43.877511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:43.909499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:43.910701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:43.911933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:43.920806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:44.273726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:44.284544 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3633bbe3-693a-43b2-bd23-d191c4c3a7a6 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1325 microversion: 2.1 time: 1.547411 Jul 25 20:26:44.292604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1945/3872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:42 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1325 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:44.298767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:44.300340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:44.311664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:44.317044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:44.319144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:44.321090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:44.390172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:44.412145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:44.415035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:44.417235 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42f18c5c-d612-41ac-a78e-b484c93c102f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1314 microversion: 2.26 time: 0.556496 Jul 25 20:26:44.418043 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1928/3873] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:43 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:45.325516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:45.326509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:45.358812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:45.359537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:45.360572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:45.362752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:45.451099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:45.474756 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc700044-4997-4ab8-a30f-dfed26519b0f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.180127 Jul 25 20:26:45.478069 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1946/3874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:44 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:45.495918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:45.504581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:45.526701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:45.527157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:45.532079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:45.536655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:46.738772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:46.753785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:46.756777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:46.761871 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ae1dc29-e651-4a70-a847-8147172f6977 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1320 microversion: 2.26 time: 1.279760 Jul 25 20:26:46.789849 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1947/3875] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:45 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1320 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:46.815658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3b1ba079-8bd8-414e-8c9f-cd3db7644fde req-aedda303-b342-46b8-b13c-264d03255bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60913648-56aa-4c97-b99b-91f5b2a99ee2", "tag": "df87dfed-739e-4480-ba0f-b27be6c26426"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:46.856923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3b1ba079-8bd8-414e-8c9f-cd3db7644fde req-aedda303-b342-46b8-b13c-264d03255bf3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:46.862362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3b1ba079-8bd8-414e-8c9f-cd3db7644fde req-aedda303-b342-46b8-b13c-264d03255bf3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:46.889117 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3b1ba079-8bd8-414e-8c9f-cd3db7644fde req-aedda303-b342-46b8-b13c-264d03255bf3 service nova] Creating event network-changed:df87dfed-739e-4480-ba0f-b27be6c26426 for instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 on n-h2-845775-3 Jul 25 20:26:46.900633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3b1ba079-8bd8-414e-8c9f-cd3db7644fde req-aedda303-b342-46b8-b13c-264d03255bf3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103092 Jul 25 20:26:46.905310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1948/3876] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:47.522881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:47.544883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95fc51b3-bd7c-401a-9876-05c8bf068352 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1325 microversion: 2.1 time: 2.220141 Jul 25 20:26:47.550183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1929/3877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:45 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1325 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:47.564640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:47.571933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:47.600476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:47.609197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:47.610184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:47.610647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:47.716725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a3abfed-16fb-4f01-8f29-c09464b4c4d3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Action: 'create', calling method: .version_select at 0x7f1968d4e550>, body: {"keypair": {"name": "tempest-keypair-1593282343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcfDKWNNJ+d1dYZokMccsqtB9SIAsKQUYmJM9HOrWGCBRxb9LZ3ciQCDzcGZPzu13C1vvO2Mo0lyJBmfOC62XT4Hhomprvn+1wdHD101NMbRkqGlOTRVVF4Gykxpe/Fog=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:47.757536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4a3abfed-16fb-4f01-8f29-c09464b4c4d3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:47.765471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4a3abfed-16fb-4f01-8f29-c09464b4c4d3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for user fde75be53e6a420b88250fea2d964c01 and project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:47.801453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a3abfed-16fb-4f01-8f29-c09464b4c4d3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.894151 Jul 25 20:26:47.801999 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1949/3878] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:26:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:47.816059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:47.818183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:47.879665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:47.881132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:47.883193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:47.884909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:48.271496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:48.289745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:48.291997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:48.300310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a78b26b-85fa-4b21-bf78-91f0530b58e8 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1320 microversion: 2.26 time: 0.496368 Jul 25 20:26:48.301035 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1950/3879] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:47 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:48.573587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:48.574450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:48.595364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:48.595937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:48.598974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:48.599441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:49.329683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:49.345124 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eae170e0-090d-492b-b170-3507aacedaa7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.791898 Jul 25 20:26:49.353044 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1930/3880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:47 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:49.365893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:49.366528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:49.399462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:49.400246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:49.410899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:49.411565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:50.080471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:50.096922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:50.129450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:50.141370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52f878ff-6633-4e8c-9863-92bb55d0c7de tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1320 microversion: 2.26 time: 0.778592 Jul 25 20:26:50.156127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1931/3881] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:49 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1320 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:50.375328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:50.378661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:50.399732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:50.402217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:50.409665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:50.410362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:51.728768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:51.745578 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36288290-0a29-4b69-af48-9a00faa3c4fc tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1325 microversion: 2.1 time: 3.181073 Jul 25 20:26:51.764069 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1951/3882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:48 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1325 bytes in 3190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:51.764069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:51.764069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:51.788193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:51.791536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:51.794004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:51.794711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:51.794857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:51.885496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:52.111663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:52.155475 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a107aebc-44db-4880-a68f-118ffe0e723f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.763120 Jul 25 20:26:52.160858 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1932/3883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:50 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:26:52.638988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:52.652755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:52.654952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:52.656722 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42e1209c-020a-49ad-9855-536bee55063d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 0.902281 Jul 25 20:26:52.674371 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1952/3884] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:51 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:52.788661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:52.789324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:52.801951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:52.806482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:52.808788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:52.809803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:53.183206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:53.183934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:53.194078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:53.199933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:53.200990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:53.201525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:54.045121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:54.063514 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b761f543-c819-4487-adfc-ea30b1979b7d tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1325 microversion: 2.1 time: 1.279578 Jul 25 20:26:54.065814 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1933/3885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:52 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1325 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:54.078317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-25de9a36-03b4-4957-b341-26366be4b7ef req-c87419fd-94c9-4c82-9aaf-42b33a88eb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60913648-56aa-4c97-b99b-91f5b2a99ee2", "name": "network-vif-plugged", "status": "completed", "tag": "df87dfed-739e-4480-ba0f-b27be6c26426"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:54.087016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:54.087622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:54.097037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cba30673-b9fc-4eb9-b761-639ee2f80a07 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 0.918537 Jul 25 20:26:54.097882 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1953/3886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:53 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:54.099987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25de9a36-03b4-4957-b341-26366be4b7ef req-c87419fd-94c9-4c82-9aaf-42b33a88eb6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:54.100724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25de9a36-03b4-4957-b341-26366be4b7ef req-c87419fd-94c9-4c82-9aaf-42b33a88eb6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:54.102784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:54.103422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:54.116387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-25de9a36-03b4-4957-b341-26366be4b7ef req-c87419fd-94c9-4c82-9aaf-42b33a88eb6b service nova] Creating event network-vif-plugged:df87dfed-739e-4480-ba0f-b27be6c26426 for instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 on n-h2-845775-3 Jul 25 20:26:54.121606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:54.122069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:54.122912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:54.123534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:54.123936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-25de9a36-03b4-4957-b341-26366be4b7ef req-c87419fd-94c9-4c82-9aaf-42b33a88eb6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056753 Jul 25 20:26:54.124623 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1934/3887] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:54.137749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1323004518", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "318d94dd-34c9-4cd8-b1b4-a2018db1e734"}], "security_groups": [{"name": "tempest-securitygroup--2115918244"}], "key_name": "tempest-keypair-1593282343", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:54.734778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] validate_networks() for [('318d94dd-34c9-4cd8-b1b4-a2018db1e734', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:26:54.920866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:54.936442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:54.939338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:54.942210 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7985ff2a-4739-4207-8721-ea07fc2cbe9d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 0.843068 Jul 25 20:26:54.942826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1954/3888] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:54 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:55.087911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:55.088726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:55.104230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:55.104952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:55.106210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:55.106940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:55.915420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:55.937800 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45e1f1dd-2057-4933-a229-6a93f1c26bf4 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1325 microversion: 2.1 time: 0.853423 Jul 25 20:26:55.945398 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1955/3889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:55 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:26:55.985688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:55.988642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:56.021684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:56.025636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:56.027344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:56.032543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:56.034739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:56.711920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:56.725220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5440e29d-df8c-47bb-85d4-4a12f81d2ff4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 0.777978 Jul 25 20:26:56.726885 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1956/3890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:55 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:56.772224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:56.774456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:56.791774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:56.793979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:56.797769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:56.798444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.216949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:57.235912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for user fde75be53e6a420b88250fea2d964c01 and project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:57.281724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:26:57.284576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:26:57.286122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:26:57.287831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:26:57.289231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:26:57.313021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:57.313863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.315744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:57.317057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.363245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:26:57.372324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Getting quotas for user fde75be53e6a420b88250fea2d964c01 and project 8dc2672ee4024e27a6ad866f68e59cd3. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:26:57.391570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:26:57.396668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:26:57.425288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:57.438465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:57.445240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:57.448130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b7521e5-e908-4bf8-aace-344fdf15a434 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 0.696236 Jul 25 20:26:57.452057 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1957/3891] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:56 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:26:57.475218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-624037be-bdb9-4454-b373-9a8b089565ee req-e1db0a76-d689-4eeb-8a3a-62991ade5a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df318ee-25f6-4b11-8b83-118376061ee6", "tag": "b1ccf884-eecd-41a7-8b17-1aaea035eff2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:26:57.501263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-624037be-bdb9-4454-b373-9a8b089565ee req-e1db0a76-d689-4eeb-8a3a-62991ade5a8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:57.504251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-624037be-bdb9-4454-b373-9a8b089565ee req-e1db0a76-d689-4eeb-8a3a-62991ade5a8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.533080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-624037be-bdb9-4454-b373-9a8b089565ee req-e1db0a76-d689-4eeb-8a3a-62991ade5a8e service nova] Creating event network-changed:b1ccf884-eecd-41a7-8b17-1aaea035eff2 for instance 4df318ee-25f6-4b11-8b83-118376061ee6 on n-h1-845775-3 Jul 25 20:26:57.534855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8d37a89-6918-49cf-90ac-91099e4f9041 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.409019 Jul 25 20:26:57.537352 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1935/3892] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:26:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 3412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:26:57.546552 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-624037be-bdb9-4454-b373-9a8b089565ee req-e1db0a76-d689-4eeb-8a3a-62991ade5a8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090462 Jul 25 20:26:57.550072 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1958/3893] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:26:57.561997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:57.563656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:57.567422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c88ac7a-c4ab-4044-9d3a-ad7a2822285b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:57.570634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c88ac7a-c4ab-4044-9d3a-ad7a2822285b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:57.584932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:57.587415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.588657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:57.589999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:57.777697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:26:57.927683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c88ac7a-c4ab-4044-9d3a-ad7a2822285b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:57.943927 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c88ac7a-c4ab-4044-9d3a-ad7a2822285b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1278 microversion: 2.1 time: 0.391542 Jul 25 20:26:57.970666 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1959/3894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:57 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1278 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:57.989372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:57.990944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:58.010004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:58.028658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:58.032245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:58.033258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:59.393753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:59.401764 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-658b5bd1-c307-46c1-a82e-9e49464ee993 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1522 microversion: 2.1 time: 1.862926 Jul 25 20:26:59.403034 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1936/3895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:57 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1522 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:59.408331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:59.409281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:59.430110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:59.430935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:59.431994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:59.432690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:59.764007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:26:59.801035 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2496c2dd-290c-4eab-b8ab-20b74e9c7ad8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.824501 Jul 25 20:26:59.812459 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1960/3896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:57 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:26:59.841175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:26:59.843776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:26:59.856303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:59.857146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:26:59.858434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:26:59.859081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.093450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:00.100852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:00.109047 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a1a8a8fd-1b37-4fd4-88e1-1e9e55103dbc tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1348 microversion: 2.1 time: 0.294558 Jul 25 20:27:00.120247 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1961/3897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:26:59 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1348 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:00.125275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:00.125978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:00.140358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.143229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.144394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.155112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.204071 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] HTTP exception thrown: Instance is not a member of specified network Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Request method failure captured: Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2/ips/invalid HTTP/1.1 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx4ooY43xFv1zAFRUJCwbmxW-Ky0-JChXvlHneCgtjWv0bVaI-rLaI0kCBvUS0RAcWG9QpfOFM9VnE0PrLzY3lo3AyO9xfRldLcS0lmiaMyMgTsseQGXLrpYAqo0cr_euSvUTrK6kIOIZl_abVQTDOfmaWVDBeQkmUAwpvVDBDgEfc Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03f264f37aa748d88cf598bde016e098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03f264f37aa748d88cf598bde016e098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}] Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ef7f975b2d084cc48722a7fceabc0e89 Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance is not a member of specified network Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '60913648-56aa-4c97-b99b-91f5b2a99ee2', 'id': 'invalid'} Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 25 20:27:00.212667 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.230723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:27:00.230723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23e70c77-348c-478f-96e1-c26635dca423 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.093504 Jul 25 20:27:00.230723 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1962/3898] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:27:00 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:27:00.232460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:00.232460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Failed to fetch instance by id 999 {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:27:00.232460 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] HTTP exception thrown: Instance 999 could not be found. Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Request method failure captured: Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx4ooY43xFv1zAFRUJCwbmxW-Ky0-JChXvlHneCgtjWv0bVaI-rLaI0kCBvUS0RAcWG9QpfOFM9VnE0PrLzY3lo3AyO9xfRldLcS0lmiaMyMgTsseQGXLrpYAqo0cr_euSvUTrK6kIOIZl_abVQTDOfmaWVDBeQkmUAwpvVDBDgEfc Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03f264f37aa748d88cf598bde016e098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03f264f37aa748d88cf598bde016e098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}] Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ef7f975b2d084cc48722a7fceabc0e89 Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 999 could not be found. Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '999'} Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 25 20:27:00.234333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:00.257810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:27:00.257810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a55bc094-2acc-46ab-8e23-a21a1ba38fe3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020415 Jul 25 20:27:00.257810 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1963/3899] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Jul 25 20:27:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:27:00.258596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:00.259966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:00.260494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:00.273911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:00.275738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:00.277237 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1bf2cd72-9445-4f45-9c47-a594d382c1cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 0.872866 Jul 25 20:27:00.278009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1937/3900] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:26:59 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:00.286101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.287689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.288784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.289395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.350260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:27:00.525136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7b6f4e8-93bb-49cd-a8b2-721dd286263a tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 204 len: 0 microversion: 2.1 time: 0.268547 Jul 25 20:27:00.526771 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1964/3901] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:27:00 2022] DELETE /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:27:00.536377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:00.537330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:00.545926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.546914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.550254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.552543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.838144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:00.840472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:00.853171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.854141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:00.856237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:00.857393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:01.323882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:01.342840 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-638dac95-d582-4a3c-9309-7eb585a9ad10 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1528 microversion: 2.1 time: 0.811127 Jul 25 20:27:01.349668 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1938/3902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:00 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1528 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:01.356802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:01.358000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:01.369719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:01.370906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:01.372144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:01.372761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:01.594175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:01.607380 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d74f9370-c62a-4d98-a50c-df86eccb866e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1336 microversion: 2.1 time: 0.255685 Jul 25 20:27:01.621219 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1939/3903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:01 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1336 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:01.636437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:01.637719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:01.648173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:01.648965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:01.649990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:01.650598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:01.739127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:01.758885 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6ecbd75-0e32-422b-92c8-fcee0ade7cc8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 0.927148 Jul 25 20:27:01.762897 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1965/3904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:00 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:02.372696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:02.374428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:02.406836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:02.407509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:02.411060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:02.415018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:03.247947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:03.265243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:03.266785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:03.268531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5064f30e-80d6-4e6d-9451-f2e368d8e997 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 1.645165 Jul 25 20:27:03.269120 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1940/3905] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:01 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:03.299558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:03.301177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:03.314543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:03.315301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:03.316581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:03.317201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:03.359108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:03.707311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:03.743140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b933a57d-c911-4454-beb4-4ed5ed9438d3 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1528 microversion: 2.1 time: 1.364466 Jul 25 20:27:03.747370 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1966/3906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:02 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1528 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:03.781922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:03.782817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:03.806207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:03.806667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:03.807481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:03.808113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:04.091745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:04.100624 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d48f2c38-6267-455c-a059-b464ecabbc95 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 0.830390 Jul 25 20:27:04.113264 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1941/3907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:03 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:04.302670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:04.303315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:04.322441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:04.325032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:04.329982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:04.330892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:04.810132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:04.833017 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-78935192-3bc1-4098-836d-819e9b9a9b6c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.081652 Jul 25 20:27:04.833826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1967/3908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:03 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:04.852636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c6f26de0-31c9-40a5-8410-f437d1f6de42 req-48623dff-ed5b-40aa-8185-c19985d2a1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60913648-56aa-4c97-b99b-91f5b2a99ee2", "name": "network-vif-deleted", "tag": "df87dfed-739e-4480-ba0f-b27be6c26426"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:04.872401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c6f26de0-31c9-40a5-8410-f437d1f6de42 req-48623dff-ed5b-40aa-8185-c19985d2a1ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:04.874158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c6f26de0-31c9-40a5-8410-f437d1f6de42 req-48623dff-ed5b-40aa-8185-c19985d2a1ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:04.908539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c6f26de0-31c9-40a5-8410-f437d1f6de42 req-48623dff-ed5b-40aa-8185-c19985d2a1ad service nova] Creating event network-vif-deleted:df87dfed-739e-4480-ba0f-b27be6c26426 for instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 on n-h2-845775-3 Jul 25 20:27:04.923924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c6f26de0-31c9-40a5-8410-f437d1f6de42 req-48623dff-ed5b-40aa-8185-c19985d2a1ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088746 Jul 25 20:27:04.937614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1968/3909] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:04.945805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:04.946773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:04.971332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:04.972689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:04.973786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:04.974483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:05.138657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:05.139888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:05.140858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lazy-loading 'fault' on Instance uuid 60913648-56aa-4c97-b99b-91f5b2a99ee2 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:05.546612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7f975b2d084cc48722a7fceabc0e89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03f264f37aa748d88cf598bde016e098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:05.562088 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ecf5c92-6b73-4511-b949-13c017273107 tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 200 len: 1315 microversion: 2.1 time: 0.621036 Jul 25 20:27:05.563053 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1969/3910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:04 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:05.571961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:05.583284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:05.584979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:05.607796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:05.609647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:05.613574 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8cfc96e-c09b-4740-b608-fd32a3e65ed4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 1.316194 Jul 25 20:27:05.619228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:05.620253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:05.622060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:05.623742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:05.634965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1942/3911] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:04 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:05.866282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:05.867185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:05.878581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:05.884911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:05.886162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:05.886716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:06.401435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:06.412456 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c202d08-2f1b-47d3-bad1-2c5363ce7bbb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 0.847761 Jul 25 20:27:06.419669 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1970/3912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:05 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:06.588532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:06.589156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] [instance: 60913648-56aa-4c97-b99b-91f5b2a99ee2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:06.601247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:06.603159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:06.605086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:06.608573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:06.641956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] HTTP exception thrown: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Request method failure captured: Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 HTTP/1.1 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx4ooY43xFv1zAFRUJCwbmxW-Ky0-JChXvlHneCgtjWv0bVaI-rLaI0kCBvUS0RAcWG9QpfOFM9VnE0PrLzY3lo3AyO9xfRldLcS0lmiaMyMgTsseQGXLrpYAqo0cr_euSvUTrK6kIOIZl_abVQTDOfmaWVDBeQkmUAwpvVDBDgEfc Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03f264f37aa748d88cf598bde016e098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03f264f37aa748d88cf598bde016e098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03f264f37aa748d88cf598bde016e098"}]}] Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 03f264f37aa748d88cf598bde016e098 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1187206338 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ef7f975b2d084cc48722a7fceabc0e89 Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1187206338-project Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '60913648-56aa-4c97-b99b-91f5b2a99ee2'} Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:06.645392 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. Jul 25 20:27:06.649098 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:06.651313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] Returning 404 to user: Instance 60913648-56aa-4c97-b99b-91f5b2a99ee2 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:27:06.652864 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-737b9cac-72ba-408a-bb47-412756b1e1ba tempest-ServerAddressesNegativeTestJSON-1187206338 tempest-ServerAddressesNegativeTestJSON-1187206338-project] 10.222.0.48 "GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2" status: 404 len: 111 microversion: 2.1 time: 0.068114 Jul 25 20:27:06.657348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1971/3913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:06 2022] GET /compute/v2.1/servers/60913648-56aa-4c97-b99b-91f5b2a99ee2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:27:06.666014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:06.672104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:06.683424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:06.686230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:06.687578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:06.689463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:06.874201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:06.917596 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-577ad09f-0992-4e95-891c-9f1f01cde78a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.055059 Jul 25 20:27:06.918700 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1943/3914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:05 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:07.077524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1e1edc93-39ac-4d4e-8e1e-fc31b1f82c44 req-50c2b39b-1d3f-4658-a4d7-fd207e06b091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c52389d-4587-455c-aa1d-71f5f9ffbf25", "tag": "3e66f18d-3dff-4a55-a908-11792000ba26"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:07.094488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e1edc93-39ac-4d4e-8e1e-fc31b1f82c44 req-50c2b39b-1d3f-4658-a4d7-fd207e06b091 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:07.096853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e1edc93-39ac-4d4e-8e1e-fc31b1f82c44 req-50c2b39b-1d3f-4658-a4d7-fd207e06b091 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:07.122487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1e1edc93-39ac-4d4e-8e1e-fc31b1f82c44 req-50c2b39b-1d3f-4658-a4d7-fd207e06b091 service nova] Creating event network-changed:3e66f18d-3dff-4a55-a908-11792000ba26 for instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 on n-h2-845775-3 Jul 25 20:27:07.138795 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1e1edc93-39ac-4d4e-8e1e-fc31b1f82c44 req-50c2b39b-1d3f-4658-a4d7-fd207e06b091 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067893 Jul 25 20:27:07.144097 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1944/3915] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:27:07.435155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:07.436107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:07.438361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:07.440291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:07.457541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:07.458015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:07.458829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:07.459278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:07.489403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:07.508525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:07.514032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:07.540280 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b89e4356-7714-4c0b-aa83-9ba04fa3f2be tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 0.854278 Jul 25 20:27:07.542364 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1972/3916] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:06 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:07.814340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4278f77-52b2-4981-ad1f-73b28dd5e99a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Action: 'create', calling method: .version_select at 0x7f1969747ee0>, body: {"keypair": {"name": "tempest-keypair-1288219307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxuYtoCaE3ml71U8WHO66K+zec/3vnuTakkXxWREVLFWrwnqmUay4IMC0HEmUgd5cbDwn9Jo5JsOEIuZlQSp+7FMFgCUxLL2gb+35ykXie8J39Y0SeitCg3hP0h86MTGA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:07.853818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e4278f77-52b2-4981-ad1f-73b28dd5e99a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Getting quotas for project 67d5b9b740654b6d92134d8af8fe1d77. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:07.866410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e4278f77-52b2-4981-ad1f-73b28dd5e99a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Getting quotas for user e104948396b14054aa1c4b28015fa296 and project 67d5b9b740654b6d92134d8af8fe1d77. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:07.916547 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e4278f77-52b2-4981-ad1f-73b28dd5e99a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.111290 Jul 25 20:27:07.927266 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1973/3917] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:27:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:27:07.977637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:07.984330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:08.002473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:08.005869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:08.007173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:08.007749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:08.113986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:08.121778 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb8dfd63-12e6-43f9-bd64-1dce53953e04 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 0.690886 Jul 25 20:27:08.132548 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1945/3918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:07 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:08.469384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:08.485876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-394b784c-a4a2-4982-9b10-0300f329eee7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 0.528635 Jul 25 20:27:08.487382 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1974/3919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:07 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:08.569492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:08.570325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:08.586098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:08.587713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:08.590248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:08.591346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:08.989716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6eb79b7a-b093-4e7f-87e0-305698b7e59a req-09a7825a-ab5a-46fa-a55e-04a2ed755be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df318ee-25f6-4b11-8b83-118376061ee6", "name": "network-vif-plugged", "status": "completed", "tag": "b1ccf884-eecd-41a7-8b17-1aaea035eff2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:09.020676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6eb79b7a-b093-4e7f-87e0-305698b7e59a req-09a7825a-ab5a-46fa-a55e-04a2ed755be5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:09.021245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6eb79b7a-b093-4e7f-87e0-305698b7e59a req-09a7825a-ab5a-46fa-a55e-04a2ed755be5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:09.055918 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6eb79b7a-b093-4e7f-87e0-305698b7e59a req-09a7825a-ab5a-46fa-a55e-04a2ed755be5 service nova] Creating event network-vif-plugged:b1ccf884-eecd-41a7-8b17-1aaea035eff2 for instance 4df318ee-25f6-4b11-8b83-118376061ee6 on n-h1-845775-3 Jul 25 20:27:09.078931 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6eb79b7a-b093-4e7f-87e0-305698b7e59a req-09a7825a-ab5a-46fa-a55e-04a2ed755be5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083740 Jul 25 20:27:09.080368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1975/3920] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:27:09.149786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:09.150920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:09.169005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:09.169914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:09.170789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:09.171337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:10.134181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:10.147505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:10.151466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:10.153101 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79cb3299-4988-4427-abd0-c1cb40bd163d tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 1.588289 Jul 25 20:27:10.154557 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1946/3921] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:08 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:10.190611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:10.192015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:10.207204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:10.208940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:10.210127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:10.210903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:10.475738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:10.494261 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69c52439-f638-4c88-9402-4fd4642e5fff tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 1.349264 Jul 25 20:27:10.519668 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1976/3922] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:09 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:10.761553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:10.773992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-751b7331-37c4-4f89-82ca-73a96b167fb8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 0.618054 Jul 25 20:27:10.775309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1947/3923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:10 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:11.183527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:11.184193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:11.199565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:11.200011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:11.202573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:11.204292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:11.527589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:11.528536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:11.542205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:11.542669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:11.543466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:11.543910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:12.235043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:12.259430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:12.266452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:12.269802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a11ff30d-2b03-4b40-8cee-7be6dc7c035f tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1362 microversion: 2.26 time: 1.090798 Jul 25 20:27:12.272105 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1977/3924] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:11 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1362 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:12.288961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:12.289591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:12.306248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:12.306780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:12.307619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:12.309871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:12.322224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:12.338554 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb4f86eb-6357-4b7f-b60e-f6b77b9d9315 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 0.815058 Jul 25 20:27:12.346766 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1948/3925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:11 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:12.624819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df2ba9fc-f8a3-4723-b05b-83bb30da3d0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: .version_select at 0x7f196ea5f670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1402654246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5IkFPeLGzzOXun3gkjuiMKh5loGU60BxHlnD3RB2TSnZYzFWs8O5/xtYLASwj7ZTKSgQQz4s3eHn1jpogZv1vs06BztBmx2hbxFKS5zGzw9K3bgVpBLXXzRL+oinaU8A=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:12.682965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df2ba9fc-f8a3-4723-b05b-83bb30da3d0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:12.702206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-df2ba9fc-f8a3-4723-b05b-83bb30da3d0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:12.760178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df2ba9fc-f8a3-4723-b05b-83bb30da3d0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.141428 Jul 25 20:27:12.763480 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1949/3926] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:27:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:27:13.297459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:13.299707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:13.318384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:13.318865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:13.319974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:13.320804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:13.385248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:13.412633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba89d342-bb4f-4f9e-ae5c-658d7c8cf4f9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1506 microversion: 2.1 time: 1.134387 Jul 25 20:27:13.413601 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1978/3927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:12 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1506 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:13.435279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:13.440280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:13.458657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:13.459380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:13.462708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:13.466042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:14.234899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:14.246636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:14.257105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:14.258431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08ebadf3-24ef-43cb-a138-39e8af804cd5 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1546 microversion: 2.26 time: 0.967496 Jul 25 20:27:14.259058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1950/3928] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:13 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1546 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:14.269842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1620719615", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b8c5636f-5188-4145-9ed1-082b31f46664"}, {"port": "43d2f154-a52c-47d9-b293-2b81ea768df3", "tag": "port-1"}, {"port": "ad66e97f-8a60-4ffa-9527-ea585ecd0e5b", "tag": "port-2"}, {"uuid": "cae61c56-433c-4594-8c57-49c6e21ca0fc", "tag": "net-1"}, {"uuid": "cae61c56-433c-4594-8c57-49c6e21ca0fc"}, {"uuid": "fe37da62-6e3b-42df-a837-9c3c85643b9f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "fe37da62-6e3b-42df-a837-9c3c85643b9f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "56cc3e91-995e-47a2-a560-99ce479c8f76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3b871bef-e6cf-4af6-bdc7-a99507801cd0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "60417161-4d42-4664-a1a9-15e4f747288b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--18012286"}], "key_name": "tempest-keypair-1288219307", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:14.688791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] validate_networks() for [('b8c5636f-5188-4145-9ed1-082b31f46664', None, None, None, None, None), (None, None, '43d2f154-a52c-47d9-b293-2b81ea768df3', None, None, None), (None, None, 'ad66e97f-8a60-4ffa-9527-ea585ecd0e5b', None, None, None), ('cae61c56-433c-4594-8c57-49c6e21ca0fc', None, None, None, None, None), ('cae61c56-433c-4594-8c57-49c6e21ca0fc', None, None, None, None, None), ('fe37da62-6e3b-42df-a837-9c3c85643b9f', '10.2.2.100', None, None, None, None), ('fe37da62-6e3b-42df-a837-9c3c85643b9f', '10.2.2.200', None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:27:15.440028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:15.464483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-602545d0-b311-4ee9-a127-c3d2077d9ec3 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 2.035375 Jul 25 20:27:15.466070 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1979/3929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:13 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:15.491195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c8c9d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:15.509591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.510361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.511606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:15.520961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.521983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.523432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.524079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.565742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.566354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.599201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:15.602217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.603595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.665675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:15.705429 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-65c67dd8-24c6-44f9-b5a1-5c1aa1942942 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-727399807" status: 201 len: 0 microversion: 2.26 time: 0.236991 Jul 25 20:27:15.709180 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1980/3930] 10.222.0.48 () {62 vars in 1377 bytes} [Mon Jul 25 20:27:15 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-727399807 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 20:27:15.718192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:15.722279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:15.732339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.736706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:15.739202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:15.744687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:16.449771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:16.464542 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e907f6b7-f9e6-480d-8cae-1435a89eee20 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1527 microversion: 2.1 time: 0.752023 Jul 25 20:27:16.476529 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1981/3931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:15 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1527 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:16.502651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34b4a432-a209-4701-bf87-0ea67514506c tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c7c3a0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:16.520588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b4a432-a209-4701-bf87-0ea67514506c tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:16.521053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b4a432-a209-4701-bf87-0ea67514506c tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:16.556812 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34b4a432-a209-4701-bf87-0ea67514506c tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-727399807" status: 204 len: 0 microversion: 2.26 time: 0.078471 Jul 25 20:27:16.557761 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1982/3932] 10.222.0.48 () {60 vars in 1358 bytes} [Mon Jul 25 20:27:16 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-727399807 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:16.567727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:16.570057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:16.585841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:16.586306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:16.587096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:16.587537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.228602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:17.245484 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19b7966b-92da-4e24-bd8c-c2863de9a082 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 0.686103 Jul 25 20:27:17.247039 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1983/3933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:16 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:17.265358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1969799dc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:17.286449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.287191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.287874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:17.295791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.296700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.297779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.298578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.379499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.380204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.414154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:17.451128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1923ee8f-579b-498c-99fc-896d6213cbfd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 204 len: 0 microversion: 2.26 time: 0.201974 Jul 25 20:27:17.453616 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1984/3934] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Jul 25 20:27:17 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:17.474657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f95070d3-cac6-4f49-b4be-85cc56c25321 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f196991f1f0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:17.499073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f95070d3-cac6-4f49-b4be-85cc56c25321 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.500583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f95070d3-cac6-4f49-b4be-85cc56c25321 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.555701 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f95070d3-cac6-4f49-b4be-85cc56c25321 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 12 microversion: 2.26 time: 0.094552 Jul 25 20:27:17.557858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1985/3935] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Jul 25 20:27:17 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 12 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:17.589523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:17.591696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:17.605280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.607680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.608999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:17.610139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:17.881789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:18.207599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:18.230825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd741b9b-f7c8-4210-a36c-5f1d0684723e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.670290 Jul 25 20:27:18.234034 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1986/3936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:17 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:18.271673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f196991f670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:18.303510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.306212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.309061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:18.324875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.326470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.327931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.332781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.427484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.429128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.448151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.449403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.502851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:18.531026 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62975294-363c-4214-b41a-e73f9cced0c9 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-734093944" status: 201 len: 0 microversion: 2.26 time: 0.295392 Jul 25 20:27:18.538696 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1987/3937] 10.222.0.48 () {62 vars in 1377 bytes} [Mon Jul 25 20:27:18 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-734093944 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 20:27:18.544554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4f97ed64-b011-4088-9222-61876c19518c req-3a52699b-9f8d-4074-8884-18d1996543a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c52389d-4587-455c-aa1d-71f5f9ffbf25", "name": "network-vif-plugged", "status": "completed", "tag": "3e66f18d-3dff-4a55-a908-11792000ba26"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:18.561103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f97ed64-b011-4088-9222-61876c19518c req-3a52699b-9f8d-4074-8884-18d1996543a7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.564283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f97ed64-b011-4088-9222-61876c19518c req-3a52699b-9f8d-4074-8884-18d1996543a7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.595410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4f97ed64-b011-4088-9222-61876c19518c req-3a52699b-9f8d-4074-8884-18d1996543a7 service nova] Creating event network-vif-plugged:3e66f18d-3dff-4a55-a908-11792000ba26 for instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 on n-h2-845775-3 Jul 25 20:27:18.605726 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4f97ed64-b011-4088-9222-61876c19518c req-3a52699b-9f8d-4074-8884-18d1996543a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064370 Jul 25 20:27:18.607690 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1988/3938] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:18.645571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:18.647539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:18.676645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.677446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:18.678477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:18.678925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:20.617825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:20.648907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-157c650a-2b33-4b23-91a3-11d4a5941ba7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1404 microversion: 2.1 time: 2.037230 Jul 25 20:27:20.681062 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1989/3939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:18 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1404 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:20.707032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3047fa31-f734-49c9-b2e1-3c3bef6deb78 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c55670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:20.739353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3047fa31-f734-49c9-b2e1-3c3bef6deb78 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:20.741891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3047fa31-f734-49c9-b2e1-3c3bef6deb78 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:20.766906 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3047fa31-f734-49c9-b2e1-3c3bef6deb78 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 35 microversion: 2.26 time: 0.081613 Jul 25 20:27:20.769658 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1990/3940] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Jul 25 20:27:20 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 35 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:20.787422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:20.788089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:20.812441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:20.813249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:20.814149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:20.816393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:21.462667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:21.477925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cfa637ab-2fb9-4189-900c-c26e12abcbc4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.704047 Jul 25 20:27:21.493694 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1991/3941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:20 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:21.520212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c1a670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:21.542187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:21.543379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:21.544123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:21.555618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:21.556304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:21.557297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:21.558146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:21.620845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:21.621761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:21.694753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:21.737465 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-40fa4832-8918-4222-a30d-84d0e13d1fcf tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-734093944" status: 204 len: 0 microversion: 2.26 time: 0.238795 Jul 25 20:27:21.738299 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1992/3942] 10.222.0.48 () {60 vars in 1361 bytes} [Mon Jul 25 20:27:21 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-734093944 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:21.750549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1699524378", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "4432e185-1495-45da-8e59-6c04ec9734a1"}], "key_name": "tempest-TestNetworkBasicOps-1402654246", "security_groups": [{"name": "tempest-secgroup-smoke-2121757417"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:21.775941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:22.334785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] validate_networks() for [('4432e185-1495-45da-8e59-6c04ec9734a1', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:27:22.731105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:24.240974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=47 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:24.290297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:27:24.290702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:27:24.291430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:27:24.291871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:27:24.292520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:27:24.330088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:24.330606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:24.335628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:24.336331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:24.415791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:24.436621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:24.478296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:27:24.482066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:27:24.621751 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-03e2c56c-723f-4c2b-a7c3-244c2b845a0c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.879013 Jul 25 20:27:24.624079 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1993/3943] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:27:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:27:24.640719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:24.641739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:24.663941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:24.664576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:24.665379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:24.665817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:25.182057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:25.194668 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c85e1cfb-c99e-49b4-b1e4-77bf5f0662bb tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1590 microversion: 2.1 time: 0.569221 Jul 25 20:27:25.195371 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1994/3944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:24 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1590 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:25.208937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5313b3c-b493-4776-9825-33662f20435a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f19695829d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:25.235167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5313b3c-b493-4776-9825-33662f20435a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:25.235635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5313b3c-b493-4776-9825-33662f20435a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:25.257391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:25.259433 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5313b3c-b493-4776-9825-33662f20435a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 12 microversion: 2.26 time: 0.062802 Jul 25 20:27:25.275233 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1995/3945] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Jul 25 20:27:25 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 12 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:25.281697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:25.282616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:25.309801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:25.312840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:25.313997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:25.321003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.108151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:27:26.108813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:27:26.109183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:27:26.109624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:27:26.110264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:27:26.129080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:26.189033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.192987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.194069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.194616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.251656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:26.254948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Getting quotas for project 67d5b9b740654b6d92134d8af8fe1d77. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:26.264940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Getting quotas for user e104948396b14054aa1c4b28015fa296 and project 67d5b9b740654b6d92134d8af8fe1d77. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:26.274374 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05ac6ad5-02a1-4c28-90e7-839922703a52 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.997250 Jul 25 20:27:26.294606 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1996/3946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:25 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:26.327280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a102a581-b094-4c93-aaf3-9acd61cbe275 req-8ac95c47-ee1c-4a09-86ff-fac65dd587c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d934e47-af93-46e3-ab11-8ddfa0d11155", "name": "network-vif-plugged", "status": "completed", "tag": "d4240364-2825-448a-90c4-3cbbb3cdbb17"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:26.380984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a102a581-b094-4c93-aaf3-9acd61cbe275 req-8ac95c47-ee1c-4a09-86ff-fac65dd587c0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.383523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a102a581-b094-4c93-aaf3-9acd61cbe275 req-8ac95c47-ee1c-4a09-86ff-fac65dd587c0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.476344 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a102a581-b094-4c93-aaf3-9acd61cbe275 req-8ac95c47-ee1c-4a09-86ff-fac65dd587c0 service nova] Creating event network-vif-plugged:d4240364-2825-448a-90c4-3cbbb3cdbb17 for instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 on n-h1-845775-3 Jul 25 20:27:26.486952 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a102a581-b094-4c93-aaf3-9acd61cbe275 req-8ac95c47-ee1c-4a09-86ff-fac65dd587c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187188 Jul 25 20:27:26.491023 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1997/3947] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:26.502642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:26.505965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:26.518888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.519764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.520831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.521787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.666417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:26.678190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:27:26.680299 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cae4806d-864f-4f26-a1a5-38811ef191b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1301 microversion: 2.1 time: 0.186956 Jul 25 20:27:26.681498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1998/3948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:26 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1301 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:26.688183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:26.689060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:26.692811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='56cc3e91-995e-47a2-a560-99ce479c8f76',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3b871bef-e6cf-4af6-bdc7-a99507801cd0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60417161-4d42-4664-a1a9-15e4f747288b',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:27:26.701942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.702437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.703232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.703842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.854917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4472830-aceb-4626-b46e-e9cc9cd2ccc7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171488 Jul 25 20:27:26.863080 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 1999/3949] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:27:26 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:26.865208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968cd9280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:26.886495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.887197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.887793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:26.905396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.906702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.910739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.912009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:26.959519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:26.960423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.012274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:27.058853 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1677f5d0-ae3f-42c6-a799-392830f6c998 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 204 len: 0 microversion: 2.26 time: 0.198075 Jul 25 20:27:27.060163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2000/3950] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Jul 25 20:27:26 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:27.073408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c1ae50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.085050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.085839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.086530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:27.094684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.095180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.096838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.097296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.130844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.131308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.149468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.150480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.187306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:27.205730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5e83ed4-506e-468c-b595-c8d33adb4149 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-675849337" status: 201 len: 0 microversion: 2.26 time: 0.138822 Jul 25 20:27:27.206715 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2001/3951] 10.222.0.48 () {62 vars in 1377 bytes} [Mon Jul 25 20:27:27 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-675849337 => generated 0 bytes in 142 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 25 20:27:27.221853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968c55700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.235927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.236681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.237252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:27.244353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.244723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.245350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.245843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.285152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.285638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.298814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.299486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.349285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:27.381501 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72094925-20b3-4e05-b24f-bb136c6227b4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-1200018956" status: 201 len: 0 microversion: 2.26 time: 0.165634 Jul 25 20:27:27.383545 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2002/3952] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Jul 25 20:27:27 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-1200018956 => generated 0 bytes in 168 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 20:27:27.389405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.390639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:27.398804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.399653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.400954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.401609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.585845 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b0cf37b-e978-435c-b0d3-51cbd0d07aa4 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 13.319852 Jul 25 20:27:27.587364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1951/3953] 10.222.0.48 () {62 vars in 1189 bytes} [Mon Jul 25 20:27:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 13323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:27:27.609988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f19698beca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.621247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.622953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.624153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:27.641077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.644720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.646894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.648004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.688878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:27.690370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:27.733613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:27.773796 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cd0c1181-39f8-468d-8a1d-58fb225c5c48 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 204 len: 0 microversion: 2.26 time: 0.169151 Jul 25 20:27:27.776950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1952/3954] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Jul 25 20:27:27 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:27.787142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.788282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:27.946651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:27.960205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:27.963856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:27.968257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b59515b6-e4d1-445b-8b22-48805e4bb130 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1286 microversion: 2.32 time: 0.187674 Jul 25 20:27:27.972373 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1953/3955] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:27 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:27.986705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:27.990563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.010528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.011503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.013814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.015692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.021090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:28.031938 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b98f278d-208f-4b2d-a282-eaaa21d74096 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.647045 Jul 25 20:27:28.040921 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2003/3956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:27 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:28.046257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-833553fb-64d9-45a4-8767-e521ee804060 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1969747e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.075617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-833553fb-64d9-45a4-8767-e521ee804060 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.076660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-833553fb-64d9-45a4-8767-e521ee804060 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.106755 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-833553fb-64d9-45a4-8767-e521ee804060 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 12 microversion: 2.26 time: 0.064012 Jul 25 20:27:28.115822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2004/3957] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Jul 25 20:27:28 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:28.136121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968d4e310>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.144185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.144641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.145125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.151495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.151957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.152796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.153242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.184494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.184946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.212508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:28.244467 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0574730e-c807-413b-b397-db83f26c3b02 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 204 len: 0 microversion: 2.26 time: 0.120563 Jul 25 20:27:28.245502 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2005/3958] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Jul 25 20:27:28 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:28.258751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1969aa9940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.273632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.274425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.275168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.286738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.287395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.288789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.289672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.338049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.338878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.353353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.354885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.397846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:28.420076 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33c0a7ed-66bb-4c09-b6cb-2c392748efc4 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-1370495084" status: 201 len: 0 microversion: 2.26 time: 0.166902 Jul 25 20:27:28.428521 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2006/3959] 10.222.0.48 () {62 vars in 1380 bytes} [Mon Jul 25 20:27:28 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-1370495084 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 25 20:27:28.436302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f1968d4e040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.455863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.456462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.457539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.464673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.465126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.465978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.466401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.501039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:28.510388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.510846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.522312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.522761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.544490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:28.552204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:28.553054 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a85787ea-6bb7-46a9-9b4f-224aa93b898b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1307 microversion: 2.1 time: 0.577954 Jul 25 20:27:28.556404 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1954/3960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:27 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1307 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:28.608797 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5edd908-5677-4a1b-a7b7-9d20fafc7051 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-440743336" status: 201 len: 0 microversion: 2.26 time: 0.178477 Jul 25 20:27:28.617966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2007/3961] 10.222.0.48 () {62 vars in 1377 bytes} [Mon Jul 25 20:27:28 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags/tempest-tag-440743336 => generated 0 bytes in 189 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 25 20:27:28.620905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Action: 'update_all', calling method: .version_select at 0x7f1969a708b0>, body: {"tags": ["tempest-tag-1089350029", "tempest-tag-202792176"]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:28.662395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.663527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.664907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.690358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.693380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.695966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.697336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.745093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.745748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.798011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:28.821425 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83051c31-2369-440b-889b-582c0fbac7e1 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 61 microversion: 2.26 time: 0.205359 Jul 25 20:27:28.823526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1955/3962] 10.222.0.48 () {62 vars in 1312 bytes} [Mon Jul 25 20:27:28 2022] PUT /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 61 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:28.834454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49882712-c376-4e30-8c83-d90dea2923cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f196eae4940>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.846886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49882712-c376-4e30-8c83-d90dea2923cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.856609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49882712-c376-4e30-8c83-d90dea2923cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.892271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49882712-c376-4e30-8c83-d90dea2923cd tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 200 len: 61 microversion: 2.26 time: 0.063857 Jul 25 20:27:28.896560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2008/3963] 10.222.0.48 () {60 vars in 1292 bytes} [Mon Jul 25 20:27:28 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:28.909020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '.version_select at 0x7f196a11c670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.935590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.941449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.944568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:28.975007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.976522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.978371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:28.981777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:28.998925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:28.999643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:29.054083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.054696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.101980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'flavor' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:29.128319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e07fd406-23d7-4851-8a34-6d9527f58808 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags" status: 204 len: 0 microversion: 2.26 time: 0.225438 Jul 25 20:27:29.129377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1956/3964] 10.222.0.48 () {60 vars in 1295 bytes} [Mon Jul 25 20:27:28 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6/tags => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 20:27:29.139070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:29.141288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:29.156272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.156855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.157956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.159527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.183128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:29.192400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:29.193904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:29.203429 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88dd67c3-aa96-42f7-bb54-32f0f393e9b8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1286 microversion: 2.32 time: 0.202734 Jul 25 20:27:29.204291 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2009/3965] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:28 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:29.238444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:29.241962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:29.271522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.271985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.272997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.273247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.355348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:27:29.513196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:29.530790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-692d97d6-44b3-4ade-a655-76e5c2687c95 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.398370 Jul 25 20:27:29.532178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1957/3966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:29 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:29.542666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:29.543297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:29.556583 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6bf31140-0edf-4ffe-b04c-f29e584b872a tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 204 len: 0 microversion: 2.26 time: 0.351116 Jul 25 20:27:29.557325 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2010/3967] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:27:29 2022] DELETE /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:27:29.558999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.559636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.560520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.561046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.568968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d2a9e0e6-fc42-44bb-a806-10f14338fbd8 req-1c7ab817-3749-46df-a96a-4dfeb09fe671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c52389d-4587-455c-aa1d-71f5f9ffbf25", "tag": "3e66f18d-3dff-4a55-a908-11792000ba26"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:29.588816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d2a9e0e6-fc42-44bb-a806-10f14338fbd8 req-1c7ab817-3749-46df-a96a-4dfeb09fe671 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.589130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d2a9e0e6-fc42-44bb-a806-10f14338fbd8 req-1c7ab817-3749-46df-a96a-4dfeb09fe671 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.638073 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d2a9e0e6-fc42-44bb-a806-10f14338fbd8 req-1c7ab817-3749-46df-a96a-4dfeb09fe671 service nova] Creating event network-changed:3e66f18d-3dff-4a55-a908-11792000ba26 for instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 on n-h2-845775-3 Jul 25 20:27:29.646933 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d2a9e0e6-fc42-44bb-a806-10f14338fbd8 req-1c7ab817-3749-46df-a96a-4dfeb09fe671 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085246 Jul 25 20:27:29.648422 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2011/3968] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:29.678178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:29.683437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:29.692891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.693696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:29.694838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:29.695720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.010078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.028176 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e12f709e-4a1b-409c-9337-dcd93c17366e tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1590 microversion: 2.1 time: 0.492566 Jul 25 20:27:30.030805 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1958/3969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:29 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1590 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:30.042799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:30.047261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.059120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.059959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:30.063309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.068367 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-373c1b40-d1be-4b64-9408-d7fd8eaa1171 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1552 microversion: 2.26 time: 0.416818 Jul 25 20:27:30.071162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2012/3970] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:29 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1552 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:30.072789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.073359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.075396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.076562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.179096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.190242 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e21e846-de37-42c7-88c4-1e18e175c3de tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1307 microversion: 2.1 time: 0.155940 Jul 25 20:27:30.192560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1959/3971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:30 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:30.231611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:30.232536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:30.247521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.248406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.249882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.252214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.358705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.368375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.370433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.371890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6cfd2a7e-12a1-4160-8bb1-922641882dcd tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1528 microversion: 2.32 time: 0.144630 Jul 25 20:27:30.372816 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2013/3972] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:30 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1528 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:30.562329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:30.563817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:30.580638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.586884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.589482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:30.589945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:30.962661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:30.975488 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d8b3f4f-352e-4bae-9295-5d05c949175e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.418731 Jul 25 20:27:30.976432 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1960/3973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:30 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:31.103471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:31.104533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:31.129638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.133702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:31.135106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.146310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:31.228858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:31.238449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:31.257734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.264960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:31.266552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.267592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:31.435416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:31.459129 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ed62ad6-a6db-475f-8b5c-e78f716d53b5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1307 microversion: 2.1 time: 0.240322 Jul 25 20:27:31.463109 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1961/3974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:31 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:31.485882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:31.487082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:31.508468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.508468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:31.513788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:31.514641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:32.056890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.073943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.077750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.081955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d780a811-1b21-499e-b1dd-eee1f8177e3a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1576 microversion: 2.32 time: 0.605005 Jul 25 20:27:32.085804 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1962/3975] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:31 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1576 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:32.096451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:32.099120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:32.115764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:32.123129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:32.124533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:32.125536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:32.173680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.209004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.211752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.240080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f906746-70dd-42f5-ab7e-5b603c20a776 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1552 microversion: 2.26 time: 1.143942 Jul 25 20:27:32.260675 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2014/3976] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:31 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1552 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:32.486919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:32.491655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:32.492362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:32.501359 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc2458a5-8c8a-4954-a34a-668f169850c5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.414265 Jul 25 20:27:32.507634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:32.508132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:32.508933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:32.509383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:32.520475 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1963/3977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:32 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:32.970779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.020062 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d85d2087-95d4-4a39-9e01-324d5713c178 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 0.532244 Jul 25 20:27:33.055562 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2015/3978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:32 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:33.079691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c35d83a9-1316-46cc-a176-2d240a13b835 req-e0f2f111-bd94-44dc-bdde-63317ee3fbbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df318ee-25f6-4b11-8b83-118376061ee6", "name": "network-vif-deleted", "tag": "b1ccf884-eecd-41a7-8b17-1aaea035eff2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:33.099444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c35d83a9-1316-46cc-a176-2d240a13b835 req-e0f2f111-bd94-44dc-bdde-63317ee3fbbe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.100193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c35d83a9-1316-46cc-a176-2d240a13b835 req-e0f2f111-bd94-44dc-bdde-63317ee3fbbe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.111770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:33.112441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:33.115131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c35d83a9-1316-46cc-a176-2d240a13b835 req-e0f2f111-bd94-44dc-bdde-63317ee3fbbe service nova] Creating event network-vif-deleted:b1ccf884-eecd-41a7-8b17-1aaea035eff2 for instance 4df318ee-25f6-4b11-8b83-118376061ee6 on n-h1-845775-3 Jul 25 20:27:33.127717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c35d83a9-1316-46cc-a176-2d240a13b835 req-e0f2f111-bd94-44dc-bdde-63317ee3fbbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051628 Jul 25 20:27:33.131902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.133199 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1964/3979] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:33.133885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.135271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.135880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.285644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:33.286636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:33.302699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.309483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.310228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.311418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.312028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.317194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.320219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.322567 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94e2fa69-8cb6-4ae0-9002-0ae83c0e7696 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1594 microversion: 2.32 time: 0.214936 Jul 25 20:27:33.323639 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2016/3980] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:33 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1594 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:33.390394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.391807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.396753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lazy-loading 'fault' on Instance uuid 4df318ee-25f6-4b11-8b83-118376061ee6 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:27:33.473635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.488206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.490834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac0c2e5eba484dfb9dbabaceb9c7b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5991e108646740419e04e1f198788f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.492505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2149662c-aeee-4133-b496-4c37e82b5156 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 200 len: 1352 microversion: 2.26 time: 0.212853 Jul 25 20:27:33.505086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1965/3981] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:33 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 1352 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:33.524877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:33.526073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:33.545439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.546238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.557251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:33.557732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:33.862775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:33.873865 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-757dce16-0fe4-4901-9a15-744f65357d9c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.354501 Jul 25 20:27:33.877841 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2017/3982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:33 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:34.055769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:34.057020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:34.079436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.088849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.090088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.090737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.324747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:34.335323 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8806cc8a-9fb6-4665-8d63-c20f2b58c2cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 0.286594 Jul 25 20:27:34.337736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1966/3983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:34 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:34.363768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:34.364463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:34.377240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:34.382867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.383632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.384685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.385382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.528507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:34.530096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] [instance: 4df318ee-25f6-4b11-8b83-118376061ee6] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:34.535560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:34.553528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.553950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:34.557245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.557918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:34.558275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.558860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.561134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89fed73e-aaf3-4fdb-b569-c8f31048b819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1594 microversion: 2.32 time: 0.201675 Jul 25 20:27:34.563407 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2018/3984] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:34 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1594 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:34.615903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] HTTP exception thrown: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Request method failure captured: Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 HTTP/1.1 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vx84Y51SbdXso4PL9UN7m7kR_av5uIdkig1CYJMRm57cbrjyeTVm1lb3_zy4PTsyPiGpWQo0gZWNF6qxcItdmaYuzsPqAQFplewWYKaWRduUAP98b6TGqoryEndFZt-117bwxlQT-T3gzq4ucJ5FlhLhOR6b9bK4d2MFWJIdAVlBv0 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.26 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 5991e108646740419e04e1f198788f34 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerTagsTestJSON-2107138295 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5991e108646740419e04e1f198788f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5991e108646740419e04e1f198788f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5991e108646740419e04e1f198788f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5991e108646740419e04e1f198788f34"}]}] Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerTagsTestJSON-2107138295 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 5991e108646740419e04e1f198788f34 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerTagsTestJSON-2107138295 Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerTagsTestJSON-2107138295-project Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ac0c2e5eba484dfb9dbabaceb9c7b29a Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerTagsTestJSON-2107138295-project Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4df318ee-25f6-4b11-8b83-118376061ee6'} Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:34.617702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] Returning 404 to user: Instance 4df318ee-25f6-4b11-8b83-118376061ee6 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:27:34.622202 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3fdf131-84a7-49c9-8036-b785e40f4675 tempest-ServerTagsTestJSON-2107138295 tempest-ServerTagsTestJSON-2107138295-project] 10.222.0.48 "GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6" status: 404 len: 111 microversion: 2.26 time: 0.103024 Jul 25 20:27:34.626241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1967/3985] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:34 2022] GET /compute/v2.1/servers/4df318ee-25f6-4b11-8b83-118376061ee6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:27:34.903370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:34.904834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:34.917723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.918439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:34.919425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:34.920052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:35.255914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:35.274931 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1de0ff98-07b4-4f86-99d1-83d924973a84 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.376536 Jul 25 20:27:35.275584 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2019/3986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:34 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:35.369577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:35.370217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:35.391879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:35.393422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:35.395082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:35.396187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:35.414807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=3,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:35.596264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:35.597496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:35.607074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:35.613423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:35.615146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:35.618598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:35.885391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:35.912827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:35.916719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:35.919776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea9a8284-603d-4cfb-9388-fba2ceb6657b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1594 microversion: 2.32 time: 0.327685 Jul 25 20:27:35.928519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2020/3987] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:35 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1594 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:36.066818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:36.094994 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7560db52-de9a-41f5-9103-f2f22ec8ecae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 0.730287 Jul 25 20:27:36.099327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1968/3988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:35 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:36.297854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:36.299118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:36.309984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:36.320976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:36.322483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:36.323245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:36.955931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:36.956681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:36.961803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:36.963369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:36.977780 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-add073cc-4c63-466a-b373-edd17860c7b3 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.683968 Jul 25 20:27:36.989435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:36.993223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:36.999071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2021/3989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:36 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:37.010084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:37.023565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:37.127970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:37.129422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:37.147596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:37.148090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:37.149005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:37.157053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:37.229693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:37.627520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:37.669057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:37.672403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:37.674845 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3183d182-5d53-445f-9c8f-bb6500bb33ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1594 microversion: 2.32 time: 0.723742 Jul 25 20:27:37.676221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1969/3990] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:36 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1594 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:38.003703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:38.004860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:38.007088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:38.036468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:38.039928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:38.044062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:38.046628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:38.096127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:38.110800 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0dce989f-fbd1-405b-8b3c-dccbdf7d9c46 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 0.987753 Jul 25 20:27:38.137250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2022/3991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:37 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:38.707102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:38.707997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:38.725368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:38.739273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:38.740580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:38.741216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:39.187395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:39.217786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:39.234321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eae1be40-ee74-4d51-802b-3b6608516548 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 1.235482 Jul 25 20:27:39.250323 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1970/3992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:37 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:39.250323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-59cd1c4c-488f-4e3f-bec5-e34e7bc0bb09 req-962fa08f-8779-42ad-afe0-619f5d79ea7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7be05bc-e14b-4875-b5af-cbebda47b04a", "tag": "f51c08c8-8325-47ee-81d6-3e43fb92f98b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:39.303236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-59cd1c4c-488f-4e3f-bec5-e34e7bc0bb09 req-962fa08f-8779-42ad-afe0-619f5d79ea7b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:39.304436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:39.306410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-59cd1c4c-488f-4e3f-bec5-e34e7bc0bb09 req-962fa08f-8779-42ad-afe0-619f5d79ea7b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:39.322115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:39.326401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:39.331032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0405e83e-108f-4967-9063-cdcca5c347a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1594 microversion: 2.32 time: 0.628051 Jul 25 20:27:39.357562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-59cd1c4c-488f-4e3f-bec5-e34e7bc0bb09 req-962fa08f-8779-42ad-afe0-619f5d79ea7b service nova] Creating event network-changed:f51c08c8-8325-47ee-81d6-3e43fb92f98b for instance a7be05bc-e14b-4875-b5af-cbebda47b04a on n-h2-845775-3 Jul 25 20:27:39.357739 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2023/3993] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:38 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1594 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:27:39.373571 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-59cd1c4c-488f-4e3f-bec5-e34e7bc0bb09 req-962fa08f-8779-42ad-afe0-619f5d79ea7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131381 Jul 25 20:27:39.376137 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1971/3994] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:39.379391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:39.380026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:39.398405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:39.399362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:39.400233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:39.402988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:40.263835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:40.264513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:40.290133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:40.290611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:40.296455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:40.297153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:41.059109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:41.077897 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa3f3081-a683-413f-8a98-1e0fc74337fc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 1.710146 Jul 25 20:27:41.078677 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2024/3995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:39 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:41.120230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:41.121294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:41.126937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:41.139584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:41.141727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:41.153818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:41.156285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:41.489776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:41.508918 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29556777-e635-4aa9-979b-04142c7363bc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 1.247683 Jul 25 20:27:41.527165 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1972/3996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:40 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:27:41.824709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:41.839290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:41.843081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:41.850973 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef755bc3-d58e-431e-ae82-ba462e8d0623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1660 microversion: 2.32 time: 0.756047 Jul 25 20:27:41.864614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2025/3997] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:41 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1660 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:42.105895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:42.107164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:42.122840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:42.126425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:42.129000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:42.132704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:42.532363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:42.533881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:42.555386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:42.556188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:42.557229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:42.557910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:43.458792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:43.469498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:43.476578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-204521eb-758f-4339-90d3-65f08ae2bc70 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 1.379371 Jul 25 20:27:43.480708 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1973/3998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:42 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:43.486991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69a31a2e-366c-46eb-b630-2f9a6e7f92aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1522 microversion: 2.1 time: 0.960486 Jul 25 20:27:43.496475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:43.496475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:43.504566 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2026/3999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:42 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1522 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:43.526558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:43.527056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:43.531655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:43.534530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:44.503073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:44.504538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:44.526496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:44.527200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:44.529188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:44.530710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:44.582204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:44.594891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:44.596542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:44.597876 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-02884d91-c2eb-4ae2-aed6-9f3f3c835452 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1660 microversion: 2.32 time: 1.116253 Jul 25 20:27:44.598454 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1974/4000] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:43 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1660 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:44.616329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:44.616957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:44.633066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:44.633742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:44.634831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:44.635491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:46.212431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:46.228381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7dae0d67-f5b1-456f-927b-5e2ca5f71d25 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1504 microversion: 2.1 time: 1.628603 Jul 25 20:27:46.233253 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1975/4001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:44 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1504 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:46.247336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:46.248338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:46.269915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:46.270685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:46.274837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:46.275558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:46.748385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:46.769220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48fac618-44c3-4026-abc9-051dd61b8bbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 2.267527 Jul 25 20:27:46.783431 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2027/4002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:44 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:46.973775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:46.995673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:46.999235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:47.001561 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3bea9c02-d982-4c46-b4ec-7d8f940a80ce tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1705 microversion: 2.32 time: 0.765093 Jul 25 20:27:47.002477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1976/4003] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:46 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1705 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:47.255316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:47.255958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:47.282476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:47.283116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:47.290969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:47.291509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:47.486477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4f04aba4-af5a-4e77-8cf2-d2d78bc160df req-8217cf9d-cc26-4908-8b78-5f25ceb7c80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7be05bc-e14b-4875-b5af-cbebda47b04a", "name": "network-vif-plugged", "status": "completed", "tag": "f51c08c8-8325-47ee-81d6-3e43fb92f98b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:47.514338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4f04aba4-af5a-4e77-8cf2-d2d78bc160df req-8217cf9d-cc26-4908-8b78-5f25ceb7c80c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:47.519338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4f04aba4-af5a-4e77-8cf2-d2d78bc160df req-8217cf9d-cc26-4908-8b78-5f25ceb7c80c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:47.560622 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4f04aba4-af5a-4e77-8cf2-d2d78bc160df req-8217cf9d-cc26-4908-8b78-5f25ceb7c80c service nova] Creating event network-vif-plugged:f51c08c8-8325-47ee-81d6-3e43fb92f98b for instance a7be05bc-e14b-4875-b5af-cbebda47b04a on n-h2-845775-3 Jul 25 20:27:47.572357 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4f04aba4-af5a-4e77-8cf2-d2d78bc160df req-8217cf9d-cc26-4908-8b78-5f25ceb7c80c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091821 Jul 25 20:27:47.574008 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1977/4004] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:27:47.795212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:47.797123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:47.812407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:47.812877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:47.813675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:47.814186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:48.352890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:48.368168 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-40884159-5606-4b7b-b9cc-1c33fd394521 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1504 microversion: 2.1 time: 1.116821 Jul 25 20:27:48.369320 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2028/4005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:47 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1504 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:48.380184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:48.381928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:48.398109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:48.398585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:48.401659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:48.402167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:48.722791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:48.734537 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4bcc54b-fe5b-434a-8412-974677d606ea tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 0.947265 Jul 25 20:27:48.736323 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1978/4006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:47 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:48.915615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:48.938894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:48.942053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:48.942719 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a394bec-d1d8-4096-b6a4-e602c30334d1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1750 microversion: 2.32 time: 0.571767 Jul 25 20:27:48.943309 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2029/4007] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:48 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1750 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:49.391896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:49.392898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:49.402592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:49.403055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:49.409443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:49.410207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:49.599809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d7530188-05ea-4d0e-8cb4-2dbf939c9d93 req-59884894-a182-4548-9149-25d2e5f905b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d934e47-af93-46e3-ab11-8ddfa0d11155", "name": "network-vif-unplugged", "status": "completed", "tag": "d4240364-2825-448a-90c4-3cbbb3cdbb17"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:49.627589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d7530188-05ea-4d0e-8cb4-2dbf939c9d93 req-59884894-a182-4548-9149-25d2e5f905b2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:49.632550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d7530188-05ea-4d0e-8cb4-2dbf939c9d93 req-59884894-a182-4548-9149-25d2e5f905b2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:49.658814 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d7530188-05ea-4d0e-8cb4-2dbf939c9d93 req-59884894-a182-4548-9149-25d2e5f905b2 service nova] Creating event network-vif-unplugged:d4240364-2825-448a-90c4-3cbbb3cdbb17 for instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 on n-h1-845775-3 Jul 25 20:27:49.694013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d7530188-05ea-4d0e-8cb4-2dbf939c9d93 req-59884894-a182-4548-9149-25d2e5f905b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098104 Jul 25 20:27:49.706035 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2030/4008] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:27:49.765138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:49.766162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:49.792596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:49.793269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:49.794334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:49.795183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:50.733904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:50.749382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-482a6356-fc05-4e39-a0b1-500f1e5d1bb9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 200 len: 1507 microversion: 2.1 time: 1.361285 Jul 25 20:27:50.752443 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1979/4009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:49 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 1507 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:50.760770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:50.767922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:50.784870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:50.785658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:50.786710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:50.787259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:50.967351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:50.981032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94de21d7-fd83-45b1-abc3-e6a797e66370 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1375 microversion: 2.1 time: 1.222453 Jul 25 20:27:50.981996 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2031/4010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:49 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1375 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:51.340121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:51.359356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:51.363744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:51.370249 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-abacacc2-9157-4130-a56b-7b38ead94c7b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1795 microversion: 2.32 time: 0.614619 Jul 25 20:27:51.371151 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1980/4011] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:50 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1795 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:51.406102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:51.412756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:51.428675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:51.431019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:51.431720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1296826058", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:51.432284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:51.434628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:51.506584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:27:51.519599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Working on deleting snapshot d32fca37-2499-4c5e-89a3-9ddb280b9be9 from shelved instance... Jul 25 20:27:51.580988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] validate_networks() for [('aaec689a-7aad-4334-8210-105206945ee3', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:27:53.143344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:27:53.143964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:27:53.144264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:27:53.144688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:27:53.145117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:27:53.191658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:53.194405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:53.195570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:53.195772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Doing local delete in cell 607c484c-f390-4dbd-9b27-5ef5ce705863(cell1) {{(pid=119723) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 25 20:27:53.197168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:53.198007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:53.198486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:53.198814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 25 20:27:53.203356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] deallocate_for_instance() {{(pid=119723) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 25 20:27:53.245678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Getting quotas for project 84e98b38c70c472cac894e968bd57769. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:53.254906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Getting quotas for user d5eb18d5109c475f85a921a530779909 and project 84e98b38c70c472cac894e968bd57769. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:53.274397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:27:53.279256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:27:53.361502 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b706b245-d812-42a2-92e0-0ed568260b09 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.378129 Jul 25 20:27:53.362970 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2032/4012] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:27:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:27:53.372772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:53.377915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:53.405748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:53.410089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:53.420792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:53.421825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:54.762552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:54.778234 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dae0d4d5-0623-4a3c-a51b-ebcfebb0d64c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1546 microversion: 2.1 time: 1.413850 Jul 25 20:27:54.780647 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2033/4013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:53 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1546 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:55.170487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1901394081", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:55.292014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:27:55.292521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:27:55.292998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:27:55.293416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:27:55.293834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:27:55.330467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:55.331059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:55.331930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:55.337553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:55.397769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Getting quotas for project 82fe6b43ad72450dbb6664c13b64806a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:27:55.409131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Getting quotas for user b0ae6aeba6604cc697c4f8e5c349bf7f and project 82fe6b43ad72450dbb6664c13b64806a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:27:55.448922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:27:55.452504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:27:55.552416 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac997ee5-d0d0-4fb9-b543-7e537066a95e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.770011 Jul 25 20:27:55.556427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2034/4014] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:27:55.572838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:55.575968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:55.611792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:55.611792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:55.611792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:55.612702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:56.670124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Updating instance_info_cache with network_info: [] {{(pid=119723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:27:56.834112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:56.852084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:56.862044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:56.863948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:56.868059 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bb2a1582-303f-43ed-85ce-ee2098e7498b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1840 microversion: 2.32 time: 1.308666 Jul 25 20:27:56.870332 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2035/4015] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:55 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1840 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:56.887299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:56.889308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:56.907233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:56.908027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:56.909863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:56.911683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.030632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:27:57.042598 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe9ae9d6-8ed3-49aa-8a85-64b2132c3b19 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 204 len: 0 microversion: 2.1 time: 5.649887 Jul 25 20:27:57.049868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1981/4016] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:27:51 2022] DELETE /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 0 bytes in 5654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:27:57.057549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:57.058687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:57.072207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.074027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.075329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.076242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.108354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:57.121519 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dce47b61-948c-4d27-a417-43191842ef4c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1281 microversion: 2.1 time: 0.246471 Jul 25 20:27:57.135874 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2036/4017] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:56 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:57.146994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-583fa1f8-533c-4def-a24b-8769bde08ff0 req-3f113c13-84c9-40fc-9144-ce552ec4ab4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "12743539-7c11-4da3-b872-3bfc3dbcd3e7"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:57.163235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-583fa1f8-533c-4def-a24b-8769bde08ff0 req-3f113c13-84c9-40fc-9144-ce552ec4ab4c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.164164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-583fa1f8-533c-4def-a24b-8769bde08ff0 req-3f113c13-84c9-40fc-9144-ce552ec4ab4c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.177533 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-583fa1f8-533c-4def-a24b-8769bde08ff0 req-3f113c13-84c9-40fc-9144-ce552ec4ab4c service nova] Creating event network-changed:12743539-7c11-4da3-b872-3bfc3dbcd3e7 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:27:57.183323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-583fa1f8-533c-4def-a24b-8769bde08ff0 req-3f113c13-84c9-40fc-9144-ce552ec4ab4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045608 Jul 25 20:27:57.184726 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2037/4018] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:27:57.192063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:57.193162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:57.201512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.202706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.203792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.205156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.535183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:57.559147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:57.565615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:57.567155 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4345f3f-daeb-43ed-9e1d-4f1286da6aab tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1330 microversion: 2.54 time: 0.380583 Jul 25 20:27:57.567714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2038/4019] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:57 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1330 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:57.728026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8a3cea8c-9f42-4e50-b128-e012319f0a4d req-864e4248-f27d-4d8c-ae30-d0ccd3e8630d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d934e47-af93-46e3-ab11-8ddfa0d11155", "name": "network-vif-deleted", "tag": "d4240364-2825-448a-90c4-3cbbb3cdbb17"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:57.753816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8a3cea8c-9f42-4e50-b128-e012319f0a4d req-864e4248-f27d-4d8c-ae30-d0ccd3e8630d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.756130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8a3cea8c-9f42-4e50-b128-e012319f0a4d req-864e4248-f27d-4d8c-ae30-d0ccd3e8630d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.785814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.compute.server_external_events [req-8a3cea8c-9f42-4e50-b128-e012319f0a4d req-864e4248-f27d-4d8c-ae30-d0ccd3e8630d service nova] Unable to find a host for instance 0d934e47-af93-46e3-ab11-8ddfa0d11155. Dropping event network-vif-deleted {{(pid=119724) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 20:27:57.797438 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8a3cea8c-9f42-4e50-b128-e012319f0a4d req-864e4248-f27d-4d8c-ae30-d0ccd3e8630d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.228468 Jul 25 20:27:57.799038 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2039/4020] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 231 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 20:27:57.804199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:57.804955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:57.818540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.820340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.824820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.825372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.861259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 HTTP/1.1 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '0d934e47-af93-46e3-ab11-8ddfa0d11155'} Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:27:57.863880 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:27:57.867976 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:27:57.885643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:27:57.885643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7916fdb8-8e62-45fb-b71b-90adac837a89 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 404 len: 111 microversion: 2.1 time: 0.078969 Jul 25 20:27:57.885643 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2040/4021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:57 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:27:57.905286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:57.905902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:57.917453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.918258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:57.920369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:57.920550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:58.633116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:58.646879 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d03a386-3770-495d-a6c5-eaf895ebca6b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1546 microversion: 2.1 time: 1.593425 Jul 25 20:27:58.649347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1982/4022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:57 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1546 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:27:58.674129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-796911133", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:27:58.800346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:27:59.861517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:59.878008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:59.880405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:27:59.882738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a98abfa-3e24-4bab-85d3-a4dcdd22b682 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1861 microversion: 2.32 time: 1.988590 Jul 25 20:27:59.883889 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2041/4023] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:27:57 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1861 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:27:59.889446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:27:59.890906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:27:59.921004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:59.921825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:27:59.923421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:27:59.924340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:00.298283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:00.315751 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5f57970-2e97-45cd-a4d8-63c2c4053a47 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1281 microversion: 2.1 time: 0.430141 Jul 25 20:28:00.324313 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2042/4024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:27:59 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1281 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:00.349847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:00.351727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:00.374674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:00.383447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:00.384807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:00.387410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:00.458904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:00.544098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:00.569462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:00.571908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:00.578010 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-075807bc-b2e8-47f4-b7cd-7efe017f1816 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1336 microversion: 2.54 time: 0.251727 Jul 25 20:28:00.580386 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2043/4025] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:00 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1336 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:00.585531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1f07df2d-320b-48e2-ba69-64ba97bf1e78 req-5aa3dfd6-83ec-4f52-9979-436cd49e143f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "43d2f154-a52c-47d9-b293-2b81ea768df3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:00.614466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1f07df2d-320b-48e2-ba69-64ba97bf1e78 req-5aa3dfd6-83ec-4f52-9979-436cd49e143f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:00.623612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1f07df2d-320b-48e2-ba69-64ba97bf1e78 req-5aa3dfd6-83ec-4f52-9979-436cd49e143f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:00.663530 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1f07df2d-320b-48e2-ba69-64ba97bf1e78 req-5aa3dfd6-83ec-4f52-9979-436cd49e143f service nova] Creating event network-changed:43d2f154-a52c-47d9-b293-2b81ea768df3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:00.670514 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1f07df2d-320b-48e2-ba69-64ba97bf1e78 req-5aa3dfd6-83ec-4f52-9979-436cd49e143f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088440 Jul 25 20:28:00.683722 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2044/4026] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:00.927518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:00.930846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:00.991270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:00.992525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:00.994330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:00.995289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.151511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:02.199350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:02.206951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:02.220771 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-540e9805-444e-46bc-9679-5e3ebaac669e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1882 microversion: 2.32 time: 1.295834 Jul 25 20:28:02.226699 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2045/4027] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:00 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1882 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:02.242495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:02.244593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:02.259221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.260501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.263242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.264786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.352156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:28:02.353100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:28:02.354986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:28:02.355978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:28:02.356976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:28:02.428880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.428880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.428880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.428880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.522608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:28:02.569329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:28:02.656010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:28:02.668330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:28:02.830885 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2bf83250-ea4b-4598-827e-2a44a54348f7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.178811 Jul 25 20:28:02.831895 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1983/4028] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:28:02.847498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:02.849660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:02.869654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.870511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:02.871575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:02.873380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:03.212029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:03.253110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:03.260099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:03.264375 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1668baaa-eb2e-4102-a98a-a99b34fd81b3 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1357 microversion: 2.54 time: 0.431159 Jul 25 20:28:03.267257 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1984/4029] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:02 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1357 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:03.277185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9ddf6378-0aaa-405e-9c56-27ba2011ce76 req-d6168982-eb62-435b-a12c-960905b521d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "ad66e97f-8a60-4ffa-9527-ea585ecd0e5b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:03.314781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9ddf6378-0aaa-405e-9c56-27ba2011ce76 req-d6168982-eb62-435b-a12c-960905b521d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:03.315650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9ddf6378-0aaa-405e-9c56-27ba2011ce76 req-d6168982-eb62-435b-a12c-960905b521d2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:03.355494 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9ddf6378-0aaa-405e-9c56-27ba2011ce76 req-d6168982-eb62-435b-a12c-960905b521d2 service nova] Creating event network-changed:ad66e97f-8a60-4ffa-9527-ea585ecd0e5b for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:03.370519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9ddf6378-0aaa-405e-9c56-27ba2011ce76 req-d6168982-eb62-435b-a12c-960905b521d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099032 Jul 25 20:28:03.374976 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1985/4030] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:03.386669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ca4026de-212a-4ae7-a854-9d175c0294a5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:03.387305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ca4026de-212a-4ae7-a854-9d175c0294a5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:03.686928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ca4026de-212a-4ae7-a854-9d175c0294a5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:03.706418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:03.715305 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ca4026de-212a-4ae7-a854-9d175c0294a5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1214 microversion: 2.1 time: 0.338470 Jul 25 20:28:03.717220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb33f8f8-4c43-4d40-a857-fbd52ee6c3fc tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 1.488321 Jul 25 20:28:03.724260 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1986/4031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:03 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:03.735241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2046/4032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:02 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:03.743012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7f736e6-5258-475d-8968-cc4861a42689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Action: 'create', calling method: .version_select at 0x7f1968c591f0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-645417281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKBVzbPIlU4dgGrlFCrHMaTvtb8+rIJ1XwCi7YrHdVTRZHYukJwslucGJ4rMvA3WTRbhNEPdh+wnyiK04voYVoBTNbOP+jP4sIyoraNkfyzwig2KMkpFgsibDkbvBR8EA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:03.768903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:03.772934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:03.799616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:03.801335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:03.818218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:03.820120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:03.821065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e7f736e6-5258-475d-8968-cc4861a42689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Getting quotas for project 82fe6b43ad72450dbb6664c13b64806a. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:28:03.841689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e7f736e6-5258-475d-8968-cc4861a42689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Getting quotas for user b0ae6aeba6604cc697c4f8e5c349bf7f and project 82fe6b43ad72450dbb6664c13b64806a. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:28:03.950444 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7f736e6-5258-475d-8968-cc4861a42689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.205460 Jul 25 20:28:03.963852 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2047/4033] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:28:03 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:28:03.982705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-645417281", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:04.016076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:04.037091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.037851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.039419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.040055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.221362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:28:04.221707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:28:04.222186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:28:04.222593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:28:04.223305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:28:04.383272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:04.397671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.398614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.399456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.399928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.470662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0da764f-bf76-4fd0-a024-a1641f67da57 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "POST /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b/action" status: 202 len: 1139 microversion: 2.54 time: 0.504762 Jul 25 20:28:04.471330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2048/4034] 10.222.0.48 () {62 vars in 1320 bytes} [Mon Jul 25 20:28:03 2022] POST /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b/action => generated 1139 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 25 20:28:04.498865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:04.498865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:04.532774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.533248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.534054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.534500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.796564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:04.805166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:04.818131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:04.819366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84ec1dcc-a04c-4c5d-9099-9f04a4b2cb53 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.328236 Jul 25 20:28:04.820159 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2049/4035] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:04 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:04.825605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:04.826426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:04.842859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.843786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:04.844896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:04.846060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:05.356495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:05.384435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:05.408875 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d727d406-a4af-4983-b36e-0fdaa1caabd8 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1284 microversion: 2.1 time: 0.587362 Jul 25 20:28:05.409983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2050/4036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:04 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1284 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:05.417764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:05.418507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:05.443760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:05.453787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:05.462254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:05.464569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:05.466164 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9813c81f-4288-4ba9-9e3a-f4022930946c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.730508 Jul 25 20:28:05.466468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:05.469139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:05.470785 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1987/4037] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:03 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:05.479435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:05.852710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:05.853525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:05.882612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:05.884195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:05.886409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:05.887051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:05.980551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:05.993830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-245e2a29-22a4-41f3-afc5-5f880fe87b63 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.581819 Jul 25 20:28:06.014635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2051/4038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:05 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:06.078786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:06.096893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:06.101246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:06.104333 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03c1f682-bc4f-40c2-9970-51e4e308e8a5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.255167 Jul 25 20:28:06.106112 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1988/4039] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:05 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:06.375209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-68e8154d-a6f2-4822-8955-332cfc2314ac req-1cfe5fbc-5321-435b-8c32-9cb407f3f3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:06.442225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:06.443298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:06.505429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-68e8154d-a6f2-4822-8955-332cfc2314ac req-1cfe5fbc-5321-435b-8c32-9cb407f3f3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.507288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-68e8154d-a6f2-4822-8955-332cfc2314ac req-1cfe5fbc-5321-435b-8c32-9cb407f3f3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.508916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.512787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.515642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.516402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.563609 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-68e8154d-a6f2-4822-8955-332cfc2314ac req-1cfe5fbc-5321-435b-8c32-9cb407f3f3ba service nova] Creating event network-changed:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:28:06.581795 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-68e8154d-a6f2-4822-8955-332cfc2314ac req-1cfe5fbc-5321-435b-8c32-9cb407f3f3ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215806 Jul 25 20:28:06.589542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2052/4040] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:28:06.598681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:06.609501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:06.613198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:06.621898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.630149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.632694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.633133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.836089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:06.851294 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08effaa2-1c02-4c5d-bef7-28bc73037216 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1272 microversion: 2.1 time: 0.423996 Jul 25 20:28:06.852522 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1989/4041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:06 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:06.865932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0b4fdab9-1385-4a9b-9334-cd76689eb7c8 req-8fb1fbcb-4670-4bc7-a7bc-aa0d35bc3c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "0b99c227-344a-4aff-bf0f-6138d40f1d19"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:06.897930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0b4fdab9-1385-4a9b-9334-cd76689eb7c8 req-8fb1fbcb-4670-4bc7-a7bc-aa0d35bc3c4c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:06.898388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0b4fdab9-1385-4a9b-9334-cd76689eb7c8 req-8fb1fbcb-4670-4bc7-a7bc-aa0d35bc3c4c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:06.923548 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0b4fdab9-1385-4a9b-9334-cd76689eb7c8 req-8fb1fbcb-4670-4bc7-a7bc-aa0d35bc3c4c service nova] Creating event network-changed:0b99c227-344a-4aff-bf0f-6138d40f1d19 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:06.938440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0b4fdab9-1385-4a9b-9334-cd76689eb7c8 req-8fb1fbcb-4670-4bc7-a7bc-aa0d35bc3c4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084290 Jul 25 20:28:06.940914 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1990/4042] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:07.028644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:07.033438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:07.052839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.053608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:07.054753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.055419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:07.719584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:07.742667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:07.745948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:07.747730 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1013fcb1-10b4-4b47-8139-1ab531ff49bf tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.156319 Jul 25 20:28:07.748678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2053/4043] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:06 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:07.756544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:07.757555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:07.769880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.771551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:07.772878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.773946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:07.859279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:07.868115 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-962cdc32-7f6e-4683-8ebd-abc995a3980c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.846733 Jul 25 20:28:07.872237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1991/4044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:07 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:07.878131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:07.879117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:07.893713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.894175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:07.902369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:07.904234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:08.216920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.266425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.279359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.283364 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-376bcf73-f725-4544-8d46-629bfb4e2936 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.532490 Jul 25 20:28:08.298064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2054/4045] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:07 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:08.488213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:08.524855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.526286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Searching by: {'deleted': False, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:28:08.564786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:08.574641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:08.576802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:08.577732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:08.674871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:28:08.730897 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3c9e17d-aa59-4040-9cea-46b29b50f9a9 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.250184 Jul 25 20:28:08.731883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2055/4046] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:28:08 2022] GET /compute/v2.1/servers => generated 340 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:08.750790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:08.769101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.770308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Searching by: {'deleted': False, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:28:08.787985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:08.789274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:08.791115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:08.792233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:08.877304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:28:08.955492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:08.981197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:08.997336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:09.496468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d56ffe8-48dc-447a-92c6-f95171c7bf1d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.752718 Jul 25 20:28:09.519176 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2056/4047] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:28:08 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:09.537548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:09.538643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:09.550510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:09.553998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:09.555597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:09.556875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:09.577225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:09.600765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc9bcd51-0660-48d2-9693-f119a2571e04 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 1.726585 Jul 25 20:28:09.602885 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1992/4048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:07 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:09.619468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:09.624524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:09.653312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:09.658310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:09.663582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:09.663972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.267689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.300978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.317572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.320219 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-60879ca7-b235-4a7d-b477-46701c4df73c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.799194 Jul 25 20:28:10.337664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2057/4049] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:09 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:10.364802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:10.366179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:10.372686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.395518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:10.396687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.398593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:10.399961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.406483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73636f32-8b34-4606-817d-019bc5d01a25 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.799630 Jul 25 20:28:10.452250 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1993/4050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:09 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:10.483450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59c29eb1-c116-414d-80e7-5990b5ade464 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:10.519636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59c29eb1-c116-414d-80e7-5990b5ade464 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065003 Jul 25 20:28:10.521058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1994/4051] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:28:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:10.541321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0aa41520-154a-4fdf-8f4c-89faeb559199 req-62344296-bde5-40db-a247-96b6f3df55a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7be05bc-e14b-4875-b5af-cbebda47b04a", "tag": "f51c08c8-8325-47ee-81d6-3e43fb92f98b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:10.564826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0aa41520-154a-4fdf-8f4c-89faeb559199 req-62344296-bde5-40db-a247-96b6f3df55a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:10.566159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0aa41520-154a-4fdf-8f4c-89faeb559199 req-62344296-bde5-40db-a247-96b6f3df55a5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.592580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0aa41520-154a-4fdf-8f4c-89faeb559199 req-62344296-bde5-40db-a247-96b6f3df55a5 service nova] Creating event network-changed:f51c08c8-8325-47ee-81d6-3e43fb92f98b for instance a7be05bc-e14b-4875-b5af-cbebda47b04a on n-h2-845775-3 Jul 25 20:28:10.609907 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0aa41520-154a-4fdf-8f4c-89faeb559199 req-62344296-bde5-40db-a247-96b6f3df55a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073712 Jul 25 20:28:10.612495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1995/4052] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:10.664658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:10.666770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:10.681606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.686992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:10.705961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:10.709240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.711968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.714428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:10.716082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:10.719150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:10.726174 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f62591b-a88a-43f9-8d0c-5a0af46f2975 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.386636 Jul 25 20:28:10.728891 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2058/4053] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:10 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:11.372631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:11.376409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:11.437898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:11.438370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:11.443083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:11.443576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:11.816515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:11.847268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c46da10-730b-4af5-9b2a-19797a13e8ac tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 1.214163 Jul 25 20:28:11.848025 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1996/4054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:10 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:11.878740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:11.880961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:11.898791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:11.900595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:11.901825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:11.902371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.221518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.236530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.242806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.247459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6eb7988-e126-481a-9353-7e633989863d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.883010 Jul 25 20:28:12.249978 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2059/4055] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:11 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:12.255486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:12.261531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:12.268102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.268824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.269781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.270375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.347518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:28:12.498945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:12.574516 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-152decaf-171b-42bd-bae1-8d09fd13fdef tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 204 len: 0 microversion: 2.1 time: 0.316956 Jul 25 20:28:12.577006 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2060/4056] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:28:12 2022] DELETE /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:28:12.587724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:12.589002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:12.602890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.603649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.605058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.605474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.606420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.624695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5af31ebc-90b5-44be-86ff-8491a8df367c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.775031 Jul 25 20:28:12.639829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1997/4057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:11 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:12.654081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:12.655701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:12.676401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.679512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.680673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.681616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.790882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.804681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.806670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:12.807998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-baabfd9b-a2ae-4291-b445-4571d20707a6 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.226246 Jul 25 20:28:12.809316 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2061/4058] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:12 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:12.825203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "9c18bae2-64e2-49ee-b81a-af5f56618bac"}, {"name": "network-changed", "server_uuid": "8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7", "tag": "1398e7fb-68c8-4e89-8122-bd9e018b120d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:12.845548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.846604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.877257 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] Creating event network-changed:9c18bae2-64e2-49ee-b81a-af5f56618bac for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:12.878471 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] Creating event network-changed:1398e7fb-68c8-4e89-8122-bd9e018b120d for instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 on n-h1-845775-3 Jul 25 20:28:12.892583 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b7c595e4-1b29-4ffb-abff-7af2839f372d req-55bba171-9786-47fb-aaec-ca745a377aa5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079548 Jul 25 20:28:12.894775 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2062/4059] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:12.918245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:12.925369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:12.939115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.939976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:12.941317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:12.950108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:13.703496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:13.839773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:13.851960 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e83ab47d-aab3-4c8c-98ef-a64f7048887d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1714 microversion: 2.1 time: 1.210746 Jul 25 20:28:13.852824 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1998/4060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:12 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1714 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:13.859673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:13.861464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:13.873378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:13.875170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:13.881479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:13.882471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.077082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.085599 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67b0e400-9130-4376-9de8-1f4bce9c3019 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 1.181245 Jul 25 20:28:14.086767 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2063/4061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:12 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:14.092527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:14.094101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:14.112627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.113331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.114748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.115560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.495383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.514811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.518323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.520981 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4734750e-842f-4219-ba1f-19f2328e4657 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.666437 Jul 25 20:28:14.522573 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 1999/4062] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:13 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:14.531925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:14.533503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:14.561796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.569096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.576820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.577586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.746480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.765777 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c03569c-62a5-4be1-84af-46ab477337d5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.677512 Jul 25 20:28:14.768823 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2064/4063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:14 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:14.802122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.819079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.821263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:14.822634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0f1c75c-4afb-4e4f-ab78-6a81214cf689 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.298410 Jul 25 20:28:14.828912 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2000/4064] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:14 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:14.897402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:14.898444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:14.915274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.918497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:14.920004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:14.923854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.111888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:15.112895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:15.120342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:15.121153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.122093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:15.122685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.128379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:UPDATE=10,nova_cell1:DELETE=2,nova_cell1:SELECT=88 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:15.877114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:15.904027 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1aded2c0-1b58-458b-8f2d-eff49322fa3e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 0.795734 Jul 25 20:28:15.905298 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2001/4065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:15 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:15.921129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:15.924667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a5846bce-3fac-4b19-98cc-a5f1147cae0b req-41a02ca6-ce49-43a3-9aca-3d87af3626ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "643be01f-9e75-48bf-b958-18e11ebe41e3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:15.948239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba76dfda-2087-4eff-a921-1ca2b8b06535 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1714 microversion: 2.1 time: 1.053801 Jul 25 20:28:15.950493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2065/4066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:14 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1714 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:15.958675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a5846bce-3fac-4b19-98cc-a5f1147cae0b req-41a02ca6-ce49-43a3-9aca-3d87af3626ac service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:15.961561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a5846bce-3fac-4b19-98cc-a5f1147cae0b req-41a02ca6-ce49-43a3-9aca-3d87af3626ac service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.963050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:15.963864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:15.978368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:15.986372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.987997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:15.988633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:15.989581 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a5846bce-3fac-4b19-98cc-a5f1147cae0b req-41a02ca6-ce49-43a3-9aca-3d87af3626ac service nova] Creating event network-changed:643be01f-9e75-48bf-b958-18e11ebe41e3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:16.007807 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a5846bce-3fac-4b19-98cc-a5f1147cae0b req-41a02ca6-ce49-43a3-9aca-3d87af3626ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100052 Jul 25 20:28:16.012207 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2002/4067] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:16.025329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:16.027918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:16.056649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:16.057116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:16.057975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:16.067151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:16.594187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:16.610452 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84887101-9468-4f89-9f8e-dd55f3d3c278 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.596124 Jul 25 20:28:16.613164 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2003/4068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:16 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:16.638156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:16.640495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:16.669093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:16.670576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:16.674288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:16.678426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:16.943062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:16.970180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:16.980377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:16.985970 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1a369972-83be-413b-9af1-7471d105376f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.364863 Jul 25 20:28:17.005501 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2004/4069] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:16 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:17.233022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:17.255665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:17.257510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:17.258750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1833fada-39eb-43e7-b95a-efc1198cb06e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.305609 Jul 25 20:28:17.272112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f2119ae0-2587-430f-9b4f-42ef19972a3c req-0e4d510d-df32-4d7f-885d-be564eee7170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "name": "network-vif-plugged", "status": "completed", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:17.272430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2066/4070] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:15 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:17.283840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:17.285045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:17.291490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:17.292298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:17.293779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:17.300578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:17.300936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f2119ae0-2587-430f-9b4f-42ef19972a3c req-0e4d510d-df32-4d7f-885d-be564eee7170 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:17.301568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f2119ae0-2587-430f-9b4f-42ef19972a3c req-0e4d510d-df32-4d7f-885d-be564eee7170 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:17.353410 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f2119ae0-2587-430f-9b4f-42ef19972a3c req-0e4d510d-df32-4d7f-885d-be564eee7170 service nova] Creating event network-vif-plugged:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:28:17.365898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f2119ae0-2587-430f-9b4f-42ef19972a3c req-0e4d510d-df32-4d7f-885d-be564eee7170 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358624 Jul 25 20:28:17.367410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2005/4071] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:17.385731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:17.386527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:17.396167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:17.396897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:17.398030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:17.398626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:17.986107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.019747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e6daddf-42af-4667-a60d-4f2ff0d61f9d tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1646 microversion: 2.1 time: 0.640696 Jul 25 20:28:18.026654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2006/4072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:17 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1646 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:18.046605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:18.053296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:18.082578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.083770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.085629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.088085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.454762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.473203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f7363b9-2291-4138-be95-96adac6e76cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 1.199524 Jul 25 20:28:18.474366 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2067/4073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:17 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:18.497848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:18.499868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:18.518380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.520018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.523309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.524790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.736892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.746616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.762985 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9194eac7-a140-4db0-8001-41c12ec54c64 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1323 microversion: 2.1 time: 0.733609 Jul 25 20:28:18.765974 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2007/4074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:18 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:18.786407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e2d204b4-8edf-4f00-b26c-2879d94a9213 req-e7218af7-78f8-49a5-9c46-21460b069f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c52389d-4587-455c-aa1d-71f5f9ffbf25", "name": "network-vif-deleted", "tag": "3e66f18d-3dff-4a55-a908-11792000ba26"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:18.800664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.803784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:18.814083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-39a4d5e0-a383-4627-af5a-3cfcea1fdbe0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.334599 Jul 25 20:28:18.822748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2068/4075] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:18 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:18.845162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:18.852201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e2d204b4-8edf-4f00-b26c-2879d94a9213 req-e7218af7-78f8-49a5-9c46-21460b069f2b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.857930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e2d204b4-8edf-4f00-b26c-2879d94a9213 req-e7218af7-78f8-49a5-9c46-21460b069f2b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.858159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:18.898942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:18.911054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.921103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.923048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:18.925714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:18.933637 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e2d204b4-8edf-4f00-b26c-2879d94a9213 req-e7218af7-78f8-49a5-9c46-21460b069f2b service nova] Creating event network-vif-deleted:3e66f18d-3dff-4a55-a908-11792000ba26 for instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 on n-h2-845775-3 Jul 25 20:28:18.954790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e2d204b4-8edf-4f00-b26c-2879d94a9213 req-e7218af7-78f8-49a5-9c46-21460b069f2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182098 Jul 25 20:28:18.962120 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2008/4076] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:19.009911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=18 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:19.065894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:19.066692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:19.093317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:19.095710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:19.098135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:19.102628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:19.202282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:19.203407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:19.204158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lazy-loading 'fault' on Instance uuid 6c52389d-4587-455c-aa1d-71f5f9ffbf25 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:28:19.451269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde75be53e6a420b88250fea2d964c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc2672ee4024e27a6ad866f68e59cd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:19.467347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85fb9f19-1333-4661-840b-7280627c81fd tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 200 len: 1368 microversion: 2.1 time: 0.415785 Jul 25 20:28:19.472574 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2009/4077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:19 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:19.542615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:19.544012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:19.587613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:19.588456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:19.589867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:19.604475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.193391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.219696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.227528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.228090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.236326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dfc32029-54b4-489c-80a9-07d089b7c688 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.408703 Jul 25 20:28:20.240902 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-200ef02a-1f59-449d-9a4b-515c6311c30c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 0.728905 Jul 25 20:28:20.245133 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2010/4078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:19 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:20.252403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2069/4079] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:18 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:20.260717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-23c30bf8-f6bf-46e2-b937-fe24d0ab6e9b req-3d1c453f-4104-47f1-832e-30bec509ccbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "8e7a009b-34d5-4fd8-924e-d2083fc61888"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:20.298203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-23c30bf8-f6bf-46e2-b937-fe24d0ab6e9b req-3d1c453f-4104-47f1-832e-30bec509ccbe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.298650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-23c30bf8-f6bf-46e2-b937-fe24d0ab6e9b req-3d1c453f-4104-47f1-832e-30bec509ccbe service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.302196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:20.302828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:20.316247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.316778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.317602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.318043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.327552 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-23c30bf8-f6bf-46e2-b937-fe24d0ab6e9b req-3d1c453f-4104-47f1-832e-30bec509ccbe service nova] Creating event network-changed:8e7a009b-34d5-4fd8-924e-d2083fc61888 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:20.345381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-23c30bf8-f6bf-46e2-b937-fe24d0ab6e9b req-3d1c453f-4104-47f1-832e-30bec509ccbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087976 Jul 25 20:28:20.346660 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2011/4080] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:20.352315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:20.353026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:20.372128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.372888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.374176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.375022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.654026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.684530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.689446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.691220 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7bfbf56e-a58d-4637-ac5a-5b198cd6e8b0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.343038 Jul 25 20:28:20.692091 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2012/4081] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:20 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:20.701296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:20.702639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] [instance: 6c52389d-4587-455c-aa1d-71f5f9ffbf25] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:20.731411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.733506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.734580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:20.735805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:20.763139 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] HTTP exception thrown: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Request method failure captured: Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 HTTP/1.1 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vyF5-2aQjCcw-hc17bjiA3Nvcfm3N9VyKqyyq7zk7w-Q44iHxtKAqQvX7NzpQuGV6fYKMXoKaG-_QbMH5Ywm5e2rjzCAqrwxuFBozB9nDPrXmDgVIdn2PB7UrQ6xG3rDjLbTWhrFaYntcW_xZ4JuGapcKkKbGwnK6AtswxqRs1urFg Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 8dc2672ee4024e27a6ad866f68e59cd3 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersTestManualDisk-476164165 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dc2672ee4024e27a6ad866f68e59cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8dc2672ee4024e27a6ad866f68e59cd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8dc2672ee4024e27a6ad866f68e59cd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8dc2672ee4024e27a6ad866f68e59cd3"}]}] Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersTestManualDisk-476164165 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 8dc2672ee4024e27a6ad866f68e59cd3 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersTestManualDisk-476164165 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersTestManualDisk-476164165-project Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: fde75be53e6a420b88250fea2d964c01 Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersTestManualDisk-476164165-project Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '6c52389d-4587-455c-aa1d-71f5f9ffbf25'} Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:28:20.765454 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Returning 404 to user: Instance 6c52389d-4587-455c-aa1d-71f5f9ffbf25 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88d0df69-58ba-42a2-a641-c2d8de85acd7 tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25" status: 404 len: 111 microversion: 2.1 time: 0.072937 Jul 25 20:28:20.769783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2013/4082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:20 2022] GET /compute/v2.1/servers/6c52389d-4587-455c-aa1d-71f5f9ffbf25 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:28:20.783339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73f48cb2-f09a-4875-8118-a212fd14f91b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] Calling method '.version_select at 0x7f19697bc040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:20.826270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73f48cb2-f09a-4875-8118-a212fd14f91b tempest-ServersTestManualDisk-476164165 tempest-ServersTestManualDisk-476164165-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593282343" status: 202 len: 0 microversion: 2.1 time: 0.050258 Jul 25 20:28:20.828610 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2014/4083] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593282343 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:28:20.964829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:20.981009 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-005e9375-e95b-4444-9a2f-6d43d92a2b99 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1518 microversion: 2.1 time: 0.726591 Jul 25 20:28:20.983211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2070/4084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:20 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1518 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:21.016743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:21.022867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:21.054354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.057855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:21.065869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.065869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:21.123778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lazy-loading 'flavor' on Instance uuid 7fb41870-c243-4a9b-adf1-e344a38c3aa3 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:28:21.294665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:21.296153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:21.300583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34736dc3-f367-4c12-a38c-ffd1b3055d43 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action" status: 200 len: 32 microversion: 2.1 time: 0.294123 Jul 25 20:28:21.312170 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2015/4085] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:28:21 2022] POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:28:21.323008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.325712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:21.326552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.327665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:21.332524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:21.333959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:21.365315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.366229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:21.367451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:21.368384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.165578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.196425 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9fcbe667-651b-416b-a989-28ba9f8d0f5f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 0.909433 Jul 25 20:28:22.211758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2071/4086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:21 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:22.219964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:22.221130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:22.240344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:22.241247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.242308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:22.243149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.340105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.368678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.371768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.374224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3892a5f6-d9ba-4e7c-bc75-5898806f135a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.060826 Jul 25 20:28:22.380197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2016/4087] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:21 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:22.394164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:22.395348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:22.420508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:22.422077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.423724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:22.424395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.601445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.615994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.617968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.620189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1645db9b-4961-47fd-9a28-4b1a9a9fbda0 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.242289 Jul 25 20:28:22.620641 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2017/4088] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:22 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:22.626519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-22418679-702a-455c-a0e0-49a215f5170d req-9259534b-0950-4dc8-8d94-9b2303d18555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7", "name": "network-vif-plugged", "status": "completed", "tag": "1398e7fb-68c8-4e89-8122-bd9e018b120d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:22.640113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-22418679-702a-455c-a0e0-49a215f5170d req-9259534b-0950-4dc8-8d94-9b2303d18555 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:22.641074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-22418679-702a-455c-a0e0-49a215f5170d req-9259534b-0950-4dc8-8d94-9b2303d18555 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:22.663843 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-22418679-702a-455c-a0e0-49a215f5170d req-9259534b-0950-4dc8-8d94-9b2303d18555 service nova] Creating event network-vif-plugged:1398e7fb-68c8-4e89-8122-bd9e018b120d for instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 on n-h1-845775-3 Jul 25 20:28:22.670409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-22418679-702a-455c-a0e0-49a215f5170d req-9259534b-0950-4dc8-8d94-9b2303d18555 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048404 Jul 25 20:28:22.671810 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2018/4089] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:22.764943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:22.779956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74402fe7-2015-4046-a685-5fd051290c36 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.579979 Jul 25 20:28:22.780958 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2072/4090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:22 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:23.226710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:23.228053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:23.234022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:23.244001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.245110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.246752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.247559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.408377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:23.409729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:23.421620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.422372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.424324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.425085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.819898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:23.842090 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6a6cabf-d87b-4976-a798-fdce48f04bb6 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1314 microversion: 2.1 time: 0.626113 Jul 25 20:28:23.843189 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2019/4091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:23 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:23.859940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:23.860953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:23.867927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.868776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.869979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.870570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.902798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:23.932411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:23.945976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:23.947944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:23.949528 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52281f08-c2b7-4a8e-9405-f187051d8232 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.549592 Jul 25 20:28:23.950502 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2073/4092] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:23 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:23.956505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:23.957243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:23.963709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.964232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.965025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:23.965470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:23.989033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:24.023961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:24.042321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:24.046248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:24.049247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c93ad267-5f97-440e-aa7a-b14e68d8b059 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.204157 Jul 25 20:28:24.050466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2020/4093] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:23 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:24.299335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:24.309890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6fa5dd16-2d51-4eda-8d91-929047d694cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.357591 Jul 25 20:28:24.329174 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2074/4094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:23 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:24.864671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:24.865461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:24.873645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:24.874193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:24.875083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:24.875602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:24.983920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:24.984817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:24.994193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:24.996848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:24.998657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:24.999266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.262349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.290572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-228c4e92-9a0f-45fc-95b3-4bae7ee64af2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1500 microversion: 2.1 time: 0.430884 Jul 25 20:28:25.291284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2021/4095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:24 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1500 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:25.296578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:25.297517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:25.304681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.305557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.306605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.307684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.391909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.404420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.409559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.412428 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-056a8f55-31e4-4df0-a444-9f92ade4f732 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.431988 Jul 25 20:28:25.428067 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2075/4096] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:24 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:25.428374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.428571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-009ec231-cc2b-43b7-bc1e-8406a1d28a93 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:25.437860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-009ec231-cc2b-43b7-bc1e-8406a1d28a93 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.442916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.447615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-009ec231-cc2b-43b7-bc1e-8406a1d28a93 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.448305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.450407 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-293cb29a-2907-4d04-976f-ca66074b88a4 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.157905 Jul 25 20:28:25.451577 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2022/4097] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:25 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:25.466827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:25.468787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:25.488006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.488772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.492094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.492763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.501570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-009ec231-cc2b-43b7-bc1e-8406a1d28a93 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:28:25.611539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-009ec231-cc2b-43b7-bc1e-8406a1d28a93 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7/action" status: 202 len: 0 microversion: 2.1 time: 0.194573 Jul 25 20:28:25.624769 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2076/4098] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:28:25 2022] POST /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:28:25.644639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:25.645924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:25.660890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.662858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.664241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:25.665177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:25.840574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.849889 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f7204489-482e-4a28-8bd1-ee75f5c21a28 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.396737 Jul 25 20:28:25.850808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2023/4099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:25 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:25.967237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:25.977419 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18431aad-b464-44b0-9453-a2db47bf459e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.343772 Jul 25 20:28:25.980363 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2077/4100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:25 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:26.459682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:26.461198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:26.471345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.472257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.474074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.475076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.497676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:26.498408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:26.513564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.514000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.518823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.521818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.722936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.732961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.747222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.748718 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a89afbb5-22f1-4f73-af8a-eaf314375ac7 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.256366 Jul 25 20:28:26.750330 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2078/4101] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:26 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:26.875634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:26.876727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:26.885017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.885816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.887369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.888384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.910399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.935335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.937513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:26.939883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-126667fc-798b-4229-af30-faa382081623 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.485519 Jul 25 20:28:26.940905 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2024/4102] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:26 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:26.947785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:26.952344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:26.964946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.965820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:26.966934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:26.967387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.043082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-89f2df2a-1336-4517-9a39-a26cbc4c6e54 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a/action" status: 200 len: 24576 microversion: 2.1 time: 0.099852 Jul 25 20:28:27.045933 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2025/4103] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:28:26 2022] POST /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a/action => generated 24576 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:28:27.054519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:27.055991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:27.064201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.064978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.065968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.066414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.176859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:27.190522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ec80b68-2f0a-408c-abb4-27bb446a4f8d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.320260 Jul 25 20:28:27.191753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2079/4104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:26 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:27.267648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:27.275852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9dfa3fc-4c80-44f4-8390-12bccd802a8a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.228221 Jul 25 20:28:27.276477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2026/4105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:27 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:27.775961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:27.776666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:27.790209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.790665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.791641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.792296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.925986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:27.937297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:27.940306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:27.942165 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-909c626b-639d-42c3-bc30-d77c9fa763a9 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.169974 Jul 25 20:28:27.943357 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2080/4106] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:27 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:27.971430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:27.972780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:27.980540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.981001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:27.981784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:27.988949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:28.215700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:28.217112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:28.224986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:28.225797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:28.226979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:28.227722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:28.928799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:28.942114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:28.951388 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f81f275-ddb2-4bc3-a277-74306adcd4f6 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.740541 Jul 25 20:28:28.954940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:28.957811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:28.959926 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3fc60b6-e216-4937-96b4-ac38843cf785 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.992456 Jul 25 20:28:28.962010 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2027/4107] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:27 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:28.970735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:28.971829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:28.980363 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2081/4108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:28 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:28.984283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:28.985084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:28.986355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:28.987480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:28.994301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:28.995627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:29.005298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:29.006070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:29.007143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:29.008500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:29.157096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:29.194983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:29.197773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:29.200849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77eccb99-5ade-438b-b7b6-8c6591696254 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.219350 Jul 25 20:28:29.201562 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2082/4109] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:28 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:29.404473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:29.417767 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62f94c9e-2487-4ea0-9d83-8921c857a12c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.453135 Jul 25 20:28:29.419480 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2028/4110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:28 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:29.997148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:29.997797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:30.003469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:30.005022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:30.011488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.015270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.015581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.016076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.016296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.017496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.017947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.020053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.593696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.607309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.609120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.611627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9afd5dc7-9330-4f10-a8a6-31e25cefe806 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.613552 Jul 25 20:28:30.612693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2029/4111] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:29 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:30.618628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:30.623126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:30.636359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.637284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.638084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.638531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.680793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.697989 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3afc1f74-1ded-4b8b-98e6-49176807f17a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.706408 Jul 25 20:28:30.699191 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2083/4112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:29 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:30.705783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:30.707821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:30.715645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.716590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.717837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:30.718562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:30.839261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.850237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.852286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:30.853553 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4eb0e2e-21a8-41f7-b69a-eb74362fc098 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.239828 Jul 25 20:28:30.854398 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2030/4113] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:30 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:31.027387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:31.041055 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25dbc12e-3e86-483f-acb6-5de2c0a4632d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.339951 Jul 25 20:28:31.057083 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2084/4114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:30 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:31.639632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:31.642170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:31.657510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:31.658382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:31.660162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:31.661167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:31.724788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:31.729259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:31.737617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:31.738252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:31.739564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:31.740332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:32.096287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.110842 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ded2699e-a4da-4898-a063-ef68c3c470f2 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.393353 Jul 25 20:28:32.111066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.111471 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2085/4115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:31 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:32.116967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:32.117877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:32.125313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:32.127468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:32.128610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:32.129218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:32.130147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.132087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.133947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5387357-8040-4a2d-b749-fb80dc9f599b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.501594 Jul 25 20:28:32.133947 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2031/4116] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:31 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:32.168827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:32.172828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:32.186379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:32.187139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:32.189971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:32.191059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:32.246315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.262334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.270380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.270380 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f6939f14-3091-46bc-bf40-3e4330b2dc0b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.152518 Jul 25 20:28:32.270380 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2086/4117] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:32 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:32.435003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:32.447165 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8cb2f05-79c3-49ea-98e8-02eca2a865c7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.311742 Jul 25 20:28:32.448876 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2032/4118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:32 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:33.142299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:33.143055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:33.152561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.153023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.153934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.154709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.168873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:33.171784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:33.184905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.185570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.187248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.188313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.471027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.479986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-261ec629-06c7-45ca-a3ab-42eef8db7353 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.344454 Jul 25 20:28:33.487680 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2087/4119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:33 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:33.487680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:33.487680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:33.492657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.493344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.494356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.494800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.503711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.514157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.515847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.517774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ce48339-8d4e-48da-ac7d-58f2f65d0fef tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.355260 Jul 25 20:28:33.524689 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2033/4120] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:33 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:33.524689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:33.524689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:33.531803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.532968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.533867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:33.534489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:33.603312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.633125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.640433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.645754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26afff9b-7a25-4ebc-ba1a-7a31e711b07f tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.162822 Jul 25 20:28:33.653589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2088/4121] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:33 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:33.834482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:33.844925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9afd8201-8ad2-4a54-8070-63f80c604702 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.325139 Jul 25 20:28:33.845999 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2034/4122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:33 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:34.506679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:34.509882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:34.518455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.519279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.520419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.521053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.545789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:34.547235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:34.559542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.560022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.560828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.561268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.851661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:34.865295 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7fd5cbe0-b9cf-439f-ab31-17a8f02641cf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.363812 Jul 25 20:28:34.866094 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2089/4123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:34 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:34.885983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:34.886842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:34.896966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.897922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.899795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:34.900760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:34.908815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:35.365137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.385717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.389810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.393140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1f4219c-a2ae-4009-b69f-5dc2ca239527 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.524317 Jul 25 20:28:35.394837 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2090/4124] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:34 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:35.418775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.423695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:35.424417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:35.436871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.440574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.443230 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d28a8b3-c3a7-4aea-992a-8e18ab2e2f83 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.901550 Jul 25 20:28:35.445248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:35.446425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:35.448326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:35.449396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:35.458185 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2035/4125] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:34 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:35.719163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:35.753117 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-756840fe-bf5a-4a70-8b3d-e0a1fefef3ca tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.356529 Jul 25 20:28:35.760659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2091/4126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:35 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:35.889671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:35.890899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:35.914681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:35.914681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:35.914681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:35.914681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.262280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:36.272162 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88812cf9-13f3-4416-b4ed-6de279c1c319 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.386680 Jul 25 20:28:36.287186 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2036/4127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:35 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:36.422376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:36.423434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:36.430283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.430982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.431928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.433166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.488647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:36.489413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:36.499183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.500421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.501723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.502571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.543215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:36.553768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:36.554037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:36.555761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:36.557238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72c8457a-ff38-417f-a574-a2386f12c9db tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1408 microversion: 2.54 time: 0.139291 Jul 25 20:28:36.577614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2092/4128] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:36 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:36.786927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:36.788015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:36.798727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:36.805898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.806943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:36.807968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:36.808661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:37.076666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.098992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.105201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.106463 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bec48740-e91e-48d7-bc5e-8bbd9f80c587 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.624174 Jul 25 20:28:37.136213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2037/4129] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:36 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:37.197215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.207033 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24c8b22d-0496-475f-8fe8-ede4314a6f30 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.428620 Jul 25 20:28:37.208084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2093/4130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:36 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:37.301418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:37.303591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:37.317697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:37.318792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:37.320362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:37.321063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:37.586076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:37.587093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:37.598036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:37.599179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:37.600900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:37.601804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:37.866149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.887035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.891477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.893917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aba32c36-9ecb-4718-8612-9bf462df112b tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1414 microversion: 2.54 time: 0.313376 Jul 25 20:28:37.896785 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2094/4131] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:37 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1414 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:37.917742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:37.968995 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33e8dad2-fb4e-44f6-beb5-b388fa8961f1 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.668484 Jul 25 20:28:37.972784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2038/4132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:37 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:38.142552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:38.144863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:38.164659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.168222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.170905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.174562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.230243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:38.231654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:38.248000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.248747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.249720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.250315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.821949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:38.842743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c39b4bbc-362d-4976-93fa-1e270bda9618 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.616394 Jul 25 20:28:38.843721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2039/4133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:38 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:38.852800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:38.876516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:38.881058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:38.886066 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2bb38d12-3fb9-4f85-8b50-d12d5ee51484 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.752703 Jul 25 20:28:38.887952 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2095/4134] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:38 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:38.925395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:38.926024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:38.943732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.947332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.951593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:38.951883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:38.995165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:38.996740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:39.008341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.009606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:39.011179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.014087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:39.543866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:39.602678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:39.606366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:39.613831 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb822d76-2805-4051-83bc-262d0ad95428 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1414 microversion: 2.54 time: 0.695265 Jul 25 20:28:39.618167 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2040/4135] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:38 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1414 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:39.689127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:39.702308 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c082b8aa-28b1-445f-ab61-c797b82d0d31 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.711801 Jul 25 20:28:39.703227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2096/4136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:38 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:28:39.873380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:39.874845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:39.902417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.905037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:39.908606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.910834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:39.913762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:39.915033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:39.924371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.925108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:39.926227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:39.927032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.450628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.461446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.478675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.480323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.481241 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-042448d9-8f32-4ac7-96bf-f902cfd144ed tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.614936 Jul 25 20:28:40.482016 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2041/4137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:39 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:40.488944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-121258ff-8e97-4751-a8ac-b408e1c9d6f3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.580148 Jul 25 20:28:40.496281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2097/4138] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:39 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:40.659302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:40.660547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:40.675293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.675771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.676627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.677077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.751696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:40.752543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:40.781237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.782697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.783691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.784346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.832196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.844119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.847372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:40.855548 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1c04fc5-f32f-471f-bd33-8dbde70491da tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1399 microversion: 2.54 time: 0.201195 Jul 25 20:28:40.875427 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2042/4139] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:40 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1399 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:40.881359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65015234-dab2-4d6e-88ff-33eaf3b659b5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '.version_select at 0x7f19695c5700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:40.908644 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65015234-dab2-4d6e-88ff-33eaf3b659b5 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-645417281" status: 204 len: 0 microversion: 2.54 time: 0.031607 Jul 25 20:28:40.909952 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2043/4140] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-645417281 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:28:40.929773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:40.931072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:40.965082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.976741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:40.983320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:40.984024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:41.039710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:28:41.089634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:41.097768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ede0c03e-e8c5-4d80-afed-c020b0d0101f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.350219 Jul 25 20:28:41.101587 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2098/4141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:40 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:41.172867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-968ddc3d-a3d6-4a1a-9a22-e5dce9cdf58e tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 204 len: 0 microversion: 2.54 time: 0.252082 Jul 25 20:28:41.174369 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2044/4142] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:28:40 2022] DELETE /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:28:41.183199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:41.183829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:41.199781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:41.200268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:41.201054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:41.201672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:41.494355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:41.505438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:41.514305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:41.519787 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c2ae64e-2d70-4cb5-8285-b385f9b65c3a tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1405 microversion: 2.54 time: 0.340679 Jul 25 20:28:41.520503 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2099/4143] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:41 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:41.538769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1330417762", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b091c95b-f8dc-467b-9401-70968cfbef52"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:41.542981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:41.544427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:41.555383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:41.556315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:41.557563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:41.558571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:41.656652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] validate_networks() for [('b091c95b-f8dc-467b-9401-70968cfbef52', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:28:42.449921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:42.460311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e44cc276-21a6-4d6a-a7a9-4792ae8d7747 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.938616 Jul 25 20:28:42.461770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2100/4144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:41 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:42.468870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:42.470103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:42.488876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:42.489614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:42.491047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:42.493741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.118497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.145235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.151509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.159279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2a46cf1-e8d9-4076-9d72-154d681f6af6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.692309 Jul 25 20:28:43.159958 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2101/4145] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:42 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:43.178389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:43.179959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:43.198208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:28:43.199228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:28:43.199586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:28:43.200448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:28:43.201028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:28:43.211214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.211750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.212602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.217010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.228180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.229094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.230333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.230781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.263705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Getting quotas for project 42fa158165154c61a252cd2bf35e841a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:28:43.271803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Getting quotas for user 654c702d1cc94f69812c486e36a8d376 and project 42fa158165154c61a252cd2bf35e841a. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:28:43.305847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:28:43.308770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:28:43.388717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b8b1f80-4fa3-4174-94c2-aa86f98e0600 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.158882 Jul 25 20:28:43.392403 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2045/4146] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:28:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:28:43.400521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:43.402537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:43.412496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.413708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.415123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.416285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.499013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.499533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.500368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lazy-loading 'fault' on Instance uuid ad41b817-58c6-4d84-85db-9a0444d8495b {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:28:43.572208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.601293 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48bc0c5d-f880-4113-9f1c-b0d0fa9f700f tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.439479 Jul 25 20:28:43.612075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2102/4147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:43 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:43.612339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.619263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd1682b7-abe2-4794-8998-0edac32eeebd tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:43.619263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd1682b7-abe2-4794-8998-0edac32eeebd tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:43.626449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.628337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0ae6aeba6604cc697c4f8e5c349bf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fe6b43ad72450dbb6664c13b64806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.629751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-89b840fb-be22-427a-82c8-cbea9e4cc336 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 200 len: 1410 microversion: 2.54 time: 0.235889 Jul 25 20:28:43.632411 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2046/4148] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:43 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:43.637301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:43.637934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:43.663050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.663516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.666418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:43.666805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:43.735448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd1682b7-abe2-4794-8998-0edac32eeebd tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.747486 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd1682b7-abe2-4794-8998-0edac32eeebd tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1225 microversion: 2.1 time: 0.142830 Jul 25 20:28:43.749220 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2103/4149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:43 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:43.967481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:43.990919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f36d59ba-3459-4c03-bfa5-cdd549f4f734 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.355637 Jul 25 20:28:44.005976 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2047/4150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:43 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:44.187922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:44.188706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:44.205166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.205632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.206432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.206878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.630440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:44.632545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:44.646210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.649276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.651339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.653681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.708572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:44.729900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:44.740968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:44.742585 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-744b4312-cabc-45da-93e8-959b6e3b0e3c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.561400 Jul 25 20:28:44.747721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2104/4151] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:44 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:44.758443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:44.759074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] [instance: ad41b817-58c6-4d84-85db-9a0444d8495b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:44.793686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.796667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.797733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.800466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.830660 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] HTTP exception thrown: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Request method failure captured: Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b HTTP/1.1 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vzHUmUiMZMLqjf8APTQLqRRtOLj1E2KYzMu7Rycq0726UvqV8pnnTLUro-N1RDb5C5SiHdVF2IJ7UWyaAp9OAXTrJA_tXcL-AQnYCcFKZwfIbRSgJqikO3TwB9f6B0-v6I3HFmgOM8mUoU2is6NHfLK6tTvbstpsi8UyzxkSArbu5E Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.54 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 82fe6b43ad72450dbb6664c13b64806a Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerShowV254Test-518531513 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82fe6b43ad72450dbb6664c13b64806a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_82fe6b43ad72450dbb6664c13b64806a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/82fe6b43ad72450dbb6664c13b64806a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/82fe6b43ad72450dbb6664c13b64806a"}]}] Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerShowV254Test-518531513 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 82fe6b43ad72450dbb6664c13b64806a Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerShowV254Test-518531513 Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerShowV254Test-518531513-project Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b0ae6aeba6604cc697c4f8e5c349bf7f Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerShowV254Test-518531513-project Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'ad41b817-58c6-4d84-85db-9a0444d8495b'} Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:28:44.834155 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. Jul 25 20:28:44.839525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:28:44.843324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] Returning 404 to user: Instance ad41b817-58c6-4d84-85db-9a0444d8495b could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:28:44.844658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07a7ca08-77f9-493c-a707-98e2a3144073 tempest-ServerShowV254Test-518531513 tempest-ServerShowV254Test-518531513-project] 10.222.0.48 "GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b" status: 404 len: 111 microversion: 2.54 time: 0.095634 Jul 25 20:28:44.848786 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2105/4152] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:44 2022] GET /compute/v2.1/servers/ad41b817-58c6-4d84-85db-9a0444d8495b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:28:44.859844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:44.863520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:44.878770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.879398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:44.883499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:44.884394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:45.060511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:45.073127 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-32f54cd7-88c8-424f-9433-2ccac3b2fa99 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1277 microversion: 2.1 time: 0.222790 Jul 25 20:28:45.073734 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2106/4153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:44 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:45.085609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:45.086219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:45.126073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:45.126521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:45.135233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:45.135233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:45.599591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:45.612817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e765262-f6e0-427b-98b8-3877fc4ad471 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.986698 Jul 25 20:28:45.624523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2048/4154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:44 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:45.766106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:45.767412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:45.787994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:45.790707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:45.791944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:45.794111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:45.910257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:45.921371 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c04821da-36a4-4dda-a4b0-2a2718014271 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.839496 Jul 25 20:28:45.925658 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2107/4155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:45 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:46.095886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:46.097101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:46.120880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.121357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:46.122179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.122617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:46.199205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:46.525642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:46.557857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fadec1e0-ae1d-4009-840f-c18791bf45d2 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1283 microversion: 2.1 time: 0.466472 Jul 25 20:28:46.574780 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2108/4156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:46 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1283 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:46.638524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:46.639191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:46.651035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.653151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:46.656467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.663022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:46.837762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:46.866356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:46.888798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:46.897634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db951da0-7ad0-4354-9599-8edeef3c924c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.136228 Jul 25 20:28:46.902497 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2049/4157] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:45 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:46.943032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:46.943663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:46.957768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.961023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:46.962034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:46.962493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:47.586469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:47.602008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5a5a629-2709-4326-940e-6023042f892c tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.967223 Jul 25 20:28:47.604526 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2109/4158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:46 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:47.616425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:47.619499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:47.644355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:47.644997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:47.645964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:47.646573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:47.814281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:47.825258 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d6de353-aa9b-4e1e-b63e-4dabbf95a515 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1283 microversion: 2.1 time: 0.219347 Jul 25 20:28:47.843936 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2110/4159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:47 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:47.914841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:47.931572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3066a54b-dcf2-4912-a763-8c90e20903cc tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.991255 Jul 25 20:28:47.933342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2050/4160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:46 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:47.935717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:47.942454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:47.951580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:47.957231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:47.962836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:47.963536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:47.984404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0f4c10b-1fcd-4c2b-8bc8-5765a9a97893 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: .version_select at 0x7f19697760d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1520214298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjf0eJMoZjySMkeVhKQJEP7LAfUiYRp4etsAeTI7/WQ++q+sFS2B1DX5zSXzE3MRIgOvT9OGSRL8r55tWmB8yrWCGXv2I4s5dQfpHBTnBYU58/w8Itohx3OxoSHqjM5Tg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:48.003156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d0f4c10b-1fcd-4c2b-8bc8-5765a9a97893 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:28:48.012365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d0f4c10b-1fcd-4c2b-8bc8-5765a9a97893 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:28:48.046130 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d0f4c10b-1fcd-4c2b-8bc8-5765a9a97893 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.065928 Jul 25 20:28:48.047984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2051/4161] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:28:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:48.629444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:48.630444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:48.643440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:48.649517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:48.650633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:48.653781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:48.656293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:49.550416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:49.567742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:49.580596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:49.586099 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4d41a7d-7682-4fae-b36d-9d5bedae25e6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.657140 Jul 25 20:28:49.587048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2111/4162] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:47 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:28:49.603811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:49.605646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:49.622787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:49.624482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:49.626890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:49.627561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:49.818739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:49.830400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-509b5550-614d-4266-a9a6-7e96b152855a tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1283 microversion: 2.1 time: 0.240687 Jul 25 20:28:49.832162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2112/4163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:49 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:49.849265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:49.854253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:49.868470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:49.869261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:49.871356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:49.874437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:50.397981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:50.408673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e33fd37-32b2-4e26-a6a7-a9bbbbc0c33e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 1.784453 Jul 25 20:28:50.427918 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2052/4164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:48 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:50.433475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1180843317", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b412a2cc-9f13-4c23-8e2f-b340bea1e96b"}], "key_name": "tempest-TestNetworkBasicOps-1520214298", "security_groups": [{"name": "tempest-secgroup-smoke-334496223"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:50.448859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:50.458660 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5168a1de-1390-4492-bdc8-ef58c693abe4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.625194 Jul 25 20:28:50.480433 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2113/4165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:49 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:50.611725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:50.614396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:50.626891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:50.634550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:50.635709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:50.636376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:50.722947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] validate_networks() for [('b412a2cc-9f13-4c23-8e2f-b340bea1e96b', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:28:51.461395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:51.479734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:51.481345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:51.482563 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab56d1b2-b04f-46df-aaed-3cc686dceb79 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.876177 Jul 25 20:28:51.484547 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2114/4166] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:50 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:51.496000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:51.496671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:51.515695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:51.517167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:51.517980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:51.518431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:52.306571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:52.322254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e2e6107-029e-4912-bd36-5ecbc56ea570 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.834955 Jul 25 20:28:52.323597 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2115/4167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:51 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:52.353078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:52.354518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:52.365805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:52.366407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:52.368208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:52.369601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:52.882762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:52.892177 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7480e086-6cbb-4de3-99a9-4d38bb4e08f5 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1524 microversion: 2.1 time: 0.567026 Jul 25 20:28:52.892650 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2116/4168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:52 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1524 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:53.126855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:28:53.126855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:28:53.127342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:28:53.128219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:28:53.128644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:28:53.145602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.147183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.151209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.152607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.215616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:28:53.240964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:28:53.279077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:28:53.283379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:28:53.443320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:53.444782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:53.470530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c9b3d84d-b6ad-465e-b9fb-8cf436e737d2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.041037 Jul 25 20:28:53.475451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.476490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.477701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.478620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2053/4169] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:28:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 3050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:28:53.499281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.512657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:53.536968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:53.608849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.610728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.615593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:53.616381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:53.746688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:54.366965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:54.392630 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6da0234-71e2-49de-a716-d7d08a827d4b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 1.490624 Jul 25 20:28:54.396974 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2117/4170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:52 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:54.412206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:54.416593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:54.436780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:54.441783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:54.443012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:54.447598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.063298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:55.084485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:55.093755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:55.105240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75e5872d-cbf7-4198-b501-f98169ba4fe1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 1.604610 Jul 25 20:28:55.106357 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2054/4171] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:53 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:55.126552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:55.127675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:55.146574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.146574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.150367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.152689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.210401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:28:55.418822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:55.448432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46115bb6-495b-4939-a58b-918824f8ba45 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1245 microversion: 2.1 time: 0.336523 Jul 25 20:28:55.464301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2055/4172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:55 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1245 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:55.471040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:55.472119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:55.483581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.486014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.493004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.493873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.498348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:55.520182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07b1dd3d-91e6-48ce-b0a7-5c9a19eaf837 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 1.120182 Jul 25 20:28:55.525684 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2118/4173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:54 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:55.532001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-37697178-f4ea-489a-82cb-73cbc70c5936 req-0ca98d6a-f843-40c8-b3ee-194586398768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89", "tag": "a562bd89-24dd-4eaf-a52d-a455ca0c6c00"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:55.555702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-37697178-f4ea-489a-82cb-73cbc70c5936 req-0ca98d6a-f843-40c8-b3ee-194586398768 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.556572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-37697178-f4ea-489a-82cb-73cbc70c5936 req-0ca98d6a-f843-40c8-b3ee-194586398768 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.592235 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-37697178-f4ea-489a-82cb-73cbc70c5936 req-0ca98d6a-f843-40c8-b3ee-194586398768 service nova] Creating event network-changed:a562bd89-24dd-4eaf-a52d-a455ca0c6c00 for instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 on n-h2-845775-3 Jul 25 20:28:55.604518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-37697178-f4ea-489a-82cb-73cbc70c5936 req-0ca98d6a-f843-40c8-b3ee-194586398768 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073990 Jul 25 20:28:55.605425 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2119/4174] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:55.622880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:55.627027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:55.643183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.643726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:55.645979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:55.649902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.240955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.249100 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd30cfbb-5c99-44f0-b1d2-64e68b647642 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1504 microversion: 2.1 time: 0.783272 Jul 25 20:28:56.267050 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2056/4175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:55 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1504 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:56.277047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:56.282281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:56.300657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.301487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.303857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.305678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.323519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.352811 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fe069291-6423-417a-84c1-94011d38279e tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1510 microversion: 2.1 time: 0.742834 Jul 25 20:28:56.367168 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2120/4176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:55 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1510 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:56.373549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b162dfb3-5edc-4dcf-b42d-1920b43ca380 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'create', calling method: .version_select at 0x7f1969582430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489662726", "description": "tempest-description-1024094328"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:56.604060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.618411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.619939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.625131 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94e2d9cb-2fcc-4fe4-8fba-bbd160cc1cbb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.356320 Jul 25 20:28:56.629527 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2057/4177] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:56 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:56.635483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:56.636718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:56.644491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.645895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.659249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.660188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.812332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:56.814056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b162dfb3-5edc-4dcf-b42d-1920b43ca380 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.444256 Jul 25 20:28:56.827264 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1503588-a097-4623-9572-765f1ac0eac8 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1307 microversion: 2.1 time: 0.195778 Jul 25 20:28:56.829030 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2058/4178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:56 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:56.838769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:56.839641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:56.846247 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2121/4179] 10.222.0.48 () {60 vars in 1180 bytes} [Mon Jul 25 20:28:56 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:56.852808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.853282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.854165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.854716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.869930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3283eeae-d6bc-4af1-b456-dc52196b004c req-0000579d-e4cb-47c1-8319-1a573aebc109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "43d2f154-a52c-47d9-b293-2b81ea768df3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:56.903760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3283eeae-d6bc-4af1-b456-dc52196b004c req-0000579d-e4cb-47c1-8319-1a573aebc109 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.904330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3283eeae-d6bc-4af1-b456-dc52196b004c req-0000579d-e4cb-47c1-8319-1a573aebc109 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.943693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3283eeae-d6bc-4af1-b456-dc52196b004c req-0000579d-e4cb-47c1-8319-1a573aebc109 service nova] Creating event network-vif-plugged:43d2f154-a52c-47d9-b293-2b81ea768df3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:28:56.955448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3283eeae-d6bc-4af1-b456-dc52196b004c req-0000579d-e4cb-47c1-8319-1a573aebc109 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107143 Jul 25 20:28:56.956404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2122/4180] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:28:56.963116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489662726"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:56.964006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:56.971033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.972810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:56.973895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:56.974493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:57.358221 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.security_group_api [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Adding security group ebb41e89-ace4-4140-a695-584fa49652a2 to port 3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 Jul 25 20:28:57.479622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:57.491243 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aeffdb9c-5c00-4a13-8b43-aec09e365373 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.660953 Jul 25 20:28:57.495506 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2059/4181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:56 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:57.501226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:57.512140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:57.529681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:57.535947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:57.550279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:57.552891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:58.192067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:58.205387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4cf76fc-c38e-4bc6-bbca-eb038acfe981 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1487 microversion: 2.1 time: 0.708390 Jul 25 20:28:58.211928 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2060/4182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:57 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1487 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:58.225743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:58.229033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:58.247582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:58.248074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:58.248834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:58.255933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:58.911698 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9cf18956-1858-44b3-ab3a-19cf969bfe4e tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action" status: 202 len: 0 microversion: 2.1 time: 1.954062 Jul 25 20:28:58.912688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2123/4183] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:28:56 2022] POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action => generated 0 bytes in 1956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:28:58.918969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:58.919591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:58.936340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:58.936895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:58.937592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:58.938061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.054237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:59.055922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:59.062274 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-27bdeb6d-36c4-4ea0-8cee-fa0bd918aaa9 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1307 microversion: 2.1 time: 0.148429 Jul 25 20:28:59.070115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:59.074970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:59.078268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9b16185-7696-4ee7-b633-f793f913a4c3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.864959 Jul 25 20:28:59.086563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2061/4184] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:28:58 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:28:59.089779 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2124/4185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:58 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:59.095738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:59.096644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:59.103097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:28:59.104717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.105394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.106649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.107269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.114111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:59.130195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.131092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.132932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.133614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.206064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:28:59.556639 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2271b346-0066-4dbb-917a-80031418dc2b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 204 len: 0 microversion: 2.1 time: 0.467048 Jul 25 20:28:59.558539 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2062/4186] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:28:59 2022] DELETE /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:28:59.568510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-489662726"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:59.570138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:28:59.585419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.586301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.587513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.588218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:28:59.921482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:28:59.933658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71ced754-6e33-4149-9d34-292529eb5700 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.839725 Jul 25 20:28:59.935845 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2125/4187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:28:59 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:28:59.948460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "12743539-7c11-4da3-b872-3bfc3dbcd3e7"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "ad66e97f-8a60-4ffa-9527-ea585ecd0e5b"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "0b99c227-344a-4aff-bf0f-6138d40f1d19"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:28:59.986584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:28:59.987066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.003243 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Creating event network-vif-plugged:12743539-7c11-4da3-b872-3bfc3dbcd3e7 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:00.004230 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Creating event network-vif-plugged:ad66e97f-8a60-4ffa-9527-ea585ecd0e5b for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:00.005417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] Creating event network-vif-plugged:0b99c227-344a-4aff-bf0f-6138d40f1d19 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:00.013894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6b7aa997-1fb4-45e5-81eb-79311b0c2970 req-a8b9c9f8-e764-4a04-a1fc-81776f5ce5ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072211 Jul 25 20:29:00.015503 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2126/4188] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:00.021548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2f103bff-79b0-465f-acd4-ebf4699db076 req-8fdda68e-2bd9-42ff-8c63-d80cb5b88025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:00.034968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2f103bff-79b0-465f-acd4-ebf4699db076 req-8fdda68e-2bd9-42ff-8c63-d80cb5b88025 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:00.035845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2f103bff-79b0-465f-acd4-ebf4699db076 req-8fdda68e-2bd9-42ff-8c63-d80cb5b88025 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.050466 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2f103bff-79b0-465f-acd4-ebf4699db076 req-8fdda68e-2bd9-42ff-8c63-d80cb5b88025 service nova] Creating event network-changed:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:29:00.060309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2f103bff-79b0-465f-acd4-ebf4699db076 req-8fdda68e-2bd9-42ff-8c63-d80cb5b88025 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042844 Jul 25 20:29:00.062895 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2127/4189] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:00.070742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:00.072206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:00.084689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:00.085388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.086433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:00.087106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.114108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Removing security group ebb41e89-ace4-4140-a695-584fa49652a2 from port 3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 Jul 25 20:29:00.659952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:00.672414 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6cfe4f1-7f8b-4f0b-80c3-c3327fc70aa5 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1493 microversion: 2.1 time: 0.607254 Jul 25 20:29:00.673602 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2128/4190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:00 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1493 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:00.678442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:00.679522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:00.687097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:00.688421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.689401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:00.690020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:00.719376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:01.244376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ea93f28-25f0-4151-8ca6-3226b12e401d tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action" status: 202 len: 0 microversion: 2.1 time: 1.684202 Jul 25 20:29:01.245003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2063/4191] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:28:59 2022] POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action => generated 0 bytes in 1686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:29:01.255225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:01.255855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:01.265793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:01.276830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:01.277859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:01.278420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:01.295787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:01.307751 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ba935ff-f855-4cae-a84f-12f312aa5641 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 0.630210 Jul 25 20:29:01.308666 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2129/4192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:00 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:01.318744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:01.321231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:01.357079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:01.361774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:01.363232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:01.363837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:01.934534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:01.946261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:01.950874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:01.960779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-efa8aac2-1616-4df9-9e52-23d50202e05c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.714509 Jul 25 20:29:01.961965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2064/4193] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:29:01 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:29:01.966628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8496a252-f2f3-417b-93f4-bd3a4340cc82 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'create', calling method: .version_select at 0x7f196987b040>, body: {"pool": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:02.019995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:02.028379 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dafe5365-8f9d-4cef-bf80-4069776a37b4 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.716942 Jul 25 20:29:02.037981 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2130/4194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:01 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:02.043756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:02.048924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:02.064502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:02.065931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:02.066963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:02.070807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:03.180069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:03.200670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:03.211124 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e39bd90f-58cc-4509-9e34-275ae7322038 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 200 len: 1493 microversion: 2.1 time: 1.170492 Jul 25 20:29:03.218600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2131/4195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:02 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 1493 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:03.224696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "9c18bae2-64e2-49ee-b81a-af5f56618bac"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "8e7a009b-34d5-4fd8-924e-d2083fc61888"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:03.257711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:03.258345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:03.259741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:03.282947 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] Creating event network-vif-plugged:9c18bae2-64e2-49ee-b81a-af5f56618bac for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:03.296802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] Creating event network-vif-plugged:8e7a009b-34d5-4fd8-924e-d2083fc61888 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:03.303616 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c360561e-a78b-4fbd-bf14-32e0ef42f576 req-6c90e96f-7e73-4872-8462-c19a6dabb5c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083280 Jul 25 20:29:03.305301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2132/4196] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:03.311942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4f44be1f-115d-4917-a1cc-5e2d0f6ba191 req-50557525-935f-4f9d-a54d-3452b43f7332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:03.322798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f44be1f-115d-4917-a1cc-5e2d0f6ba191 req-50557525-935f-4f9d-a54d-3452b43f7332 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:03.323660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4f44be1f-115d-4917-a1cc-5e2d0f6ba191 req-50557525-935f-4f9d-a54d-3452b43f7332 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:03.343039 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4f44be1f-115d-4917-a1cc-5e2d0f6ba191 req-50557525-935f-4f9d-a54d-3452b43f7332 service nova] Creating event network-changed:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:29:03.355776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4f44be1f-115d-4917-a1cc-5e2d0f6ba191 req-50557525-935f-4f9d-a54d-3452b43f7332 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048179 Jul 25 20:29:03.356821 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2133/4197] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:03.376084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:03.377578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:03.390618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:03.391118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:03.392018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:03.392886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:04.034271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:04.043454 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f72a92b-0aa9-430b-9711-5854a02d6d2e tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 0.685334 Jul 25 20:29:04.044078 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2134/4198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:03 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:04.063062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:04.063656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:04.082823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:04.083283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:04.084167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:04.084613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:04.712839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:04.723411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:04.731626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:04.739867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e670e65-910a-46a3-bba9-b17e00cc4ac6 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.694683 Jul 25 20:29:04.741019 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2135/4199] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:29:04 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:29:04.746031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:04.756152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:04.772703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:04.773235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:04.774449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:04.775121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:05.417161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:05.440294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7734816e-2fdb-4f48-87b2-6fe9559467c0 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.687844 Jul 25 20:29:05.441521 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2136/4200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:04 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:05.446551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:05.447175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:05.459853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:05.460459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:05.461526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:05.466950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:05.487371 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 HTTP/1.1 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7'} Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:05.489141 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:05.493691 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:05.495845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:05.496965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-96b1ca1f-f650-4df0-9795-5f19f08f28e4 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 404 len: 111 microversion: 2.1 time: 0.054362 Jul 25 20:29:05.497578 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2137/4201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:05 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:05.619623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9bdbee79-499a-47d1-b108-b4d5fa087751 req-906212f0-b4a2-44ad-af47-30398a2d3091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded", "tag": "33036c09-f112-4b8f-97e4-4bea1e12d2bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:05.637340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9bdbee79-499a-47d1-b108-b4d5fa087751 req-906212f0-b4a2-44ad-af47-30398a2d3091 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:05.637788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9bdbee79-499a-47d1-b108-b4d5fa087751 req-906212f0-b4a2-44ad-af47-30398a2d3091 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:05.673925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9bdbee79-499a-47d1-b108-b4d5fa087751 req-906212f0-b4a2-44ad-af47-30398a2d3091 service nova] Creating event network-changed:33036c09-f112-4b8f-97e4-4bea1e12d2bb for instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded on n-h2-845775-3 Jul 25 20:29:05.686265 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9bdbee79-499a-47d1-b108-b4d5fa087751 req-906212f0-b4a2-44ad-af47-30398a2d3091 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187207 Jul 25 20:29:05.687475 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2138/4202] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:05.694258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:05.695226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:05.702314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:05.703054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:05.704565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:05.705899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:06.264918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:06.277608 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18573c88-b9b5-4237-a12b-7900361522ca tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 0.587708 Jul 25 20:29:06.278212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2139/4203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:05 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:06.284933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-plugged", "status": "completed", "tag": "643be01f-9e75-48bf-b958-18e11ebe41e3"}, {"server_uuid": "8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89", "name": "network-vif-plugged", "status": "completed", "tag": "a562bd89-24dd-4eaf-a52d-a455ca0c6c00"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:06.317462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:06.317876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:06.346740 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] Creating event network-vif-plugged:643be01f-9e75-48bf-b958-18e11ebe41e3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:06.347254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] Creating event network-vif-plugged:a562bd89-24dd-4eaf-a52d-a455ca0c6c00 for instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 on n-h2-845775-3 Jul 25 20:29:06.372236 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5080f3c0-680b-434a-ac9c-050d8eff915f req-8bcdcfc3-2f90-47ab-893a-fb2e4611fd94 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091862 Jul 25 20:29:06.373554 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2140/4204] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:06.402103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-733d4c30-a20d-4b7b-b1e7-8e753386e0e1 req-455f3ebb-59a9-49e9-8178-9865bb7b9e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7", "name": "network-vif-deleted", "tag": "1398e7fb-68c8-4e89-8122-bd9e018b120d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:06.431779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-733d4c30-a20d-4b7b-b1e7-8e753386e0e1 req-455f3ebb-59a9-49e9-8178-9865bb7b9e12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:06.434856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-733d4c30-a20d-4b7b-b1e7-8e753386e0e1 req-455f3ebb-59a9-49e9-8178-9865bb7b9e12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:06.463175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-733d4c30-a20d-4b7b-b1e7-8e753386e0e1 req-455f3ebb-59a9-49e9-8178-9865bb7b9e12 service nova] Creating event network-vif-deleted:1398e7fb-68c8-4e89-8122-bd9e018b120d for instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 on n-h1-845775-3 Jul 25 20:29:06.476065 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-733d4c30-a20d-4b7b-b1e7-8e753386e0e1 req-455f3ebb-59a9-49e9-8178-9865bb7b9e12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098256 Jul 25 20:29:06.477366 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2141/4205] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:06.492848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-275531790", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "b682f7b7-7344-4599-b42c-497365d8bb7a"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:06.592951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] validate_networks() for [('b682f7b7-7344-4599-b42c-497365d8bb7a', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:29:07.120259 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8496a252-f2f3-417b-93f4-bd3a4340cc82 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.157027 Jul 25 20:29:07.121296 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2065/4206] 10.222.0.48 () {60 vars in 1170 bytes} [Mon Jul 25 20:29:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:07.126185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:07.127037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:07.143117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.143616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.149490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.150261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.541564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:07.552553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:07.554184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:07.555507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28f0847d-679f-451a-acdf-1abcf143d324 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1870 microversion: 2.32 time: 0.433123 Jul 25 20:29:07.556127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2066/4207] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:29:07 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1870 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:29:07.561473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:07.562186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:07.575119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.575315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.576593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.577193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.703879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:29:07.706013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:29:07.707254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:29:07.708346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:29:07.709163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:29:07.717658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:07.741707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.743284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.745055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.746129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.798317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:29:07.809244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:07.815298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Getting quotas for user c38c00ddcc14420bbb568d4b1551311b and project f83dc67ff5b04948819eb8b6e13ebca5. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:29:07.832753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:29:07.835382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a0235aa-52f9-4f09-9879-d7b5ce4bdfde tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1325 microversion: 2.1 time: 0.277552 Jul 25 20:29:07.835642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:29:07.844617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2067/4208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:07 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1325 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:07.869768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.93"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:07.873135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:07.886036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.887373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.895561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:07.896855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:07.958550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Acquired lock "refresh_cache-7fb41870-c243-4a9b-adf1-e344a38c3aa3" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:29:08.017769 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a939270a-3581-4414-aecc-6a62807a088a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538445 Jul 25 20:29:08.018859 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2142/4209] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:29:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:29:08.064070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:08.065966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:08.096202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:08.096956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:08.098227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:08.105908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:10.083711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:10.100014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-729f4416-3931-462c-b10f-08f0f9e9599f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 2.066670 Jul 25 20:29:10.101059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2143/4210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:08 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:10.119493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:10.120933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:10.146064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:10.153127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:10.154052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:10.154539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:10.430278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:10.446992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23a7b71b-6739-43d7-80f3-e760b6b90f6a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1272 microversion: 2.1 time: 0.342050 Jul 25 20:29:10.453658 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2144/4211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:10 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1272 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:10.585690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1944606903", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:10.734693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] validate_networks() for [('6c5e2337-ad74-4e5b-8f37-15330da4632d', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:29:12.486106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:29:12.487218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:29:12.488202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:29:12.489346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:29:12.490831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:29:12.523451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:12.524494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:12.526536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:12.527642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:12.573569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Getting quotas for project 23c606f8cc3c416da99df27c473131e4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:29:12.586275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Getting quotas for user 5d5be665c18142a8917312b500d0c805 and project 23c606f8cc3c416da99df27c473131e4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:29:12.605753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:29:12.608789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:29:12.674545 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69056c9b-cecd-4e4d-81ae-7512445c6fbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218903 Jul 25 20:29:12.677365 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2145/4212] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:29:12.689971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:12.691627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:12.704633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:12.705214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:12.708915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:12.709370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:14.134497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:14.161325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:14.183717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:14.191189 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0fc12a55-1665-4a51-8908-872c33f16273 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2823 microversion: 2.32 time: 1.506562 Jul 25 20:29:14.191861 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2146/4213] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:29:12 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2823 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:29:14.223713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:14.228600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:14.258168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:14.267142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:14.274119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:14.274788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:14.297693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Building network info cache for instance {{(pid=119723) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:29:15.213781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:15.229628 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8efa2abf-18b1-4053-be33-7acbaab7a662 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1521 microversion: 2.1 time: 1.029944 Jul 25 20:29:15.235212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2147/4214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:14 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1521 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:15.244020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:15.247517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:15.268586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:15.269417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:15.271081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:15.271716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.051754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:16.073469 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4f3181f-efbc-4d91-9886-19c7402eea12 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 0.836246 Jul 25 20:29:16.075611 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2148/4215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:15 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:16.082952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:16.084361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:16.097333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.097805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.098603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.099044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.644449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:16.654613 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ddb7693-6477-40f8-a9e8-c950737ab7dd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 0.575636 Jul 25 20:29:16.669607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2149/4216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:16 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:16.676002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:16.676664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:16.685595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.686128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.686922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.688263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.884565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:16.893867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9056140c-6533-4317-b961-9289b9d6f585 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1275 microversion: 2.1 time: 0.223017 Jul 25 20:29:16.895600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2150/4217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:16 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:16.913312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9a60ae35-5eb2-4e0a-af10-b7d0307ae85d req-8ae07809-ec9e-42b1-8359-9ddb84589fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded", "name": "network-vif-plugged", "status": "completed", "tag": "33036c09-f112-4b8f-97e4-4bea1e12d2bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:16.925142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9a60ae35-5eb2-4e0a-af10-b7d0307ae85d req-8ae07809-ec9e-42b1-8359-9ddb84589fdc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.925496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9a60ae35-5eb2-4e0a-af10-b7d0307ae85d req-8ae07809-ec9e-42b1-8359-9ddb84589fdc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.931321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:16.945553 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9a60ae35-5eb2-4e0a-af10-b7d0307ae85d req-8ae07809-ec9e-42b1-8359-9ddb84589fdc service nova] Creating event network-vif-plugged:33036c09-f112-4b8f-97e4-4bea1e12d2bb for instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded on n-h2-845775-3 Jul 25 20:29:16.953095 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9a60ae35-5eb2-4e0a-af10-b7d0307ae85d req-8ae07809-ec9e-42b1-8359-9ddb84589fdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054660 Jul 25 20:29:16.956570 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2151/4218] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:16.964381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:16.965296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:16.974092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.974801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:16.975851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:16.994347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:17.299417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6664a40-2e85-40b5-aa21-ad846f104bf9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.341366 Jul 25 20:29:17.300867 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2152/4219] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:29:16 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374/os-interface => generated 1831 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:29:17.312065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-397ff65c-b057-46b5-817d-c5b87cd7385b req-807e6ee1-90dc-4828-86a3-fc415c2b8e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:17.327901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-397ff65c-b057-46b5-817d-c5b87cd7385b req-807e6ee1-90dc-4828-86a3-fc415c2b8e89 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:17.339586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-397ff65c-b057-46b5-817d-c5b87cd7385b req-807e6ee1-90dc-4828-86a3-fc415c2b8e89 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:17.369643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-397ff65c-b057-46b5-817d-c5b87cd7385b req-807e6ee1-90dc-4828-86a3-fc415c2b8e89 service nova] Creating event network-changed:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:29:17.378254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-397ff65c-b057-46b5-817d-c5b87cd7385b req-807e6ee1-90dc-4828-86a3-fc415c2b8e89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075375 Jul 25 20:29:17.379299 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2153/4220] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:17.387247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:17.388346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:17.404285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:17.406617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:17.411415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:17.412558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:17.460836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Updating instance_info_cache with network_info: [{"id": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5", "address": "fa:16:3e:36:67:7d", "network": {"id": "aaec689a-7aad-4334-8210-105206945ee3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1098440390-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "84e98b38c70c472cac894e968bd57769", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d503d64-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119723) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:29:17.477667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] HTTP exception thrown: Action 999 not found Jul 25 20:29:17.479028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Releasing lock "refresh_cache-7fb41870-c243-4a9b-adf1-e344a38c3aa3" {{(pid=119723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:29:17.480148 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e13d070-7fa4-4596-8c39-883cca858a35 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action" status: 202 len: 0 microversion: 2.1 time: 9.633610 Jul 25 20:29:17.481532 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2068/4221] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:29:07 2022] POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action => generated 0 bytes in 9636 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Request method failure captured: Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89/os-instance-actions/999 HTTP/1.1 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vz5xshNpUnPxKV87y9op6hcLnNhJxr-NqvRrN58UpPgqfEyy-PvKTkjcXdGoOv1dKyEUkpiGdFXb2U7BJk69Y3chfzYohnxpqTI0QxLWCg5LjrYovgbWpjneChjyZ82R0rkBzZ1lwPEOtnuENsAiE1JxzEtDtOEWx9rz4z7-BJ4Ti8 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42fa158165154c61a252cd2bf35e841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}] Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 654c702d1cc94f69812c486e36a8d376 Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: exception: Action 999 not found Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89', 'id': '999'} Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 25 20:29:17.488093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:17.491967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Returning 404 to user: Action 999 not found {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:17.491967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e75ac7d0-b3af-4cbf-9795-3bbad9da4d47 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.108372 Jul 25 20:29:17.494941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2154/4222] 10.222.0.48 () {58 vars in 1308 bytes} [Mon Jul 25 20:29:17 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89/os-instance-actions/999 => generated 66 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:29:17.497737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:17.498674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:17.501527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.93"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:17.509561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:17.510067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:17.511360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:17.511873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:18.680926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:18.709846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:18.714796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:18.716930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:18.719473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:18.980652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:18.994914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d98ef57a-fd7b-450c-99f3-095b37b201fb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1374 microversion: 2.1 time: 1.511742 Jul 25 20:29:19.002866 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2069/4223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:17 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1374 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:19.016416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '.version_select at 0x7f1969ad1ee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:19.017337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 76fb6f45-178d-4085-8428-d69d919d713f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:19.026706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:19.045382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] HTTP exception thrown: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Request method failure captured: Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/76fb6f45-178d-4085-8428-d69d919d713f/os-instance-actions HTTP/1.1 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vz5xshNpUnPxKV87y9op6hcLnNhJxr-NqvRrN58UpPgqfEyy-PvKTkjcXdGoOv1dKyEUkpiGdFXb2U7BJk69Y3chfzYohnxpqTI0QxLWCg5LjrYovgbWpjneChjyZ82R0rkBzZ1lwPEOtnuENsAiE1JxzEtDtOEWx9rz4z7-BJ4Ti8 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42fa158165154c61a252cd2bf35e841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}] Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 654c702d1cc94f69812c486e36a8d376 Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: method: Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '76fb6f45-178d-4085-8428-d69d919d713f'} Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:19.055381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. Jul 25 20:29:19.061427 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:19.066621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Returning 404 to user: Instance 76fb6f45-178d-4085-8428-d69d919d713f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:19.068497 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-442bc070-c96e-4df3-9d35-f00d0f07e683 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/76fb6f45-178d-4085-8428-d69d919d713f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.064195 Jul 25 20:29:19.073766 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2070/4224] 10.222.0.48 () {58 vars in 1296 bytes} [Mon Jul 25 20:29:19 2022] GET /compute/v2.1/servers/76fb6f45-178d-4085-8428-d69d919d713f/os-instance-actions => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:19.099809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:19.101268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:19.140700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:19.141312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:19.142411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:19.143169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:20.136500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:20.158723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-107455ed-c4a4-4c4a-a346-93a81343daa2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 1.074481 Jul 25 20:29:20.159543 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2071/4225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:19 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:20.164592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:20.165604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:20.184151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:20.185227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:20.186355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:20.187101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:20.195023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:20.396090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Acquired lock "refresh_cache-7fb41870-c243-4a9b-adf1-e344a38c3aa3" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 20:29:21.158782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:21.183209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b933a0ab-688f-4e23-b3ba-4d55c72055da tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 1.021732 Jul 25 20:29:21.183871 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2072/4226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:21.192028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:21.193754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:21.220732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.222363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:21.225097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.230434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:21.283600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:29:21.472499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ce1eaa0-ce21-4d72-be14-5fb5e02490bc tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 204 len: 0 microversion: 2.1 time: 0.286797 Jul 25 20:29:21.473417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2073/4227] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:21 2022] DELETE /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:29:21.494682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-98077026-9c8f-439b-8f83-3e138d5248a5 req-be61230c-88e7-4579-ab78-22f74b71856d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7", "tag": "fabf5802-53a0-4560-b6f8-1455202ee4db"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:21.515994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-98077026-9c8f-439b-8f83-3e138d5248a5 req-be61230c-88e7-4579-ab78-22f74b71856d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.517052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-98077026-9c8f-439b-8f83-3e138d5248a5 req-be61230c-88e7-4579-ab78-22f74b71856d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:21.549770 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-98077026-9c8f-439b-8f83-3e138d5248a5 req-be61230c-88e7-4579-ab78-22f74b71856d service nova] Creating event network-changed:fabf5802-53a0-4560-b6f8-1455202ee4db for instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 on n-h1-845775-3 Jul 25 20:29:21.561191 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-98077026-9c8f-439b-8f83-3e138d5248a5 req-be61230c-88e7-4579-ab78-22f74b71856d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085706 Jul 25 20:29:21.564447 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2074/4228] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:21.574490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5a4d82b2-e0d3-43db-89c4-dc040f9a1d90 req-1b3a80be-9c45-42c2-af07-3d6e524a9ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "tag": "12743539-7c11-4da3-b872-3bfc3dbcd3e7"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:21.604024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5a4d82b2-e0d3-43db-89c4-dc040f9a1d90 req-1b3a80be-9c45-42c2-af07-3d6e524a9ca3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.606400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5a4d82b2-e0d3-43db-89c4-dc040f9a1d90 req-1b3a80be-9c45-42c2-af07-3d6e524a9ca3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:21.637738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5a4d82b2-e0d3-43db-89c4-dc040f9a1d90 req-1b3a80be-9c45-42c2-af07-3d6e524a9ca3 service nova] Creating event network-changed:12743539-7c11-4da3-b872-3bfc3dbcd3e7 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:29:21.659765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5a4d82b2-e0d3-43db-89c4-dc040f9a1d90 req-1b3a80be-9c45-42c2-af07-3d6e524a9ca3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092610 Jul 25 20:29:21.670826 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2075/4229] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:21.678713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:21.679441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:21.716395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.720142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:21.731427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:21.732244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:22.552501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:22.599112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:22.965309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:22.988568 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd5adbb3-2389-41f7-904f-2605b6db408b tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1547 microversion: 2.1 time: 1.315482 Jul 25 20:29:22.989217 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2076/4230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:21 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1547 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:23.015234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:23.016516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:23.043489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:23.044138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:23.044969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:23.045430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:24.285702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:24.301455 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ad206b4-bf4d-47b3-b9ca-a50acbc4214b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 1.290766 Jul 25 20:29:24.302505 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2077/4231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:22 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:24.322452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:24.323565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:24.352740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:24.353530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:24.354902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:24.355673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:24.677556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c702d1cc94f69812c486e36a8d376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fa158165154c61a252cd2bf35e841a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:24.703738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da15edc3-bcce-41d8-b9f7-b91a6f44402e tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 200 len: 1485 microversion: 2.1 time: 0.399951 Jul 25 20:29:24.718147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2078/4232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:24 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 1485 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:24.730750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:24.731585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:24.746505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:24.747249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:24.748086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:24.748546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:25.511078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Building network info cache for instance {{(pid=119724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 25 20:29:25.719004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:25.730857 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-639385d1-2085-4f53-9cef-809480e50b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 1.017147 Jul 25 20:29:25.738692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2079/4233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:24 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:25.757403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:25.758861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:25.792439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:25.795501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:25.796488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:25.798153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:26.756867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:26.803903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a747e702-698f-480e-a75a-2933a324c0ce tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1547 microversion: 2.1 time: 1.061039 Jul 25 20:29:26.806347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2080/4234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:25 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1547 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:26.822733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-12bc2776-ab8c-4e30-8445-f578ea9ac502 req-05546c29-e245-4c2d-87f1-e0941fecfa19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:26.896447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-12bc2776-ab8c-4e30-8445-f578ea9ac502 req-05546c29-e245-4c2d-87f1-e0941fecfa19 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:26.901583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-12bc2776-ab8c-4e30-8445-f578ea9ac502 req-05546c29-e245-4c2d-87f1-e0941fecfa19 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:26.954318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-12bc2776-ab8c-4e30-8445-f578ea9ac502 req-05546c29-e245-4c2d-87f1-e0941fecfa19 service nova] Creating event network-changed:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h2-845775-3 Jul 25 20:29:26.961515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-12bc2776-ab8c-4e30-8445-f578ea9ac502 req-05546c29-e245-4c2d-87f1-e0941fecfa19 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151145 Jul 25 20:29:26.963634 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2081/4235] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:26.973636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b8db60ce-1830-46ea-a540-dc8864969ffe req-afe74448-ffab-4d33-82f1-81f5c0870e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89", "name": "network-vif-deleted", "tag": "a562bd89-24dd-4eaf-a52d-a455ca0c6c00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:26.996461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b8db60ce-1830-46ea-a540-dc8864969ffe req-afe74448-ffab-4d33-82f1-81f5c0870e6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:26.997145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b8db60ce-1830-46ea-a540-dc8864969ffe req-afe74448-ffab-4d33-82f1-81f5c0870e6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:27.038272 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b8db60ce-1830-46ea-a540-dc8864969ffe req-afe74448-ffab-4d33-82f1-81f5c0870e6b service nova] Creating event network-vif-deleted:a562bd89-24dd-4eaf-a52d-a455ca0c6c00 for instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 on n-h2-845775-3 Jul 25 20:29:27.057497 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b8db60ce-1830-46ea-a540-dc8864969ffe req-afe74448-ffab-4d33-82f1-81f5c0870e6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091634 Jul 25 20:29:27.063129 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2082/4236] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:27.069268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:27.085186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:27.092758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:27.094015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:27.095355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:27.096256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:27.770320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:27.802718 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8541ba6e-8455-4e11-b036-f6b63ed56086 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 0.736724 Jul 25 20:29:27.803832 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2083/4237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:27 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:27.869369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:27.874006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] [instance: 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:27.904386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:27.912006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:27.918540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:27.920850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:27.982344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] HTTP exception thrown: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Request method failure captured: Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 HTTP/1.1 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vz5xshNpUnPxKV87y9op6hcLnNhJxr-NqvRrN58UpPgqfEyy-PvKTkjcXdGoOv1dKyEUkpiGdFXb2U7BJk69Y3chfzYohnxpqTI0QxLWCg5LjrYovgbWpjneChjyZ82R0rkBzZ1lwPEOtnuENsAiE1JxzEtDtOEWx9rz4z7-BJ4Ti8 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42fa158165154c61a252cd2bf35e841a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42fa158165154c61a252cd2bf35e841a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42fa158165154c61a252cd2bf35e841a"}]}] Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 42fa158165154c61a252cd2bf35e841a Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1606517361 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 654c702d1cc94f69812c486e36a8d376 Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1606517361-project Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89'} Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:27.987100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:27.991707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] Returning 404 to user: Instance 8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:27.996240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-077934f8-f3e2-404a-90b0-bbf45fd42922 tempest-InstanceActionsNegativeTestJSON-1606517361 tempest-InstanceActionsNegativeTestJSON-1606517361-project] 10.222.0.48 "GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89" status: 404 len: 111 microversion: 2.1 time: 0.161939 Jul 25 20:29:27.998120 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2084/4238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:27 2022] GET /compute/v2.1/servers/8a1a3d99-fe94-4f35-b46b-1c6a84dcdf89 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:28.017371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:28.022837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:28.045370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:28.046430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:28.047671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:28.048423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:28.098908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Updating instance_info_cache with network_info: [{"id": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5", "address": "fa:16:3e:36:67:7d", "network": {"id": "aaec689a-7aad-4334-8210-105206945ee3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1098440390-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "84e98b38c70c472cac894e968bd57769", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3d503d64-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 25 20:29:28.131989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Releasing lock "refresh_cache-7fb41870-c243-4a9b-adf1-e344a38c3aa3" {{(pid=119724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 20:29:28.133644 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23d47fca-1fac-4587-845f-6f4f1803989a tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action" status: 202 len: 0 microversion: 2.1 time: 10.637313 Jul 25 20:29:28.134678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2155/4239] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:29:17 2022] POST /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3/action => generated 0 bytes in 10639 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 25 20:29:28.157688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64ddac51-8bb6-49dc-b26d-2db953e7ebbf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '.version_select at 0x7f196835e8b0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:28.573169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:28.594773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c9082c0-df53-43b0-a1c1-6c6ac77eb009 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 0.593123 Jul 25 20:29:28.595486 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2085/4240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:27 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:28.694141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:28.850297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:28.851453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:28.891729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:28.892734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:28.894048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:28.894908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:29.347410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:29.368792 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e86ea7d-7975-4abc-8bb7-48bfe0d1c74a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 0.523273 Jul 25 20:29:29.370085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2086/4241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:28 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:29.389817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6f453258-a08d-46c0-9c50-cc64809974df req-f3d5540b-7d00-426c-8dbf-17aa432da99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:29.413061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6f453258-a08d-46c0-9c50-cc64809974df req-f3d5540b-7d00-426c-8dbf-17aa432da99e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:29.415502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6f453258-a08d-46c0-9c50-cc64809974df req-f3d5540b-7d00-426c-8dbf-17aa432da99e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:29.451978 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6f453258-a08d-46c0-9c50-cc64809974df req-f3d5540b-7d00-426c-8dbf-17aa432da99e service nova] Creating event network-changed:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:29:29.467819 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6f453258-a08d-46c0-9c50-cc64809974df req-f3d5540b-7d00-426c-8dbf-17aa432da99e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096220 Jul 25 20:29:29.475415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2087/4242] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:29.637550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:29.639344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:29.656713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:29.659053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:29.667172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:29.669753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:30.620520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:30.629788 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ee3c839-495a-4956-8270-d7c50e3c6abc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 0.997576 Jul 25 20:29:30.630926 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2088/4243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:29 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:30.656620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:30.661337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:30.708334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:30.709376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:30.710402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:30.710917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:32.335519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:32.354121 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c67d6cd6-026f-4e3e-8281-4d536374fe90 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 1.722006 Jul 25 20:29:32.361943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2089/4244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:30 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:32.398805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5c4f4c83-e203-4196-8639-8465b095a471 req-5d84cd18-1f45-44f7-983c-491be3104263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7", "name": "network-vif-plugged", "status": "completed", "tag": "fabf5802-53a0-4560-b6f8-1455202ee4db"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:32.433110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5c4f4c83-e203-4196-8639-8465b095a471 req-5d84cd18-1f45-44f7-983c-491be3104263 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:32.433872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5c4f4c83-e203-4196-8639-8465b095a471 req-5d84cd18-1f45-44f7-983c-491be3104263 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:32.461609 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64ddac51-8bb6-49dc-b26d-2db953e7ebbf tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/f88504a7-eea8-48b8-9114-7f602fa88afa" status: 202 len: 0 microversion: 2.1 time: 4.311603 Jul 25 20:29:32.462371 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2156/4245] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:29:28 2022] DELETE /compute/v2.1/os-floating-ips/f88504a7-eea8-48b8-9114-7f602fa88afa => generated 0 bytes in 4313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:29:32.467596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:32.468244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:32.485982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:32.486443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:32.487302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:32.487756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:32.490644 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5c4f4c83-e203-4196-8639-8465b095a471 req-5d84cd18-1f45-44f7-983c-491be3104263 service nova] Creating event network-vif-plugged:fabf5802-53a0-4560-b6f8-1455202ee4db for instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 on n-h1-845775-3 Jul 25 20:29:32.507314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5c4f4c83-e203-4196-8639-8465b095a471 req-5d84cd18-1f45-44f7-983c-491be3104263 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125028 Jul 25 20:29:32.513257 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2090/4246] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:32.527371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-360b016a-9fbc-4545-b834-7bff852d2c39 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '.version_select at 0x7f196eaded30>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:33.889538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:33.904206 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0f88656-55fe-42e7-ac74-820c290e96cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 1.440484 Jul 25 20:29:33.919050 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2157/4247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:33.919050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:33.919842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:33.935854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:33.936502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:33.939242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:33.940096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.127398 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-360b016a-9fbc-4545-b834-7bff852d2c39 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ebb41e89-ace4-4140-a695-584fa49652a2" status: 202 len: 0 microversion: 2.1 time: 1.605185 Jul 25 20:29:34.134654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2091/4248] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 20:29:32 2022] DELETE /compute/v2.1/os-security-groups/ebb41e89-ace4-4140-a695-584fa49652a2 => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:29:34.140056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:34.141162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:34.149987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.150480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.151331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.151791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.195644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:29:34.201773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:34.315588 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a128c3a8-c9ce-4f8d-9ad6-b6ec68487480 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 204 len: 0 microversion: 2.1 time: 0.178983 Jul 25 20:29:34.316326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2092/4249] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:34 2022] DELETE /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:29:34.326437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:34.327502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:34.334980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.335726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.336888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.337662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.447305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:34.461542 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25d8774b-609b-4eac-9019-fefaa69f5656 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 0.553118 Jul 25 20:29:34.463980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2158/4250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:33 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:34.623794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-883e35ce-1ebe-48a6-bad9-5cb9ed2899b7 req-1929c5aa-9d40-4180-bd3b-ba601c693328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "name": "network-vif-plugged", "status": "completed", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:34.643712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-883e35ce-1ebe-48a6-bad9-5cb9ed2899b7 req-1929c5aa-9d40-4180-bd3b-ba601c693328 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.644639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-883e35ce-1ebe-48a6-bad9-5cb9ed2899b7 req-1929c5aa-9d40-4180-bd3b-ba601c693328 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.741002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:34.758923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-651cdd8b-e108-41b7-a02f-759803b4cbf7 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1510 microversion: 2.1 time: 0.436405 Jul 25 20:29:34.761998 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2093/4251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:34 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1510 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:34.942892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:34.943944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:34.958271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.961674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:34.962557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:34.964273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:35.031929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-883e35ce-1ebe-48a6-bad9-5cb9ed2899b7 req-1929c5aa-9d40-4180-bd3b-ba601c693328 service nova] Creating event network-vif-plugged:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h2-845775-3 Jul 25 20:29:35.040970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-883e35ce-1ebe-48a6-bad9-5cb9ed2899b7 req-1929c5aa-9d40-4180-bd3b-ba601c693328 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.420269 Jul 25 20:29:35.046729 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2159/4252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:35.474472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:35.491255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:35.495745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:35.508367 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f965a99c-9a9b-4bb5-a16c-9ad1ae64d11a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 0.565245 Jul 25 20:29:35.512178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2094/4253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:34 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:35.528856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:35.532755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:35.534676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:35.538275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:35.794594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:35.795701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:35.805121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:35.806763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:35.808268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:35.809030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:36.204895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:36.220995 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74d06cfb-e9bd-4849-808e-5224a8ba305f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1314 microversion: 2.1 time: 0.739527 Jul 25 20:29:36.221594 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2160/4254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:35 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:36.424347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:36.444965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65f059a2-3871-4b7c-96b5-18114cdd40ff tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1510 microversion: 2.1 time: 0.657978 Jul 25 20:29:36.445498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2095/4255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:35 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:36.542949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:36.543920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:36.560518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:36.564276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:36.565435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:36.567656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:37.266877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:37.268091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:37.278598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:37.290881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:37.292051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:37.292987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:37.422305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:37.503896 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1ea3799-246c-4a9b-a3df-59a0fb90c164 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1317 microversion: 2.1 time: 0.964541 Jul 25 20:29:37.511162 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2161/4256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:36 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:37.542142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:37.550120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:37.603866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:37.607214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:37.614348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:37.616362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:38.753665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:38.795584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37533f8d-1ec5-477e-bc34-9b92cbfb724a tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1500 microversion: 2.1 time: 1.532308 Jul 25 20:29:38.797373 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2096/4257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:37 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1500 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:38.816954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:38.824524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:38.838243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:38.854085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:38.855803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24a942c2-a5d2-4c74-a53a-c922ca7cce56 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1510 microversion: 2.1 time: 1.340567 Jul 25 20:29:38.856268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:38.868875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:38.868875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:38.873934 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2162/4258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:37 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1510 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:38.891725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:38.898315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:38.918138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:38.931565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:38.932878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:38.933563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:38.995099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'flavor' on Instance uuid 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:29:39.216740 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c86a1f9d-426c-4a48-a283-7486ea2fda92 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "POST /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.335373 Jul 25 20:29:39.217656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2163/4259] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:29:38 2022] POST /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:29:39.229731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:39.230459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:39.243244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:39.243759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:39.244603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:39.245058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:39.754650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:39.803857 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a53d325b-9d42-47fb-b671-51b88feaa690 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.989823 Jul 25 20:29:39.811426 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2097/4260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:38 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:39.926449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:39.935245 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-929eb32f-a9c1-43c6-87ad-3c6ed501c30d tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1508 microversion: 2.1 time: 0.710529 Jul 25 20:29:39.941402 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2164/4261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:39 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1508 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:39.968205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:39.972909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:39.987458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:39.988524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:39.989530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:39.990140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:40.154140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2018490319", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:40.310385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] validate_networks() for [('6c5e2337-ad74-4e5b-8f37-15330da4632d', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:29:40.357827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5eb18d5109c475f85a921a530779909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e98b38c70c472cac894e968bd57769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:40.442268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-66386fd5-695d-430f-bfd7-2aa963740872 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 200 len: 1468 microversion: 2.1 time: 0.541320 Jul 25 20:29:40.458887 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2098/4262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:39 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 1468 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:40.482260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c977a207-631c-4838-9d9a-be47d8fbb999 req-90facc76-4f35-49de-aacf-ae657d88c81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb41870-c243-4a9b-adf1-e344a38c3aa3", "name": "network-vif-deleted", "tag": "3d503d64-6052-42b1-ac17-ae7ba8d3a8d5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:40.534974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c977a207-631c-4838-9d9a-be47d8fbb999 req-90facc76-4f35-49de-aacf-ae657d88c81d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:40.536622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c977a207-631c-4838-9d9a-be47d8fbb999 req-90facc76-4f35-49de-aacf-ae657d88c81d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:40.582944 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c977a207-631c-4838-9d9a-be47d8fbb999 req-90facc76-4f35-49de-aacf-ae657d88c81d service nova] Creating event network-vif-deleted:3d503d64-6052-42b1-ac17-ae7ba8d3a8d5 for instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 on n-h1-845775-3 Jul 25 20:29:40.602553 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c977a207-631c-4838-9d9a-be47d8fbb999 req-90facc76-4f35-49de-aacf-ae657d88c81d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140967 Jul 25 20:29:40.603678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2099/4263] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:41.018617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:41.022552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:41.097889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.101050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.104956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.109831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.547935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:41.556002 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf864637-ade2-4e46-a494-31887cf58dc2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1491 microversion: 2.1 time: 0.562544 Jul 25 20:29:41.560162 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2100/4264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:40 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1491 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:41.578859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:41.579519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] [instance: 7fb41870-c243-4a9b-adf1-e344a38c3aa3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:41.632338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.633038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.634988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.641583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.673634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] HTTP exception thrown: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Request method failure captured: Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 HTTP/1.1 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vzFBxK2OSy4V681xS92r8W6EBtnuSVy491oPj15wt90bL2JIrN_DLXV5fLSkuI9Mz0Vx3-S15OcaLxk4jBLjw_U0wPbJA3lhZxnHJVhPNptwChYIcTllM-baePu2EMndnK4uMPvdArus3hJc1uKgC21xA3jz7S3zQudUkgy8pzR3Z8 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 84e98b38c70c472cac894e968bd57769 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1967779298 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84e98b38c70c472cac894e968bd57769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84e98b38c70c472cac894e968bd57769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84e98b38c70c472cac894e968bd57769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84e98b38c70c472cac894e968bd57769"}]}] Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1967779298 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 84e98b38c70c472cac894e968bd57769 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1967779298 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerRescueTestJSONUnderV235-1967779298-project Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: d5eb18d5109c475f85a921a530779909 Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1967779298-project Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7fb41870-c243-4a9b-adf1-e344a38c3aa3'} Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:41.678306 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] Returning 404 to user: Instance 7fb41870-c243-4a9b-adf1-e344a38c3aa3 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:41.682808 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f7675cde-d562-4b05-bacf-423b4a03c539 tempest-ServerRescueTestJSONUnderV235-1967779298 tempest-ServerRescueTestJSONUnderV235-1967779298-project] 10.222.0.48 "GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3" status: 404 len: 111 microversion: 2.1 time: 0.118896 Jul 25 20:29:41.701313 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2101/4265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:41 2022] GET /compute/v2.1/servers/7fb41870-c243-4a9b-adf1-e344a38c3aa3 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:41.714814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:41.716135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:41.728163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.728840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.729870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.730576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.774094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:29:41.936422 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc871aed-90d4-4762-a392-a00f5c83ced2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 204 len: 0 microversion: 2.1 time: 0.233330 Jul 25 20:29:41.937069 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2102/4266] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:41 2022] DELETE /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:29:41.947941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:41.949105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:41.975129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.980621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:41.985771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:41.986476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:42.455708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:29:42.458517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:29:42.460076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:29:42.461081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:29:42.462037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:29:42.482856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:42.484221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:42.486018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:42.487061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:42.519554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:42.530083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe18dddf-bb79-4b64-8204-2ab570388e0c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1497 microversion: 2.1 time: 0.586963 Jul 25 20:29:42.532581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2103/4267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:41 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1497 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:42.540914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Getting quotas for project 23c606f8cc3c416da99df27c473131e4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:29:42.548160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Getting quotas for user 5d5be665c18142a8917312b500d0c805 and project 23c606f8cc3c416da99df27c473131e4. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:29:42.576619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:29:42.595469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:29:42.654434 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48f0331c-04d9-4cff-bc86-f6a1fb2776b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.508619 Jul 25 20:29:42.666211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2165/4268] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:29:42.673211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7abde40d-e0f3-47c1-9b40-787e183dacf4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:42.673838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7abde40d-e0f3-47c1-9b40-787e183dacf4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:42.803816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7abde40d-e0f3-47c1-9b40-787e183dacf4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:42.807925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7abde40d-e0f3-47c1-9b40-787e183dacf4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1217 microversion: 2.1 time: 0.138646 Jul 25 20:29:42.809094 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2104/4269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:42 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:43.580996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:43.583114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:43.617925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:43.619892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:43.624028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:43.635010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:43.842280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:43.844028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:43.889497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:43.893632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:43.895244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:43.910908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:44.348398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:44.388459 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-929fc6c8-634d-4efc-b014-094fe2b6afa5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1213 microversion: 2.1 time: 0.553092 Jul 25 20:29:44.390455 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2105/4270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:43 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1213 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:45.094219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:45.105389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-be682716-7bc3-4943-b116-bf10b715bf13 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1497 microversion: 2.1 time: 1.537661 Jul 25 20:29:45.131942 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2166/4271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:43 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1497 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:45.420127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:45.422045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:45.445107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:45.445979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:45.447036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:45.447866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:45.900372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:45.933745 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd018e5c-826d-4e42-8875-927e5ccb6180 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1275 microversion: 2.1 time: 0.517384 Jul 25 20:29:45.948162 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2106/4272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:45 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1275 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:46.138237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:46.141100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:46.180156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:46.181768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:46.184292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:46.185342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:46.368300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:46.382877 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd7e40cb-709c-4d7b-954e-d97d9816832b tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1455 microversion: 2.1 time: 0.253274 Jul 25 20:29:46.383486 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2167/4273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:46 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1455 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:46.966685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:46.967515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:46.992135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:46.993234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:46.995935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:46.997719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:47.272469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a0e43bb0-5f0a-46a2-9c5f-6ecc561f1447 req-ed657c3f-541b-410d-90b7-7dee3f65611d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7", "name": "network-vif-deleted", "tag": "fabf5802-53a0-4560-b6f8-1455202ee4db"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:47.307228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a0e43bb0-5f0a-46a2-9c5f-6ecc561f1447 req-ed657c3f-541b-410d-90b7-7dee3f65611d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:47.311646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a0e43bb0-5f0a-46a2-9c5f-6ecc561f1447 req-ed657c3f-541b-410d-90b7-7dee3f65611d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:47.318448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=86,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:47.339722 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a0e43bb0-5f0a-46a2-9c5f-6ecc561f1447 req-ed657c3f-541b-410d-90b7-7dee3f65611d service nova] Creating event network-vif-deleted:fabf5802-53a0-4560-b6f8-1455202ee4db for instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 on n-h1-845775-3 Jul 25 20:29:47.365554 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a0e43bb0-5f0a-46a2-9c5f-6ecc561f1447 req-ed657c3f-541b-410d-90b7-7dee3f65611d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099125 Jul 25 20:29:47.367225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2168/4274] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:47.420011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:47.421880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:47.455944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:47.463448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:47.465115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:47.466171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:47.555323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:47.555808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:47.556313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lazy-loading 'fault' on Instance uuid 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:29:47.861864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38c00ddcc14420bbb568d4b1551311b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83dc67ff5b04948819eb8b6e13ebca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:47.876291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed025663-4301-4aa6-bb54-3465b0144674 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 200 len: 1304 microversion: 2.1 time: 0.472646 Jul 25 20:29:47.882022 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2169/4275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:47 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 1304 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:48.053288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:48.074968 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c105acdb-8372-47eb-934b-694bc55483d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 1.113258 Jul 25 20:29:48.090242 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2107/4276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:46 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:48.923302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:48.925329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:48.956013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:48.956946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:48.959761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:48.961404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.040930 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 HTTP/1.1 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7'} Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.043333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.049027 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.052504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.054242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63d42f5a-113e-4302-a18f-b5e7cb4f4c50 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 404 len: 111 microversion: 2.1 time: 0.138148 Jul 25 20:29:49.057268 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2170/4277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:48 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.070464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.072435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.101746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.103816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.124467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.129470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.136245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.137982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.141085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.144077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.146947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.150271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.217562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 HTTP/1.1 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7'} Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.217913 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.229731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ee6393ec-284a-421e-ab8a-611431cc0872 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 404 len: 111 microversion: 2.1 time: 0.161911 Jul 25 20:29:49.231966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2108/4278] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:49 2022] DELETE /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.245954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.248732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.267816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:49.286287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.286760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.287789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.288406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.308726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:49.368514 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 HTTP/1.1 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7'} Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.370654 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.375697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84c4f466-f89d-437b-b043-d071d62c96d2 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7" status: 404 len: 111 microversion: 2.1 time: 0.140279 Jul 25 20:29:49.382886 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2109/4279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:49 2022] GET /compute/v2.1/servers/3666e07c-2e38-45ed-85c2-9e6e5e1fa4c7 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.397941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.398532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.423593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.424069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.429903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.432452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.495236 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 HTTP/1.1 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7'} Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.516084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.522511 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-663d7a05-d6fe-42d8-8dd1-636ae88cef3f tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 404 len: 111 microversion: 2.1 time: 0.133389 Jul 25 20:29:49.531880 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2110/4280] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:49 2022] DELETE /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.548874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.549623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.566872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.567559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.568521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.568970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.622648 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 HTTP/1.1 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7'} Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.628487 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. Jul 25 20:29:49.633186 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.634840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.636283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d3eae91-2aa1-44f3-be06-0772149028d7 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7" status: 404 len: 111 microversion: 2.1 time: 0.103265 Jul 25 20:29:49.640997 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2111/4281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:49 2022] GET /compute/v2.1/servers/8a6e71c5-962b-4ce6-9b58-5f6af3bb49b7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.653163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.653994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.662369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.663101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.664322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.665558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.692011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 HTTP/1.1 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '0d934e47-af93-46e3-ab11-8ddfa0d11155'} Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.698512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.704158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.711921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.714748 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4e373a7-8462-4cf2-9116-79cebe49f119 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 404 len: 111 microversion: 2.1 time: 0.065926 Jul 25 20:29:49.716833 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2112/4282] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:49 2022] DELETE /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.732853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.735065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 0d934e47-af93-46e3-ab11-8ddfa0d11155] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.754674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.755176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.755985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.757494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.792767 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 HTTP/1.1 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '0d934e47-af93-46e3-ab11-8ddfa0d11155'} Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.795297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 0d934e47-af93-46e3-ab11-8ddfa0d11155 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19867015-0f43-4e05-8ef3-5d166c063c41 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155" status: 404 len: 111 microversion: 2.1 time: 0.075351 Jul 25 20:29:49.806893 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2113/4283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:49 2022] GET /compute/v2.1/servers/0d934e47-af93-46e3-ab11-8ddfa0d11155 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:29:49.825090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:49.835555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.838571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:49.857346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.863227 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57ddb230-da55-4daa-8591-22f23ed878aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 0.764323 Jul 25 20:29:49.874040 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2171/4284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:49 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:49.887349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.887720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:49.888554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:49.926997 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 HTTP/1.1 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f48238f1-bc52-4345-a19c-5fe0d5adf5f0'} Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:49.931360 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:49.945941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:49.951722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:49.955935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42b19e1f-4853-4c7f-8cf4-228c773b6a86 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 404 len: 111 microversion: 2.1 time: 0.147778 Jul 25 20:29:49.959123 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2114/4285] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:49 2022] DELETE /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:49.979112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:49.980219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: f48238f1-bc52-4345-a19c-5fe0d5adf5f0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:50.007738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.008550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.009994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.010702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.055026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-52c207a6-d2b0-4ea3-8fed-13c69136f775 req-690790b7-0d7c-4ab4-883d-faa5344cdf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d174e7-6f13-45f9-b69d-5c4e571c6dea", "tag": "07a25e0b-900b-44d2-bf6a-dba489277d50"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:50.057777 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 HTTP/1.1 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f48238f1-bc52-4345-a19c-5fe0d5adf5f0'} Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.060701 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. Jul 25 20:29:50.077289 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.082463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance f48238f1-bc52-4345-a19c-5fe0d5adf5f0 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:50.094300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-095ccfd1-2ad6-4afd-bae1-e56b62b376e0 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0" status: 404 len: 111 microversion: 2.1 time: 0.128027 Jul 25 20:29:50.095742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2172/4286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:49 2022] GET /compute/v2.1/servers/f48238f1-bc52-4345-a19c-5fe0d5adf5f0 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:50.109611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:50.118525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:50.136068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-52c207a6-d2b0-4ea3-8fed-13c69136f775 req-690790b7-0d7c-4ab4-883d-faa5344cdf4f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.136857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-52c207a6-d2b0-4ea3-8fed-13c69136f775 req-690790b7-0d7c-4ab4-883d-faa5344cdf4f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.142653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.147974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.161439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.162591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.178869 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.190642 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-52c207a6-d2b0-4ea3-8fed-13c69136f775 req-690790b7-0d7c-4ab4-883d-faa5344cdf4f service nova] Creating event network-changed:07a25e0b-900b-44d2-bf6a-dba489277d50 for instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea on n-h1-845775-3 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 HTTP/1.1 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6180b647-b34b-43df-b06a-ac4076836608'} Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:50.191468 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.198078 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.207829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:50.217998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f46cec4c-6475-4da2-8c40-ddec951149c9 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608" status: 404 len: 111 microversion: 2.1 time: 0.116404 Jul 25 20:29:50.219705 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2173/4287] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:50 2022] DELETE /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:50.226192 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-52c207a6-d2b0-4ea3-8fed-13c69136f775 req-690790b7-0d7c-4ab4-883d-faa5344cdf4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191892 Jul 25 20:29:50.227293 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2115/4288] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:50.237239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:50.238894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 6180b647-b34b-43df-b06a-ac4076836608] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:50.258819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.259913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.261035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.261730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.324102 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 HTTP/1.1 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '6180b647-b34b-43df-b06a-ac4076836608'} Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:50.333589 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. Jul 25 20:29:50.347983 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:29:50.357424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 6180b647-b34b-43df-b06a-ac4076836608 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:50.361468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5731c36a-52d2-43e4-bc2d-802dae03218c tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608" status: 404 len: 111 microversion: 2.1 time: 0.137234 Jul 25 20:29:50.364340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2174/4289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:50 2022] GET /compute/v2.1/servers/6180b647-b34b-43df-b06a-ac4076836608 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:50.903511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:50.904593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:50.925079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.926012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:50.927187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:50.927926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:51.268001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:51.301662 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19e0b965-293e-4858-a1b9-bf6da6e202c7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 0.403532 Jul 25 20:29:51.306344 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2116/4290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:50 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:52.328840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:52.330439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:52.339453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:52.340441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:52.345145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:52.347076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:52.519440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:52.559324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:53.039867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:53.069110 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7df34750-c180-4550-972a-b856f217a03c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 0.743034 Jul 25 20:29:53.071910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2175/4291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:52 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:54.108352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:54.109460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:54.117756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:29:54.192274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:54.193081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:54.200307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:54.203026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:56.580764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:56.610643 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-92603891-5aa1-48e1-b426-bb172917dd17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 2.504976 Jul 25 20:29:56.612933 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2117/4292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:54 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:29:57.637554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:57.638194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:57.659755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.667256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.668178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.668643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.766722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:57.767526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:57.802546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.803578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.805045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.805899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.842492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 HTTP/1.1 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4f6b4b2c-7d19-4c22-9f3e-be787ef70598'} Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:57.851415 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.858708 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.862682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:57.866183 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82f260ff-4bc2-424d-be23-c0d3e23eb5df tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 404 len: 111 microversion: 2.1 time: 0.110125 Jul 25 20:29:57.869725 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2118/4293] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:57 2022] DELETE /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:57.879977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:57.880769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: 4f6b4b2c-7d19-4c22-9f3e-be787ef70598] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:57.898607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.899862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.901174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.902214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.933396 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 HTTP/1.1 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4f6b4b2c-7d19-4c22-9f3e-be787ef70598'} Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:57.936509 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. Jul 25 20:29:57.943255 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:57.945433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance 4f6b4b2c-7d19-4c22-9f3e-be787ef70598 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:57.947747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39d344bf-a332-4c26-abae-914bd295d5aa tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598" status: 404 len: 111 microversion: 2.1 time: 0.073255 Jul 25 20:29:57.953841 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2119/4294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:57 2022] GET /compute/v2.1/servers/4f6b4b2c-7d19-4c22-9f3e-be787ef70598 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:57.964087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:57.965139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:57.980151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.982948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:57.994421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:57.995834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:58.026508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 HTTP/1.1 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd1fec4a0-205d-4e51-aeb4-a29ed52eac47'} Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:58.028512 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.034117 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.037342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:58.038512 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23f64ad6-910d-4e14-8740-c34f6ecb6338 tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 404 len: 111 microversion: 2.1 time: 0.080055 Jul 25 20:29:58.042909 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2120/4295] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:29:57 2022] DELETE /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:58.052541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:58.053970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] [instance: d1fec4a0-205d-4e51-aeb4-a29ed52eac47] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:58.063583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:58.064580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:58.065763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:58.066795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:58.095373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] HTTP exception thrown: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Request method failure captured: Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 HTTP/1.1 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vvV2Pvdz_6hf2o1lj-AcD4M0pllpCR7iu2q-LYb8Hg50gDe4N82mg8ZglNGxmKX1cenQL7d-1VxZysCSN-tDbGRY_GzAv46xVYZeZJRV5NZB0GV_SVcH3AHDSCahuo4EJ4Zs-zn8LIM8B50bYQl5EkwISsPBrD9i5t-gXuXCwpQSuo Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f83dc67ff5b04948819eb8b6e13ebca5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f83dc67ff5b04948819eb8b6e13ebca5"}]}] Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f83dc67ff5b04948819eb8b6e13ebca5 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161655287 Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c38c00ddcc14420bbb568d4b1551311b Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1161655287-project Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd1fec4a0-205d-4e51-aeb4-a29ed52eac47'} Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:29:58.100203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. Jul 25 20:29:58.105572 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:29:58.107216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] Returning 404 to user: Instance d1fec4a0-205d-4e51-aeb4-a29ed52eac47 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:29:58.109856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-655e2212-eaac-4885-a710-b67340e2e9cd tempest-DeleteServersTestJSON-1161655287 tempest-DeleteServersTestJSON-1161655287-project] 10.222.0.48 "GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47" status: 404 len: 111 microversion: 2.1 time: 0.063146 Jul 25 20:29:58.123030 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2121/4296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:58 2022] GET /compute/v2.1/servers/d1fec4a0-205d-4e51-aeb4-a29ed52eac47 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:29:58.131770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-394894ce-c1ce-458c-accf-7ddc928519ba req-2d46b2be-7089-4edc-9bf8-e16f5c8d7153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d174e7-6f13-45f9-b69d-5c4e571c6dea", "name": "network-vif-plugged", "status": "completed", "tag": "07a25e0b-900b-44d2-bf6a-dba489277d50"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:29:58.147348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-394894ce-c1ce-458c-accf-7ddc928519ba req-2d46b2be-7089-4edc-9bf8-e16f5c8d7153 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:58.149000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-394894ce-c1ce-458c-accf-7ddc928519ba req-2d46b2be-7089-4edc-9bf8-e16f5c8d7153 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:58.189061 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-394894ce-c1ce-458c-accf-7ddc928519ba req-2d46b2be-7089-4edc-9bf8-e16f5c8d7153 service nova] Creating event network-vif-plugged:07a25e0b-900b-44d2-bf6a-dba489277d50 for instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea on n-h1-845775-3 Jul 25 20:29:58.205951 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-394894ce-c1ce-458c-accf-7ddc928519ba req-2d46b2be-7089-4edc-9bf8-e16f5c8d7153 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083310 Jul 25 20:29:58.206586 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2122/4297] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:29:58.419219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:29:58.475383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f00e11c5-e395-4b8d-952f-b1ff5f25ccb4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 0.839628 Jul 25 20:29:58.501498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2176/4298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:57 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:29:59.538570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:29:59.540216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:29:59.565147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:59.574407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:29:59.583436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:29:59.586934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:00.232638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:00.234553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:00.245771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:00.253103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:00.253864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:00.258552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:00.259851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:00.444167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:00.458384 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0701f3f8-2b28-4db0-b059-93987e91cb91 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1317 microversion: 2.1 time: 0.931926 Jul 25 20:30:00.465178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2123/4299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:29:59 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:01.005257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:01.018599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:01.026334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:01.045641 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d1e54d2-b636-4498-924e-6e51db0b6024 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2942 microversion: 2.32 time: 0.829035 Jul 25 20:30:01.046701 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2177/4300] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:00 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2942 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:30:01.079656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:01.084483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:01.097758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.098468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:01.099435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.100070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:01.475212 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-111fbd2f-9586-4cff-ad6a-302849e30336 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.403122 Jul 25 20:30:01.476761 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2124/4301] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:30:01 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374/os-interface => generated 1831 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:01.496746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:01.497708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:01.531647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.533827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:01.535801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.536654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:01.912243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:01.925998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f745dd88-64e4-43ee-8d98-412b7ea8074b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1507 microversion: 2.1 time: 0.435804 Jul 25 20:30:01.927165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2178/4302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:01 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:01.959006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:01.960417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:01.969923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.971391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:01.972604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:01.973723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:02.029999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:30:02.489180 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ac09b48-968c-4e2d-8485-1d1134431786 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 204 len: 0 microversion: 2.1 time: 0.533585 Jul 25 20:30:02.491508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2125/4303] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:30:01 2022] DELETE /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:30:02.512651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:02.513804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:02.552856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:02.553951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:02.555181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:02.561399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:02.844745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:02.846015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:02.871058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:02.871546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:02.876849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:02.881326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:03.022076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:30:03.529698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c8545f9f-f1f1-4ecc-96bc-3f1a724ac4a1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 204 len: 0 microversion: 2.1 time: 0.690149 Jul 25 20:30:03.538042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:03.539234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2126/4304] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:30:02 2022] DELETE /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:30:03.571415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:03.572175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:03.580693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c7f7cb7-6e9f-4c01-afbb-7c0da4280dbd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1513 microversion: 2.1 time: 1.065526 Jul 25 20:30:03.582870 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2179/4305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:02 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1513 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:03.597439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:03.599300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:03.601950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:03.605095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:04.006520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-497660052", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": "none"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:04.168512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:30:04.171147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:30:04.171768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:30:04.176433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:30:04.176756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:30:04.220789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:04.222458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:04.230870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:04.231873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:04.294351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Getting quotas for project dc7050f9d336430e958fb96aed61419a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:30:04.308854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Getting quotas for user 9c0a9646b621494c832d473912571f1c and project dc7050f9d336430e958fb96aed61419a. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:30:04.371827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:30:04.384144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:30:04.591646 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a43099b-2a47-476f-a157-9e2603893987 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.882463 Jul 25 20:30:04.601306 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2180/4306] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 20:30:04.610806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:04.611803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:05.839918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:05.857689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:05.869077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:05.875978 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b3ebf13-c2f4-4df9-8bfd-51a4863ba7c9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1277 microversion: 2.57 time: 1.272780 Jul 25 20:30:05.897019 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2181/4307] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:04 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1277 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:05.902290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:05.902937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:05.940678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:05.941148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:05.943840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:05.944471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:06.096646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:06.121225 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84a631fb-d043-497c-8ee2-a8b575597cbd tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1553 microversion: 2.1 time: 2.572851 Jul 25 20:30:06.138341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2127/4308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:03 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1553 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:06.918788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:06.919559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:06.940255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:06.941064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:06.942091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:06.942741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:07.607767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:07.628851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:07.641378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:07.642736 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-866d6737-2b19-4200-b7e9-8e070bdcd898 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1329 microversion: 2.57 time: 0.730560 Jul 25 20:30:07.643346 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2128/4309] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:06 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1329 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:07.657566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:07.660839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:07.667291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:07.679811 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5383b6ad-765c-4365-9ceb-12ec2469296b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1513 microversion: 2.1 time: 1.781349 Jul 25 20:30:07.683504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2182/4310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:05 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1513 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:07.715626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:07.716283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:07.719442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:07.724073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.151877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:08.179197 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb14dbef-0a43-49e9-9f54-ac388fbaa402 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1486 microversion: 2.1 time: 0.524059 Jul 25 20:30:08.187333 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2129/4311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:07 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1486 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:08.343679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-25e601be-2c7b-4a1c-81ae-2d2c1a95a8f7 req-f6837389-b5e0-4ff3-8896-0b61f6d0faba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d174e7-6f13-45f9-b69d-5c4e571c6dea", "name": "network-vif-unplugged", "status": "completed", "tag": "07a25e0b-900b-44d2-bf6a-dba489277d50"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:08.398350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-25e601be-2c7b-4a1c-81ae-2d2c1a95a8f7 req-f6837389-b5e0-4ff3-8896-0b61f6d0faba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.401373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-25e601be-2c7b-4a1c-81ae-2d2c1a95a8f7 req-f6837389-b5e0-4ff3-8896-0b61f6d0faba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.465270 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-25e601be-2c7b-4a1c-81ae-2d2c1a95a8f7 req-f6837389-b5e0-4ff3-8896-0b61f6d0faba service nova] Creating event network-vif-unplugged:07a25e0b-900b-44d2-bf6a-dba489277d50 for instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea on n-h1-845775-3 Jul 25 20:30:08.495276 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-25e601be-2c7b-4a1c-81ae-2d2c1a95a8f7 req-f6837389-b5e0-4ff3-8896-0b61f6d0faba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163906 Jul 25 20:30:08.500283 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2183/4312] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:30:08.512673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6acad2fe-3dad-4081-b63c-6d1b0e7747ec req-100d9902-3bb2-4a89-9f3f-81b985f17b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded", "name": "network-vif-deleted", "tag": "33036c09-f112-4b8f-97e4-4bea1e12d2bb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:08.562164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6acad2fe-3dad-4081-b63c-6d1b0e7747ec req-100d9902-3bb2-4a89-9f3f-81b985f17b97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.568312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6acad2fe-3dad-4081-b63c-6d1b0e7747ec req-100d9902-3bb2-4a89-9f3f-81b985f17b97 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.599086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6acad2fe-3dad-4081-b63c-6d1b0e7747ec req-100d9902-3bb2-4a89-9f3f-81b985f17b97 service nova] Creating event network-vif-deleted:33036c09-f112-4b8f-97e4-4bea1e12d2bb for instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded on n-h2-845775-3 Jul 25 20:30:08.625522 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6acad2fe-3dad-4081-b63c-6d1b0e7747ec req-100d9902-3bb2-4a89-9f3f-81b985f17b97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121316 Jul 25 20:30:08.629784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2130/4313] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:30:08.686139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:08.696639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:08.744421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:08.746090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:08.756092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.792890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.797005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.799080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.805463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.806297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.813340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:08.814013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:08.846092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:09.869622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:09.896361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef8fe77f-6590-493d-8dca-6721b808cd8e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1471 microversion: 2.1 time: 1.158932 Jul 25 20:30:09.907265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2131/4314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:08 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1471 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:09.927851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:09.928642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:09.949141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:09.949632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:09.950484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:09.950927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:09.963518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:10.003808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:10.011608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:10.031263 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc2f51c0-5f84-4e2c-b7ba-e9e4ea8b7860 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1335 microversion: 2.57 time: 1.354316 Jul 25 20:30:10.034440 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2184/4315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:08 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1335 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:10.149728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:10.151069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:10.153477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lazy-loading 'fault' on Instance uuid bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:30:10.310450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:10.343824 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b65d529-7373-439f-9c3c-3a9fa2af3f0d tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 200 len: 1339 microversion: 2.1 time: 0.419849 Jul 25 20:30:10.360622 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2132/4316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:09 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 1339 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:10.760436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f92383e8-5421-4965-8167-087055438a6c req-5918e268-6882-4729-87bf-e16386a03fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d174e7-6f13-45f9-b69d-5c4e571c6dea", "name": "network-vif-deleted", "tag": "07a25e0b-900b-44d2-bf6a-dba489277d50"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:10.799353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f92383e8-5421-4965-8167-087055438a6c req-5918e268-6882-4729-87bf-e16386a03fae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:10.800990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f92383e8-5421-4965-8167-087055438a6c req-5918e268-6882-4729-87bf-e16386a03fae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:10.829361 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f92383e8-5421-4965-8167-087055438a6c req-5918e268-6882-4729-87bf-e16386a03fae service nova] Creating event network-vif-deleted:07a25e0b-900b-44d2-bf6a-dba489277d50 for instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea on n-h1-845775-3 Jul 25 20:30:10.839781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f92383e8-5421-4965-8167-087055438a6c req-5918e268-6882-4729-87bf-e16386a03fae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106912 Jul 25 20:30:10.841596 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2185/4317] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:30:10.926968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:10.927620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:10.942021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:10.942825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:10.943713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:10.947524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.031051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:11.044854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.045514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'fault' on Instance uuid 44d174e7-6f13-45f9-b69d-5c4e571c6dea {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:30:11.079881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.085632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:11.115902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:11.117095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.121169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:11.122441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.215632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:11.228197 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef7c1512-7ae5-4073-91fb-e0949bbdca79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 200 len: 1307 microversion: 2.1 time: 0.305405 Jul 25 20:30:11.242942 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2133/4318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:10 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:30:11.336585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Action: 'create', calling method: .version_select at 0x7f1968f82790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:11.372825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Getting quotas for project d3d27ee153074899a51ef886f3b0cbbe. Resources: {'server_groups'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:30:11.386442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Getting quotas for user 7d31c074b22c44ab858c41fa291bb441 and project d3d27ee153074899a51ef886f3b0cbbe. Resources: {'server_groups'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:30:11.392676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:11.435094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:11.445110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:11.447154 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3342c758-1da9-4321-9d06-2e7a3c5a8c5b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1335 microversion: 2.57 time: 0.382354 Jul 25 20:30:11.448006 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2186/4319] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:11 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1335 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:11.488898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Getting quotas for project d3d27ee153074899a51ef886f3b0cbbe. Resources: {'server_groups'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:30:11.497399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Getting quotas for user 7d31c074b22c44ab858c41fa291bb441 and project d3d27ee153074899a51ef886f3b0cbbe. Resources: {'server_groups'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:30:11.503519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.513871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:11.521249 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2c1df34-ed5b-455b-b0d3-8382dc508ba3 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.290541 Jul 25 20:30:11.522382 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2134/4320] 10.222.0.48 () {62 vars in 1214 bytes} [Mon Jul 25 20:30:11 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:30:11.539107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:11.539897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.540993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:11.541740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:11.547768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd1b2dcb-bbdd-4e74-b665-ad9bbb8490a0 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.599003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd1b2dcb-bbdd-4e74-b665-ad9bbb8490a0 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.064609 Jul 25 20:30:11.600867 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2135/4321] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Jul 25 20:30:11 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:30:11.613789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] HTTP exception thrown: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Request method failure captured: Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded HTTP/1.1 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx67DVfFex60d0uo1n9vNiHSfDG_vqNxbJrc0qDoHt1y1SKrVno2G79bRQg4FiCQHWgyBqyfXMgBb0hrrj6Mo2cQht0I6IL7NwThBb0MJwIBjxer0csdygeT6hiWZ8Y8j__1vMTobck5IwIiFggZ94Hm3u9Rb0BMhhQWrRVKy82wwk Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_284fb24804444beca38878cf47f64c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/284fb24804444beca38878cf47f64c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}] Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2b756e7d53114329bb377fd0c6fbf2a1 Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded'} Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:11.620498 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Returning 404 to user: Instance bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c22633e-8d3d-437c-a719-24b2057e31ae tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded" status: 404 len: 111 microversion: 2.1 time: 0.140047 Jul 25 20:30:11.626652 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2187/4322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:11 2022] GET /compute/v2.1/servers/bf3b7b0e-7f7d-44ba-a602-0fcf68e4aded => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:11.640015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1685df07-4934-4f38-93d8-472f9fd278cf tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.676873 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1685df07-4934-4f38-93d8-472f9fd278cf tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a" status: 200 len: 235 microversion: 2.64 time: 0.066295 Jul 25 20:30:11.691265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2136/4323] 10.222.0.48 () {60 vars in 1304 bytes} [Mon Jul 25 20:30:11 2022] GET /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a => generated 235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:30:11.704895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b695880b-0c0c-486f-a761-15ecbeb46c37 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.759326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b695880b-0c0c-486f-a761-15ecbeb46c37 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a" status: 204 len: 0 microversion: 2.64 time: 0.059509 Jul 25 20:30:11.769032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2188/4324] 10.222.0.48 () {60 vars in 1307 bytes} [Mon Jul 25 20:30:11 2022] DELETE /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 20:30:11.773446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58415a7c-8e2b-494d-8355-e9b45f562f63 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:11.801760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-58415a7c-8e2b-494d-8355-e9b45f562f63 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] HTTP exception thrown: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58415a7c-8e2b-494d-8355-e9b45f562f63 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Request method failure captured: Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a HTTP/1.1 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v1Srq5ixjTUJZpTVtJfgdvIZ-fjJ5U3DFrnWJdEv6eswoYeTMuVeagMEsg_BjVlcutt2amjyxqia4TdWk_gUNksEEzAYddxWxXIYDopztTZvVM-orSHVCNJKbBz85eSS4bpKyPY1TqcWwjksis5o8yDjfk0IQH9kwkekXUrR3Sz1x4 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.64 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d3d27ee153074899a51ef886f3b0cbbe Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerGroup264TestJSON-1102834984 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d3d27ee153074899a51ef886f3b0cbbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d3d27ee153074899a51ef886f3b0cbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d3d27ee153074899a51ef886f3b0cbbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d3d27ee153074899a51ef886f3b0cbbe"}]}] Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerGroup264TestJSON-1102834984 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d3d27ee153074899a51ef886f3b0cbbe Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1102834984 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerGroup264TestJSON-1102834984-project Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 7d31c074b22c44ab858c41fa291bb441 Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerGroup264TestJSON-1102834984-project Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ed2d4b27-ccaf-42b2-a2d0-802e99a3919a'} Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.803528 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. Jul 25 20:30:11.808406 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:11.810082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58415a7c-8e2b-494d-8355-e9b45f562f63 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] Returning 404 to user: Instance group ed2d4b27-ccaf-42b2-a2d0-802e99a3919a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:11.816494 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58415a7c-8e2b-494d-8355-e9b45f562f63 tempest-ServerGroup264TestJSON-1102834984 tempest-ServerGroup264TestJSON-1102834984-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a" status: 404 len: 117 microversion: 2.64 time: 0.046432 Jul 25 20:30:11.818035 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2137/4325] 10.222.0.48 () {60 vars in 1307 bytes} [Mon Jul 25 20:30:11 2022] DELETE /compute/v2.1/os-server-groups/ed2d4b27-ccaf-42b2-a2d0-802e99a3919a => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:30:12.269730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:12.274090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:12.321419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.322798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.325658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.327535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.416590 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea HTTP/1.1 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '44d174e7-6f13-45f9-b69d-5c4e571c6dea'} Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:12.430203 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:30:12.441857 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:12.447522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:12.447522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da26ed9a-0b63-40e0-83e7-330ad5f8b83c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 404 len: 111 microversion: 2.1 time: 0.195206 Jul 25 20:30:12.453138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2189/4326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:12 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:12.476224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:12.488148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:12.492537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:12.498529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:12.508521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:12.538330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.543437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.544861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.552097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.552730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.555071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.559556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:12.567812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:12.865335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:12.904740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:12.909108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:12.922406 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2635b2f8-f2a8-417b-9447-5d40ba144d6a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1356 microversion: 2.57 time: 0.441956 Jul 25 20:30:12.937443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2190/4327] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:12 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1356 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:12.978002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:12.986545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:13.018542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.019847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:13.022164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.023314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:13.325183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:30:13.328069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:30:13.332316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:30:13.337932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:30:13.339454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:30:13.564847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:13.629916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:13.685441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.686213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:13.694329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.695517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:13.802320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:13.824020 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a88ce68b-4b50-464e-8868-64230d538646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "POST /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8/action" status: 202 len: 1137 microversion: 2.57 time: 0.853616 Jul 25 20:30:13.825049 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fdab92e4-fcf1-431f-a044-2e54c7f1a679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.363752 Jul 25 20:30:13.853443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2191/4328] 10.222.0.48 () {62 vars in 1320 bytes} [Mon Jul 25 20:30:12 2022] POST /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8/action => generated 1137 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 25 20:30:13.862432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-029882a0-bc7d-4ee1-9a14-e070b7d49585 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '.version_select at 0x7f1968a104c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:13.862896 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2138/4329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:12 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:30:13.900779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:13.914752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:13.972415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.976752 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-029882a0-bc7d-4ee1-9a14-e070b7d49585 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1520214298" status: 202 len: 0 microversion: 2.1 time: 0.121637 Jul 25 20:30:13.980686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:13.981763 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2192/4330] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1520214298 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:30:13.986790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:13.990436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:14.315393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbec6c15-8afb-4e5a-99ab-f2e172599450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbec6c15-8afb-4e5a-99ab-f2e172599450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 163 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": 12345, "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 12345 Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:30:14.338350 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 25 20:30:14.343887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:14.346298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbec6c15-8afb-4e5a-99ab-f2e172599450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:14.347821 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbec6c15-8afb-4e5a-99ab-f2e172599450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.040282 Jul 25 20:30:14.363865 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2193/4331] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:14 2022] POST /compute/v2.1/servers => generated 127 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:14.365962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:14.381389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:14.382248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:14.423106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:14.445938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:14.449666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:14.450889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:14.570169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:14.587818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:14.589500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:14.590730 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6f72e31-62d3-4ec1-8696-67307a8a272b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.726126 Jul 25 20:30:14.624970 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2139/4332] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:13 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:15.623218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:15.624133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:15.641648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:15.644434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:15.646120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:15.647711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:15.825525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:15.862692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:15.875732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13398032-5f36-4d2b-ba78-9b1341f562e4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.510443 Jul 25 20:30:15.888173 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2194/4333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:14 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:15.931703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:15.943234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:15.987541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:15.990559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:15.997507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:15.998183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:16.062036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:16.087906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:16.105972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:16.112391 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75d05933-f027-4f7b-a386-1086d144c8f9 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.491009 Jul 25 20:30:16.114571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2140/4334] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:15 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:16.937904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:16.968795 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d6c6476-c3b4-481d-ab3f-ffa82f4afcc6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.037968 Jul 25 20:30:16.978636 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2195/4335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:15 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:17.142357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:17.143431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:17.192014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:17.192836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:17.198427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:17.198945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:17.533948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:17.577778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:17.590733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:17.594140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b8a9a227-ee3e-4978-88ce-828bbce49391 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.459918 Jul 25 20:30:17.608761 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2141/4336] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:17 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:18.638475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:18.650059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:18.672809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:18.673993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:18.674995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:18.675658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:18.865668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:18.879429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:18.888758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:18.891346 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4611d95f-2151-4198-beb2-9221d1787f0d tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.256852 Jul 25 20:30:18.892463 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2196/4337] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:18 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:19.942744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:19.943383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:19.959401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:19.967043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:19.968815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:19.969435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:20.343750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:20.378766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:20.400862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:20.403379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1daac7ba-8e57-4a70-943c-ccc0970dc3fa tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.464755 Jul 25 20:30:20.405855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2142/4338] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:19 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:20.761866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d9a4930-9ea3-4b62-9b36-e5ac186e705e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1608217110", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "229a22c5-fc5b-40d6-b377-0ed1edab4ea5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:20.980646 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-6d9a4930-9ea3-4b62-9b36-e5ac186e705e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d9a4930-9ea3-4b62-9b36-e5ac186e705e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 358 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1608217110", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "229a22c5-fc5b-40d6-b377-0ed1edab4ea5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: exception: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1608217110', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '229a22c5-fc5b-40d6-b377-0ed1edab4ea5'}], 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:20.986789 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:20.992238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d9a4930-9ea3-4b62-9b36-e5ac186e705e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Block Device 229a22c5-fc5b-40d6-b377-0ed1edab4ea5 is not bootable. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:20.994896 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d9a4930-9ea3-4b62-9b36-e5ac186e705e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.244387 Jul 25 20:30:20.995352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2197/4339] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:21.015105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:21.015105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:21.040439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.041315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.043106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.043764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.380394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:21.412426 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17586c37-e56e-4cd7-afba-5b1466a0d601 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.403435 Jul 25 20:30:21.414341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2143/4340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:21.443830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:21.445456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:21.459993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:21.463843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.466532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:21.466979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.473256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.474145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.481794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.484615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.485621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:21.497012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:21.513673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:21.818607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:21.847872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:21.853717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:21.860888 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd4e34ed-4f75-4f40-9510-eefd93ed494b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.405032 Jul 25 20:30:21.863597 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2144/4341] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:21 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:22.103840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:22.105650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:22.118140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.122288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.125369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.126230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.232583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:30:22.410541 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-acb0e79e-ed14-4fd2-a76e-eb0987bd76c2 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 204 len: 0 microversion: 2.1 time: 0.321469 Jul 25 20:30:22.412972 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2145/4342] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:30:22 2022] DELETE /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:30:22.425539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3e4690d5-3da7-4470-a0fd-197085aca5a4 req-5f9a7ad6-5173-4aad-b812-6c9235a7d317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7be05bc-e14b-4875-b5af-cbebda47b04a", "tag": "f51c08c8-8325-47ee-81d6-3e43fb92f98b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:22.453253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3e4690d5-3da7-4470-a0fd-197085aca5a4 req-5f9a7ad6-5173-4aad-b812-6c9235a7d317 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.454379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3e4690d5-3da7-4470-a0fd-197085aca5a4 req-5f9a7ad6-5173-4aad-b812-6c9235a7d317 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.485999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3e4690d5-3da7-4470-a0fd-197085aca5a4 req-5f9a7ad6-5173-4aad-b812-6c9235a7d317 service nova] Creating event network-changed:f51c08c8-8325-47ee-81d6-3e43fb92f98b for instance a7be05bc-e14b-4875-b5af-cbebda47b04a on n-h2-845775-3 Jul 25 20:30:22.488001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:22.494554 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3e4690d5-3da7-4470-a0fd-197085aca5a4 req-5f9a7ad6-5173-4aad-b812-6c9235a7d317 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079906 Jul 25 20:30:22.500874 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2146/4343] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:30:22.506511 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-738b9fbc-40ce-4def-94d7-db6cc50e3ae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.067940 Jul 25 20:30:22.518305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:22.519059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:22.536466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2198/4344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:21 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:22.542088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.543299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.545448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.548633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.902115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:22.903380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:22.939759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.941172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:22.943033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:22.944412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:23.487587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:23.515102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac018858-afbd-4744-a62c-8075d6b1f7aa tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1670 microversion: 2.1 time: 1.010701 Jul 25 20:30:23.519748 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2147/4345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:22 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1670 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:23.807537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:23.842990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:23.847972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:23.849624 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-217caae7-bb61-4510-83cf-a160f8bc7b0a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.960434 Jul 25 20:30:23.865166 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2199/4346] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:22 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:24.552139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:24.554008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:24.576152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:24.576972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:24.577961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:24.578564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:24.891967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:24.893078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:24.952678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:24.958094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:24.959866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:24.960967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:25.082360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:25.102724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c7be337-c934-4313-9410-a779b1369e20 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1670 microversion: 2.1 time: 0.555424 Jul 25 20:30:25.114889 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2148/4347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:24 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1670 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:25.227596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:25.255822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:25.258418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:25.266596 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86fd4b6d-330e-4812-9792-71aefa6beda7 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.386493 Jul 25 20:30:25.267687 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2200/4348] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:24 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:26.185429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:26.187404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:26.221852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:26.223064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:26.229492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:26.241473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:26.307701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:26.312552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:26.352129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:26.352806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:26.353668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:26.358053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:26.569386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:26.589625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:26.601275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:26.603578 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1ad2b8b-7365-4db0-951f-17f26d53c646 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.300258 Jul 25 20:30:26.604765 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2201/4349] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:26 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:26.722417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:26.738960 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ecb77e70-fd67-4da4-b599-27a4bbeda0eb tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1670 microversion: 2.1 time: 0.563707 Jul 25 20:30:26.742491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2149/4350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:26 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1670 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:27.124090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4faea3ff-e879-496f-be47-be27a322ae8c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-804400715", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "destination_type": "local"}, {"source_type": "volume", "uuid": "6a43165a-2877-448d-990d-546eb1b7b4b2", "destination_type": "invalid"}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4faea3ff-e879-496f-be47-be27a322ae8c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 494 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-804400715", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "destination_type": "local"}, {"source_type": "volume", "uuid": "6a43165a-2877-448d-990d-546eb1b7b4b2", "destination_type": "invalid"}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-804400715', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6a43165a-2877-448d-990d-546eb1b7b4b2', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'invalid' Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:27.137825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4faea3ff-e879-496f-be47-be27a322ae8c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:27.144294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4faea3ff-e879-496f-be47-be27a322ae8c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021521 Jul 25 20:30:27.152245 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2202/4351] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:27 2022] POST /compute/v2.1/servers => generated 155 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:27.157532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:27.158189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:27.206488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.207264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.208699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.209591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.314146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:27.574864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5ddc4532-6e34-4f64-b4b0-bbba7ddfff02 req-52bb1940-e17e-4959-a793-f771e95f083d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7be05bc-e14b-4875-b5af-cbebda47b04a", "name": "network-vif-deleted", "tag": "f51c08c8-8325-47ee-81d6-3e43fb92f98b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:27.648583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5ddc4532-6e34-4f64-b4b0-bbba7ddfff02 req-52bb1940-e17e-4959-a793-f771e95f083d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.649089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5ddc4532-6e34-4f64-b4b0-bbba7ddfff02 req-52bb1940-e17e-4959-a793-f771e95f083d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.701919 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5ddc4532-6e34-4f64-b4b0-bbba7ddfff02 req-52bb1940-e17e-4959-a793-f771e95f083d service nova] Creating event network-vif-deleted:f51c08c8-8325-47ee-81d6-3e43fb92f98b for instance a7be05bc-e14b-4875-b5af-cbebda47b04a on n-h2-845775-3 Jul 25 20:30:27.716128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5ddc4532-6e34-4f64-b4b0-bbba7ddfff02 req-52bb1940-e17e-4959-a793-f771e95f083d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146882 Jul 25 20:30:27.718220 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2203/4352] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:30:27.740072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:27.740877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:27.757714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:27.770872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.773226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.775572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57f5f996-f636-4236-9fd5-97f27a1309a2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.624097 Jul 25 20:30:27.778540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.780914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.785764 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2150/4353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:27 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:27.800257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:27.801219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:27.814142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.814852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.816556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.817375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.890239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:27.891189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:27.896862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lazy-loading 'fault' on Instance uuid a7be05bc-e14b-4875-b5af-cbebda47b04a {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:30:28.171348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:28.184479 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec7404e1-c65b-4d80-ae2b-0a98feb2a758 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1339 microversion: 2.1 time: 0.392963 Jul 25 20:30:28.185467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2151/4354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:27 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1339 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:28.192559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:28.193524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:28.211753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:28.213653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:28.214750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:28.216212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:28.285160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:28.299630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:28.304505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:28.307219 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e312763d-432c-4b85-8fdd-85dfd98ff32a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.587271 Jul 25 20:30:28.311544 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2204/4355] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:27 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:28.628430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:28.659583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d61fbd1d-a595-4254-9d97-5e0b00e43e00 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.471740 Jul 25 20:30:28.661937 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2152/4356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:28 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:28.971698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59edbfb6-8599-457f-9416-cde824c3bd34 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-784782673", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59edbfb6-8599-457f-9416-cde824c3bd34 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 491 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-784782673", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-784782673', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.979073 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 25 20:30:28.983802 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:28.988217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59edbfb6-8599-457f-9416-cde824c3bd34 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:28.997836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59edbfb6-8599-457f-9416-cde824c3bd34 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.031846 Jul 25 20:30:28.999044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2205/4357] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:28 2022] POST /compute/v2.1/servers => generated 624 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:29.009681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:29.010744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:29.025702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.026480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.028424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.036903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.209553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:29.211451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:29.229256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.233978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.236697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.237390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.382240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.383618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.383618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lazy-loading 'fault' on Instance uuid a7be05bc-e14b-4875-b5af-cbebda47b04a {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:30:29.471981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:29.480858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f90c91c8-f47c-46db-9501-9cf8eab20339 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 200 len: 1339 microversion: 2.1 time: 0.275380 Jul 25 20:30:29.486649 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2206/4358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:29 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:29.541541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:29.546244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:29.547184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:29.550796 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31e7acab-780e-4b9d-9c9c-677c8933129c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.545981 Jul 25 20:30:29.566858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.578329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.581599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.582508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.582896 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2153/4359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:29 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:30:29.597686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:29.598327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:29.645327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.646363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.647945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:29.648883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:29.807079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:29.828052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:29.831811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:29.837712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f8913d3-6372-4cf4-9b13-71be6663b406 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.320225 Jul 25 20:30:29.838553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2207/4360] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:29 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:30.091122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:30.119776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29076b3e-7132-4189-af4f-f2755ee8914b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.535550 Jul 25 20:30:30.121796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2154/4361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:29 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:30.386725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77718742-deb5-4b01-913f-3bafcfb8a5a4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77718742-deb5-4b01-913f-3bafcfb8a5a4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 416 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.398870 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:30:30.403565 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.408205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77718742-deb5-4b01-913f-3bafcfb8a5a4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:30.410500 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77718742-deb5-4b01-913f-3bafcfb8a5a4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.040737 Jul 25 20:30:30.411688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2208/4362] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:30 2022] POST /compute/v2.1/servers => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:30.422547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:30.423239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:30.442315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.444832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.445772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.446361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.510500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:30.512180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: a7be05bc-e14b-4875-b5af-cbebda47b04a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:30.521776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:30.542063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.543548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.545261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.551373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.572923 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] HTTP exception thrown: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Request method failure captured: Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a HTTP/1.1 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx67DVfFex60d0uo1n9vNiHSfDG_vqNxbJrc0qDoHt1y1SKrVno2G79bRQg4FiCQHWgyBqyfXMgBb0hrrj6Mo2cQht0I6IL7NwThBb0MJwIBjxer0csdygeT6hiWZ8Y8j__1vMTobck5IwIiFggZ94Hm3u9Rb0BMhhQWrRVKy82wwk Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_284fb24804444beca38878cf47f64c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/284fb24804444beca38878cf47f64c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}] Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2b756e7d53114329bb377fd0c6fbf2a1 Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a7be05bc-e14b-4875-b5af-cbebda47b04a'} Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:30.575080 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. Jul 25 20:30:30.580520 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:30.583131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Returning 404 to user: Instance a7be05bc-e14b-4875-b5af-cbebda47b04a could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:30.586895 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16602213-cc4d-4192-8e2d-0067c3617e14 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a" status: 404 len: 111 microversion: 2.1 time: 0.083333 Jul 25 20:30:30.588726 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2209/4363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:30 2022] GET /compute/v2.1/servers/a7be05bc-e14b-4875-b5af-cbebda47b04a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:30.880499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:30.881410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:30.907743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:30.925598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.926533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.944989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:30.947246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:30.962784 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-20bbe045-2daf-45c9-a0f8-4f17f6e9f08a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.537775 Jul 25 20:30:30.966135 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2155/4364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:30 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:31.025663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:31.028705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:31.067013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:31.067705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:31.076430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:31.079529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:31.356406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:31.371696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:31.374350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:31.375637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-198c44bf-4fc3-41aa-8fc8-bf856a9353f3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.512879 Jul 25 20:30:31.392718 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2210/4365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:30 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:31.400292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7c45b03-bde9-4820-b6c9-29a87e2883ed tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '.version_select at 0x7f1968c554c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:31.464007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7c45b03-bde9-4820-b6c9-29a87e2883ed tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1402654246" status: 202 len: 0 microversion: 2.1 time: 0.069164 Jul 25 20:30:31.464653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2211/4366] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:30:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1402654246 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:30:31.715864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:31.737614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dea17d9f-eadd-4d85-98a8-efd86e12c450 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.728281 Jul 25 20:30:31.740130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2156/4367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:30 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:32.056054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7adefa28-afe8-4e77-a6d0-d6f058382c8a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-9468923", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": -1, "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:32.097663 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7adefa28-afe8-4e77-a6d0-d6f058382c8a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Flavor -1 could not be found. Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7adefa28-afe8-4e77-a6d0-d6f058382c8a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 203 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-9468923", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": -1, "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: exception: Flavor -1 could not be found. Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-9468923', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': -1, 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:32.100700 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 25 20:30:32.105862 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:32.112633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7adefa28-afe8-4e77-a6d0-d6f058382c8a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:32.113809 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7adefa28-afe8-4e77-a6d0-d6f058382c8a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.073092 Jul 25 20:30:32.121459 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2212/4368] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:32 2022] POST /compute/v2.1/servers => generated 73 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 25 20:30:32.131504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:32.132913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:32.143356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.147745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:32.150353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.151184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:32.401289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:32.402586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:32.416370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.416838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:32.417650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.418096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:32.678742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:32.711108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:32.716119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:32.737876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-406601ff-2fc0-4fa3-bca0-bab4bd1236e6 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.340220 Jul 25 20:30:32.761616 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2213/4369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:32 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:32.923368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:32.937505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a0be205-a6d3-42c4-835a-43fa21e8b67b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.810188 Jul 25 20:30:32.941754 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2157/4370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:32.969337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:32.969956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:32.990246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.991015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:32.992254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:32.993056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:33.785471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:33.786091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:33.809154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:33.809885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:33.810822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:33.811942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:33.965110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:33.984592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:33.995865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:34.014284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:34.028852 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c4b0ad0-6818-4668-80c7-2c3b6ae87496 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.242655 Jul 25 20:30:34.036444 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13b75e6a-06c1-4542-acaa-ad162b36fab4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.071660 Jul 25 20:30:34.037047 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2158/4371] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:33 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:34.049530 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2214/4372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:34.162210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08c46b81-3fac-4714-8e27-30628091a30f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1017496679", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08c46b81-3fac-4714-8e27-30628091a30f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 173 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1017496679", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1017496679', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi -1 Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:30:34.168230 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 25 20:30:34.177691 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:34.191391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08c46b81-3fac-4714-8e27-30628091a30f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:34.201092 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08c46b81-3fac-4714-8e27-30628091a30f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.047888 Jul 25 20:30:34.202930 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2159/4373] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:34.214742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:34.215844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:34.227675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:34.236361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:34.237390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:34.237919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:35.057597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:35.058386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:35.086282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:35.088254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:35.091887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:35.095309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:35.119534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:35.153805 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e3b1ac3-fb85-4cb0-8648-94ad4feda21b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.946169 Jul 25 20:30:35.163343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2215/4374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:34 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:35.191600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:35.194487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:35.245840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:35.250330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:35.252764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:35.256931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:35.807716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:35.826472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:35.829980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:35.831236 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-876c57b1-e976-4859-b287-640163c0d65e tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.779009 Jul 25 20:30:35.847589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2160/4375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:35 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:30:36.177295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:36.182281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:36.187757 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53086543-1e11-4fd4-9ec2-513cd230122f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.004279 Jul 25 20:30:36.205920 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2216/4376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:35 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:36.729756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2853365a-1216-4a2c-bfd7-dc1975e0a7fd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622623285", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:36.737393 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2853365a-1216-4a2c-bfd7-dc1975e0a7fd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2853365a-1216-4a2c-bfd7-dc1975e0a7fd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 215 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-622623285", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-622623285', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:36.744660 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 25 20:30:36.749075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:36.751383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2853365a-1216-4a2c-bfd7-dc1975e0a7fd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:36.758238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2853365a-1216-4a2c-bfd7-dc1975e0a7fd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033867 Jul 25 20:30:36.773039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:36.779458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:36.790305 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2161/4377] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:36.812056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:36.819306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:36.821834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:36.833512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:36.876876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:36.879471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:36.900341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:36.918145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:36.919011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:36.919465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:37.216957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:37.233095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:37.243414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:37.248315 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95ad93bc-58f1-4505-a1f0-f1fa3af868e0 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.379782 Jul 25 20:30:37.255337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2162/4378] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:36 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:37.575927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:37.595918 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b95d8097-8249-40f9-abf6-9d5c66749404 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.829560 Jul 25 20:30:37.612770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2217/4379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:36 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:37.622826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:37.625528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:37.641496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:37.643076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:37.644123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:37.644782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:38.080712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:38.091378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4148f0c-90b4-45f4-b738-f3bdbea1e0c1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.472835 Jul 25 20:30:38.110223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2163/4380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:37 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:38.279850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:38.281286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:38.298322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:38.309066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:38.310412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:38.311595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:38.425798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-313771898", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-key-790204657", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:38.489893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:38.507473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:38.510143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:38.512009 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35217c75-c8c8-43c9-85fb-5d10a82e09d1 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.237677 Jul 25 20:30:38.514413 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2218/4381] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:38 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:38.556793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] validate_networks() for [('6c5e2337-ad74-4e5b-8f37-15330da4632d', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:30:39.109411 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Invalid key_name provided. Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 245 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-313771898", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-key-790204657", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid key_name provided. Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-313771898', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'key_name': 'tempest-key-790204657', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-790204657 not found for user 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:39.113520 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 25 20:30:39.118265 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:39.123707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid key_name provided. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:39.135720 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3bbaea85-f927-4657-a225-03071d5de46d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.710423 Jul 25 20:30:39.152384 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2164/4382] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 731 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 25 20:30:39.167755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:39.168507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:39.220505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:39.247453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:39.257501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:39.259436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:39.540202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:39.541231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:39.560161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:39.565459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:39.569833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:39.571340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:39.874317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:39.927881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:39.938424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:39.946217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-535a0231-b81a-4456-9125-f9ff9dfbbd23 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.412558 Jul 25 20:30:39.973188 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2165/4383] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:39 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:40.009319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:40.039281 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc07b413-2580-4f23-a068-dc44b795e175 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.880786 Jul 25 20:30:40.044664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2219/4384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:39 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:40.080596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:40.082001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:40.096532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:40.100303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:40.107438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:40.108594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:40.709159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:40.723467 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33cc927d-c4fb-4cbc-9ac5-b62504c04b14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.649730 Jul 25 20:30:40.724904 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2166/4385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:40 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:40.841926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805765046", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:40.985020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:40.987314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:41.038712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.039650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:41.059727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.066880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:41.151194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.security_group_api [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Neutron security group does_not_exist not found {{(pid=119724) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 25 20:30:41.153237 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 257 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-805765046", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-805765046', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 25 20:30:41.167944 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 25 20:30:41.174330 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:41.182468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:41.182468 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-345be80b-9aae-4656-9460-f660b67bb57f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.345189 Jul 25 20:30:41.183047 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2220/4386] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:40 2022] POST /compute/v2.1/servers => generated 106 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:41.197652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:41.198547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:41.252881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.253337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:41.254116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.254961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:41.456699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:41.472292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:41.481858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:41.490735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78d4becc-87ef-4da5-8a53-46cbd4e7e592 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1365 microversion: 2.57 time: 0.513301 Jul 25 20:30:41.513936 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2167/4387] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:40 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1365 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:30:41.829236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:41.860390 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e262cb87-6045-49b1-944b-617641a324e0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.672085 Jul 25 20:30:41.864600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2221/4388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:41 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:30:41.891048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:41.893565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:41.930895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.936662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:41.941239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:41.942504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:42.679687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:42.704743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-677c9ae2-30fa-400c-8b13-d7df1f0a8a5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.819723 Jul 25 20:30:42.705358 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2168/4389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:41 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:42.751743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:42.754178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:42.794284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:42.820379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:42.825513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:42.835190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:42.839464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:42.845714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-493258365", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "055c0709-47d5-4595-ae8d-6198217cdafc"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:43.052222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] validate_networks() for [('055c0709-47d5-4595-ae8d-6198217cdafc', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:30:43.157774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:43.167029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:43.206579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:43.211834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:43.228118 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a54b530-31ad-4739-a2cf-4faf74a9d724 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1371 microversion: 2.57 time: 0.521260 Jul 25 20:30:43.248357 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2169/4390] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:42 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:43.254852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:43.255639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: b3925942-1ce7-4194-b496-a6b7ef15efee] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:43.283695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/b3925942-1ce7-4194-b496-a6b7ef15efee HTTP/1.1 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b3925942-1ce7-4194-b496-a6b7ef15efee'} Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:43.289825 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance b3925942-1ce7-4194-b496-a6b7ef15efee could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:43.303844 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fae09e39-9357-49b6-ad24-d362a98bb694 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3925942-1ce7-4194-b496-a6b7ef15efee" status: 404 len: 111 microversion: 2.1 time: 0.042969 Jul 25 20:30:43.309630 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2170/4391] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:30:43 2022] DELETE /compute/v2.1/servers/b3925942-1ce7-4194-b496-a6b7ef15efee => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:43.350422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:43.351385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:43.408872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:43.409638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:43.410713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:43.410713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:44.405913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:44.462867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d6e0d04-3e7b-4c4e-9f20-4097e4b6f9cc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.152218 Jul 25 20:30:44.468526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2171/4392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:43 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:44.506970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:44.521738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:44.553610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:44.556929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:44.558008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:44.560569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:44.911596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:44.927295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:44.946593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:44.959682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-49347dec-cdec-4be0-bce3-3bac2e5e59e5 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1371 microversion: 2.57 time: 0.489632 Jul 25 20:30:44.968146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2172/4393] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:44 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1371 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:45.000865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:45.005642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:45.054122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:45.061505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:45.071534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:45.076195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.072129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:30:46.072685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:30:46.073213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:30:46.074788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:30:46.075331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:30:46.101704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.105726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.112006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.113469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.135620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:46.147262 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7c40276-c24f-4096-89f6-7a74a3459256 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.176640 Jul 25 20:30:46.158086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2173/4394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:44 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:46.174495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:46.178825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:46.192335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Getting quotas for project 0f5a281a95d542a59c167f24661c217f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:30:46.203920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.212836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.214065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.214735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.217769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Getting quotas for user ff7fe34ccf6449b294e41aa7e436a957 and project 0f5a281a95d542a59c167f24661c217f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:30:46.294481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:30:46.297988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:30:46.479024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:46.534697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:46.537086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:46.544894 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f135a05-8859-41f1-be06-e74246593c7a tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1356 microversion: 2.57 time: 0.383873 Jul 25 20:30:46.561174 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2174/4395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:46 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1356 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:46.566874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:46.567370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:30:46.567881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9223372036854775808 could not be found. Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9223372036854775808'} Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:46.577431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4aeebd7b-9b79-49ee-9c73-24d373c21bc0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016665 Jul 25 20:30:46.582297 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2175/4396] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Jul 25 20:30:46 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:30:46.604192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:46.604192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:46.636182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.638386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.652439 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9614c1e-62f6-4cb7-ba4e-397de31d8511 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.413625 Jul 25 20:30:46.663509 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2222/4397] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4428 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:30:46.667736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.671407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.703930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:46.706022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:46.762487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.769336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:30:46.770194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:46.773112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:46.779517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:47.054964 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db6dbcbb-3923-4919-b950-33c9681c16d3 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "DELETE /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 204 len: 0 microversion: 2.57 time: 0.473090 Jul 25 20:30:47.058856 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2176/4398] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:30:46 2022] DELETE /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:30:47.075713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:47.081690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:47.372899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.401704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.403894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.405668 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb333639-ad38-4d7f-a3bc-dadff80fe3df tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1258 microversion: 2.21 time: 0.344809 Jul 25 20:30:47.418353 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2177/4399] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:47 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1258 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:47.468621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:47.471886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:47.514887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:47.521220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:47.524571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:47.526510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:47.605700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.616298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-46719f86-dd30-4f39-862c-5c7cb1fd5fc8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.950973 Jul 25 20:30:47.616918 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2223/4400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:46 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:47.683971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:47.687571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:47.729447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:47.730205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:47.733148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:47.733148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:47.893407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.902901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.904968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:47.906203 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01e5e05a-a671-4d8f-9b4b-764b4e930fdb tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1362 microversion: 2.57 time: 0.486888 Jul 25 20:30:47.907258 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2178/4401] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:47 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:48.402240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:48.412588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72160fa8-4e8b-4e1e-a737-56569771e81b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.760141 Jul 25 20:30:48.425343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2224/4402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:47 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:48.441824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:48.441824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:48.494036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:48.494811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Failed to fetch instance by id -1 {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 25 20:30:48.495412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance -1 could not be found. Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance -1 could not be found. Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '-1'} Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:48.511093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c110a849-a30f-4321-b463-480ce06f490e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.068592 Jul 25 20:30:48.516368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2225/4403] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Jul 25 20:30:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:30:48.555621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:48.575384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:48.629697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:48.630311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:48.636453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:48.642495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:48.685511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:48.705266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:48.707078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:48.714851 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-899685a9-5420-4a40-b3b7-0311896f99bb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1258 microversion: 2.21 time: 0.287873 Jul 25 20:30:48.724724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2179/4404] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:48 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:48.939883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:48.940897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:48.955300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:48.957261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:48.961090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:48.961878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:49.260516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:49.291912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:49.306864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:49.308379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc109bf2-38b5-4f74-8e93-051f9f662a7b tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1362 microversion: 2.57 time: 0.375639 Jul 25 20:30:49.308991 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2180/4405] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:48 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:49.481786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:49.534880 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6768c8cd-c12c-494c-8286-358723b32ff8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.003458 Jul 25 20:30:49.564381 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2226/4406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:48 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:49.568978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:49.570243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:49.618482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:49.620177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:49.624225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:49.631998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:49.769620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:49.771144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:49.809524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:49.810158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:49.837163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:49.837839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.391432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.407543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.417445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.418654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a22ff1d3-ae26-4669-a60f-55118c69dcd2 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1310 microversion: 2.21 time: 0.664331 Jul 25 20:30:50.443121 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2227/4407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:49 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1310 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:50.454388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:50.455040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:50.505959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:50.510041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.521090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:50.521858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.550354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.575815 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1ab760f9-84dd-4e81-a82d-79840b2089b4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.011033 Jul 25 20:30:50.582637 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2181/4408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:49 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:50.611858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:50.612112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:50.612580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.613047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 9776502f-787c-47ce-9a54-047620a72bf8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:50.613212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lazy-loading 'fault' on Instance uuid 519c5743-2852-4f01-8b97-deff387ec4b8 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:30:50.629304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/9776502f-787c-47ce-9a54-047620a72bf8/action HTTP/1.1 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 19 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: {"forceDelete": {}} Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9776502f-787c-47ce-9a54-047620a72bf8', 'body': {'forceDelete': {}}} Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:50.655702 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:50.662914 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:50.662914 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:50.662914 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. Jul 25 20:30:50.662914 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:50.676422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 9776502f-787c-47ce-9a54-047620a72bf8 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:50.683412 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59a54365-0145-4caa-b599-6acbc9014ac1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/9776502f-787c-47ce-9a54-047620a72bf8/action" status: 404 len: 111 microversion: 2.1 time: 0.080208 Jul 25 20:30:50.686877 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2182/4409] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:30:50 2022] POST /compute/v2.1/servers/9776502f-787c-47ce-9a54-047620a72bf8/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:50.701527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:50.702030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:50.719056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:50.725638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.728327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:50.728797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:50.828838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.847459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.861963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c0a9646b621494c832d473912571f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7050f9d336430e958fb96aed61419a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:50.863454 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7e4d8ff-281b-490a-872c-4a2d2e542b89 tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 200 len: 1367 microversion: 2.57 time: 0.418969 Jul 25 20:30:50.870743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2228/4410] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:50 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:51.445495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:51.448201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:51.465924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:51.468325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:51.478764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:51.479468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:51.805005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:51.830646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:51.842924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:51.847032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2eb01d84-8f0c-4a4e-bf24-1f3a6ac683f9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1316 microversion: 2.21 time: 0.405237 Jul 25 20:30:51.850603 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2229/4411] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:51 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:51.943286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:51.961428 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ecea89e-8f15-4698-aa8f-793c820b5c17 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.270002 Jul 25 20:30:51.963755 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2183/4412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:50 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:51.972824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:51.974144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] [instance: 519c5743-2852-4f01-8b97-deff387ec4b8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:51.986893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1505650192", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:51.994456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:51.995193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:51.999039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:52.002252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:52.039186 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] HTTP exception thrown: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Request method failure captured: Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 HTTP/1.1 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v1Ls66mBP_f3-oUmd8XAE-poD4Yuly6oAO5yRg5f7PUnosbJsxK6MNS_uGS7NTEiZ9oIm3hO2j6SnMivLOf0IoLeAE--MacTUAma41YF-N1bIOlWnA_39wJQB1EzH4fkzGzcR6xSGmbf-Gih1cY89-JG3wknGet8mvTjLamejxqvgc Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.57 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: dc7050f9d336430e958fb96aed61419a Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerShowV257Test-1082119338 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc7050f9d336430e958fb96aed61419a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc7050f9d336430e958fb96aed61419a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc7050f9d336430e958fb96aed61419a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc7050f9d336430e958fb96aed61419a"}]}] Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerShowV257Test-1082119338 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: dc7050f9d336430e958fb96aed61419a Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerShowV257Test-1082119338 Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerShowV257Test-1082119338-project Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9c0a9646b621494c832d473912571f1c Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerShowV257Test-1082119338-project Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '519c5743-2852-4f01-8b97-deff387ec4b8'} Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:52.047308 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] Returning 404 to user: Instance 519c5743-2852-4f01-8b97-deff387ec4b8 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a57e8b03-96d9-49a1-9492-68c7e403126f tempest-ServerShowV257Test-1082119338 tempest-ServerShowV257Test-1082119338-project] 10.222.0.48 "GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8" status: 404 len: 111 microversion: 2.57 time: 0.085221 Jul 25 20:30:52.052484 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2184/4413] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:51 2022] GET /compute/v2.1/servers/519c5743-2852-4f01-8b97-deff387ec4b8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:30:52.088892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:52.092720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:52.112608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:52.113211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] validate_networks() for [('b976a04f-1fdc-4b75-a0a9-9f0a5b78115e', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:30:52.114807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:52.116472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:52.116948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:53.125138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:53.143611 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29547baf-a2da-4b76-91c9-166570725ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.090169 Jul 25 20:30:53.163096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2185/4414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:52 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:53.181382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:53.182642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:53.201000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:53.202956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:53.204702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:53.205325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:54.148985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:54.159067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:54.166063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:54.177514 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7bc7d92-cb45-4d95-94a5-5f1eaf6be3fc tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.012936 Jul 25 20:30:54.179054 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2186/4415] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:53 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:54.184278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:54.187104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 10c32795-1748-4256-bc21-757e146273c8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:54.202171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/10c32795-1748-4256-bc21-757e146273c8/action HTTP/1.1 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 39 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: {"os-getConsoleOutput": {"length": 10}} Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '10c32795-1748-4256-bc21-757e146273c8', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:54.213242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 10c32795-1748-4256-bc21-757e146273c8 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd99e0c5-ef79-4dee-a982-924962aab380 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/10c32795-1748-4256-bc21-757e146273c8/action" status: 404 len: 111 microversion: 2.1 time: 0.034650 Jul 25 20:30:54.219242 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2187/4416] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:30:54 2022] POST /compute/v2.1/servers/10c32795-1748-4256-bc21-757e146273c8/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:54.224634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:54.225525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:54.251784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:54.252513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:54.253508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:54.254123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:54.646426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:54.665043 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-80ac2c82-1aee-4d2d-a4c2-9defc1530ae4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.441734 Jul 25 20:30:54.683162 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2188/4417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:54 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:54.713947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:54.716487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:54.739000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:54.739561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:54.740578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:54.741907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:55.406725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:30:55.407513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:30:55.408117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:30:55.408646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:30:55.409205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:30:55.429810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:55.433057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:55.434972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:55.437157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:55.477446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:30:55.493346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for user 6562bfb1c9db4ee9a53f4f1b987438d1 and project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:30:55.535262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:30:55.538955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:30:55.618393 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ee6b764-5669-4e7c-ac19-69fc107ae3d9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.766256 Jul 25 20:30:55.623158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2230/4418] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:30:55.630804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:55.633566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:55.673080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:55.674687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:55.676008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:55.680476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:55.707998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:55.725093 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f5cdffc-5788-40e5-92e2-bb56e846214d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.034333 Jul 25 20:30:55.732024 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2189/4419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:54 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:55.749013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26c0ea5a-b90d-4cae-ad68-5e233dedde1d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:55.760025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-26c0ea5a-b90d-4cae-ad68-5e233dedde1d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:55.981656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-26c0ea5a-b90d-4cae-ad68-5e233dedde1d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:55.995594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26c0ea5a-b90d-4cae-ad68-5e233dedde1d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1222 microversion: 2.1 time: 0.257743 Jul 25 20:30:56.015134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2190/4420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:55 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:56.059671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:56.069689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 1e1127d7-7a4d-4cac-bf69-8d455e1e8454] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:56.102280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/1e1127d7-7a4d-4cac-bf69-8d455e1e8454 HTTP/1.1 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1e1127d7-7a4d-4cac-bf69-8d455e1e8454'} Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:30:56.113236 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:30:56.118399 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:30:56.118399 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:30:56.118399 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:30:56.118399 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. Jul 25 20:30:56.118399 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:30:56.128857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 1e1127d7-7a4d-4cac-bf69-8d455e1e8454 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:30:56.133754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94d1bb75-6691-47f7-a82f-d589797f5789 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/1e1127d7-7a4d-4cac-bf69-8d455e1e8454" status: 404 len: 111 microversion: 2.1 time: 0.114974 Jul 25 20:30:56.134340 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2191/4421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:56 2022] GET /compute/v2.1/servers/1e1127d7-7a4d-4cac-bf69-8d455e1e8454 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:30:56.165867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:56.178394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:56.219452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:56.219911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:56.220733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:56.221173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:56.368611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:56.413759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:56.426493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:56.436111 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7de18a3-3d0d-44fe-80fe-7a1cd2931236 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 0.807311 Jul 25 20:30:56.444086 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2231/4422] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:55 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:30:56.461352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1026837449", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:30:56.667966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] validate_networks() for [('b976a04f-1fdc-4b75-a0a9-9f0a5b78115e', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:30:57.377503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:57.387790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7fab7b16-d1de-4b8c-a2b8-700abd95689f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.245100 Jul 25 20:30:57.393086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2192/4423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:56 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:57.429831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:57.430974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:57.467450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:57.469326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:57.470490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:57.471257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:57.595428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:30:58.792995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:30:58.801763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aba1af80-c5bd-472b-b028-4f62ea8ff0bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.380364 Jul 25 20:30:58.826349 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2193/4424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:30:57 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:30:58.841253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:30:58.847434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:30:58.860895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:58.863592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:58.866159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:30:58.867036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:30:59.997358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:30:59.999154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:31:00.000138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:31:00.000783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:31:00.001447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:31:00.021166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:00.024271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:00.025394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:00.026601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:00.098060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:31:00.123618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for user 6562bfb1c9db4ee9a53f4f1b987438d1 and project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:31:00.129383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:00.147493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:00.160655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:00.171555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3db23c34-91c3-4183-aa3d-2dbfd20a1886 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.339910 Jul 25 20:31:00.172711 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2194/4425] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:30:58 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:00.225811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf8b2c02-a8f7-46f7-a6e1-f5f87d149772 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-273715285", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:00.246011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:31:00.258012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf8b2c02-a8f7-46f7-a6e1-f5f87d149772 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 237 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-273715285", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-273715285', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.272869 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 25 20:31:00.277345 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:00.284761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf8b2c02-a8f7-46f7-a6e1-f5f87d149772 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:00.293338 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf8b2c02-a8f7-46f7-a6e1-f5f87d149772 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.099303 Jul 25 20:31:00.295310 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2195/4426] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:31:00 2022] POST /compute/v2.1/servers => generated 139 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:31:00.324452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:00.333870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:00.377779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:00.380451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:00.382862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:00.387376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:00.491854 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c613d9f8-e297-4fb4-9c8e-f7b2095743e8 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.046496 Jul 25 20:31:00.498870 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2232/4427] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:30:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:31:00.511823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73419bf8-56a9-4923-884c-71d148317a4c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:00.518341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73419bf8-56a9-4923-884c-71d148317a4c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:01.042473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-73419bf8-56a9-4923-884c-71d148317a4c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:01.089334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73419bf8-56a9-4923-884c-71d148317a4c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1222 microversion: 2.1 time: 0.582926 Jul 25 20:31:01.092814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2233/4428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:00 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1222 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:01.112829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cf14a079-c854-48a7-bf41-4ed221c6310b req-565610b6-790d-4bda-8e5c-18935ad2be9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dabbdc2-6d3c-44bf-a55a-6112a01592d7", "tag": "e4b26637-7d1b-44b2-b6fc-3324bdb70db2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:01.157650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:01.165850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cf14a079-c854-48a7-bf41-4ed221c6310b req-565610b6-790d-4bda-8e5c-18935ad2be9c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:01.166320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cf14a079-c854-48a7-bf41-4ed221c6310b req-565610b6-790d-4bda-8e5c-18935ad2be9c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:01.230959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cf14a079-c854-48a7-bf41-4ed221c6310b req-565610b6-790d-4bda-8e5c-18935ad2be9c service nova] Creating event network-changed:e4b26637-7d1b-44b2-b6fc-3324bdb70db2 for instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 on n-h1-845775-3 Jul 25 20:31:01.260307 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cf14a079-c854-48a7-bf41-4ed221c6310b req-565610b6-790d-4bda-8e5c-18935ad2be9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157496 Jul 25 20:31:01.265435 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2234/4429] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:01.321836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:01.325274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:01.371997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:01.377290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:01.380066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:01.382198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:01.625725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:01.644792 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d00b97d-8837-4103-8427-fb4703ec9c95 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.344976 Jul 25 20:31:01.651717 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2196/4430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:00 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:01.689039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:01.690646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:01.729835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:01.742171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:01.747363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:01.747848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:02.780726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:02.797299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:02.798949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:02.803058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd92c5db-08a4-4da8-9020-846accebba53 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.530332 Jul 25 20:31:02.825101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2235/4431] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:01 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:02.831303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:02.838080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:02.853115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:02.853944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:02.854968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:02.855626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:02.908093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:02.921794 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-92a752ec-afc8-4bbf-a58a-72acb924b10d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.254911 Jul 25 20:31:02.922742 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2197/4432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:01 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:03.084786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:03.097910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-855e210e-7059-4d68-a6f5-4a26ed605c65 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1274 microversion: 2.1 time: 0.271468 Jul 25 20:31:03.100755 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2236/4433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:02 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:03.256397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4a38160-0a1e-4d5b-b02e-82af5ddb9781 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098375192", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4a38160-0a1e-4d5b-b02e-82af5ddb9781 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 235 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1098375192", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1098375192', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.274952 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 25 20:31:03.280353 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:03.289955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4a38160-0a1e-4d5b-b02e-82af5ddb9781 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:03.290997 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4a38160-0a1e-4d5b-b02e-82af5ddb9781 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050047 Jul 25 20:31:03.291739 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2198/4434] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:31:03 2022] POST /compute/v2.1/servers => generated 133 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:31:03.302714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:03.303640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:03.320582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:03.321353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:03.322305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:03.322908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:03.835601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:03.837112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:03.855898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:03.857911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:03.863417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:03.864442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:04.602131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:04.630646 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b25958a0-a35d-4321-9499-6dc0d930a19f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.333295 Jul 25 20:31:04.632887 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2237/4435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:03 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:04.637797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:04.638416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:04.648386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:04.649085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:04.650023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:04.651346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:04.785030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:04.787706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:04.809268 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-542510ae-811a-4f11-ad40-4c6ef3f15727 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1280 microversion: 2.1 time: 0.175231 Jul 25 20:31:04.813322 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2238/4436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:04 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1280 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:04.827189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:04.829162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:04.844247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:04.844879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:04.847371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:04.849450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:04.870653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:04.890739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:04.895738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:04.898604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-605f4762-3f64-4809-b539-eed1ba6bf6cb tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.069477 Jul 25 20:31:04.918419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2199/4437] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:03 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:31:05.743310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4e3298ef-9d47-4452-bc55-9e35bad0d986 req-566f0552-037e-4c36-b923-c674aa2c50f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2", "tag": "c7ef8d44-126b-4591-bc77-1d2f2568ce6e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:05.767859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e3298ef-9d47-4452-bc55-9e35bad0d986 req-566f0552-037e-4c36-b923-c674aa2c50f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:05.770155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e3298ef-9d47-4452-bc55-9e35bad0d986 req-566f0552-037e-4c36-b923-c674aa2c50f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:05.820612 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4e3298ef-9d47-4452-bc55-9e35bad0d986 req-566f0552-037e-4c36-b923-c674aa2c50f5 service nova] Creating event network-changed:c7ef8d44-126b-4591-bc77-1d2f2568ce6e for instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 on n-h2-845775-3 Jul 25 20:31:05.829839 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4e3298ef-9d47-4452-bc55-9e35bad0d986 req-566f0552-037e-4c36-b923-c674aa2c50f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092158 Jul 25 20:31:05.830540 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2200/4438] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:05.842743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:05.843697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:05.851256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:05.851780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:05.853701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:05.854206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:05.987270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:06.085867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:06.097932 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14e6bd33-8a1f-45c0-8059-017089e529dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.283282 Jul 25 20:31:06.100656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2239/4439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:04 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:06.111242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:06.111882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:06.129424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:06.129884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:06.141854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:06.142495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:06.366594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:06.378636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7316ffac-9b1e-4f91-8c36-787f177c7d68 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1280 microversion: 2.1 time: 0.543754 Jul 25 20:31:06.381549 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2201/4440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:05 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1280 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:06.393449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:06.397755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 8653bac7-c6f4-45dc-9cee-abc150e55a36] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:06.416146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/8653bac7-c6f4-45dc-9cee-abc150e55a36/action HTTP/1.1 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 13 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: {"pause": {}} Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '8653bac7-c6f4-45dc-9cee-abc150e55a36', 'body': {'pause': {}}} Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:06.427771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:06.434888 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:06.434888 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:06.434888 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. Jul 25 20:31:06.434888 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:06.434888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 8653bac7-c6f4-45dc-9cee-abc150e55a36 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:06.438445 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65d868ac-0e77-4671-9cad-806826debf31 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/8653bac7-c6f4-45dc-9cee-abc150e55a36/action" status: 404 len: 111 microversion: 2.1 time: 0.054853 Jul 25 20:31:06.440517 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2202/4441] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:06 2022] POST /compute/v2.1/servers/8653bac7-c6f4-45dc-9cee-abc150e55a36/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:06.493378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:06.496489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:06.541731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:06.543568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:06.549823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:06.551323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:07.335159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:07.349687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:07.351708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:07.353380 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9dbae86f-a255-4ffa-86a1-116b4d3222f1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.251514 Jul 25 20:31:07.354196 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2240/4442] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:06 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:07.401611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:07.402576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:07.417497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:07.418474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:07.420845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:07.422823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:08.507152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:08.517625 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dcc0493a-a321-49eb-a2ec-9a968eeed486 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 2.054843 Jul 25 20:31:08.518224 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2203/4443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:06 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:08.557213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:08.563155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:08.584470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:08.588290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:08.589240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:08.589760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:08.895214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:08.911591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c2c954f-cc6c-425b-bd7c-7d1dc76a4093 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 1.511805 Jul 25 20:31:08.921136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2241/4444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:07 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:08.956012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:08.959891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:09.008280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:09.011648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:09.015560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:09.017088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:09.929675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:09.951674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:09.964801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:09.966560 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a110d58-c855-40e5-ae32-9136be064e0a tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 1.423047 Jul 25 20:31:09.967768 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2204/4445] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:08 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:09.975960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9b5525d-fff9-45c9-ac2b-060b6d52bcb3 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: .version_select at 0x7f1968892820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1335325603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCD/VD2tx6fO5gNgRfX/pMqZpK1uQOt1O/N3tezwsayi8QZTLy3NV6PP4b6fVK06ly4GgqYv8Pp4XsY2bL8XFH4I+gJ7x5AMWSKFoIbUqID9xomg0qirNXyL190M6s3Hg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:10.019087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d9b5525d-fff9-45c9-ac2b-060b6d52bcb3 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:31:10.028366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d9b5525d-fff9-45c9-ac2b-060b6d52bcb3 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:31:10.059348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:10.067967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9b5525d-fff9-45c9-ac2b-060b6d52bcb3 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.098230 Jul 25 20:31:10.069103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2205/4446] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:31:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:10.073971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:10.077417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:10.100693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.101669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.102851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.103525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.251754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:10.264830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a79454a-440e-4a47-ade3-dbc68c086841 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.334533 Jul 25 20:31:10.281478 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2242/4447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:08 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:10.295925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:10.296956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:10.307916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.309105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.311176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.313709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.482258 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3af24603-2863-496a-9983-b54bd77b4939 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.191783 Jul 25 20:31:10.484284 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2243/4448] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:10 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:31:10.496105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:10.496834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:10.516605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.520464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.522220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:10.522686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:10.675023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:10.687347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74d42f05-757c-422a-a2a7-5f34cc54ae96 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.617026 Jul 25 20:31:10.689612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2206/4449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:10 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:11.000295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:11.002648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:11.048443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:11.052982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:11.055007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:11.062521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:11.075664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=20 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:11.347537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:11.356607 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1784d161-b861-4a2a-b296-e6432a621de9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1511 microversion: 2.1 time: 0.867639 Jul 25 20:31:11.361435 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2244/4450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:10 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1511 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:11.370466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c2214c6f-c9cd-417f-8994-78cba0870645 req-b0e129be-c2b0-4e8d-a71e-b4eb6a5c566c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dabbdc2-6d3c-44bf-a55a-6112a01592d7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b26637-7d1b-44b2-b6fc-3324bdb70db2"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:11.405202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c2214c6f-c9cd-417f-8994-78cba0870645 req-b0e129be-c2b0-4e8d-a71e-b4eb6a5c566c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:11.405872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c2214c6f-c9cd-417f-8994-78cba0870645 req-b0e129be-c2b0-4e8d-a71e-b4eb6a5c566c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:11.431887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c2214c6f-c9cd-417f-8994-78cba0870645 req-b0e129be-c2b0-4e8d-a71e-b4eb6a5c566c service nova] Creating event network-vif-plugged:e4b26637-7d1b-44b2-b6fc-3324bdb70db2 for instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 on n-h1-845775-3 Jul 25 20:31:11.441938 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c2214c6f-c9cd-417f-8994-78cba0870645 req-b0e129be-c2b0-4e8d-a71e-b4eb6a5c566c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079005 Jul 25 20:31:11.453003 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2245/4451] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:11.713613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:11.714646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:11.733141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:11.736535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:11.737843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:11.738473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:11.895787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:11.921429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:11.924304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:11.925490 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-47000ed9-9ae5-4a6f-ac90-dc436378ff35 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 0.935395 Jul 25 20:31:11.928341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2207/4452] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:10 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:12.391196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:12.393447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:12.397595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:12.421761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-840f2246-b114-4048-90bb-0931de153570 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.702697 Jul 25 20:31:12.440067 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2246/4453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:11 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:12.440282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:12.440282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:12.442903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:12.442903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:12.950938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:12.952574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:12.970640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:12.978235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:12.979781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:12.985623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.335523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:13.365500 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75ccd612-5022-4773-a584-253aab40b9c0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1491 microversion: 2.1 time: 0.986665 Jul 25 20:31:13.382450 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2208/4454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:12 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1491 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:13.390107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5dde1746-2358-4b98-adb9-0d030021f61b req-c4e489de-1728-4414-9828-e21fcb01d0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f903e64d-a941-4ad5-9601-d8186e5f079a", "tag": "2850f457-796e-4cbd-87a8-6c803ae6c7e0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:13.397408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:13.406190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5dde1746-2358-4b98-adb9-0d030021f61b req-c4e489de-1728-4414-9828-e21fcb01d0df service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.406894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5dde1746-2358-4b98-adb9-0d030021f61b req-c4e489de-1728-4414-9828-e21fcb01d0df service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.422432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5dde1746-2358-4b98-adb9-0d030021f61b req-c4e489de-1728-4414-9828-e21fcb01d0df service nova] Creating event network-changed:2850f457-796e-4cbd-87a8-6c803ae6c7e0 for instance f903e64d-a941-4ad5-9601-d8186e5f079a on n-h2-845775-3 Jul 25 20:31:13.432810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5dde1746-2358-4b98-adb9-0d030021f61b req-c4e489de-1728-4414-9828-e21fcb01d0df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048696 Jul 25 20:31:13.433771 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2209/4455] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:13.439598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:13.440433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:13.452192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.452880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.453724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.454176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.488536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'pause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state paused Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 13 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: {"pause": {}} Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'pause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state paused Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'pause': {}}} Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state paused. Cannot pause while the instance is in this state. Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state paused Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:13.491701 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:13.498737 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:13.498737 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:13.498737 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:13.498737 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state paused Jul 25 20:31:13.498737 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:13.503462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'pause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state paused {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:13.504435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6b1fdf9-20b6-4225-8203-70291af00f36 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 143 microversion: 2.1 time: 0.069444 Jul 25 20:31:13.505043 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2210/4456] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:13 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 143 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:31:13.512744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:13.513399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:13.538282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.538742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.539535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.539986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.850174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:13.875525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:13.880627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:13.884445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ec12cd5-29d0-4b70-a10c-ab0905568ec3 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1358 microversion: 2.21 time: 0.937643 Jul 25 20:31:13.890037 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2247/4457] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:12 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1358 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:13.907615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:13.912540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:13.970548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.975058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:13.978456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:13.979127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:14.056173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:14.075562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9278c5d6-8f68-42cc-b0bb-f67ef6ac1c0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.569144 Jul 25 20:31:14.076868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2211/4458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:13 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:14.085432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1750866865", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6ea26894-0639-45aa-a1b0-3cac934a8540"}], "key_name": "tempest-TestNetworkBasicOps-1335325603", "security_groups": [{"name": "tempest-secgroup-smoke-756080248"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:14.242944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f10ccdc-c4c2-4d1d-a7a4-c6e7933c03a3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.346654 Jul 25 20:31:14.244050 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2248/4459] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:13 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:31:14.265748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:14.266903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:14.290599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:14.291066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:14.291872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:14.292375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:14.730183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:14.748876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25de9ab3-026e-4f49-85dc-25a777c053d4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1498 microversion: 2.1 time: 0.486844 Jul 25 20:31:14.749880 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2249/4460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:14 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1498 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:14.762953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] validate_networks() for [('6ea26894-0639-45aa-a1b0-3cac934a8540', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:31:14.780017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5810d762-19c2-4dc0-80d1-6c95633f4339 req-8d049946-c1bc-4306-addd-35b177b525f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2", "name": "network-vif-plugged", "status": "completed", "tag": "c7ef8d44-126b-4591-bc77-1d2f2568ce6e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:14.809281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5810d762-19c2-4dc0-80d1-6c95633f4339 req-8d049946-c1bc-4306-addd-35b177b525f3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:14.812891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5810d762-19c2-4dc0-80d1-6c95633f4339 req-8d049946-c1bc-4306-addd-35b177b525f3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:14.838962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5810d762-19c2-4dc0-80d1-6c95633f4339 req-8d049946-c1bc-4306-addd-35b177b525f3 service nova] Creating event network-vif-plugged:c7ef8d44-126b-4591-bc77-1d2f2568ce6e for instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 on n-h2-845775-3 Jul 25 20:31:14.860639 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5810d762-19c2-4dc0-80d1-6c95633f4339 req-8d049946-c1bc-4306-addd-35b177b525f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109425 Jul 25 20:31:14.861870 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2250/4461] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:14.914725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:14.916584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:14.932366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:14.933199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:14.934264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:14.934714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.348827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:15.361551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:15.364311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:15.367570 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31fd64c2-9271-4c3f-9c8d-d364b521955d tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1550 microversion: 2.21 time: 0.457144 Jul 25 20:31:15.368966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2251/4462] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:14 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1550 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:31:15.375653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:15.376677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:15.390588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.391307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.392342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.392856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.603057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:15.611866 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d4f36d1-d5af-4d24-a418-db65a34baf7c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.240846 Jul 25 20:31:15.612620 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2252/4463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:15 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:15.649284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:15.649907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:15.675509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.677481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.679769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.681809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.758911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:31:15.863626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:15.964547 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e483f5ad-c432-4c2b-a7cc-a6b8c971e31f tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 204 len: 0 microversion: 2.21 time: 0.339137 Jul 25 20:31:15.965142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2253/4464] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:31:15 2022] DELETE /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:31:15.979149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:15.979871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:15.986784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:31:15.987314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:31:15.987793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:31:15.988414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:31:15.989228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:31:15.996942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.997376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:15.998214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:15.999038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.002462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.003261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.004382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.005462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.031659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:31:16.037987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Getting quotas for user 2b756e7d53114329bb377fd0c6fbf2a1 and project 284fb24804444beca38878cf47f64c92. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:31:16.070677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:31:16.070677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:31:16.126058 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-92cda1e3-e9b2-4146-a87c-9c67d9eacbd7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.047833 Jul 25 20:31:16.146074 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2212/4465] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:31:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:31:16.164755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:16.164755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:16.196666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.205287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.210967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.214762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.250107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:16.258961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-317a70b8-c142-4881-8a67-b9fbffa93fcc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1498 microversion: 2.1 time: 0.292620 Jul 25 20:31:16.261127 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2254/4466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:15 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1498 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:16.276513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-147eb7af-0ad8-456b-b322-3a6f58066be1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:16.277967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-147eb7af-0ad8-456b-b322-3a6f58066be1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:16.386003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-147eb7af-0ad8-456b-b322-3a6f58066be1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:16.408861 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-147eb7af-0ad8-456b-b322-3a6f58066be1 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1249 microversion: 2.1 time: 0.146349 Jul 25 20:31:16.409424 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2255/4467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:16 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:16.509380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:16.526807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:16.531401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:16.535066 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e7cfdfe-d9a5-4cbb-8419-abd33d37ea89 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1556 microversion: 2.21 time: 0.404707 Jul 25 20:31:16.537477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2213/4468] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:16 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1556 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:16.640377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:16.640998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:16.651017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.652384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:16.653384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:16.654728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.284484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:17.285952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:17.308257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.312902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.316727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.317182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.843587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:17.855689 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94c859a8-234c-4660-a781-a33021a4cd87 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 1.216000 Jul 25 20:31:17.855689 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2256/4469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:16 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:17.857687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:17.857848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:17.858342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:17.864441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.864898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.865666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.866098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.874501 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-198ae9a1-23c0-4d29-87da-d7e2b2d67369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1498 microversion: 2.1 time: 0.595089 Jul 25 20:31:17.875587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2214/4470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:17 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1498 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:17.909534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:17.910383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:17.917245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.917976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:17.918934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:17.919620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:18.130295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:18.138206 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55384440-c01f-4486-98ab-7b182dbfb745 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1301 microversion: 2.1 time: 0.284514 Jul 25 20:31:18.142797 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2257/4471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:17 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1301 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:18.479344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:18.488975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:18.493991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:18.497508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5da1e4a0-16c4-43c6-94a7-3533afd4d373 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1556 microversion: 2.21 time: 0.619907 Jul 25 20:31:18.512472 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2215/4472] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:17 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1556 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:18.882048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:18.883018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:18.891755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:18.892557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:18.893600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:18.900574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:18.901890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:18.906673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:18.921655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:18.924081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:18.932478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:18.933254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.024208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:19.537260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.548288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a053bd63-608c-4089-8add-0928e94d97c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.678908 Jul 25 20:31:19.549951 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2258/4473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:18 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:19.552387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.558462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:19.559616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:19.569304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.570070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.571065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.571714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.591351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff0181a3-d42a-4c8a-a254-a0147b16192f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1498 microversion: 2.1 time: 0.691381 Jul 25 20:31:19.602030 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2216/4474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:18 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1498 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:19.630345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ab058d2e-4fc7-41d4-9d93-cf9623fc2268 req-1071ce58-3298-49de-875b-e309999ac79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dabbdc2-6d3c-44bf-a55a-6112a01592d7", "name": "network-vif-deleted", "tag": "e4b26637-7d1b-44b2-b6fc-3324bdb70db2"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:19.665004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ab058d2e-4fc7-41d4-9d93-cf9623fc2268 req-1071ce58-3298-49de-875b-e309999ac79e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.672128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ab058d2e-4fc7-41d4-9d93-cf9623fc2268 req-1071ce58-3298-49de-875b-e309999ac79e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.699111 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ab058d2e-4fc7-41d4-9d93-cf9623fc2268 req-1071ce58-3298-49de-875b-e309999ac79e service nova] Creating event network-vif-deleted:e4b26637-7d1b-44b2-b6fc-3324bdb70db2 for instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 on n-h1-845775-3 Jul 25 20:31:19.710223 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ab058d2e-4fc7-41d4-9d93-cf9623fc2268 req-1071ce58-3298-49de-875b-e309999ac79e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105824 Jul 25 20:31:19.711134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2217/4475] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:19.712595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.720592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:19.722056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:19.727672 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd4b1e14-f1b9-4ade-9085-efc5edfd2fa6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1307 microversion: 2.1 time: 0.176052 Jul 25 20:31:19.730195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2259/4476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:19 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:19.753005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.753957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.754884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.757530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.837760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:19.838964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:19.839788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lazy-loading 'fault' on Instance uuid 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:31:19.928732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.941028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.943175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff7fe34ccf6449b294e41aa7e436a957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5a281a95d542a59c167f24661c217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:19.945983 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1bdb33fa-7e38-437e-9ce7-cff1d1176de9 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 200 len: 1348 microversion: 2.21 time: 0.233087 Jul 25 20:31:19.948315 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2218/4477] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:19 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 1348 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:31:20.584818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:20.590500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:20.625138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:20.628920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:20.629650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:20.640296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:20.644267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:20.645122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:20.647431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:20.650737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:20.651703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:20.652242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.192249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:21.215302 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e978365f-33d7-4034-991a-e827f1f2ddf6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.596518 Jul 25 20:31:21.217240 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2219/4478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:21.228657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:21.229272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:21.230431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:21.243662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6956132f-8e44-4c13-8a86-b714edd06381 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.672824 Jul 25 20:31:21.248603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.250186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.251441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.252561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.261252 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2260/4479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:20 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:21.271553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:21.272397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:21.279516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.280288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.281261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.281872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.307952 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] HTTP exception thrown: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Request method failure captured: Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 HTTP/1.1 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v1xJCx9kRi2knDShDOT-_03RgQUtwOvWRp52D2r0L0Z-OwSJawerbodvDM1jZoUKtz7jxfnmUp11p93pMKnlg6d8tl8jv0VqVTZDldzEBtePl2E7vTIaowD7XiEoPcQ6sX_nOWdUal1VCFmlH5d7HWsVWOK5qRc2ml2vc25bmKYFXg Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f5a281a95d542a59c167f24661c217f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}] Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ff7fe34ccf6449b294e41aa7e436a957 Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '4dabbdc2-6d3c-44bf-a55a-6112a01592d7'} Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.314430 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Returning 404 to user: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67877456-a486-4649-a695-1df69653f183 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 404 len: 111 microversion: 2.21 time: 0.053249 Jul 25 20:31:21.328228 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2261/4480] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:21 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:31:21.351568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:21.355549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:21.377154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.377789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.378728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.384399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.811538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:21.824733 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65ebd22b-5ce5-4a15-aaab-ac999a9648d5 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.605050 Jul 25 20:31:21.828534 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2220/4481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:21 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:21.835514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '.version_select at 0x7f19688cf9d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:21.839084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:21.860138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.861195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.862324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.863007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.893390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:21.902688 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16c1c1cb-1b62-481d-8e11-3859376f7b4b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.583778 Jul 25 20:31:21.903277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2262/4482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:21 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:21.932389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:21.936240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:21.943692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.944720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.945976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:21.947821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:21.970402 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action HTTP/1.1 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 28 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: {"reboot": {"type": "SOFT"}} Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '44d174e7-6f13-45f9-b69d-5c4e571c6dea', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:21.973181 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:21.978149 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:21.980409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:21.981678 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92bd7936-dab4-4ad1-a6c5-ab962fabc556 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action" status: 404 len: 111 microversion: 2.1 time: 0.054837 Jul 25 20:31:21.983545 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2263/4483] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:21 2022] POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:22.005320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.008393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.029835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.031816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.034120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.035382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.045695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-540bf1f6-fcc8-4e99-b8d8-90ae9baa1278 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.215719 Jul 25 20:31:22.046531 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2221/4484] 10.222.0.48 () {60 vars in 1337 bytes} [Mon Jul 25 20:31:21 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7/os-instance-actions => generated 611 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:31:22.063688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.067932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.080342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.080800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.081602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.082054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.130792 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] HTTP exception thrown: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Request method failure captured: Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 HTTP/1.1 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v1xJCx9kRi2knDShDOT-_03RgQUtwOvWRp52D2r0L0Z-OwSJawerbodvDM1jZoUKtz7jxfnmUp11p93pMKnlg6d8tl8jv0VqVTZDldzEBtePl2E7vTIaowD7XiEoPcQ6sX_nOWdUal1VCFmlH5d7HWsVWOK5qRc2ml2vc25bmKYFXg Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f5a281a95d542a59c167f24661c217f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}] Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ff7fe34ccf6449b294e41aa7e436a957 Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4dabbdc2-6d3c-44bf-a55a-6112a01592d7'} Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:22.133375 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Returning 404 to user: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:22.138182 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05163b1c-f267-476f-b2e1-df267f7c1aa1 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 404 len: 111 microversion: 2.21 time: 0.077719 Jul 25 20:31:22.139095 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2222/4485] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:31:22 2022] DELETE /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:31:22.145730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.146986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] [instance: 4dabbdc2-6d3c-44bf-a55a-6112a01592d7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.155105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.155567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.156414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.156861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.177270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] HTTP exception thrown: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Request method failure captured: Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 HTTP/1.1 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v1xJCx9kRi2knDShDOT-_03RgQUtwOvWRp52D2r0L0Z-OwSJawerbodvDM1jZoUKtz7jxfnmUp11p93pMKnlg6d8tl8jv0VqVTZDldzEBtePl2E7vTIaowD7XiEoPcQ6sX_nOWdUal1VCFmlH5d7HWsVWOK5qRc2ml2vc25bmKYFXg Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.21 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f5a281a95d542a59c167f24661c217f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f5a281a95d542a59c167f24661c217f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5a281a95d542a59c167f24661c217f"}]}] Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0f5a281a95d542a59c167f24661c217f Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-602328357 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ff7fe34ccf6449b294e41aa7e436a957 Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-InstanceActionsV221TestJSON-602328357-project Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4dabbdc2-6d3c-44bf-a55a-6112a01592d7'} Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.178957 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] Returning 404 to user: Instance 4dabbdc2-6d3c-44bf-a55a-6112a01592d7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d4b65c73-fd3d-4cea-a18a-d339418d3b83 tempest-InstanceActionsV221TestJSON-602328357 tempest-InstanceActionsV221TestJSON-602328357-project] 10.222.0.48 "GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7" status: 404 len: 111 microversion: 2.21 time: 0.040409 Jul 25 20:31:22.193047 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2223/4486] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:31:22 2022] GET /compute/v2.1/servers/4dabbdc2-6d3c-44bf-a55a-6112a01592d7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:31:22.274542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.275397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.289124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.289738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.290709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.291372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.580023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:22.597516 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0735dfde-6098-4dde-a233-f399e2aa7a50 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.605174 Jul 25 20:31:22.600814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2264/4487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:21 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:22.625762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.626018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.635672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.636471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.637422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.638361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.675635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:22.700394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-70108c9d-f15c-4b5a-ac26-65d80b533d6d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.430925 Jul 25 20:31:22.705078 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2224/4488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:22 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:22.848799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:22.849775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:22.885853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.886320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:22.887209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:22.887555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:23.551322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:23.564592 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-355366f1-03f8-4821-ad1d-2aca104da6d9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.944009 Jul 25 20:31:23.568546 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2265/4489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:22 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:23.580452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-41eaf878-6f1b-4de8-a2f9-652baf64919e req-02d54344-88b8-4259-a04d-70b9ccbf903f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:23.595457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-41eaf878-6f1b-4de8-a2f9-652baf64919e req-02d54344-88b8-4259-a04d-70b9ccbf903f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:23.596291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-41eaf878-6f1b-4de8-a2f9-652baf64919e req-02d54344-88b8-4259-a04d-70b9ccbf903f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:23.611685 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-41eaf878-6f1b-4de8-a2f9-652baf64919e req-02d54344-88b8-4259-a04d-70b9ccbf903f service nova] Creating event network-changed:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:31:23.618625 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-41eaf878-6f1b-4de8-a2f9-652baf64919e req-02d54344-88b8-4259-a04d-70b9ccbf903f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047114 Jul 25 20:31:23.619811 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2266/4490] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:23.626961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:23.630641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 04b0b2d8-059f-40fd-91ec-6174a55ff66e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:23.642021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/04b0b2d8-059f-40fd-91ec-6174a55ff66e/action HTTP/1.1 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 28 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: {"reboot": {"type": "SOFT"}} Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '04b0b2d8-059f-40fd-91ec-6174a55ff66e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. Jul 25 20:31:23.644759 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. Jul 25 20:31:23.649957 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:23.651688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 04b0b2d8-059f-40fd-91ec-6174a55ff66e could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:23.652789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8ba98180-b846-4ddb-aed3-4e27fc107ccb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/04b0b2d8-059f-40fd-91ec-6174a55ff66e/action" status: 404 len: 111 microversion: 2.1 time: 0.031713 Jul 25 20:31:23.654688 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2267/4491] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:23 2022] POST /compute/v2.1/servers/04b0b2d8-059f-40fd-91ec-6174a55ff66e/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:23.666518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:23.667350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:23.677501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:23.678572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:23.679838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:23.680733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:23.755671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:23.775164 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-853b05de-71b2-4a64-b775-f50d09e1142a tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.931894 Jul 25 20:31:23.792855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2225/4492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:22 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:23.814625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:23.815931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:23.854981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:23.858020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:23.859863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:23.861248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:24.964394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:24.980023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70156c2d-d55e-472f-b05f-b5757402bf11 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.318973 Jul 25 20:31:24.985661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2268/4493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:23 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:25.007928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:25.014349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:25.028434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.030250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.032932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.038829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.118654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:25.144670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-785c274f-7f5b-45a6-86b7-3e41ed8096ca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 1.349811 Jul 25 20:31:25.145279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2226/4494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:23 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:25.151413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:25.163939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:25.182750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.183220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.184093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.184549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.879636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:25.885924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:25.893458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5534ae11-6c64-460f-b7a3-01ec0d57b54f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.746915 Jul 25 20:31:25.896108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2227/4495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:25 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:25.905312 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f980cf86-9169-427c-8109-f7ee64ba7223 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.914191 Jul 25 20:31:25.922780 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2269/4496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:24 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:25.938307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:25.943110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:25.953886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.954343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.955933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:25.956886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:25.987768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action HTTP/1.1 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 65 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '44d174e7-6f13-45f9-b69d-5c4e571c6dea', 'body': {'rebuild': {'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba'}}} Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 20:31:25.990527 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:31:25.995133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:25.998572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:25.999721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7075973d-7c06-4e25-8dad-9f049adab557 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action" status: 404 len: 111 microversion: 2.1 time: 0.071314 Jul 25 20:31:26.004380 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2228/4497] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:25 2022] POST /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:26.014641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:26.018870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:26.059544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.063072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.069601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.072672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.173459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:26.174921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:26.186064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:26.191803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:26.218364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.218838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.219648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.220140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.399494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:26.795236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:26.803973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec8decfc-e4ff-4be2-bf76-129b0f14e1b2 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.640730 Jul 25 20:31:26.823357 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2229/4498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:26 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:26.846518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:26.857497 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34b85ef4-349e-4c14-ab26-da676fa2dd35 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.850268 Jul 25 20:31:26.868514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2270/4499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:26 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:26.889646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:26.890633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:26.904589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.905053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.905874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.906585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.926781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:26.929527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:26.948300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.948938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:26.950375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:26.962949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:27.480598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:27.502555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08398ad1-8e5a-4c45-86c3-d9b1d7e769d1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.611695 Jul 25 20:31:27.503221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2230/4500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:26 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:27.521551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b2f81307-8e4d-491a-92da-fd9893b369a7 req-3d5bdf7c-92aa-4ff5-bf53-e1ea049f02be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903e64d-a941-4ad5-9601-d8186e5f079a", "name": "network-vif-plugged", "status": "completed", "tag": "2850f457-796e-4cbd-87a8-6c803ae6c7e0"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:27.564469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b2f81307-8e4d-491a-92da-fd9893b369a7 req-3d5bdf7c-92aa-4ff5-bf53-e1ea049f02be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:27.564930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b2f81307-8e4d-491a-92da-fd9893b369a7 req-3d5bdf7c-92aa-4ff5-bf53-e1ea049f02be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:27.603242 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b2f81307-8e4d-491a-92da-fd9893b369a7 req-3d5bdf7c-92aa-4ff5-bf53-e1ea049f02be service nova] Creating event network-vif-plugged:2850f457-796e-4cbd-87a8-6c803ae6c7e0 for instance f903e64d-a941-4ad5-9601-d8186e5f079a on n-h2-845775-3 Jul 25 20:31:27.616435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b2f81307-8e4d-491a-92da-fd9893b369a7 req-3d5bdf7c-92aa-4ff5-bf53-e1ea049f02be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108403 Jul 25 20:31:27.619701 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2231/4501] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:27.636180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:27.640471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 77b5b8a3-f027-447c-8346-da8466c09d4a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:27.640692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:27.669486 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5e0f0649-078f-48f8-9136-6a53881caeab tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.746050 Jul 25 20:31:27.674056 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2271/4502] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:26 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:27.701301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/77b5b8a3-f027-447c-8346-da8466c09d4a/action HTTP/1.1 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 65 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '77b5b8a3-f027-447c-8346-da8466c09d4a', 'body': {'rebuild': {'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba'}}} Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 25 20:31:27.704978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. Jul 25 20:31:27.710797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:27.715210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 77b5b8a3-f027-447c-8346-da8466c09d4a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:27.718361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b5ed4aec-c2a5-424f-be29-b0c9a572f964 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/77b5b8a3-f027-447c-8346-da8466c09d4a/action" status: 404 len: 111 microversion: 2.1 time: 0.096448 Jul 25 20:31:27.721338 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2232/4503] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:27 2022] POST /compute/v2.1/servers/77b5b8a3-f027-447c-8346-da8466c09d4a/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:27.735276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:27.736027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:27.762942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:27.763816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:27.766622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:27.767291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:27.838982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:27.847095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:27.893489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:27.894298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:27.895682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:27.896488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:28.932804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:28.958325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-59cd1294-5990-4b3a-b2cb-3a9c237f9031 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.229332 Jul 25 20:31:28.972947 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2272/4504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:27 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:29.011731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:29.012517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:29.051686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:29.061708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:29.071047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:29.071047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:29.354068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:29.398629 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7aa3bc51-888a-42b4-ad77-334c4bb9209f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 1.571225 Jul 25 20:31:29.413888 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2233/4505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:27 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:29.459251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:29.461302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:29.503441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:29.504609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:29.506766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:29.507807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:30.180631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:30.183915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:30.199044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:30.212203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b1fd8f0-4674-484a-9fc2-806a49f32500 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 1.236444 Jul 25 20:31:30.216239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2273/4506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:28 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:30.217014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5bead5c-c89a-4c57-ac36-68d24fcf251f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.786790 Jul 25 20:31:30.218488 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2234/4507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:29 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:30.252548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:30.254097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: c2f19745-794d-4c09-9d2e-d6d27d8df549] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:30.265089 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/c2f19745-794d-4c09-9d2e-d6d27d8df549/action HTTP/1.1 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: {"restore": {}} Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c2f19745-794d-4c09-9d2e-d6d27d8df549', 'body': {'restore': {}}} Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:30.271634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:30.283595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:30.283595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:30.283595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. Jul 25 20:31:30.283595 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:30.285387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance c2f19745-794d-4c09-9d2e-d6d27d8df549 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:30.286717 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eceb67c1-3d00-4b41-9c1f-da27f84e6563 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/c2f19745-794d-4c09-9d2e-d6d27d8df549/action" status: 404 len: 111 microversion: 2.1 time: 0.040443 Jul 25 20:31:30.287860 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2274/4508] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:30 2022] POST /compute/v2.1/servers/c2f19745-794d-4c09-9d2e-d6d27d8df549/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:30.302391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:30.305089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:30.372008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:30.375208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:30.376665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:30.377442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:30.450310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:30.453786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:30.492239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:30.493003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:30.494404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:30.495176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:30.938578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:30.961447 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83c1bc14-0a98-4ac5-9849-9a64e5c58ced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.666145 Jul 25 20:31:30.972520 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2235/4509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:30 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:30.989701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:30.990502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:30.991377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:31.001591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.002446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.003493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.004224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.021269 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-901c54d4-e388-4758-898b-30467470ec0b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1322 microversion: 2.1 time: 0.577303 Jul 25 20:31:31.022277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2275/4510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:30 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:31.253043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:31.255816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:31.286612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.287466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.290049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.293879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.296836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:31.331653 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c05a7c7-8ad5-4c24-b2a6-bf1c2cbb68fe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.344745 Jul 25 20:31:31.332347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2236/4511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:30 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:31.365309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:31.366140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:31.383974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.386767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.387583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.388122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.391860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:31.462205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'restore' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 15 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: {"restore": {}} Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'restore' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'restore': {}}} Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state active. Cannot restore while the instance is in this state. Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:31.465260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:31.470181 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:31.470181 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:31.470181 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:31.470181 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:31.470181 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:31.474227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'restore' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:31.477219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2cc5ba67-4e5e-40b6-bfc1-eb1f2e749eb0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 145 microversion: 2.1 time: 0.118075 Jul 25 20:31:31.486896 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2237/4512] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:31 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 145 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 20:31:31.500689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:31.501321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:31.521170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.521632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.522422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.522860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.737989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:31.757939 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09686500-7306-4886-9a66-86997df72e28 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.515157 Jul 25 20:31:31.758798 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2276/4513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:31 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:31.827090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:31.839746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d9b55d6-4f54-4dde-947a-e83317c84b4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.349926 Jul 25 20:31:31.856067 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2238/4514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:31 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:31.874136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:31.875439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:31.884824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:31.887932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.888687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:31.889950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:31.890619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.074908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:32.076216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:32.092405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.093470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.095295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.096863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.269861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:32.292891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-001c9346-d858-4691-942e-7e6953f37cfa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.425082 Jul 25 20:31:32.293870 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2277/4515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:31 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:32.338040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:32.338723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 74476b88-3ccc-4010-9980-86e1c3a7cdbe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:32.358802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/74476b88-3ccc-4010-9980-86e1c3a7cdbe/action HTTP/1.1 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 14 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: {"resume": {}} Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '74476b88-3ccc-4010-9980-86e1c3a7cdbe', 'body': {'resume': {}}} Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:32.374326 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:32.379601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:32.379601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:32.379601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. Jul 25 20:31:32.379601 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:32.388953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 74476b88-3ccc-4010-9980-86e1c3a7cdbe could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:32.390126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-029eb293-1bcb-4b19-8ffa-964da433d044 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/74476b88-3ccc-4010-9980-86e1c3a7cdbe/action" status: 404 len: 111 microversion: 2.1 time: 0.068696 Jul 25 20:31:32.392281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2278/4516] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:32 2022] POST /compute/v2.1/servers/74476b88-3ccc-4010-9980-86e1c3a7cdbe/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:32.405561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:32.406189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:32.431209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.431677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.432519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.433658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.445809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:32.459023 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9fcc81b-5133-43a4-97e7-38d446d60f2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1515 microversion: 2.1 time: 0.410622 Jul 25 20:31:32.460780 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2239/4517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:32 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:32.502287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:32.509406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:32.522330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.523313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.525523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.547282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.671172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'flavor' on Instance uuid f903e64d-a941-4ad5-9601-d8186e5f079a {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:31:32.941473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:32.949905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f109cee-100e-445b-92ed-19508354e822 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.548634 Jul 25 20:31:32.951258 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2279/4518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:32.956803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:32.973185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:32.980248 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f83c866-f990-4f0c-9a3b-e65efc949e2a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action" status: 200 len: 32 microversion: 2.1 time: 0.486494 Jul 25 20:31:32.987090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.987802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.989401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:32.990019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:32.990721 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2240/4519] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:32 2022] POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action => generated 32 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:31:33.008370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-907a4add-6f4b-4d88-be0a-66f89be70ab0 req-e3ab6798-4822-4279-9583-624e482015a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "name": "network-vif-plugged", "status": "completed", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:33.050151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-907a4add-6f4b-4d88-be0a-66f89be70ab0 req-e3ab6798-4822-4279-9583-624e482015a4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.052738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-907a4add-6f4b-4d88-be0a-66f89be70ab0 req-e3ab6798-4822-4279-9583-624e482015a4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.090415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-907a4add-6f4b-4d88-be0a-66f89be70ab0 req-e3ab6798-4822-4279-9583-624e482015a4 service nova] Creating event network-vif-plugged:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:31:33.099972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-907a4add-6f4b-4d88-be0a-66f89be70ab0 req-e3ab6798-4822-4279-9583-624e482015a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107495 Jul 25 20:31:33.100885 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2241/4520] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:31:33.109546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:33.110168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:33.118515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.119197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.120159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.120754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.760558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:33.774447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0a93798-5b47-42ba-bee2-4a9883d08723 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.821777 Jul 25 20:31:33.775356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2280/4521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:32 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:33.787935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:33.795198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:33.796132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:33.807958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc289ffa-e399-4f19-a897-e726426d25a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.705399 Jul 25 20:31:33.810757 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2242/4522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:33 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:33.811623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.812120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.813110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.813721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.846897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:33.848665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:33.865521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.869225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.874639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:33.877594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:33.952777 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'resume' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 14 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: {"resume": {}} Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'resume' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'resume': {}}} Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state active. Cannot resume while the instance is in this state. Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:33.960906 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:33.969407 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:33.969407 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:33.969407 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:33.969407 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:31:33.969407 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:33.981483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'resume' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:33.985238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23e793be-919e-4b71-8578-6601ef71e051 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 144 microversion: 2.1 time: 0.147901 Jul 25 20:31:33.986883 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2243/4523] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:33 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 144 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:31:34.006165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:34.008227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:34.024451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.025518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:34.027319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.028372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:34.285497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:34.311823 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-06080f37-b04b-4e58-b230-dcfd5d22b51e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.532749 Jul 25 20:31:34.316293 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2281/4524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:33 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:34.458483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:34.471995 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e608fc3-ebdb-4878-bb70-53d390f06656 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.480082 Jul 25 20:31:34.475805 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2244/4525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:33 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:34.508256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:34.509236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:34.528198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.529603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:34.530506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.531025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:34.810137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:34.810137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:34.857159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.857725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:34.863831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:34.864341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:35.279806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:35.299248 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ceb2d7cb-7644-4fa8-b8c2-ac408e690525 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.794844 Jul 25 20:31:35.316372 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2282/4526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:34 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:35.366953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:35.370033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:35.370273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:35.394773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b52a981a-2c07-49b6-be36-a0a107d094ac tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1374 microversion: 2.1 time: 0.589029 Jul 25 20:31:35.400246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:35.402192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:35.403498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:35.404780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:35.417493 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2245/4527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:34 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1374 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:35.574618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eadfb6e7-d9f9-4454-a8a2-c01520dac17b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eadfb6e7-d9f9-4454-a8a2-c01520dac17b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 160 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "6c5e2337-ad74-4e5b-8f37-15330da4632d"}]}} Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': '', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'networks': [{'uuid': '6c5e2337-ad74-4e5b-8f37-15330da4632d'}]}}} Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '' Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:31:35.588272 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:31:35.595709 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:31:35.605374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eadfb6e7-d9f9-4454-a8a2-c01520dac17b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:35.608140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eadfb6e7-d9f9-4454-a8a2-c01520dac17b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.051255 Jul 25 20:31:35.614197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2246/4528] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:31:35 2022] POST /compute/v2.1/servers => generated 108 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:31:35.625324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:35.632256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:35.648814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:35.649681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:35.651616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:35.652501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:35.846220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:35.893737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7fde55e4-9984-420c-9bcc-188902894970 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.534856 Jul 25 20:31:35.899408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2283/4529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:35 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:36.240433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:36.259535 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4afd68c7-8d80-4aaa-92ef-5b5ec06f1f14 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.640720 Jul 25 20:31:36.269620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2247/4530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:35 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:36.297570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:36.299942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:36.321030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:36.324107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:36.329083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:36.331900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:36.779123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:36.805657 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84a219e8-34e1-4a8b-a379-869711d447fa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.516273 Jul 25 20:31:36.807966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2284/4531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:36 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:36.838872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:36.839720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: b9582629-0e4d-4aed-80eb-dd43e4bd8363] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:36.854162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/b9582629-0e4d-4aed-80eb-dd43e4bd8363/action HTTP/1.1 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 14 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: {"shelve": {}} Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'b9582629-0e4d-4aed-80eb-dd43e4bd8363', 'body': {'shelve': {}}} Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:31:36.860594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:31:36.866594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:31:36.866594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:31:36.866594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. Jul 25 20:31:36.866594 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:31:36.867422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance b9582629-0e4d-4aed-80eb-dd43e4bd8363 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:31:36.872570 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a4916b4-8575-4fa3-a9d0-a47c1a163411 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/b9582629-0e4d-4aed-80eb-dd43e4bd8363/action" status: 404 len: 111 microversion: 2.1 time: 0.038245 Jul 25 20:31:36.879370 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2285/4532] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:36 2022] POST /compute/v2.1/servers/b9582629-0e4d-4aed-80eb-dd43e4bd8363/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:31:36.905404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:36.909876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:36.946282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:36.948274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:36.952349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:36.953121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:37.101461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:37.102240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:37.133310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:37.134010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:37.138660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:37.139495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:38.567184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:38.595801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3c1780c6-9160-4970-ad30-b856379651cc tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1545 microversion: 2.1 time: 2.164142 Jul 25 20:31:38.621247 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2248/4533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:36 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1545 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:38.667682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:38.669396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:38.684175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:38.709246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:38.709968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:38.711320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:38.712061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:38.724070 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d06ab4a8-2af8-4f14-bebf-b8fed0d95bf0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.841857 Jul 25 20:31:38.725686 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2286/4534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:36 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:38.768506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:38.769820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:38.818604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:38.819788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:38.823625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:38.833247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:39.512383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:39.547037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a0ab9e74-dd42-43a4-85ea-d8efc536bd55 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1545 microversion: 2.1 time: 0.819500 Jul 25 20:31:39.580939 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2287/4535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:38 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1545 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:39.593400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:39.599023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:39.600107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:39.623146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:39.624283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:39.625905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:39.626878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:39.641715 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b19add43-5205-4b6f-8405-c6ad1f6e38eb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.998394 Jul 25 20:31:39.644356 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2249/4536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:38 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:40.239376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:40.253478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eba788a3-d3de-4aa8-a47c-8b8f341ceb92 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.670684 Jul 25 20:31:40.255210 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2288/4537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:39 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:40.297708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:40.298433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:40.317987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:40.322357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:40.323643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:40.325605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:40.433663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'flavor' on Instance uuid 2409431d-6e0a-4adc-b72e-4a2817b080a3 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:31:40.685848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:40.687105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:40.709980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:40.711857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:40.714697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:40.716634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:41.040378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-706a9ca0-8c8d-4bc1-8f2b-cd603c226ac4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.746753 Jul 25 20:31:41.048449 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2250/4538] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:31:40 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:31:41.072706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:41.079442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:41.098326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:41.105360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:41.111085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:41.119801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:41.121680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:42.266127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:42.284066 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e65962b6-6bb1-4643-94f5-687d6c68e81a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.223656 Jul 25 20:31:42.285522 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2251/4539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:41 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:42.388498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:42.407301 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6db13b4c-6a5a-4ef4-a7a5-c5366d25cd69 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.728917 Jul 25 20:31:42.425291 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2289/4540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:40 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:43.323799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:43.325114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:43.347486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:43.348580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:43.358435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:43.360562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:43.387970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:43.452982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:43.454533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:43.480222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:43.483007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:43.490539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:43.492161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:44.362032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:44.380988 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55a20a5a-2fa7-418c-922b-f1eea42c5f00 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.934832 Jul 25 20:31:44.385786 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2290/4541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:43 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:44.442633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:44.461789 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f7ae993b-8b61-48d8-acab-282d36814e78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.141789 Jul 25 20:31:44.472568 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2252/4542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:43 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:45.421134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:45.422690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:45.446011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:45.454796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:45.464784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:45.466654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:45.507263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:45.509344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:45.537279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:45.543885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:45.545292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:45.546261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:46.543553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:46.567395 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-226edfab-37b4-4d16-ab09-d0a7749044b3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.074475 Jul 25 20:31:46.568750 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2253/4543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:45 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:46.752807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ab52ed74-d1c8-4b34-9673-c96299adab58 req-c47f19ec-6e46-4f33-b459-79947d2c00ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:46.792067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ab52ed74-d1c8-4b34-9673-c96299adab58 req-c47f19ec-6e46-4f33-b459-79947d2c00ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:46.795508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ab52ed74-d1c8-4b34-9673-c96299adab58 req-c47f19ec-6e46-4f33-b459-79947d2c00ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:46.834230 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ab52ed74-d1c8-4b34-9673-c96299adab58 req-c47f19ec-6e46-4f33-b459-79947d2c00ab service nova] Creating event network-changed:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:31:46.858779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ab52ed74-d1c8-4b34-9673-c96299adab58 req-c47f19ec-6e46-4f33-b459-79947d2c00ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108607 Jul 25 20:31:46.864353 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2254/4544] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:31:47.392175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:47.410451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c882864b-f87d-4acd-9ee3-4dbc9cd9cbd6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.995373 Jul 25 20:31:47.417864 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2291/4545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:45 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:47.614343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:47.615345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:47.659578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:47.661014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:47.665312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:47.671875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:48.441206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:48.442602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:48.457438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:48.459065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:48.460822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:48.463142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:49.811988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:49.831652 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebc9bdaf-abe4-4885-bad0-b6761e6e3df0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 2.222539 Jul 25 20:31:49.832289 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2255/4546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:47 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:50.121625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:50.146152 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4890e3af-8b38-486c-a4d9-8d9c7a48d6e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.710158 Jul 25 20:31:50.147139 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2292/4547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:48 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:50.863177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:50.864984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:50.883840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:50.889002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:50.891331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:50.895432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:51.174218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:51.175286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:51.187224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:51.187772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:51.188747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:51.189226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:51.271171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:31:51.939100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:51.956256 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2694cd63-eb41-43c2-aac3-09cd353d8bdc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.100332 Jul 25 20:31:51.958424 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2256/4548] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:50 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:52.208573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:52.221505 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dec1b761-aa33-464c-96f0-06e5d1523bc3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.051111 Jul 25 20:31:52.222184 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2293/4549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:51 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:52.983959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:52.984896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:53.001035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:53.006195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:53.007864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:53.009483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:53.348329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:53.374878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-102572a6-00f8-4739-885f-450fecf85fa9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 0.388613 Jul 25 20:31:53.375641 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2294/4550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:52 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:53.391191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:53.393775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:53.411604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:53.414353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:53.415570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:53.418696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:53.486624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2055570388", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:31:53.817667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:53.831666 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73984a70-1c35-4c37-8474-2f591d648352 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.447653 Jul 25 20:31:53.834480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2295/4551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:53 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:54.400497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:54.401604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:54.420622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:54.427418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:54.428461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:54.437060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:54.546759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] validate_networks() for [('1c0ecf12-b767-4c99-9169-e085ddb2ff8f', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:31:55.058057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:55.087809 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c7d34c9-2559-4813-b2b5-0d5a88775ab9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 0.691478 Jul 25 20:31:55.088239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2296/4552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:54 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:55.112441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:55.119233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:55.152786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:55.153635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:55.167038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:55.172305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:56.843751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:56.874889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-868591a2-3208-4941-b113-4de25deb415e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.774654 Jul 25 20:31:56.891189 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2297/4553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:55 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:56.922576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:56.927174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:56.974572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:56.980536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:56.985465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:56.986582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:57.263112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:31:57.264685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:31:57.265446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:31:57.266277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:31:57.266934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:31:57.280172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:57.280927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:57.282623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:57.283739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:57.324739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Getting quotas for project bae9050eddcf454199cd0f226f3acf4e. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:31:57.335336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Getting quotas for user d7a085352a724d6e8d46d0edc93d0ca1 and project bae9050eddcf454199cd0f226f3acf4e. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:31:57.380560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:31:57.382961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:31:57.487376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f86a1d47-c35f-4eee-9653-ad7a5484e50f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.720110 Jul 25 20:31:57.489150 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2257/4554] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:31:57.515573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-96cb2e8a-aa0f-4c9f-b25a-4d0504517633 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:57.519852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-96cb2e8a-aa0f-4c9f-b25a-4d0504517633 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:57.522307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:57.551996 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51296f15-3233-4bf9-8306-3ac871da5126 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1533 microversion: 2.1 time: 0.651313 Jul 25 20:31:57.556159 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2298/4555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:56 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1533 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:57.827605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-96cb2e8a-aa0f-4c9f-b25a-4d0504517633 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:57.854790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-96cb2e8a-aa0f-4c9f-b25a-4d0504517633 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1224 microversion: 2.1 time: 0.354179 Jul 25 20:31:57.872077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2258/4556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:57 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1224 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:57.918242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:57.920288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:57.947690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:57.961893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:57.967336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:57.970865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:58.587329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:58.588669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:58.630813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:58.636545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:58.637597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:58.638059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:58.705769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:58.717604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-31e6ea1b-8790-4663-8508-f4f9057e067d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.806013 Jul 25 20:31:58.723792 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2299/4557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:57 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:58.891674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:58.892150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:58.912553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:58.915476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:58.918939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:58.919906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:59.279374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:59.294798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a69e331-3e59-46db-a8d4-507a141862e1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1228 microversion: 2.1 time: 0.406093 Jul 25 20:31:59.298449 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2300/4558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:58 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1228 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:31:59.460341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:31:59.500775 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2c8142fb-bdaf-4c71-8634-de7caa8aef39 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1533 microversion: 2.1 time: 0.919039 Jul 25 20:31:59.502756 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2259/4559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:58 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1533 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:31:59.761791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:31:59.763504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:31:59.800598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:59.804430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:31:59.806293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:31:59.813784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:00.352169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:00.354014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:00.373549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:00.384424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:00.385995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:00.388497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:00.692110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:00.705313 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b96d38ca-211e-45ee-a662-c996d90c3f9c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.959943 Jul 25 20:32:00.711021 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2301/4560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:31:59 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:00.729013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:00.742555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:00.743217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:00.745129 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc49724c-99dd-41f6-8516-9dfd1c84fdf9 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1282 microversion: 2.1 time: 0.418169 Jul 25 20:32:00.747213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2260/4561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:00 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1282 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:00.754223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:00.754982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:00.756494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:00.757134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.224488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9c08cc78-61e9-40da-8b6b-5a090b3bff28 req-b4804f4e-469e-424a-b9c4-e3385ab7dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "name": "network-vif-plugged", "status": "completed", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:01.250857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9c08cc78-61e9-40da-8b6b-5a090b3bff28 req-b4804f4e-469e-424a-b9c4-e3385ab7dee3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:01.251413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9c08cc78-61e9-40da-8b6b-5a090b3bff28 req-b4804f4e-469e-424a-b9c4-e3385ab7dee3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.291638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9c08cc78-61e9-40da-8b6b-5a090b3bff28 req-b4804f4e-469e-424a-b9c4-e3385ab7dee3 service nova] Creating event network-vif-plugged:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h2-845775-3 Jul 25 20:32:01.301699 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9c08cc78-61e9-40da-8b6b-5a090b3bff28 req-b4804f4e-469e-424a-b9c4-e3385ab7dee3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085912 Jul 25 20:32:01.303307 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2261/4562] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:32:01.346556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:01.362957 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d13a13b6-e64f-4449-9985-12b7c3143b78 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.650371 Jul 25 20:32:01.363568 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2302/4563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:00 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:01.746796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:01.749989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:01.776691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:01.778682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:01.789683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:01.791897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:01.792393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.793504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:01.794773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.795529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.796584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:01.797034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:01.941763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:01.960125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c07fdbe1-29f9-443a-bcdf-d0fce5a84ace tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1282 microversion: 2.1 time: 0.188365 Jul 25 20:32:01.972123 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2303/4564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:01 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:02.265418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:02.285429 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc4f1063-1149-4625-b074-1d3f8c1503d3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.543605 Jul 25 20:32:02.293509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2262/4565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:01 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:02.416546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:02.418494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:02.446447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=54 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:02.453994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:02.455649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:02.457868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:02.460872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.001385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:03.003620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:03.019457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.022292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.026428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.027358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.413891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:03.434517 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f86a9791-01be-45d0-b654-4692ad32d679 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.035705 Jul 25 20:32:03.438682 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2304/4566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:02 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:03.446913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:03.451820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:03.484452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.487581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.496242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.499228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.642433 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-820bc88b-75a6-47d2-ab42-ca6213ca5e9f tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45/action" status: 200 len: 24566 microversion: 2.1 time: 0.199893 Jul 25 20:32:03.655515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2305/4567] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:03 2022] POST /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45/action => generated 24566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:32:03.667779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:03.668849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:03.724558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.725248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.726275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:03.726858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:03.781184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:03.797445 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d745580-80c7-41c9-93aa-7e2c5f7d12b5 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.803691 Jul 25 20:32:03.814718 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2263/4568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:02 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:04.127298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:04.151764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28a66412-a1cb-4fba-ac52-fd5d39148d54 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 0.494372 Jul 25 20:32:04.152404 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2306/4569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:03 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:04.466957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:04.468345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:04.496478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:04.499589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:04.503611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:04.507546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:04.845229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:04.846265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:04.884601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:04.887207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:04.889837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:04.901764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:05.257239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:05.268898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1fe03103-e955-4ee3-b194-8626d9e5634f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.807653 Jul 25 20:32:05.269750 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2264/4570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:04 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:05.280400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:05.284838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:05.301445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:05.304883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:05.305963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:05.306595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:05.548716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:05.574224 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-af42cea8-1ea2-42ab-aca8-dfe7139ac25c tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.742873 Jul 25 20:32:05.592070 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2307/4571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:04 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:06.284785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:06.299307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:06.302539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:06.321962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:06.324384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:06.327801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:06.345088 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0cadd9b-0e56-4dbe-877f-2a8fba709b57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.054646 Jul 25 20:32:06.352251 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2265/4572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:05 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:06.353535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:06.627318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:06.627922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:06.657492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:06.661436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:06.664549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:06.665563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:07.312590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:07.394235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:07.405053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-028695a7-2289-413e-bbfb-601fc6c2717e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.112967 Jul 25 20:32:07.424153 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2308/4573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:06 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:07.437091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e3a99c1e-bb72-4851-96c5-85c97e6f0a25 req-399381f6-ed7d-4ff4-9614-ae611ced8ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06b88ac-b1ef-4a86-96a4-2309bdbe577f", "tag": "c45b138e-5ab8-4861-8924-3b6b90d32017"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:07.449335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3a99c1e-bb72-4851-96c5-85c97e6f0a25 req-399381f6-ed7d-4ff4-9614-ae611ced8ff8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:07.451180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3a99c1e-bb72-4851-96c5-85c97e6f0a25 req-399381f6-ed7d-4ff4-9614-ae611ced8ff8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:07.480284 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e3a99c1e-bb72-4851-96c5-85c97e6f0a25 req-399381f6-ed7d-4ff4-9614-ae611ced8ff8 service nova] Creating event network-changed:c45b138e-5ab8-4861-8924-3b6b90d32017 for instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f on n-h1-845775-3 Jul 25 20:32:07.490171 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e3a99c1e-bb72-4851-96c5-85c97e6f0a25 req-399381f6-ed7d-4ff4-9614-ae611ced8ff8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062067 Jul 25 20:32:07.498154 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2309/4574] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:07.516890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:07.523596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:07.532151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:07.533487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:07.534508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:07.535142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:07.847936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:07.882134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:07.902700 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-72e59ab3-ea15-46b5-82ce-36c7a050b8bb tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 1.293200 Jul 25 20:32:07.904408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2266/4575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:06 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:08.441505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:08.443040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:08.465016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:08.466211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:08.467137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:08.467621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:08.946633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:08.973071 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eceac24b-1dec-4634-af45-f55567e47651 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1521 microversion: 2.1 time: 1.463512 Jul 25 20:32:08.974815 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2310/4576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:07 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1521 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:09.008269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:09.008932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:09.021699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:09.022155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:09.022947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:09.023409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:09.026656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:09.431302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:09.452927 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2193d9c6-217a-48a8-a8cc-3dffc23f7977 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.013885 Jul 25 20:32:09.453902 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2267/4577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:08 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:09.523933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:09.566646 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99e1cc96-c65f-48fc-9717-3aa97984abcf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.579866 Jul 25 20:32:09.574430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2311/4578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:08 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:10.015224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:10.017081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:10.026318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.028687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.030650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.031279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.164232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:10.166506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:10.200623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.204907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.209640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.212857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.315170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:32:10.410227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:10.425179 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1855bc46-3c99-4279-a990-38be1c677d36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1501 microversion: 2.1 time: 0.415978 Jul 25 20:32:10.437757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2312/4579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:10 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1501 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:10.437757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:10.453636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:10.485470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.504537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.507948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.537176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.673991 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d473dfc9-5601-4477-bab0-f6033adce4e0 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 204 len: 0 microversion: 2.32 time: 1.206121 Jul 25 20:32:10.684873 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2268/4580] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:32:09 2022] DELETE /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 0 bytes in 1231 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:32:10.707277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:10.710175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:10.731996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.740568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:10.742057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:10.742798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.092097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:11.102227 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e1a2523-f47c-41c6-b6d0-028691ba241a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1514 microversion: 2.1 time: 0.407987 Jul 25 20:32:11.103662 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2269/4581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:10 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:11.109026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:11.109890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:11.118354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.119105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.120418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.122402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.126005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:11.396842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:11.410298 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4dee8a7-deac-49fc-a340-dad5a6de9527 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.304920 Jul 25 20:32:11.411498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2270/4582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:11 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:11.420025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:11.421377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:11.430576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:11.433607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.434419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.436069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.436666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.860952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:11.877284 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1cb099e7-03f0-42a8-b257-87d33600a52e tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.463409 Jul 25 20:32:11.878925 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2271/4583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:11 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:11.907224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:11.908809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:11.926082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.927529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:11.936632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:11.937549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:12.425096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:12.438002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:12.440216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:12.442187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c182d321-98d6-41ea-aef8-ff537a3ea8e3 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2948 microversion: 2.32 time: 0.561185 Jul 25 20:32:12.442947 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2272/4584] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:11 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2948 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:12.447946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:12.450780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: bc2fea88-de08-4cca-800e-c666208184e0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:12.457017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/bc2fea88-de08-4cca-800e-c666208184e0/action HTTP/1.1 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 14 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: {"rescue": {}} Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'bc2fea88-de08-4cca-800e-c666208184e0', 'body': {'rescue': {}}} Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:12.467401 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. Jul 25 20:32:12.474972 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:12.477384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 404 to user: Instance bc2fea88-de08-4cca-800e-c666208184e0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:12.478622 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb3a0a35-2989-483d-9a56-df25d7f5af34 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/bc2fea88-de08-4cca-800e-c666208184e0/action" status: 404 len: 111 microversion: 2.1 time: 0.034589 Jul 25 20:32:12.484678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2273/4585] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:12 2022] POST /compute/v2.1/servers/bc2fea88-de08-4cca-800e-c666208184e0/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:32:12.490371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:12.491220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:12.502727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:12.503756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:12.505079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:12.505708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:12.877422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:12.892270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60bdb738-a205-408f-9377-e43b75180edc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.405903 Jul 25 20:32:12.913466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2274/4586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:12 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:12.922603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:12.923398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:12.931056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:12.931515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:12.932868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:12.933581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.007849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16711ea3-e889-417c-ad0d-fbda5434b4a7 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "POST /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45/action" status: 200 len: 32633 microversion: 2.1 time: 2.576622 Jul 25 20:32:13.009438 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2313/4587] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:10 2022] POST /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45/action => generated 32633 bytes in 2579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:32:13.025413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:13.027366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:13.037317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.038261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.039601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.039999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.079769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5013a4cd-d0d4-4e13-8f6d-d90fd9ff9439 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.162720 Jul 25 20:32:13.084494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2275/4588] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:12 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:32:13.100077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:13.100729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:13.109100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.110672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.112299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.114223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.878871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:13.887768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c25b99f0-0a5d-449b-b9e1-282ff4e54c3f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.869385 Jul 25 20:32:13.890969 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2314/4589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:13 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:13.922874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:13.922874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:13.938318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.938924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.939825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:13.942128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:13.982940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:13.993973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfc6c154-e95b-42ee-bce1-0119b86a07bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1519 microversion: 2.1 time: 0.904134 Jul 25 20:32:14.014897 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2276/4590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:13 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1519 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:14.030257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:14.031078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:14.037917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:14.039650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:14.041155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:14.043887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:14.819533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:14.836149 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a96468d0-4b98-4482-b645-259f1bc5acdb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.820220 Jul 25 20:32:14.859213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2277/4591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:14 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:14.876648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4caf629e-317b-42c0-806e-837ca0e964ab req-710289d1-c37c-4369-b827-c4d804434ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b88ac-b1ef-4a86-96a4-2309bdbe577f", "name": "network-vif-plugged", "status": "completed", "tag": "c45b138e-5ab8-4861-8924-3b6b90d32017"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:14.947980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4caf629e-317b-42c0-806e-837ca0e964ab req-710289d1-c37c-4369-b827-c4d804434ba5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:14.948787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4caf629e-317b-42c0-806e-837ca0e964ab req-710289d1-c37c-4369-b827-c4d804434ba5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.013015 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4caf629e-317b-42c0-806e-837ca0e964ab req-710289d1-c37c-4369-b827-c4d804434ba5 service nova] Creating event network-vif-plugged:c45b138e-5ab8-4861-8924-3b6b90d32017 for instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f on n-h1-845775-3 Jul 25 20:32:15.039050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:15.048781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:15.050363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:15.051689 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b79a0484-59a0-419a-a93d-e7ea89a5aa19 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2948 microversion: 2.32 time: 1.159056 Jul 25 20:32:15.053134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4caf629e-317b-42c0-806e-837ca0e964ab req-710289d1-c37c-4369-b827-c4d804434ba5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203551 Jul 25 20:32:15.053772 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2278/4592] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:15.089483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2315/4593] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:13 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2948 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:15.107508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:15.109662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:15.115754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:15.122788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:15.135095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.137068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.140505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.141967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.167397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.168319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.182956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.183590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.716000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:15.720834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:15.729786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-115a497e-b89d-4724-81e9-847baa431b84 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1324 microversion: 2.1 time: 0.668362 Jul 25 20:32:15.734032 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2279/4594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:15 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1324 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:15.745213 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d536036a-f769-4325-a702-f8b4548f7f55 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1499 microversion: 2.1 time: 0.654120 Jul 25 20:32:15.746105 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2316/4595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:15 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1499 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:15.789559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:15.789559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:15.808278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.808768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.809982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.811301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.867473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:15.868012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:15.875347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.875809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.876632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.877082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.890393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'flavor' on Instance uuid 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:32:15.925800 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Cannot 'rescue' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state paused Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action HTTP/1.1 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 14 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: {"rescue": {}} Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'rescue' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state paused Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2', 'body': {'rescue': {}}} Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 in vm_state paused. Cannot rescue while the instance is in this state. Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state paused Jul 25 20:32:15.939953 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state paused Jul 25 20:32:15.945495 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:15.947229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 409 to user: Cannot 'rescue' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state paused {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:15.950910 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b30f21a5-41ec-4c9a-97cd-174126f6824b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action" status: 409 len: 144 microversion: 2.1 time: 0.170187 Jul 25 20:32:15.954561 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2280/4596] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:15 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action => generated 144 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:32:15.965193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:15.972818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:15.990256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.992611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:15.996082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:15.996819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:16.103525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1bd15706-9414-4879-b1a3-8b1efd08e4bb tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.140405 Jul 25 20:32:16.112951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2281/4597] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:15 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:32:16.126504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:16.131525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:16.174506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:16.175481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:16.185852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:16.186834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:17.062584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:17.092970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-83de323a-7e42-463e-ae1f-44bf8abcf11e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.229898 Jul 25 20:32:17.095057 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2317/4598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:15 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:17.109060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:17.110352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:17.129458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:17.130239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:17.135168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:17.135879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:17.927834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:17.940416 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53312803-3938-498a-8b32-719eb441a3c3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1514 microversion: 2.1 time: 0.844027 Jul 25 20:32:17.945423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2318/4599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:17 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1514 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:17.952097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:17.995617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:18.005709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:18.010130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:18.010641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:18.026746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7056b08-2a9c-43ed-b8e1-f135ab185733 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2948 microversion: 2.32 time: 1.910321 Jul 25 20:32:18.037478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.037898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.038723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.039156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.045466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2282/4600] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:16 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2948 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:18.077448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-798f5954-f1bc-4ad8-894f-814ee8d19a0a req-052096e6-0a23-4afa-a640-cdb7506fee81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:18.113864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-798f5954-f1bc-4ad8-894f-814ee8d19a0a req-052096e6-0a23-4afa-a640-cdb7506fee81 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.115156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-798f5954-f1bc-4ad8-894f-814ee8d19a0a req-052096e6-0a23-4afa-a640-cdb7506fee81 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.153601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-798f5954-f1bc-4ad8-894f-814ee8d19a0a req-052096e6-0a23-4afa-a640-cdb7506fee81 service nova] Creating event network-changed:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:32:18.170013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-798f5954-f1bc-4ad8-894f-814ee8d19a0a req-052096e6-0a23-4afa-a640-cdb7506fee81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116922 Jul 25 20:32:18.172127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2283/4601] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:18.178725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:32:18.206576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:18.208222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:18.219300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.219749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.220764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.221366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.708357 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3148df5-c801-4ffb-b6d9-7ac2322a46b6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 204 len: 0 microversion: 2.1 time: 0.737747 Jul 25 20:32:18.726884 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2319/4602] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:32:17 2022] DELETE /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:32:18.760453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:18.761454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:18.819973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.830104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:18.834624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:18.835924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:19.349945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:19.360293 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3c05781-59db-420e-ad72-0d420bd5694d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.628448 Jul 25 20:32:19.382086 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2320/4603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:18 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:19.389925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:19.391308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:19.415231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:19.415854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:19.416806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:19.417629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:19.495833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:19.548320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6180705-671a-496f-b827-303801b95706 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1520 microversion: 2.1 time: 1.353775 Jul 25 20:32:19.549488 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2284/4604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:18 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1520 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:19.577345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:19.578854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:19.612995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:19.613459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:19.619821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:19.620632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:20.828277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:20.860401 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91011452-9711-43c1-b367-cc208e92d928 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1670 microversion: 2.1 time: 1.476946 Jul 25 20:32:20.863374 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2321/4605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:19 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1670 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:20.875102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-675376e4-8de7-4c2f-9b98-f056022020a1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-389527309", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-675376e4-8de7-4c2f-9b98-f056022020a1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 242 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-389527309", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-389527309', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1c0ecf12-b767-4c99-9169-e085ddb2ff8f'}]}}} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:20.895838 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:20.901389 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:20.909492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-675376e4-8de7-4c2f-9b98-f056022020a1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:20.911844 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-675376e4-8de7-4c2f-9b98-f056022020a1 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.047047 Jul 25 20:32:20.913119 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2322/4606] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:32:20 2022] POST /compute/v2.1/servers => generated 175 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:32:20.961277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:20.962193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:21.023746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:21.024756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:21.028559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:21.034643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:22.523195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:22.570432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:22.572917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:22.574539 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3af5c7c9-a9df-4500-a309-02c712e192ff tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2927 microversion: 2.32 time: 3.019535 Jul 25 20:32:22.577086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2285/4607] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:19 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2927 bytes in 3027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:22.588311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2fa25899-204a-40e9-bb63-94912641fccb req-086258cc-38dd-434c-a222-4da43ff8d213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-unplugged", "status": "completed", "tag": "9c18bae2-64e2-49ee-b81a-af5f56618bac"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:22.619679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2fa25899-204a-40e9-bb63-94912641fccb req-086258cc-38dd-434c-a222-4da43ff8d213 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:22.620465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2fa25899-204a-40e9-bb63-94912641fccb req-086258cc-38dd-434c-a222-4da43ff8d213 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:22.656793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2fa25899-204a-40e9-bb63-94912641fccb req-086258cc-38dd-434c-a222-4da43ff8d213 service nova] Creating event network-vif-unplugged:9c18bae2-64e2-49ee-b81a-af5f56618bac for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:22.675026 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2fa25899-204a-40e9-bb63-94912641fccb req-086258cc-38dd-434c-a222-4da43ff8d213 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094371 Jul 25 20:32:22.680665 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2286/4608] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:22.692880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:22.695244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: 3603dff9-4cd6-4234-88ac-4be8ff92b52f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:22.711953 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] HTTP exception thrown: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/3603dff9-4cd6-4234-88ac-4be8ff92b52f/metadata HTTP/1.1 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '3603dff9-4cd6-4234-88ac-4be8ff92b52f'} Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:22.721961 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 404 to user: Instance 3603dff9-4cd6-4234-88ac-4be8ff92b52f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:22.726304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0d645434-6ec9-44f5-879b-43f4483af205 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/3603dff9-4cd6-4234-88ac-4be8ff92b52f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.042084 Jul 25 20:32:22.735898 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2287/4609] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:32:22 2022] GET /compute/v2.1/servers/3603dff9-4cd6-4234-88ac-4be8ff92b52f/metadata => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:32:22.743131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:22.744051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:22.754367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:22.756821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:22.758346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:22.762837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.100545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:23.109867 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3d5f6df-d91e-4b31-b63b-6efb8aa68f9e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 2.195292 Jul 25 20:32:23.116704 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2323/4610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:23.132181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:23.141727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:23.173027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.173891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.181019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.188849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.251311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'flavor' on Instance uuid 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:32:23.411075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:23.413986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:23.447696 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5965e4d-6337-4f29-b35e-4312c6af6658 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1551 microversion: 2.1 time: 0.708415 Jul 25 20:32:23.466090 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2288/4611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:22 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1551 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:23.476550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bc3cc0e2-1a47-443a-a413-40fc3338e03f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action" status: 200 len: 32 microversion: 2.1 time: 0.357810 Jul 25 20:32:23.482352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2324/4612] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:23 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:32:23.489598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef9e635b-c5ff-4a49-bc5b-5f9d9483541a tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-484213744", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef9e635b-c5ff-4a49-bc5b-5f9d9483541a tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 498 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-484213744", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-484213744', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1c0ecf12-b767-4c99-9169-e085ddb2ff8f'}]}}} Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:32:23.513017 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:23.516203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ef9e635b-c5ff-4a49-bc5b-5f9d9483541a tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:23.518400 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ef9e635b-c5ff-4a49-bc5b-5f9d9483541a tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.047643 Jul 25 20:32:23.525538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:23.536512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:23.543709 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2289/4613] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:32:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:32:23.592639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.597098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.606176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.610192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:23.610497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.610993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:23.651829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.652331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.654802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:23.658276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:23.677823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:25.182867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:25.201035 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6d40682-ce37-45c2-9b57-8b9ef95eef8d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.713720 Jul 25 20:32:25.201944 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2325/4614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:23 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:25.214771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-548fcc83-195b-4e48-b8c5-f119c9b29ff7 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771373949", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:25.222881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:25.251470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-548fcc83-195b-4e48-b8c5-f119c9b29ff7 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 499 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-771373949", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-771373949', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1c0ecf12-b767-4c99-9169-e085ddb2ff8f'}]}}} Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:32:25.255008 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.258463 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.280994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:25.280994 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3e47dc1-d0d8-49ad-ab35-7d545b3b9fac tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2906 microversion: 2.32 time: 1.665532 Jul 25 20:32:25.280994 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2290/4615] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:23 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2906 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:25.292555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-548fcc83-195b-4e48-b8c5-f119c9b29ff7 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:25.292819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:25.292819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:25.296319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-548fcc83-195b-4e48-b8c5-f119c9b29ff7 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.090115 Jul 25 20:32:25.297646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2326/4616] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:32:25 2022] POST /compute/v2.1/servers => generated 689 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:32:25.309817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:25.310587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:25.311038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:25.311484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:25.322139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:25.324498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:25.359829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:25.360845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:25.362793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:25.365428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:25.661141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:25.674815 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a66f189c-7096-4c26-8a6c-1a7c7136c6ff tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1484 microversion: 2.1 time: 0.374067 Jul 25 20:32:25.675678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2327/4617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:25 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1484 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:25.701724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-unplugged", "status": "completed", "tag": "12743539-7c11-4da3-b872-3bfc3dbcd3e7"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-unplugged", "status": "completed", "tag": "8e7a009b-34d5-4fd8-924e-d2083fc61888"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-unplugged", "status": "completed", "tag": "643be01f-9e75-48bf-b958-18e11ebe41e3"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-unplugged", "status": "completed", "tag": "0b99c227-344a-4aff-bf0f-6138d40f1d19"}, {"server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "name": "network-vif-unplugged", "status": "completed", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:25.725558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:25.726208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:25.742676 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Creating event network-vif-unplugged:12743539-7c11-4da3-b872-3bfc3dbcd3e7 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:25.744311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Creating event network-vif-unplugged:8e7a009b-34d5-4fd8-924e-d2083fc61888 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:25.744311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Creating event network-vif-unplugged:643be01f-9e75-48bf-b958-18e11ebe41e3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:25.744311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Creating event network-vif-unplugged:0b99c227-344a-4aff-bf0f-6138d40f1d19 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:25.745250 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] Creating event network-vif-unplugged:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:32:25.755324 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a92df671-53af-4883-858f-4e691859f377 req-770940af-8d72-4fe5-ae0f-943ff42876f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.076473 Jul 25 20:32:25.756695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2328/4618] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:25.767911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9af9042-21b6-4fdf-956c-cd5baa5c71b2 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-154602562", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9af9042-21b6-4fdf-956c-cd5baa5c71b2 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 753 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-154602562", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-154602562', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1c0ecf12-b767-4c99-9169-e085ddb2ff8f'}]}}} Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:32:25.779064 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:32:25.782311 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:32:25.788138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:25.788138 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:25.790782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9af9042-21b6-4fdf-956c-cd5baa5c71b2 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:25.792095 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9af9042-21b6-4fdf-956c-cd5baa5c71b2 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.033943 Jul 25 20:32:25.803873 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2329/4619] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:32:25 2022] POST /compute/v2.1/servers => generated 1197 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 25 20:32:25.947477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-96247926-3b4b-494c-b6f9-281fef19630e req-72bc3ff2-d47f-4b0a-ac17-9b0573c9a63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff758e3d-99df-4622-a1d8-44c8bd87fb45", "name": "network-vif-deleted", "tag": "2104a9e7-180b-4f43-aa6c-544bd176cd0d"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:25.998776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-96247926-3b4b-494c-b6f9-281fef19630e req-72bc3ff2-d47f-4b0a-ac17-9b0573c9a63e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.000444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-96247926-3b4b-494c-b6f9-281fef19630e req-72bc3ff2-d47f-4b0a-ac17-9b0573c9a63e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.068558 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-96247926-3b4b-494c-b6f9-281fef19630e req-72bc3ff2-d47f-4b0a-ac17-9b0573c9a63e service nova] Creating event network-vif-deleted:2104a9e7-180b-4f43-aa6c-544bd176cd0d for instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 on n-h1-845775-3 Jul 25 20:32:26.091872 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-96247926-3b4b-494c-b6f9-281fef19630e req-72bc3ff2-d47f-4b0a-ac17-9b0573c9a63e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149445 Jul 25 20:32:26.094032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2330/4620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:26.122163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12a2fa53-5512-40c4-b34b-68d78fb786cf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891247181", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12a2fa53-5512-40c4-b34b-68d78fb786cf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 1265 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-891247181", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1c0ecf12-b767-4c99-9169-e085ddb2ff8f"}]}} Jul 25 20:32:26.130586 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-891247181', 'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1c0ecf12-b767-4c99-9169-e085ddb2ff8f'}]}}} Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.133571 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:32:26.134780 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:32:26.142295 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 25 20:32:26.142295 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.142295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12a2fa53-5512-40c4-b34b-68d78fb786cf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:26.142295 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12a2fa53-5512-40c4-b34b-68d78fb786cf tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020839 Jul 25 20:32:26.148064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2331/4621] 10.222.0.48 () {60 vars in 1148 bytes} [Mon Jul 25 20:32:26 2022] POST /compute/v2.1/servers => generated 2221 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 25 20:32:26.149012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:26.149727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: 5cebf800-5857-4978-88d8-6d75db1d0454] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:26.164723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] HTTP exception thrown: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/5cebf800-5857-4978-88d8-6d75db1d0454/metadata/test2 HTTP/1.1 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '5cebf800-5857-4978-88d8-6d75db1d0454', 'id': 'test2'} Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:26.166533 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 404 to user: Instance 5cebf800-5857-4978-88d8-6d75db1d0454 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8fbfdc8d-4c5a-4a57-aa28-ab7f990dbd16 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/5cebf800-5857-4978-88d8-6d75db1d0454/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023152 Jul 25 20:32:26.180480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2332/4622] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Jul 25 20:32:26 2022] GET /compute/v2.1/servers/5cebf800-5857-4978-88d8-6d75db1d0454/metadata/test2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:32:26.185277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:26.185929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:26.206617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.207275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.209836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.210424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.272368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:32:26.443389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a272b3e7-a5e4-49a8-a242-6b90933d9258 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 204 len: 0 microversion: 2.1 time: 0.256782 Jul 25 20:32:26.444714 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2333/4623] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:32:26 2022] DELETE /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:32:26.454654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:26.455369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:26.459707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:26.467779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e33c723d-5513-4a84-9d32-bc06d8a5be54 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.190762 Jul 25 20:32:26.468414 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2291/4624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:25 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:26.485776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.486250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.487046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.487491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.493319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:26.493954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:26.513060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.513444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:26.514241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:26.514684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.308202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:27.319975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d88272c9-d581-4c3c-97a2-922d53ef41c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.873824 Jul 25 20:32:27.326261 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2334/4625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:26 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:27.331336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:27.336631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:27.349729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.350539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.352808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.353495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.364603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:27.376172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:27.393917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:27.395215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bca64b54-596d-4051-bf56-1ebdbac286fe tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2861 microversion: 2.32 time: 0.925872 Jul 25 20:32:27.396314 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2292/4626] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:26 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2861 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:27.404943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:27.405657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:27.421437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.422260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.423294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.424179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.496008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.497687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.503905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lazy-loading 'fault' on Instance uuid ff758e3d-99df-4622-a1d8-44c8bd87fb45 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:32:27.852173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b756e7d53114329bb377fd0c6fbf2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284fb24804444beca38878cf47f64c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:27.867954 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a059de5-d66c-4192-8866-9817618ea4e6 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 200 len: 1339 microversion: 2.1 time: 0.467521 Jul 25 20:32:27.891838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2293/4627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:27 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 1339 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:27.919390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:27.920470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:27.930911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.931713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:27.932835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:27.934000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:28.377570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:28.401190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b04884da-e941-4321-bbef-81c824ed8314 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1526 microversion: 2.1 time: 1.061101 Jul 25 20:32:28.416741 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2335/4628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:27 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1526 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:28.493192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9fbce612-6fb9-4f0e-a3b4-732b9a24f580 req-e740625d-7a5c-4a93-aa97-3a135907c31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-deleted", "tag": "643be01f-9e75-48bf-b958-18e11ebe41e3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:28.506597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:28.538553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9fbce612-6fb9-4f0e-a3b4-732b9a24f580 req-e740625d-7a5c-4a93-aa97-3a135907c31e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:28.539016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9fbce612-6fb9-4f0e-a3b4-732b9a24f580 req-e740625d-7a5c-4a93-aa97-3a135907c31e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:28.548782 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-058bcc6f-60d6-480a-9eba-a09989c7e496 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 0.651105 Jul 25 20:32:28.566476 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2294/4629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:27 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:28.579176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:28.580192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:28.588837 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9fbce612-6fb9-4f0e-a3b4-732b9a24f580 req-e740625d-7a5c-4a93-aa97-3a135907c31e service nova] Creating event network-vif-deleted:643be01f-9e75-48bf-b958-18e11ebe41e3 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:28.592135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:28.592880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:28.594428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:28.595311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:28.604400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9fbce612-6fb9-4f0e-a3b4-732b9a24f580 req-e740625d-7a5c-4a93-aa97-3a135907c31e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136934 Jul 25 20:32:28.606102 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2336/4630] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:28.622248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:28.623356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:28.643390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:28.644282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:28.645803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:28.646133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.294874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:29.309014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:29.313761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:29.318910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72623917-3d5e-4c68-8194-92469e75adee tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2816 microversion: 2.32 time: 0.708616 Jul 25 20:32:29.320966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2337/4631] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:28 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2816 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:29.326689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:29.327734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] [instance: ff758e3d-99df-4622-a1d8-44c8bd87fb45] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:29.365599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.368228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.369645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.370936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.391560 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] HTTP exception thrown: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Request method failure captured: Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 HTTP/1.1 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3vx67DVfFex60d0uo1n9vNiHSfDG_vqNxbJrc0qDoHt1y1SKrVno2G79bRQg4FiCQHWgyBqyfXMgBb0hrrj6Mo2cQht0I6IL7NwThBb0MJwIBjxer0csdygeT6hiWZ8Y8j__1vMTobck5IwIiFggZ94Hm3u9Rb0BMhhQWrRVKy82wwk Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_284fb24804444beca38878cf47f64c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/284fb24804444beca38878cf47f64c92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/284fb24804444beca38878cf47f64c92"}]}] Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestNetworkBasicOps-525524083 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 284fb24804444beca38878cf47f64c92 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestNetworkBasicOps-525524083 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 2b756e7d53114329bb377fd0c6fbf2a1 Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestNetworkBasicOps-525524083-project Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'ff758e3d-99df-4622-a1d8-44c8bd87fb45'} Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:29.396169 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. Jul 25 20:32:29.402374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:29.406197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Returning 404 to user: Instance ff758e3d-99df-4622-a1d8-44c8bd87fb45 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:29.420792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d06081d7-25b8-4ebd-80ad-590fec3edc8c tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45" status: 404 len: 111 microversion: 2.1 time: 0.098408 Jul 25 20:32:29.438414 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2338/4632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:29 2022] GET /compute/v2.1/servers/ff758e3d-99df-4622-a1d8-44c8bd87fb45 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:32:29.472024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:29.473721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:29.481586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:29.487683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.489978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.491897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.493346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.495578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da30ebed-f42d-4ec3-8c0b-04dc91b9c623 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.922612 Jul 25 20:32:29.497978 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2295/4633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:28 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:29.602770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:29.604169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:29.616566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.625611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:29.629510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:29.634186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:30.735335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a085352a724d6e8d46d0edc93d0ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae9050eddcf454199cd0f226f3acf4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:30.827996 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e103e110-dc5b-4cc6-94a1-63ba2b090546 tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 200 len: 1526 microversion: 2.1 time: 1.376246 Jul 25 20:32:30.837343 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2339/4634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:29 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 1526 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:30.846464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cbc965e1-daf4-463f-9cf2-838221550f19 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] Calling method '.version_select at 0x7f196ebbaa60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:30.865565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:30.895537 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eac6440c-400e-4153-b0bd-dd4ea574ac5d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1528 microversion: 2.1 time: 1.296121 Jul 25 20:32:30.896517 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2296/4635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:29 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1528 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:30.926109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:30.926997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:30.940816 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cbc965e1-daf4-463f-9cf2-838221550f19 tempest-TestNetworkBasicOps-525524083 tempest-TestNetworkBasicOps-525524083-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1335325603" status: 202 len: 0 microversion: 2.1 time: 0.102246 Jul 25 20:32:30.941440 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2340/4636] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 20:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1335325603 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:32:30.941602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:30.942079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:30.943436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:30.948339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:30.964220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:30.967290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:30.981608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:30.984989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:30.990249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:30.990960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:31.847965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:31.859238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7745bff2-69cd-46a1-988e-ec247a218262 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.912567 Jul 25 20:32:31.865385 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2341/4637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:30 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:31.879898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0187917a-4093-47d6-858c-e67e61def8e1 req-00ddc6d7-6fa2-40ae-81b1-9fcdab1cb6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-deleted", "tag": "0b99c227-344a-4aff-bf0f-6138d40f1d19"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:31.925343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0187917a-4093-47d6-858c-e67e61def8e1 req-00ddc6d7-6fa2-40ae-81b1-9fcdab1cb6eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:31.930631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0187917a-4093-47d6-858c-e67e61def8e1 req-00ddc6d7-6fa2-40ae-81b1-9fcdab1cb6eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:31.950431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:31.983962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:31.991936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:31.997523 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0187917a-4093-47d6-858c-e67e61def8e1 req-00ddc6d7-6fa2-40ae-81b1-9fcdab1cb6eb service nova] Creating event network-vif-deleted:0b99c227-344a-4aff-bf0f-6138d40f1d19 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:32.000275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-27bf6dbc-a91b-4838-9b30-c609e237a2f1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2702 microversion: 2.32 time: 1.089801 Jul 25 20:32:32.005595 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2297/4638] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:30 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2702 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:32.029566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:32.036760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] [instance: f06b88ac-b1ef-4a86-96a4-2309bdbe577f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:32.051148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0187917a-4093-47d6-858c-e67e61def8e1 req-00ddc6d7-6fa2-40ae-81b1-9fcdab1cb6eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182465 Jul 25 20:32:32.055561 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2342/4639] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:32.068660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:32.070367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:32.080830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.084474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:32.088676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.089953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.090774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:32.091840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:32.102154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.103214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:32.157289 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] HTTP exception thrown: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Request method failure captured: Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f HTTP/1.1 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v24oOGPWMqMUuLMDEXJ-0Fr1fIckX08fpIzxTGwTmLslxHg55JfT2znP4t21QOLymSD3ocTLWAeCe84WjUg94RIWnyCXxjN1X5JXgop0aNqdbJP8Nlrulb0nO1qTOx9ldqS-Tcfab-Hacb0Sf8cg2E9IK0CZv_faO9a3pVSoVkfcBw Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bae9050eddcf454199cd0f226f3acf4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bae9050eddcf454199cd0f226f3acf4e"}]}] Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: bae9050eddcf454199cd0f226f3acf4e Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1819040040 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: d7a085352a724d6e8d46d0edc93d0ca1 Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1819040040-project Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f06b88ac-b1ef-4a86-96a4-2309bdbe577f'} Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:32.159284 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:32:32.168602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] Returning 404 to user: Instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:32.170575 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1f34db2-9eca-4653-b184-914381201c0f tempest-ServerMetadataNegativeTestJSON-1819040040 tempest-ServerMetadataNegativeTestJSON-1819040040-project] 10.222.0.48 "GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f" status: 404 len: 111 microversion: 2.1 time: 0.159230 Jul 25 20:32:32.176678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2298/4640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:32 2022] GET /compute/v2.1/servers/f06b88ac-b1ef-4a86-96a4-2309bdbe577f => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:32:32.713146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:32.771426 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13705d57-7a22-4033-94d1-c9811e2fb872 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1510 microversion: 2.1 time: 0.713806 Jul 25 20:32:32.802476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2343/4641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:32.889528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:32.890182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:32.902313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.902988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:32.903809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:32.904290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:33.054484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:33.055999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:33.060072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:33.067579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:33.068535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:33.070938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:33.071608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:33.485366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:33.502603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:33.505027 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1233d702-319b-405f-aea7-4e6620d0ab5c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.619741 Jul 25 20:32:33.516969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:33.518515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:33.519802 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07011174-c723-4959-ab67-23a674fa3be9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2498 microversion: 2.32 time: 0.472835 Jul 25 20:32:33.524781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2299/4642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:32 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:33.544594 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2344/4643] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:33 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2498 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:33.807847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:33.809409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:33.823236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:33.823930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:33.828182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:33.829645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:34.190931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b88ac-b1ef-4a86-96a4-2309bdbe577f", "name": "network-vif-deleted", "tag": "c45b138e-5ab8-4861-8924-3b6b90d32017"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-deleted", "tag": "8e7a009b-34d5-4fd8-924e-d2083fc61888"}, {"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-deleted", "tag": "9c18bae2-64e2-49ee-b81a-af5f56618bac"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:34.207166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:34.208565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:34.227550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Creating event network-vif-deleted:c45b138e-5ab8-4861-8924-3b6b90d32017 for instance f06b88ac-b1ef-4a86-96a4-2309bdbe577f on n-h1-845775-3 Jul 25 20:32:34.228566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Creating event network-vif-deleted:8e7a009b-34d5-4fd8-924e-d2083fc61888 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:34.229351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] Creating event network-vif-deleted:9c18bae2-64e2-49ee-b81a-af5f56618bac for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:34.239562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6351afef-b82d-4e5c-b414-ccde8f16ed61 req-6b6d788a-82a8-4ac0-8218-4f70deb43452 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052947 Jul 25 20:32:34.240911 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2345/4644] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:32:34.450674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:34.462586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-56df4d51-5348-41d8-a7c4-2ad2c2d60120 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1510 microversion: 2.1 time: 0.659459 Jul 25 20:32:34.463796 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2300/4645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:33 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1510 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:34.542286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:34.546518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:34.576096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:34.577490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:34.585863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:34.587619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:34.589436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:34.592501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:34.595318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:34.596138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:34.597142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:34.597747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:35.568672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:35.592577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-514fc4d0-03ef-4644-8ce9-c2becd03f79d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.059897 Jul 25 20:32:35.595614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2346/4646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:34 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:35.614094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:35.627657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-68ff2a86-0453-4de3-8724-86c366ccd205 req-5114d565-0227-46a5-ad3d-ba0f13e3a4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "name": "network-vif-unplugged", "status": "completed", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:35.669757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:35.672791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-68ff2a86-0453-4de3-8724-86c366ccd205 req-5114d565-0227-46a5-ad3d-ba0f13e3a4be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:35.674107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-68ff2a86-0453-4de3-8724-86c366ccd205 req-5114d565-0227-46a5-ad3d-ba0f13e3a4be service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:35.680380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:35.689133 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d9845da-8e23-40df-8915-d4c3e408bd13 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 2227 microversion: 2.32 time: 1.116165 Jul 25 20:32:35.694067 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2301/4647] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:34 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 2227 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:35.705437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-68ff2a86-0453-4de3-8724-86c366ccd205 req-5114d565-0227-46a5-ad3d-ba0f13e3a4be service nova] Creating event network-vif-unplugged:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h2-845775-3 Jul 25 20:32:35.715340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-68ff2a86-0453-4de3-8724-86c366ccd205 req-5114d565-0227-46a5-ad3d-ba0f13e3a4be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115628 Jul 25 20:32:35.716916 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2347/4648] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:35.725449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:35.726090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:35.736197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:35.736723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:35.737560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:35.738005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:36.061511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:36.082616 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-438be0a6-e06a-4218-b9eb-c4aa8dfa5fcb tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1510 microversion: 2.1 time: 0.382933 Jul 25 20:32:36.093142 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2302/4649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:35 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:36.414249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-cc2d8fa0-d852-49d6-bf26-fc322507393c req-f7d3a8f0-962c-4a1d-a11f-cbfd1a7a55c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe9f140-853f-42c4-8173-5081bd2a6374", "name": "network-vif-deleted", "tag": "12743539-7c11-4da3-b872-3bfc3dbcd3e7"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:36.435631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cc2d8fa0-d852-49d6-bf26-fc322507393c req-f7d3a8f0-962c-4a1d-a11f-cbfd1a7a55c4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:36.442196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-cc2d8fa0-d852-49d6-bf26-fc322507393c req-f7d3a8f0-962c-4a1d-a11f-cbfd1a7a55c4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:36.477751 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-cc2d8fa0-d852-49d6-bf26-fc322507393c req-f7d3a8f0-962c-4a1d-a11f-cbfd1a7a55c4 service nova] Creating event network-vif-deleted:12743539-7c11-4da3-b872-3bfc3dbcd3e7 for instance ffe9f140-853f-42c4-8173-5081bd2a6374 on n-h1-845775-3 Jul 25 20:32:36.497123 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-cc2d8fa0-d852-49d6-bf26-fc322507393c req-f7d3a8f0-962c-4a1d-a11f-cbfd1a7a55c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086922 Jul 25 20:32:36.498499 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2348/4650] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:32:36.633764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:36.635338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:36.657721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:36.658445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:36.659268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:36.659716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:36.729206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:36.730704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:36.751254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:36.757908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:36.758792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:36.759252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:37.048802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:37.068226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:37.079287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:37.080799 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b6d92f3-c809-4ebb-9e40-6e8515cbb6a7 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.357716 Jul 25 20:32:37.087607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2349/4651] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:36 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:37.111263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:37.112303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:37.130977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:37.134292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:37.135421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:37.138709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:37.755205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:37.771431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc55ce45-f137-47eb-b6a7-6aaa31b64f5a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.144406 Jul 25 20:32:37.781393 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2303/4652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:36 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:38.121934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:38.122844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:38.159002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:38.161300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:38.171589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:38.174144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:38.795725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:38.815743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:38.823656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:38.825616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:38.834825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:38.835360 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aff9a5a6-b447-4be1-9d70-828146c6a5a6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1510 microversion: 2.1 time: 1.723496 Jul 25 20:32:38.837074 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2350/4653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:37 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1510 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:38.839485 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b87f103-ee1f-4b1a-8fbf-596d61e99b89 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.724828 Jul 25 20:32:38.842603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2304/4654] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:38 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:32:38.857295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:38.857929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:38.883630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:38.884128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:38.892889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:38.893502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:39.857976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:39.858831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:39.876558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:39.879019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:39.885575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:39.886199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:40.128908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:40.143415 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a30896bf-00d1-40ef-abc5-ca50e7566e1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.305215 Jul 25 20:32:40.147362 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2351/4655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:38 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:40.154541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:40.155582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:40.165508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:40.169724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:40.194344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:40.201077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:40.558441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:40.578614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:40.584948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:40.586768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de34c34d-8d43-43c6-8404-163aee471791 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.437535 Jul 25 20:32:40.590761 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2352/4656] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:40 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:40.700329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:40.712846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad440b33-74c5-451c-85b4-5e9c6167b8bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1453 microversion: 2.1 time: 0.858674 Jul 25 20:32:40.713472 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2305/4657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:39 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1453 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:40.738513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:40.739152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:40.750525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:40.750990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:40.751796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:40.752277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.124712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:41.145768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-171a1442-2bc0-4349-b42d-d2e7bf78aef6 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1453 microversion: 2.1 time: 0.412209 Jul 25 20:32:41.148995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2353/4658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:40 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1453 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:41.168699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:41.169385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:41.189490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.192551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.193459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.193921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.221421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:41.222831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:41.232399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.232859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.237019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.237711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.303114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'flavor' on Instance uuid 2409431d-6e0a-4adc-b72e-4a2817b080a3 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:32:41.347521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'shelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state shelved_offloaded Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 14 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: {"shelve": {}} Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'shelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state shelved_offloaded Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'shelve': {}}} Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 25 20:32:41.349602 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state shelved_offloaded Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state shelved_offloaded Jul 25 20:32:41.354658 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:41.365107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'shelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state shelved_offloaded {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:41.366368 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8429a3b5-e4e1-4d04-904b-f8efda0ea31a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 155 microversion: 2.1 time: 0.149004 Jul 25 20:32:41.367744 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2354/4659] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:41 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 155 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 20:32:41.376377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:41.376989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:41.384920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.385382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.386177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.386620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.724216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-740ac40a-2144-41d3-b587-7522c332d5fc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.351358 Jul 25 20:32:41.725732 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2355/4660] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:41 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:32:41.731989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:41.733004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:41.742071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.742967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.744085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:41.744825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:41.991259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:41.999315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:42.033637 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-471c6340-e56a-4857-80df-894e8779dd45 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.866560 Jul 25 20:32:42.048390 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2306/4661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:41 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:42.048390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:42.048390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:42.072550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=72 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:42.075006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:42.076328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:42.077331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:42.078144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:42.636977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:42.654751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:42.656376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:42.660229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-26c3fea3-f14f-4240-814d-03cda7be96ec tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.933036 Jul 25 20:32:42.660960 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2356/4662] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:41 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:43.055430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:43.056165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:43.076073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:43.084015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:43.085163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:43.089270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:43.541450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:43.566632 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46e2fba8-de72-439b-bcbc-01e9387e947a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1461 microversion: 2.1 time: 1.528731 Jul 25 20:32:43.568072 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2307/4663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:42 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1461 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:43.687573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:43.688286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:43.708885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:43.709358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:43.710544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:43.711831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:45.021233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:45.023058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:45.035091 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2259880a-e4ef-4f40-802e-472292aa3444 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.982646 Jul 25 20:32:45.036813 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2357/4664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:43 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:45.040439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:45.042112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:45.042642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:45.043518 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d281e01-a070-42d3-82fb-d9c5f71b2e60 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 1.360409 Jul 25 20:32:45.043882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:45.047310 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2308/4665] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:43 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:45.053978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:45.055277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:45.057166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:45.058259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:46.059542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:46.063161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:46.063836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:46.070451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7bd50629-32ab-4c08-a0c9-a3986464f0f9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.032187 Jul 25 20:32:46.075363 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2358/4666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:45 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:46.083364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:46.085033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:46.087747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:46.088202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:46.088679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:46.097512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:46.124766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:46.133106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:46.134826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:46.135791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:46.392819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:46.412775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:46.418749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:46.420308 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1956bfa0-161b-4f0b-a5f8-b7a298cc3de9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.343569 Jul 25 20:32:46.424284 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2359/4667] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:46 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:46.771527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:46.797962 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8909635e-e227-49f5-b5d9-24f458574b81 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.740558 Jul 25 20:32:46.803083 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2309/4668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:46 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:47.103267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:47.104259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:47.114888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.130275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:47.130275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.130275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:47.469374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:47.475988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:47.515296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.517888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:47.519643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.523395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:47.818367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:47.854106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:47.861994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:47.864320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65dd49e1-cec0-4276-bca8-7cf6107ec689 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.414891 Jul 25 20:32:47.870407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2310/4669] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:47 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:47.887681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:47.895953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:47.926990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.931475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:47.932832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:47.938559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.025542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:48.034824 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eed646db-663d-4975-aa46-51c04061d87f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 0.935512 Jul 25 20:32:48.044262 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2360/4670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:47 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:48.762086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:48.773920 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77f7f844-7693-45b5-baf1-6360af512132 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1500 microversion: 2.1 time: 0.900084 Jul 25 20:32:48.792584 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2311/4671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:47 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1500 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:48.802600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33cff697-feba-464c-9b62-822ebb1d7d95"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:48.806508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:48.818074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.818535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.819330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.819777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.882784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Cannot 'attach_volume' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state rescued Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/os-volume_attachments HTTP/1.1 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 74 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: {"volumeAttachment": {"volumeId": "33cff697-feba-464c-9b62-822ebb1d7d95"}} Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'attach_volume' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state rescued Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2', 'body': {'volumeAttachment': {'volumeId': '33cff697-feba-464c-9b62-822ebb1d7d95'}}} Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 20:32:48.884443 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state rescued Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state rescued Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 409 to user: Cannot 'attach_volume' instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 while it is in vm_state rescued {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:32:48.889058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37ad9c12-336e-4b1c-a398-14eff7a5a87a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087487 Jul 25 20:32:48.897026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:48.897580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:48.906439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.906904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.907712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.908195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.913071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2361/4672] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:32:48 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/os-volume_attachments => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:32:48.924680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:48.925841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:48.946215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.946583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:48.947648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:48.948213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:49.054940 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d78a7d3f-bf49-46cd-9c28-e7f6d486989c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action" status: 202 len: 0 microversion: 2.1 time: 0.163017 Jul 25 20:32:49.059417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2312/4673] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:32:48 2022] POST /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:32:49.066683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:49.068562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:49.078045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:49.079199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:49.080604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:49.081700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:49.199138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:49.225593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:49.229111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:49.235107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6b8906d-ee69-46be-8a57-18d8c06c3f6e tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.320667 Jul 25 20:32:49.255695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2362/4674] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:48 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:49.269320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:49.270223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:49.285501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:49.289801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:49.290861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:49.291487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:50.089504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:50.124466 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4724a5f5-d2c2-40b9-9859-34985e1ae596 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1508 microversion: 2.1 time: 1.051587 Jul 25 20:32:50.144047 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2313/4675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:49 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1508 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:50.161765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0361f531-219a-4558-bd5d-97eb6e63fe40 req-36fc6a62-5325-41e3-903c-2642bbaac8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:50.181207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0361f531-219a-4558-bd5d-97eb6e63fe40 req-36fc6a62-5325-41e3-903c-2642bbaac8cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:50.182339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0361f531-219a-4558-bd5d-97eb6e63fe40 req-36fc6a62-5325-41e3-903c-2642bbaac8cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:50.218225 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0361f531-219a-4558-bd5d-97eb6e63fe40 req-36fc6a62-5325-41e3-903c-2642bbaac8cb service nova] Creating event network-changed:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h1-845775-3 Jul 25 20:32:50.243735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0361f531-219a-4558-bd5d-97eb6e63fe40 req-36fc6a62-5325-41e3-903c-2642bbaac8cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094587 Jul 25 20:32:50.244844 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2314/4676] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:50.269401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:50.270944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:50.283786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:50.284944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:50.286570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:50.287513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:50.575642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:50.600494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:50.601608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:50.603380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:50.604892 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65390a70-ac41-4936-be9c-262a91fdbd45 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.344033 Jul 25 20:32:50.613337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3435f37-7755-4bb4-8e22-b35f10a07704 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.355933 Jul 25 20:32:50.620884 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2315/4677] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:50 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:50.628928 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2363/4678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:49 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:51.165592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:51.167743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:51.225006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:51.232474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:51.234934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:51.240459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:51.634756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:51.636901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:51.646740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:51.647212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:51.648153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:51.648604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:52.416216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:52.425893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:52.427440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:52.441063 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-06752757-f501-47a8-a2d1-fa658127cf4b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.810074 Jul 25 20:32:52.456062 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2364/4679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:51 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:32:52.465924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:52.466557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:52.477359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:52.477818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:52.478710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:52.479193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:53.142439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:53.157828 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5b35be7d-7fcc-4492-b375-53cf8c870769 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1508 microversion: 2.1 time: 1.993300 Jul 25 20:32:53.163221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2316/4680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:51 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1508 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:53.473104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:53.476444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:53.512733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:53.522782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:53.523789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:53.525810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:54.166642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:54.184233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:54.193935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:54.205626 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1680c02e-80e7-4811-9a66-4481556699a8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.739448 Jul 25 20:32:54.207075 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2317/4681] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:53 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:32:54.218744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:54.220747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:54.246175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:54.255399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:54.256807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:54.257480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:54.555280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:54.597632 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c438eeac-9629-424b-bd72-e5c26752e5bd tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 2.145450 Jul 25 20:32:54.600229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2365/4682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:52 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:54.915493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:54.935454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5d57a23-e2ba-4424-a5b1-a84494840646 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1508 microversion: 2.1 time: 0.727043 Jul 25 20:32:54.936068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2318/4683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:54 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:55.243894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:55.245311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:55.311843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.316318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:55.318720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.323727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:55.621908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:55.623373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:55.646862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.665034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:55.666167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.666842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:55.753445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:55.756236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:32:55.790728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:55.798293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:55.807084 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-607a5ddf-9efb-4bf1-8834-19256df05b47 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.569177 Jul 25 20:32:55.834986 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2366/4684] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:55 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:55.964226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:55.965641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:55.980663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.981731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:55.982959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:55.983651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:56.938684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:56.947394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2344ffe-61de-4886-898a-7a0114c58cc4 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.329390 Jul 25 20:32:56.956916 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2319/4685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:55 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:32:57.446187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ef3a2be-30b0-42e2-8869-0644855d6f0c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Action: 'create', calling method: .version_select at 0x7f19687dd550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1879585683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNAEJDw5ypxkjufMelYufcPLg8I3x7KP+Q8HOPKXeIViL1HKG0hOvvk/hgZzZyV8AB74hYfF0giTvqalfoW4oaVY50zeztClqYBHCX6nACzekq4dugs+O1rYw6VkRkfDg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:32:57.514664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-8ef3a2be-30b0-42e2-8869-0644855d6f0c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for project 9443339e53024f45b1b33a900e3aff18. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:32:57.537783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-8ef3a2be-30b0-42e2-8869-0644855d6f0c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for user 04a0a5ec4bf54f7d86827862faa32386 and project 9443339e53024f45b1b33a900e3aff18. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:32:57.584232 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ef3a2be-30b0-42e2-8869-0644855d6f0c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.614743 Jul 25 20:32:57.591588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2320/4686] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:32:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:32:57.596890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:57.609693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:57.616624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:57.617378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:57.618349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:57.618963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:57.726874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:57.759101 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7bc2fff1-5427-4b0e-8b4e-436f014d4671 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1514 microversion: 2.1 time: 1.799303 Jul 25 20:32:57.764456 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2367/4687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:55 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1514 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:32:57.990488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:32:57.991364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:32:58.024884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:58.025554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:58.028023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:32:58.071877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:32:59.397856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:59.413054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:59.414735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:59.416053 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-877cc094-d509-4bea-87a0-c58176896819 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 1.823100 Jul 25 20:32:59.430636 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2321/4688] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:32:57 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:32:59.548486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:32:59.563096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f05eae37-7435-4ad5-bec1-df2bc7efa652 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.584211 Jul 25 20:32:59.563708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2368/4689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:32:57 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:00.448647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:00.453702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:00.471551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:00.472046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:00.475694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:00.476180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:00.589909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:00.590468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:00.606317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:00.606791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:00.613715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:00.618530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:01.231844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:01.280271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:01.282608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:01.284596 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5459bd6-241e-4e4d-9560-f7e0c3f2aec9 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.839998 Jul 25 20:33:01.299464 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2322/4690] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:00 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:01.951176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:01.965296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1d04bff-6e8b-4add-9c66-f030ca926047 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.379663 Jul 25 20:33:01.965908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2369/4691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:00 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:02.314962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:02.315588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:02.364515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:02.365085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:02.378313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:02.381570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:02.412444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bb3ac428-e168-49ea-b9e6-f754a68afbee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: .version_select at 0x7f196ea0e790>, body: {"keypair": {"name": "tempest-keypair-1304296872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNJ90dfBEVaHROKp0lyqsJxCLsr5onvBEKTfsTVjHO/irj7Dt3E8fIxx5du0NxQ0RVVQZuMMY4Rji75d8oCMpbS7Va/A0ZkhSHBovPodSxl8774a2nqPIex/GWKO7ugvQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:02.480743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bb3ac428-e168-49ea-b9e6-f754a68afbee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for project 290f0da5c9e5416da747a013170e2580. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:33:02.506728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bb3ac428-e168-49ea-b9e6-f754a68afbee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for user 6562bfb1c9db4ee9a53f4f1b987438d1 and project 290f0da5c9e5416da747a013170e2580. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:33:02.595017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:02.605050 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bb3ac428-e168-49ea-b9e6-f754a68afbee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194114 Jul 25 20:33:02.608447 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2370/4692] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:33:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:02.628068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:02.629697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:02.638021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d70cf115-c5a3-40ea-88e0-fe856bd970eb tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.321788 Jul 25 20:33:02.667220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2323/4693] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:02 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:02.994337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:02.996330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:03.029622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:03.037014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:03.041533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:03.044699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:03.671604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:03.672253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:03.694091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:03.694562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:03.695358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:03.696003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:03.706763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:05.085826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:05.101545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:05.125049 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-afe41491-910d-4a0d-b61d-8c022a3ad932 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 2.127514 Jul 25 20:33:05.138340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2371/4694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:02 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:05.162757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:05.171826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:05.178013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8ba985d-f63f-49d0-8757-e90df48d3f56 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 1.508942 Jul 25 20:33:05.207587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2324/4695] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:03 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:33:06.154705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:06.159178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:06.162478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:06.187799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:06.191430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:06.193434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:06.195730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:06.217322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:06.217945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:06.245584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:06.250801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:06.253662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:06.254312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:06.808442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:06.825897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:06.857030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:06.859029 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-648e8a3e-fd9d-4b4f-83d4-9603db661b8c tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.648501 Jul 25 20:33:06.881831 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2325/4696] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:06 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:07.326955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:07.335180 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7ac4c0a-76d7-4c7b-89f2-9164d4752150 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.185353 Jul 25 20:33:07.336537 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2372/4697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:06 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:07.903578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:07.904355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:07.910863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:07.936945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:07.937494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:07.938381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:07.938830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:08.366983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:08.368464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:08.409528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:08.410141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:08.410965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:08.411414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:08.907772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:08.960523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:08.962400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:08.973172 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d1398a1-f612-4a9b-83b3-d86c181eb237 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 1.065465 Jul 25 20:33:08.994852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2326/4698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:07 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:10.016494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:10.017178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:10.057024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:10.061361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:10.062664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:10.065141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:10.427051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:10.452557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:10.461065 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-037cc44a-26c3-4a67-b76b-b7cacff97d5a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 2.100028 Jul 25 20:33:10.488567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2373/4699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:08 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:10.499058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:10.500813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:10.505758 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c161c19-bf77-423c-857d-852d6b58106d tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.493215 Jul 25 20:33:10.515698 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2327/4700] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:10 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:11.496765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:11.497391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:11.530420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:11.538643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:11.539406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:11.543887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:11.549677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:11.550147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:11.579195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:11.584152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:11.587192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:11.587659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:12.214171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:12.229700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:12.232639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:12.239225 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3eb2ef34-1f6a-43b4-bcae-047c2ef77c25 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1873 microversion: 2.32 time: 0.704822 Jul 25 20:33:12.245479 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2328/4701] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:11 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1873 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:12.542659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:12.783979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:12.803910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b420eee-baa6-446b-9d6d-a3ca609084be tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.312485 Jul 25 20:33:12.805185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2374/4702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:11 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:13.298256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:13.301361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:13.352443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:13.355134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:13.355902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:13.410535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:13.411345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:13.603790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:13.604289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:13.604756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lazy-loading 'fault' on Instance uuid ffe9f140-853f-42c4-8173-5081bd2a6374 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:33:13.732539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:13.750077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:13.755855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e104948396b14054aa1c4b28015fa296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d5b9b740654b6d92134d8af8fe1d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:13.759597 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0997243-f159-4527-97e8-51b64623ade8 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 200 len: 1878 microversion: 2.32 time: 0.492201 Jul 25 20:33:13.760478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2329/4703] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:13 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 1878 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:33:13.829471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:13.830743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:13.845613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:13.848877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:13.850216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:13.854655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:14.785049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:14.786418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:14.799817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:14.802346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:14.804245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:14.807479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:14.852857 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] HTTP exception thrown: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Request method failure captured: Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 HTTP/1.1 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vw95GzmoMRN6ccfW2qEiugaCjXMzFRMZc-h9wBsQZ2os_y7lvq42_CU8Rjsdd03J32L0ElOh6IqKFJuUdtObONM1YtduXhJxWALNXjDNWJEYj5_huJHsSHfuIjRGErVThgVQtt5XZY0jWX5mm46LqMQfr1OBRTogwPcrO1ebnpkb6s Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "tempest-type-1147477295", "name": "tempest-service-1015313448", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}] Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: e104948396b14054aa1c4b28015fa296 Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ffe9f140-853f-42c4-8173-5081bd2a6374'} Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:14.854894 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:14.860503 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:14.866302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Returning 404 to user: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:14.867599 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f691dee2-74c5-41ce-ab7c-98645423200b tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 404 len: 111 microversion: 2.32 time: 0.087440 Jul 25 20:33:14.872992 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2330/4704] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:14 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:33:14.881604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d739596b-2a99-40bb-8607-2f70920deea5 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '.version_select at 0x7f1968812670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:14.924054 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d739596b-2a99-40bb-8607-2f70920deea5 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288219307" status: 204 len: 0 microversion: 2.32 time: 0.046048 Jul 25 20:33:14.925229 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2331/4705] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288219307 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 20:33:15.287675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:15.296431 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c9ee353-07f0-4be5-a9da-68665e196b96 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.471483 Jul 25 20:33:15.297048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2375/4706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:13 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:16.022770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d739596b-2a99-40bb-8607-2f70920deea5 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:16.023750 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d739596b-2a99-40bb-8607-2f70920deea5 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001344 Jul 25 20:33:16.032970 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2332/4707] 10.222.0.48 () {56 vars in 886 bytes} [Mon Jul 25 20:33:16 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 25 20:33:16.297007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1767983319", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b976a04f-1fdc-4b75-a0a9-9f0a5b78115e"}], "security_groups": [{"name": "tempest-securitygroup--2092532656"}], "key_name": "tempest-keypair-1304296872", "user_data": "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:16.322888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:16.324474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:16.346427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:16.346886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:16.360130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:16.362972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:16.851992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] validate_networks() for [('b976a04f-1fdc-4b75-a0a9-9f0a5b78115e', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:33:16.975795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:16.990695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12afbd3d-cc31-4ec8-920f-5f80cc3ef6f2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 0.674453 Jul 25 20:33:16.995932 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2333/4708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:16 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:18.016748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:18.017390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:18.041073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:18.060532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:18.060532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:18.060532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:19.102377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:19.125528 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b0a8ced-b18a-477a-b81d-84605f199c58 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.114641 Jul 25 20:33:19.130222 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2334/4709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:18 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:19.582951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:33:19.584301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:33:19.585031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:33:19.585680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:33:19.586330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:33:19.611564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:19.612222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:19.613371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:19.613935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:19.651654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:33:19.664372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Getting quotas for user 6562bfb1c9db4ee9a53f4f1b987438d1 and project 290f0da5c9e5416da747a013170e2580. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:33:19.704531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:33:19.707727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:33:19.857583 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-56dcfa72-de55-4936-8163-e61f4541ff59 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.567704 Jul 25 20:33:19.863795 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2376/4710] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:33:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:33:19.872647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e119c732-2e78-40e3-b41b-9ddd6bb4194d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:19.873284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e119c732-2e78-40e3-b41b-9ddd6bb4194d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:20.073216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e119c732-2e78-40e3-b41b-9ddd6bb4194d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:20.081268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e119c732-2e78-40e3-b41b-9ddd6bb4194d tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1246 microversion: 2.1 time: 0.215892 Jul 25 20:33:20.081855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2335/4711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:19 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1246 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:20.152459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:20.153089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:20.161188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:20.161644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:20.162433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:20.162873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:20.469695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:20.481500 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-466bb8f9-21bd-4c37-b9f1-f43c388fe1ae tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 0.333171 Jul 25 20:33:20.482104 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2377/4712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:21.102590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b55474f6-ea48-4203-9a5a-451235b42f62 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:21.104176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b55474f6-ea48-4203-9a5a-451235b42f62 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:21.271877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b55474f6-ea48-4203-9a5a-451235b42f62 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:21.279861 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b55474f6-ea48-4203-9a5a-451235b42f62 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1246 microversion: 2.1 time: 0.181449 Jul 25 20:33:21.281438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2336/4713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:21 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1246 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:21.502908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:21.503999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:21.519088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:21.519576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:21.520642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:21.521090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:21.912655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:21.932807 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b13059e-8432-4de7-8bac-7b8d0b224916 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 0.433373 Jul 25 20:33:21.933408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2378/4714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:21 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:22.306476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:22.307553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:22.324733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:22.325428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:22.326311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:22.326764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:22.564490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-bf6a0200-e3a8-4136-bb14-8f6ace2d82a6 req-f08ed93d-3147-47a2-9b11-cc61af4feb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "name": "network-vif-plugged", "status": "completed", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:22.575604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bf6a0200-e3a8-4136-bb14-8f6ace2d82a6 req-f08ed93d-3147-47a2-9b11-cc61af4feb56 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:22.576906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bf6a0200-e3a8-4136-bb14-8f6ace2d82a6 req-f08ed93d-3147-47a2-9b11-cc61af4feb56 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:22.590396 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-bf6a0200-e3a8-4136-bb14-8f6ace2d82a6 req-f08ed93d-3147-47a2-9b11-cc61af4feb56 service nova] Creating event network-vif-plugged:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h1-845775-3 Jul 25 20:33:22.598463 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-bf6a0200-e3a8-4136-bb14-8f6ace2d82a6 req-f08ed93d-3147-47a2-9b11-cc61af4feb56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287733 Jul 25 20:33:22.599916 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2379/4715] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:33:22.603211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:22.621680 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5a90919-b5f4-4edc-b467-8097010cebca tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1316 microversion: 2.1 time: 0.321806 Jul 25 20:33:22.636901 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2337/4716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:22 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:22.961707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:22.963296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:22.980483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:22.981409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:22.985900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:22.986734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:23.665749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:23.667085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:23.700869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:23.703497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:23.706195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:23.707519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:24.193243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:24.218655 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c71cb2a8-fc4d-4a88-a989-f6a43849999e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1304 microversion: 2.1 time: 0.572321 Jul 25 20:33:24.226256 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2338/4717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:23 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1304 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:24.250185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:24.285651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d1c34ff-7201-437c-bc0b-4531e4433e20 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 1.328104 Jul 25 20:33:24.286675 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2380/4718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:22 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:25.267802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:25.269894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:25.294229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:25.294721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:25.298477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:25.298952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:25.322226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:25.325882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:25.350099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:25.351839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:25.356754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:25.357271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:25.846064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:25.886327 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-612de0eb-f51b-4bee-96cf-117b21df5cc7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1304 microversion: 2.1 time: 0.623297 Jul 25 20:33:25.934968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2339/4719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:25 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1304 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:26.076297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:26.079649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=76 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:26.097043 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33bdf19c-2573-41a9-9b60-05d54523e748 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 0.787894 Jul 25 20:33:26.106747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2381/4720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:25 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:26.956475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:26.958946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:27.012181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:27.021362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:27.024257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:27.026032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:27.129471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:27.132360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:27.156561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:27.163699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:27.165241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:27.172651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:28.175520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:28.189145 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-43ee6ac8-3092-4b0d-b6ab-1d60217b5819 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 1.240311 Jul 25 20:33:28.207728 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2340/4721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:26 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:29.216161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:29.223382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:29.232906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:29.262283 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-697924a5-cf0c-43f3-b91a-1979e1572384 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1519 microversion: 2.1 time: 2.131117 Jul 25 20:33:29.264113 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2382/4722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:27 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1519 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:29.267919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:29.267919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:29.279017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:29.281953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:30.294403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:30.295589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:30.317091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:30.318954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:30.324158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:30.352980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:30.363435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:30.367345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:30.926946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:30.942975 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7858a0c-2047-4701-90a4-e6461d333a28 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 1.731335 Jul 25 20:33:30.957057 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2341/4723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:29 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:31.460337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:31.473358 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1330277a-4005-4283-9317-39eac5940814 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.185363 Jul 25 20:33:31.474541 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2383/4724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:30 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:31.508096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:31.532928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:31.535432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:31.572751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:31.574634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:31.578350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:31.579913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:31.995403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:32.001665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:32.025238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:32.025746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:32.027990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:32.030963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:32.776872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:32.791117 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18e97667-d51a-41f5-bdb2-682fc4cdccd9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.285860 Jul 25 20:33:32.799350 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2342/4725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:31 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:32.849326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:32.850061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:32.875946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:32.885806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:32.896840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:32.898446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:33.334019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:33.360642 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ddc3bf6-b6e3-49ec-a033-1e49e95efca9 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.506108 Jul 25 20:33:33.362060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2343/4726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:32 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:33.444695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:33.474521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-629a613d-0d24-4b0a-9a98-04f6a2f44cee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 1.482038 Jul 25 20:33:33.484725 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2384/4727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:31 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:33.499241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36c0b3cd-8b44-4a1e-8c1d-a616b3e14827 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:33.520175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-36c0b3cd-8b44-4a1e-8c1d-a616b3e14827 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36c0b3cd-8b44-4a1e-8c1d-a616b3e14827 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/c9866bb6-26cb-46ea-8406-90844901af92/action HTTP/1.1 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: {"os-stop": {}} Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c9866bb6-26cb-46ea-8406-90844901af92', 'body': {'os-stop': {}}} Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:33.537791 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. Jul 25 20:33:33.546496 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:33.551586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36c0b3cd-8b44-4a1e-8c1d-a616b3e14827 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance c9866bb6-26cb-46ea-8406-90844901af92 has no mapping to a cell. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:33.553479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36c0b3cd-8b44-4a1e-8c1d-a616b3e14827 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/c9866bb6-26cb-46ea-8406-90844901af92/action" status: 404 len: 117 microversion: 2.1 time: 0.067017 Jul 25 20:33:33.554431 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2385/4728] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:33 2022] POST /compute/v2.1/servers/c9866bb6-26cb-46ea-8406-90844901af92/action => generated 117 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:33:33.556131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-71a44692-001d-4586-831d-7097d296057c req-72ac0068-ca3a-4fbc-980c-16b42c0cb286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:33.570008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:33.583964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:33.591651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-71a44692-001d-4586-831d-7097d296057c req-72ac0068-ca3a-4fbc-980c-16b42c0cb286 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:33.600100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-71a44692-001d-4586-831d-7097d296057c req-72ac0068-ca3a-4fbc-980c-16b42c0cb286 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:33.623002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:33.626198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:33.629423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:33.631969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:33.646336 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-71a44692-001d-4586-831d-7097d296057c req-72ac0068-ca3a-4fbc-980c-16b42c0cb286 service nova] Creating event network-changed:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:33:33.666723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-71a44692-001d-4586-831d-7097d296057c req-72ac0068-ca3a-4fbc-980c-16b42c0cb286 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299743 Jul 25 20:33:33.669167 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2344/4729] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:34.226688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:34.244771 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-661b4986-3073-4b09-a350-9835c9bddd79 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.683606 Jul 25 20:33:34.252100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2386/4730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:33 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:34.278594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:34.281338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:34.298977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.300342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.302450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.303487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.318315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:34.513112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:34.519208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:34.532446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.534224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.537700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.538631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.634233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:34.647306 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-939d128f-18e0-4735-8b00-171a30f7c491 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.376850 Jul 25 20:33:34.665355 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2345/4731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:34 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:34.692459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:34.693438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 094fd36e-14f8-411d-b817-70e77fdd5c50] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:34.710345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/094fd36e-14f8-411d-b817-70e77fdd5c50/action HTTP/1.1 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 15 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: {"suspend": {}} Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '094fd36e-14f8-411d-b817-70e77fdd5c50', 'body': {'suspend': {}}} Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:34.712582 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:34.718636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:34.718636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:34.718636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. Jul 25 20:33:34.718636 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:34.720501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 094fd36e-14f8-411d-b817-70e77fdd5c50 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:34.721586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6805412-13d4-4389-a9ea-d13480fd8dd7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/094fd36e-14f8-411d-b817-70e77fdd5c50/action" status: 404 len: 111 microversion: 2.1 time: 0.038869 Jul 25 20:33:34.728794 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2346/4732] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:34 2022] POST /compute/v2.1/servers/094fd36e-14f8-411d-b817-70e77fdd5c50/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:33:34.735249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:34.736239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:34.747365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.750375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.753234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:34.756195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:34.923715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:34.949448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0c19d1ba-e96f-48d1-bca5-d66e53005bef tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 0.440576 Jul 25 20:33:34.952744 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2387/4733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:34 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:35.165290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:35.192285 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c191580f-879d-40e3-8396-79be41c0e1c8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.461787 Jul 25 20:33:35.195261 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2347/4734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:34 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:35.221752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:35.222776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:35.254434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:35.255880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:35.258092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:35.258958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:35.703630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:35.714110 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8d7bee8-ffcc-43c9-b6ce-2d52e4ac0406 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.496688 Jul 25 20:33:35.719365 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2388/4735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:35 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:35.745079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:35.746471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:35.762955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:35.764882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:35.766046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:35.766733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:35.786591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-270132949-access_point-1434599477", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "0e55a8ec-aa7d-4642-86ec-e8f4ca8cde07"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1879585683", "security_groups": [{"name": "tempest-secgroup_access--576264025"}, {"name": "tempest-secgroup_general--1626969243"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:35.850377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'flavor' on Instance uuid 2409431d-6e0a-4adc-b72e-4a2817b080a3 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:33:36.008689 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f25eb419-2fef-4ef3-b871-5f1698eefc75 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.268519 Jul 25 20:33:36.014759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2348/4736] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:35 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:33:36.029323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:36.030284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:36.048129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:36.048604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:36.053421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:36.054272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:36.372414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] validate_networks() for [('0e55a8ec-aa7d-4642-86ec-e8f4ca8cde07', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:33:36.505758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:36.516374 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4826e207-130a-49a8-9e86-c35d94b34321 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 0.500142 Jul 25 20:33:36.524856 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2349/4737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:36 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:36.530680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:36.531291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:36.547981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:36.548468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:36.555648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:36.556227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:37.083290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:37.109556 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5935857d-6921-41d2-af91-f54e3e75cfb5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1514 microversion: 2.1 time: 0.582057 Jul 25 20:33:37.111284 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2350/4738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:36 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1514 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:37.299082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:37.548423 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:37.549372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:37.561095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:37.566321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:37.567824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:37.572823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.023974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:33:38.024739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:33:38.028426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:33:38.028859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:33:38.029291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:33:38.056154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.056893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.058375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.058864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.123037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for project 9443339e53024f45b1b33a900e3aff18. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:33:38.149091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for user 04a0a5ec4bf54f7d86827862faa32386 and project 9443339e53024f45b1b33a900e3aff18. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:33:38.186640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:33:38.188778 n-d-845775-3 devstack@n-api.service[119724]: WARNING nova.utils [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-270132949-access_point-1434599477 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-270132949-acc Jul 25 20:33:38.189531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:33:38.204055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:38.224726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c31869d9-4c13-437c-9070-b7587e9c50ee tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 0.678468 Jul 25 20:33:38.226867 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2351/4739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:37 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:38.252966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:38.254858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:38.274956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.277392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.281762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.282680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.311588 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8443b54-d625-4bab-84c6-ca20ea969e11 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.528854 Jul 25 20:33:38.312913 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2389/4740] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:33:35 2022] POST /compute/v2.1/servers => generated 457 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:33:38.343837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84add7fa-bbc3-4485-ad02-21b740b199d6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:38.347885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-84add7fa-bbc3-4485-ad02-21b740b199d6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:38.578048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84add7fa-bbc3-4485-ad02-21b740b199d6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:38.590977 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84add7fa-bbc3-4485-ad02-21b740b199d6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1294 microversion: 2.1 time: 0.266565 Jul 25 20:33:38.593497 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2390/4741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:38 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1294 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:38.662597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:38.676052 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f67d4780-0bbe-43dc-8e09-f2b6a9bcd88e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1497 microversion: 2.1 time: 0.446876 Jul 25 20:33:38.688558 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2352/4742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:38 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1497 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:38.715814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:38.717996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:38.738024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.738495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.739391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.739848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.793252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'flavor' on Instance uuid 2409431d-6e0a-4adc-b72e-4a2817b080a3 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:33:38.830074 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'suspend' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state suspended Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 15 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: {"suspend": {}} Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'suspend' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state suspended Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'suspend': {}}} Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 25 20:33:38.842454 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state suspended Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state suspended Jul 25 20:33:38.847788 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:38.849915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'suspend' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state suspended {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:38.851005 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2025fe34-d6b7-478b-830f-c5a9fbcb97b8 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 148 microversion: 2.1 time: 0.144786 Jul 25 20:33:38.856402 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2391/4743] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:38 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 148 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:33:38.861613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:38.862185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:38.893766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.897871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:38.904441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:38.906676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:39.099011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-32365a57-480c-4022-a5aa-d417fd9acae3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 202 len: 0 microversion: 2.1 time: 0.241243 Jul 25 20:33:39.100418 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2353/4744] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:38 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:33:39.113694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:39.114333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:39.130410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:39.130920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:39.131746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:39.132257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:39.252948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:39.255069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:39.273154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:39.273714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:39.274983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:39.275529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:40.712412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:40.722184 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd76e502-1770-4071-b5a8-6baa438d268c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1503 microversion: 2.1 time: 1.612678 Jul 25 20:33:40.740636 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2392/4745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:39 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1503 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:40.765481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:40.767153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:40.795622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:40.796110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:40.797152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:40.797796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:40.918731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:40.951946 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cf4720f-a797-4448-adef-8be37f8f804b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 1.700578 Jul 25 20:33:40.953243 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2354/4746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:39 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:40.981479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:40.984341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:41.006976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.009127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.013149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.016202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.063760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] HTTP exception thrown: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Request method failure captured: Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 HTTP/1.1 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vw95GzmoMRN6ccfW2qEiugaCjXMzFRMZc-h9wBsQZ2os_y7lvq42_CU8Rjsdd03J32L0ElOh6IqKFJuUdtObONM1YtduXhJxWALNXjDNWJEYj5_huJHsSHfuIjRGErVThgVQtt5XZY0jWX5mm46LqMQfr1OBRTogwPcrO1ebnpkb6s Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "tempest-type-1147477295", "name": "tempest-service-1015313448", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}] Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: e104948396b14054aa1c4b28015fa296 Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ffe9f140-853f-42c4-8173-5081bd2a6374'} Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:33:41.067880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.072821 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.080151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Returning 404 to user: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:41.086222 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82ec100f-bcb6-4bf7-9e90-02d847831a4a tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 404 len: 111 microversion: 2.32 time: 0.130737 Jul 25 20:33:41.090033 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2355/4747] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:33:40 2022] DELETE /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:33:41.109760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:41.111368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] [instance: ffe9f140-853f-42c4-8173-5081bd2a6374] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:41.137565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.138280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.139808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.141449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.181363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] HTTP exception thrown: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Request method failure captured: Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 HTTP/1.1 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3vw95GzmoMRN6ccfW2qEiugaCjXMzFRMZc-h9wBsQZ2os_y7lvq42_CU8Rjsdd03J32L0ElOh6IqKFJuUdtObONM1YtduXhJxWALNXjDNWJEYj5_huJHsSHfuIjRGErVThgVQtt5XZY0jWX5mm46LqMQfr1OBRTogwPcrO1ebnpkb6s Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.32 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "tempest-type-1147477295", "name": "tempest-service-1015313448", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67d5b9b740654b6d92134d8af8fe1d77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67d5b9b740654b6d92134d8af8fe1d77"}]}] Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 67d5b9b740654b6d92134d8af8fe1d77 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TaggedBootDevicesTest-995605701 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: e104948396b14054aa1c4b28015fa296 Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TaggedBootDevicesTest-995605701-project Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ffe9f140-853f-42c4-8173-5081bd2a6374'} Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.184912 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] Returning 404 to user: Instance ffe9f140-853f-42c4-8173-5081bd2a6374 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:41.189670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-844563c3-43bf-40da-b375-e3e352ba9bb1 tempest-TaggedBootDevicesTest-995605701 tempest-TaggedBootDevicesTest-995605701-project] 10.222.0.48 "GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374" status: 404 len: 111 microversion: 2.32 time: 0.091133 Jul 25 20:33:41.193620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2356/4748] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:33:41 2022] GET /compute/v2.1/servers/ffe9f140-853f-42c4-8173-5081bd2a6374 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:33:41.300941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:41.314310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e06d21e-8f01-4aa5-afc6-12c78d4d1e57 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1352 microversion: 2.1 time: 0.569806 Jul 25 20:33:41.329523 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2393/4749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:40 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1352 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:41.748319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:41.749469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:41.761993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.766245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.770095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:41.771737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:41.975540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:41.976349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:42.010252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:42.010745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:42.013500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:42.020577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:43.239103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:43.248515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf8f0be3-38e0-4306-b851-0ba3bd281b9f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1503 microversion: 2.1 time: 1.504892 Jul 25 20:33:43.252462 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2357/4750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:41 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1503 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:43.257472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:43.258094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:43.281104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:43.281593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:43.282833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:43.283282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:43.440784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:43.471119 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09f29a70-e109-4327-ad8f-6a97ff65da93 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 1.499820 Jul 25 20:33:43.472838 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2394/4751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:41 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:43.499365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:43.517482 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b05a85fa-4b29-427c-ba3e-016129913a51 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1352 microversion: 2.1 time: 0.263857 Jul 25 20:33:43.518099 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2358/4752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:43 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1352 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:43.533044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9ef44093-4088-4719-bbb2-57743e3810ef req-efc78ff5-dd8a-4cfa-9f8f-2f7146971226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "name": "network-vif-plugged", "status": "completed", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:43.553627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:43.558795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9ef44093-4088-4719-bbb2-57743e3810ef req-efc78ff5-dd8a-4cfa-9f8f-2f7146971226 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:43.560575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9ef44093-4088-4719-bbb2-57743e3810ef req-efc78ff5-dd8a-4cfa-9f8f-2f7146971226 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:43.597890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9ef44093-4088-4719-bbb2-57743e3810ef req-efc78ff5-dd8a-4cfa-9f8f-2f7146971226 service nova] Creating event network-vif-plugged:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:33:43.612597 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9ef44093-4088-4719-bbb2-57743e3810ef req-efc78ff5-dd8a-4cfa-9f8f-2f7146971226 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090999 Jul 25 20:33:43.616104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2359/4753] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:43.835159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b55e7502-a63b-4647-8aa5-3311e2f069f6 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] Calling method '.version_select at 0x7f196c08c280>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:43.972204 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b55e7502-a63b-4647-8aa5-3311e2f069f6 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.494849 Jul 25 20:33:43.976188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2395/4754] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:33:43 2022] GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6/defaults => generated 371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:43.985559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a04b4188-a607-4ccc-9604-cb8ae2eade64 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] Calling method '.version_select at 0x7f1968ab8c10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:44.122814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a04b4188-a607-4ccc-9604-cb8ae2eade64 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6" status: 200 len: 371 microversion: 2.1 time: 0.141745 Jul 25 20:33:44.128652 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2360/4755] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:33:43 2022] GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:44.152617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e68dc0b5-813e-4918-8f2e-d788ce60f745 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] Calling method '.version_select at 0x7f196839b670>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:44.295338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:44.296852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:44.331875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:44.333133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:44.335728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:44.340862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:44.347877 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e68dc0b5-813e-4918-8f2e-d788ce60f745 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214599 Jul 25 20:33:44.348532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2396/4756] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:33:44 2022] GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6/defaults => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:44.367162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f5ec0f8-5e1b-4333-94ed-f229b5c9d9a5 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] Calling method '.version_select at 0x7f196839b4c0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:44.570012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f5ec0f8-5e1b-4333-94ed-f229b5c9d9a5 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6" status: 200 len: 371 microversion: 2.1 time: 0.211525 Jul 25 20:33:44.572339 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2397/4757] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:33:44 2022] GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6 => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:44.600361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:44.601316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:44.625889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:44.626426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:44.627163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:44.627615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:45.369025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:45.377760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eee04ee3-9368-4a48-af2b-50540b30024a tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1503 microversion: 2.1 time: 1.096660 Jul 25 20:33:45.383635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2361/4758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:44 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1503 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:45.389485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:45.395277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:45.411623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:45.412421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:45.414499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:45.415923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:45.488181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:45.501989 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a6d8368-2cd2-4d96-9db0-f9b19a875913 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1372 microversion: 2.1 time: 0.928358 Jul 25 20:33:45.512434 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2398/4759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:44 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1372 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:45.522796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-993ee4dc-eba0-42ed-aa0e-1642c8424b67 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] Calling method '.version_select at 0x7f19695c5700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:45.891616 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-993ee4dc-eba0-42ed-aa0e-1642c8424b67 tempest-QuotasTestJSON-1221558256 tempest-QuotasTestJSON-1221558256-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6?user_id=93c523cd9dc64dfebe7ac631420bd5e8" status: 200 len: 371 microversion: 2.1 time: 0.377541 Jul 25 20:33:45.919148 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2399/4760] 10.222.0.48 () {58 vars in 1323 bytes} [Mon Jul 25 20:33:45 2022] GET /compute/v2.1/os-quota-sets/a3b84fac362147c3801f7763f97869b6?user_id=93c523cd9dc64dfebe7ac631420bd5e8 => generated 371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:46.029971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:46.043167 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-122027c0-1065-4018-aeb4-728fdcfa852e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 0.657967 Jul 25 20:33:46.048283 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2362/4761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:45 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:46.402539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:46.403179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:46.436473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:46.437569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:46.446566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:46.447202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:46.534472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:46.535250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:46.551323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:46.551796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:46.552634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:46.553083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:46.570059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:47.269481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:47.277518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:47.286020 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d7c2715-634c-4129-8b74-d63a06c831f3 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1564 microversion: 2.1 time: 0.756282 Jul 25 20:33:47.293858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1a69117d-6411-4a6c-adbd-ee9179c07851 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.890464 Jul 25 20:33:47.300058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2363/4762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:46 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1564 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:47.313703 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2400/4763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:46 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:47.316604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:47.317670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:47.336783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.340755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:47.342646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.344115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:47.350723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:47.352754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:47.398985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.412378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:47.415355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.415909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:47.848473 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d953e70-c05e-4e7f-9971-a0b06f352600 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.523919 Jul 25 20:33:47.849672 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2401/4764] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:33:47 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-interface => generated 284 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:47.854791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:47.855416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:47.867707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.869451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:47.869451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:47.869451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:48.098752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:48.921182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:48.934283 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6aaa4a89-070b-4548-b855-d6482651d3ec tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 1.632697 Jul 25 20:33:48.936160 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2364/4765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:47 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:48.936957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:48.962368 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8edb622d-3a32-455b-be62-2b7b4e989e4f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.111338 Jul 25 20:33:49.001045 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2402/4766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:47 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:49.010266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:49.014634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 53b458ce-17b8-4c96-90a4-e3df9a1ebd28] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:49.061057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/53b458ce-17b8-4c96-90a4-e3df9a1ebd28/action HTTP/1.1 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 15 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: {"unpause": {}} Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '53b458ce-17b8-4c96-90a4-e3df9a1ebd28', 'body': {'unpause': {}}} Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:49.075390 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:49.089892 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:49.089892 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:49.089892 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. Jul 25 20:33:49.089892 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:49.095591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 53b458ce-17b8-4c96-90a4-e3df9a1ebd28 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:49.099225 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d198ae52-f3cc-4304-b783-d6a240b6cdc5 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/53b458ce-17b8-4c96-90a4-e3df9a1ebd28/action" status: 404 len: 111 microversion: 2.1 time: 0.106632 Jul 25 20:33:49.100653 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2365/4767] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:48 2022] POST /compute/v2.1/servers/53b458ce-17b8-4c96-90a4-e3df9a1ebd28/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:33:49.115578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:49.121946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:49.175295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:49.190563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:49.204444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:49.208385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:49.971183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:49.972976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:50.004546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:50.008362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:50.009749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:50.012515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:51.934224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:51.946668 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b125ca9-a409-497a-9163-7fe7f20a0a68 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 2.837931 Jul 25 20:33:51.947384 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2403/4768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:49 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 2840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:51.982291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-74a68394-b3c6-4923-a1ff-5fbb3bda8178 req-329aecb9-0189-4958-81a1-68f8197fcf7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d307024d-da2f-4ac2-aafb-c2e5d34f2d61", "tag": "72f2ba67-3251-409d-beee-64e48211dcb5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:51.998044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-74a68394-b3c6-4923-a1ff-5fbb3bda8178 req-329aecb9-0189-4958-81a1-68f8197fcf7f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:52.003751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-74a68394-b3c6-4923-a1ff-5fbb3bda8178 req-329aecb9-0189-4958-81a1-68f8197fcf7f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:52.036412 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-74a68394-b3c6-4923-a1ff-5fbb3bda8178 req-329aecb9-0189-4958-81a1-68f8197fcf7f service nova] Creating event network-changed:72f2ba67-3251-409d-beee-64e48211dcb5 for instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 on n-h2-845775-3 Jul 25 20:33:52.055667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-74a68394-b3c6-4923-a1ff-5fbb3bda8178 req-329aecb9-0189-4958-81a1-68f8197fcf7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086915 Jul 25 20:33:52.056812 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2404/4769] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:52.093300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-fe30544e-56d4-4c35-a02a-5d0689e88f66 req-9e3d5868-4425-481f-a526-0cd16ee47503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:52.146851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fe30544e-56d4-4c35-a02a-5d0689e88f66 req-9e3d5868-4425-481f-a526-0cd16ee47503 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:52.183307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fe30544e-56d4-4c35-a02a-5d0689e88f66 req-9e3d5868-4425-481f-a526-0cd16ee47503 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:52.268239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-fe30544e-56d4-4c35-a02a-5d0689e88f66 req-9e3d5868-4425-481f-a526-0cd16ee47503 service nova] Creating event network-changed:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:33:52.295144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-fe30544e-56d4-4c35-a02a-5d0689e88f66 req-9e3d5868-4425-481f-a526-0cd16ee47503 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236565 Jul 25 20:33:52.301818 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2405/4770] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:52.329201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:52.330122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:52.337138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:52.337876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:52.338916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:52.339537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:53.609211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:53.629545 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f5d29d5-5fdd-4d53-9015-10db344c6dcd tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 3.655202 Jul 25 20:33:53.645370 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2366/4771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:49 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 3679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:53.934198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:53.943798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:53.947624 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30269b4a-242e-4694-b31a-7a5ebe92b43e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.644114 Jul 25 20:33:53.949075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2406/4772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:52 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:53.974503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:53.975066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:53.992561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:53.994352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:53.996603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:53.997722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:54.089677 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'unpause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 15 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: {"unpause": {}} Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'unpause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'unpause': {}}} Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state active. Cannot unpause while the instance is in this state. Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:54.091276 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:54.096325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'unpause' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:54.100557 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9c27ca5-8b0a-4c1e-b6b6-11bad429022e tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 145 microversion: 2.1 time: 0.130529 Jul 25 20:33:54.108808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2367/4773] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:53 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 145 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:33:54.110764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:54.111620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:54.129845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:54.134531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:54.137116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:54.140469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:54.651906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:54.652552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:54.655210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:54.667157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:54.672850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:54.673995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:54.674852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:55.347446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:55.357414 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed9a6e4e-c049-4bc6-91d1-7ca62011798f tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.251159 Jul 25 20:33:55.362403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2407/4774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:54 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:33:55.387874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:55.389648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:55.410439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:55.410941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:55.411753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:55.419549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:55.843051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:33:56.158707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:56.168239 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-149bfd0e-bbd1-4fa6-8b63-57db04beb7e0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 1.520373 Jul 25 20:33:56.172656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2368/4775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:54 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:56.468372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc12029a-75a4-4083-a0e2-b959383a143e tempest-ComputeTenantNetworksTest-1837603862 tempest-ComputeTenantNetworksTest-1837603862-project] Calling method '.version_select at 0x7f1968ac9430>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:56.903188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:56.921446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7e8dcf93-0fc0-45e7-9911-ab91285a15e7 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.537983 Jul 25 20:33:56.922303 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2408/4776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:55 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:56.949567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:56.950427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 98ded0e4-dba7-44bf-ad14-38441b510959] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:56.961959 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/98ded0e4-dba7-44bf-ad14-38441b510959/action HTTP/1.1 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 18 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: {"unshelve": null} Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '98ded0e4-dba7-44bf-ad14-38441b510959', 'body': {'unshelve': None}} Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:56.963906 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. Jul 25 20:33:56.970237 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:33:56.976839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 98ded0e4-dba7-44bf-ad14-38441b510959 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:56.981107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c87b1f5-e8cc-4d87-812c-a41f6ec87f8b tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/98ded0e4-dba7-44bf-ad14-38441b510959/action" status: 404 len: 111 microversion: 2.1 time: 0.036449 Jul 25 20:33:56.982352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2409/4777] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:56 2022] POST /compute/v2.1/servers/98ded0e4-dba7-44bf-ad14-38441b510959/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:33:56.990615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:56.991544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:57.002559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:57.004331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:57.005433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:57.006097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:57.834698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc12029a-75a4-4083-a0e2-b959383a143e tempest-ComputeTenantNetworksTest-1837603862 tempest-ComputeTenantNetworksTest-1837603862-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.659191 Jul 25 20:33:57.836626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2369/4778] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:33:56 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:57.842063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:57.843253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:57.879776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:57.883014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:57.885641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:57.891238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:58.294056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:58.304729 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-137cdb4a-be02-411f-8cf8-011e2b603297 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 1.318337 Jul 25 20:33:58.310435 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2410/4779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:56 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:58.325478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34683c6d-d95c-472c-b55c-f50a16cd09cd tempest-ComputeTenantNetworksTest-1837603862 tempest-ComputeTenantNetworksTest-1837603862-project] Calling method '.version_select at 0x7f196839b430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:59.330708 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34683c6d-d95c-472c-b55c-f50a16cd09cd tempest-ComputeTenantNetworksTest-1837603862 tempest-ComputeTenantNetworksTest-1837603862-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks/8146c518-5c12-426b-925e-97faaa48ff4b" status: 200 len: 139 microversion: 2.1 time: 1.018886 Jul 25 20:33:59.333012 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2411/4780] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:33:58 2022] GET /compute/v2.1/os-tenant-networks/8146c518-5c12-426b-925e-97faaa48ff4b => generated 139 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:33:59.339653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:59.340818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:59.359212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.362250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:59.370596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.372058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:59.498439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:59.514935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-247d4c26-6d6a-4021-b362-dcff65467f1e tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 1.677001 Jul 25 20:33:59.520679 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2370/4781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:57 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:59.738416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:33:59.754386 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fb4ddfe-af9e-43a4-8b2d-b38380711369 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.419988 Jul 25 20:33:59.760816 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2412/4782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:59 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:33:59.785384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:33:59.786007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:59.797330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.797815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:59.801479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.804710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:59.933082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Cannot 'unshelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action HTTP/1.1 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 18 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: {"unshelve": null} Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'unshelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'unshelve': None}} Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 in vm_state active. Cannot unshelve while the instance is in this state. Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:33:59.936257 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 409 to user: Cannot 'unshelve' instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 while it is in vm_state active {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dddada2f-5908-400f-a81d-5964c265526c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action" status: 409 len: 146 microversion: 2.1 time: 0.157060 Jul 25 20:33:59.945371 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2371/4783] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:33:59 2022] POST /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3/action => generated 146 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:33:59.955102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:33:59.955744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:33:59.990608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.991169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:33:59.992029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:33:59.992502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:00.546208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:00.554007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:00.554812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:00.580880 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5697c3b6-7ed4-4d0a-a7b2-011b72005c7c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.636061 Jul 25 20:34:00.589999 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2413/4784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:33:59 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:00.614319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:00.616594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:00.617629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:00.618531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:00.619261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:00.630785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:00.657324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:00.660266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:00.661326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:00.661879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:01.269523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:01.279739 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-85eb7201-4851-48d6-9f70-d2889008b0aa tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.672553 Jul 25 20:34:01.283927 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2414/4785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:00 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:01.297170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:01.305676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f428ef4-7aa0-410e-93a9-a5d284e8914b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 0.766862 Jul 25 20:34:01.313570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-319747515_updated"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:01.316834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 3cc3ce4c-0439-404b-8251-d84a823cb134] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:01.321830 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2372/4786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:00 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:34:01.329806 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/servers/3cc3ce4c-0439-404b-8251-d84a823cb134 HTTP/1.1 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 80 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-319747515_updated"}} Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '3cc3ce4c-0439-404b-8251-d84a823cb134', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-319747515_updated'}}} Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 25 20:34:01.334894 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. Jul 25 20:34:01.340125 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:01.344664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 3cc3ce4c-0439-404b-8251-d84a823cb134 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:01.347247 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f097e5b7-f5a8-4854-84c0-1d8f53ed81dc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "PUT /compute/v2.1/servers/3cc3ce4c-0439-404b-8251-d84a823cb134" status: 404 len: 111 microversion: 2.1 time: 0.038040 Jul 25 20:34:01.352542 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2415/4787] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:34:01 2022] PUT /compute/v2.1/servers/3cc3ce4c-0439-404b-8251-d84a823cb134 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:34:01.358230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:01.359078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:01.374965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:01.375595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:01.377598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:01.378698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:01.971691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:01.991562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a65c48de-05f8-4e49-8aeb-27ef03bfc5bc tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.637604 Jul 25 20:34:01.999420 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2373/4788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:01 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:02.032687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:02.038944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:02.069941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.070672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:02.074310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.075425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:02.346806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:02.347963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:02.364681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.365235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:02.373201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.376245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:02.538561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:02.546321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b1ae084a-24b3-4511-980c-31928d058cfe tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.523276 Jul 25 20:34:02.551819 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2416/4789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:02 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:02.580133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-220a76eb-e1a0-4194-9aa3-73aafa9ccae1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-220a76eb-e1a0-4194-9aa3-73aafa9ccae1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: request: PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 HTTP/1.1 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 280 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.585909 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 25 20:34:02.591612 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:02.595675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-220a76eb-e1a0-4194-9aa3-73aafa9ccae1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:02.597962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-220a76eb-e1a0-4194-9aa3-73aafa9ccae1 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 400 len: 619 microversion: 2.1 time: 0.026713 Jul 25 20:34:02.600927 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2417/4790] 10.222.0.48 () {60 vars in 1257 bytes} [Mon Jul 25 20:34:02 2022] PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:34:02.623364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:02.625945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:02.647938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.649005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:02.650024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:02.652471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:03.220308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:03.241174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:03.243443 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-418d1050-8612-41fd-9662-60e339290169 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.624166 Jul 25 20:34:03.246972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2418/4791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:02 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:03.251411 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34c67602-cb19-4fdf-9054-260f52163d15 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 0.909539 Jul 25 20:34:03.269730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2374/4792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:02 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:34:03.289157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:03.290248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:03.306030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:03.306349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:03.307135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:03.308251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:03.679228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2bacc2d9-c4ab-49d2-8131-87eeeb6f6e82 req-7418e000-39e0-4cd9-b740-022d6efeffe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d307024d-da2f-4ac2-aafb-c2e5d34f2d61", "name": "network-vif-plugged", "status": "completed", "tag": "72f2ba67-3251-409d-beee-64e48211dcb5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:03.699232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2bacc2d9-c4ab-49d2-8131-87eeeb6f6e82 req-7418e000-39e0-4cd9-b740-022d6efeffe6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:03.699694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2bacc2d9-c4ab-49d2-8131-87eeeb6f6e82 req-7418e000-39e0-4cd9-b740-022d6efeffe6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:03.712225 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2bacc2d9-c4ab-49d2-8131-87eeeb6f6e82 req-7418e000-39e0-4cd9-b740-022d6efeffe6 service nova] Creating event network-vif-plugged:72f2ba67-3251-409d-beee-64e48211dcb5 for instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 on n-h2-845775-3 Jul 25 20:34:03.722726 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2bacc2d9-c4ab-49d2-8131-87eeeb6f6e82 req-7418e000-39e0-4cd9-b740-022d6efeffe6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046886 Jul 25 20:34:03.723943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2375/4793] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:34:03.736596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:03.747715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ed5a163-6c2a-4852-bf8a-3e312b0648b0 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.465695 Jul 25 20:34:03.764995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2419/4794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:03 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:03.790849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1206f17-6889-4832-85e2-a866b603195c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1206f17-6889-4832-85e2-a866b603195c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: request: PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 HTTP/1.1 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 24 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: {"server": {"name": ""}} Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3', 'body': {'server': {'name': ''}}} Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '' Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:34:03.806571 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1206f17-6889-4832-85e2-a866b603195c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1206f17-6889-4832-85e2-a866b603195c tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 400 len: 108 microversion: 2.1 time: 0.025077 Jul 25 20:34:03.811949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2376/4795] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:34:03 2022] PUT /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:34:03.820223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:03.821516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:03.837225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:03.839586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:03.840618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:03.842432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:04.280399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:04.281133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:04.296374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:04.296841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:04.297624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:04.298069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:04.326906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:04.341637 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cfadd1b9-acfa-46a4-a954-5a03e79626ec tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1506 microversion: 2.1 time: 0.523372 Jul 25 20:34:04.345357 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2420/4796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:03 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:04.899452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:04.918654 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bee2f0e6-90c9-4e6d-a649-b1e9c6dc7536 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1471 microversion: 2.1 time: 0.642772 Jul 25 20:34:04.919268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2377/4797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:04 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1471 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:34:05.952413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:05.953710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:05.969533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:05.971803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:05.973459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:05.974498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:06.683764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:06.703084 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e17212c-76e1-41b2-8b7c-0f0832c77fd0 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1641 microversion: 2.1 time: 0.755644 Jul 25 20:34:06.718934 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2421/4798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:05 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1641 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:06.761067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:06.761692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:06.787599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:06.789086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:06.797303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:06.801842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:08.491752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:08.544345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a4a8100-dedc-4dcd-ad62-cf0e44474235 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1641 microversion: 2.1 time: 1.782634 Jul 25 20:34:08.550020 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2378/4799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:06 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1641 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:08.588746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:08.591088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:08.601823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:08.606149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:08.607214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:08.608903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:08.609925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:09.866605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb12331c-632e-4be6-800d-1308dd7e5ce5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1792 microversion: 2.1 time: 1.284249 Jul 25 20:34:09.871743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2422/4800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:08 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1792 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:15.596470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:15.601102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:15.646449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=38 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:15.653332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.668390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.669981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.672772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.737275 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea HTTP/1.1 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '44d174e7-6f13-45f9-b69d-5c4e571c6dea'} Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:34:15.752260 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:15.758410 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ee4fdcaa-f017-494d-9423-ebde68d9aced tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 404 len: 111 microversion: 2.1 time: 0.168436 Jul 25 20:34:15.768316 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2379/4801] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:34:15 2022] DELETE /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:34:15.779619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:15.780397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 44d174e7-6f13-45f9-b69d-5c4e571c6dea] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:15.791446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.792305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.793455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.794122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.849495 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea HTTP/1.1 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '44d174e7-6f13-45f9-b69d-5c4e571c6dea'} Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:15.854834 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. Jul 25 20:34:15.861447 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:15.866706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 44d174e7-6f13-45f9-b69d-5c4e571c6dea could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:15.868486 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ebfbfe7-235c-49e2-b7f9-02d4e35ae4c3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea" status: 404 len: 111 microversion: 2.1 time: 0.094531 Jul 25 20:34:15.871428 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2423/4802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:15 2022] GET /compute/v2.1/servers/44d174e7-6f13-45f9-b69d-5c4e571c6dea => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:34:15.884558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:15.888370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:15.915518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.916261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.917442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:15.918097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:15.989375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:34:16.254933 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-14f276c1-b963-4c2b-bdd6-25c2633d18e3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 204 len: 0 microversion: 2.1 time: 0.377632 Jul 25 20:34:16.256991 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2380/4803] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:34:15 2022] DELETE /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:34:16.269663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:16.270688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:16.284420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:16.286347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:16.289063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:16.290853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:16.894965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:16.930827 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b74e8cee-ea86-4ee4-b62f-1a4518a1446d tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 0.667319 Jul 25 20:34:16.933898 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2424/4804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:16 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:17.817669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-eb485073-2bc7-43c3-bd36-14fcb880d25f req-a1bcb9d0-9b35-43d2-a45e-511a0eaa97ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d307024d-da2f-4ac2-aafb-c2e5d34f2d61", "tag": "72f2ba67-3251-409d-beee-64e48211dcb5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:17.840497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eb485073-2bc7-43c3-bd36-14fcb880d25f req-a1bcb9d0-9b35-43d2-a45e-511a0eaa97ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:17.846487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eb485073-2bc7-43c3-bd36-14fcb880d25f req-a1bcb9d0-9b35-43d2-a45e-511a0eaa97ad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:17.877800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:17.880774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-eb485073-2bc7-43c3-bd36-14fcb880d25f req-a1bcb9d0-9b35-43d2-a45e-511a0eaa97ad service nova] Creating event network-changed:72f2ba67-3251-409d-beee-64e48211dcb5 for instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 on n-h2-845775-3 Jul 25 20:34:17.898405 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-eb485073-2bc7-43c3-bd36-14fcb880d25f req-a1bcb9d0-9b35-43d2-a45e-511a0eaa97ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417026 Jul 25 20:34:17.902003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2381/4805] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:34:17.965053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:17.967007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:17.980736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:17.983866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:17.987303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:17.987977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:19.769123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:19.785304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-84499a51-4815-4bc9-a705-74093978bec3 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.823855 Jul 25 20:34:19.800291 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2425/4806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:17 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:20.841848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:20.845263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:20.864438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:20.870790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:20.875772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:20.877103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:22.071763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:22.106768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58fb2b97-df14-43b3-a4e4-b2a4909fe548 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1512 microversion: 2.1 time: 1.283862 Jul 25 20:34:22.108135 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2382/4807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:20 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1512 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:34:22.550300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8e651a6e-01ab-41e4-8345-c7dafda01449 req-826b15a4-9880-4a93-9b6b-a2a74c728fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409431d-6e0a-4adc-b72e-4a2817b080a3", "name": "network-vif-deleted", "tag": "8c208610-f68f-46a0-abc4-467d86c4f87b"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:22.583745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8e651a6e-01ab-41e4-8345-c7dafda01449 req-826b15a4-9880-4a93-9b6b-a2a74c728fb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:22.596767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8e651a6e-01ab-41e4-8345-c7dafda01449 req-826b15a4-9880-4a93-9b6b-a2a74c728fb2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:22.661316 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8e651a6e-01ab-41e4-8345-c7dafda01449 req-826b15a4-9880-4a93-9b6b-a2a74c728fb2 service nova] Creating event network-vif-deleted:8c208610-f68f-46a0-abc4-467d86c4f87b for instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 on n-h1-845775-3 Jul 25 20:34:22.673366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8e651a6e-01ab-41e4-8345-c7dafda01449 req-826b15a4-9880-4a93-9b6b-a2a74c728fb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127526 Jul 25 20:34:22.677692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2426/4808] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:34:23.131195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:23.132733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:23.146219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:23.149657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:23.151930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:23.153075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:23.279805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:23.280632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:23.281611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lazy-loading 'fault' on Instance uuid 2409431d-6e0a-4adc-b72e-4a2817b080a3 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:34:23.431655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d5be665c18142a8917312b500d0c805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c606f8cc3c416da99df27c473131e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:23.455566 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0107581-f276-4db7-8c39-f1ff61cc81b2 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 200 len: 1307 microversion: 2.1 time: 0.324021 Jul 25 20:34:23.456956 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2383/4809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:23 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:24.490289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:24.492255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] [instance: 2409431d-6e0a-4adc-b72e-4a2817b080a3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:24.509962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:24.510549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:24.511342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:24.523302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:24.564342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=90 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:24.565674 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] HTTP exception thrown: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Request method failure captured: Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 HTTP/1.1 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v0TT1-kUg0lkxObn6lfKCBd-W3fN5-ZbYZLTYMdhQxOjoTUgdepb-vdMT159XmVMzfKEYmt9oETAOkSlNU8p0Nk2rWghYlkJzHZihgon6D_asYS3UdawYMzFBv_284x7Xau-pj3azaiAjWlw2rD_4yAwgnhtKtv3YBiTSvy1drgO0E Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c606f8cc3c416da99df27c473131e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c606f8cc3c416da99df27c473131e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c606f8cc3c416da99df27c473131e4"}]}] Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 23c606f8cc3c416da99df27c473131e4 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1992108318 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5d5be665c18142a8917312b500d0c805 Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1992108318-project Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2409431d-6e0a-4adc-b72e-4a2817b080a3'} Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:34:24.567559 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] Returning 404 to user: Instance 2409431d-6e0a-4adc-b72e-4a2817b080a3 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54317e88-b522-4ba1-aae9-ec208b658219 tempest-ServersNegativeTestJSON-1992108318 tempest-ServersNegativeTestJSON-1992108318-project] 10.222.0.48 "GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3" status: 404 len: 111 microversion: 2.1 time: 0.086951 Jul 25 20:34:24.579194 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2427/4810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:24 2022] GET /compute/v2.1/servers/2409431d-6e0a-4adc-b72e-4a2817b080a3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:34:25.836937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a217c3d5-37d3-44a6-8951-358530c58e01"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:25.850214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:25.865390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:25.865906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:25.866810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:25.867371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:26.481914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e85ab8db-7f91-487f-a826-efeab39ebb1a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646401 Jul 25 20:34:26.485050 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2384/4811] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:34:25 2022] POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:34:50.101375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:34:50.103740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:50.107514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=11 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:50.118091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:50.118546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:50.121245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:50.122031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:50.216888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'flavor' on Instance uuid 9212921a-ba59-4504-9f8f-e7dd447a5b2f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:34:50.646437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a29e9ca5-19c6-4240-b7d1-bf705b26e6f0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/action" status: 200 len: 32 microversion: 2.1 time: 0.547696 Jul 25 20:34:50.653321 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2428/4812] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:34:50 2022] POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:34:50.659038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:50.660838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:50.665005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:50.673527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:34:50.699517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:50.706638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:50.707935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:50.708916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:51.630107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:51.669215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-daf61610-4763-4522-8e73-aa53d1ccac2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.014624 Jul 25 20:34:51.671759 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2385/4813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:50 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:34:52.697853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:52.698563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:52.720010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:52.720502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:52.721306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:52.727125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:55.876155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:55.886477 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51ff7218-4dc2-4ce5-b353-010836764385 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 3.194582 Jul 25 20:34:55.892480 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2429/4814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:52 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 3202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:34:56.915235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:34:56.916479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:34:56.950025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:56.950687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:56.951881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:34:56.952536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:34:59.574751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:34:59.588281 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5255f102-25a2-41fb-a1ef-6191850aac57 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 2.676292 Jul 25 20:34:59.588965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2386/4815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:34:56 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:00.610614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:00.613930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:00.629519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:00.630167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:00.636005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:00.636664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:00.914992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-841120458", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3144570d-d2e0-454b-aab9-60ce2be3cdf0"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:01.098064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] validate_networks() for [('3144570d-d2e0-454b-aab9-60ce2be3cdf0', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:35:01.867540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:01.879848 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ab15b7e1-b275-42f4-a6ae-d38bbf09f64f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.273156 Jul 25 20:35:01.888530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2387/4816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:00 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:01.915770 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:35:01.916478 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 20:35:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:35:02.840641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:35:02.841195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:35:02.841793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:35:02.842326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:35:02.842858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:35:02.873907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:02.874657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:02.876839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:02.880427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:02.907503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:02.908157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:02.933756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:02.934318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:02.935035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:02.935543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:02.967578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Getting quotas for project 35ac9159fa2f466b85363a93900f6c05. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:35:02.996556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Getting quotas for user b50608c829ae42468feb019b4a56769a and project 35ac9159fa2f466b85363a93900f6c05. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:35:03.031992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Going to run 3 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:35:03.039535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:03.097524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=00bb3a2c-03b0-4089-808b-446c9ed46c99,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:03.200942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:03.378364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:03.390676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac5cb560-8d88-4ad9-bb7a-210c7a2e3c44 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 0.487629 Jul 25 20:35:03.391963 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2388/4817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:02 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:03.465190 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fba34ec8-07ac-450e-95d5-622c13fdbbd4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.862849 Jul 25 20:35:03.476728 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2430/4818] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:35:03.480282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:03.493093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:03.497147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:03.574369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:03.579376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:03.583420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:03.584759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:03.702608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1eb97669-add6-4779-964b-939b1ea28484 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: .version_select at 0x7f1968c688b0>, body: {"keypair": {"name": "tempest-keypair-881787018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISUzpF4FkQlX8CNZbbZetSNOIvq9Fm15MZo8ai7eyTjVo/qlfYZ2BSnXmDi0JAh0S9TaevCh3FBL29/lMR579CB14x/61xEr0xM/Jdwd5HHQRdQythIvM17ThN1fi6Gpw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:03.724500 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-29236449-36c6-40dd-a8f7-4fe0ea2b526f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.250193 Jul 25 20:35:03.726542 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2389/4819] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:35:03 2022] GET /compute/v2.1/servers => generated 1015 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:03.742098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15ace62c-7683-4915-9783-de623cb354ac tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:03.743040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15ace62c-7683-4915-9783-de623cb354ac tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:03.751664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1eb97669-add6-4779-964b-939b1ea28484 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:35:03.770863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1eb97669-add6-4779-964b-939b1ea28484 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for user 5a9fe47530b24272b5cf96e66ec11ae1 and project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:35:03.844493 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1eb97669-add6-4779-964b-939b1ea28484 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.274131 Jul 25 20:35:03.846102 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2431/4820] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:35:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:03.899797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-15ace62c-7683-4915-9783-de623cb354ac tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:03.911280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15ace62c-7683-4915-9783-de623cb354ac tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1222 microversion: 2.1 time: 0.171552 Jul 25 20:35:03.924119 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2390/4821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:03 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:04.417628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:04.418493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:04.433131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:04.438797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:04.440437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:04.443096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:04.936415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18a838b0-72d5-4acc-b266-d3bb1e0df298 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:04.937058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18a838b0-72d5-4acc-b266-d3bb1e0df298 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:04.970340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:04.987321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-204555cd-48bd-4418-ada3-4bf49e27e0c9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 0.574018 Jul 25 20:35:04.989985 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2432/4822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:04 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:05.147892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18a838b0-72d5-4acc-b266-d3bb1e0df298 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:05.186015 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18a838b0-72d5-4acc-b266-d3bb1e0df298 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1222 microversion: 2.1 time: 0.252442 Jul 25 20:35:05.186702 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2391/4823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:04 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:06.018191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:06.019006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:06.057151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:06.059448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:06.062599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:06.063062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:06.211241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:06.213759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:06.235142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:06.235865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:06.239588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:06.244120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:06.467274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:06.476163 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2673dff8-b815-4c5e-83e7-c22ff2d33ad4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1226 microversion: 2.1 time: 0.269000 Jul 25 20:35:06.481838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2392/4824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:06 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1226 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:06.811566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:06.841788 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b15ddb3f-b182-46e8-8802-2b38520c9fa0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 0.827113 Jul 25 20:35:06.859776 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2433/4825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:06 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:07.504021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:07.504704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:07.523992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:07.531191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:07.532065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:07.537428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:07.866613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:07.868142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:07.893446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:07.894334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:07.896610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:07.898723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:08.924291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:08.937558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08d2bc41-f646-4d96-9037-863fa8dbbbc3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1274 microversion: 2.1 time: 1.436368 Jul 25 20:35:08.938723 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2393/4826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:07 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1274 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:09.671053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:09.690858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a8abb54b-dea2-45c5-ab7f-53dac27d8942 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.829857 Jul 25 20:35:09.708453 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2434/4827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:07 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:09.970630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:09.977450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:09.999785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:10.000672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:10.002384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:10.004962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:10.315428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:10.325936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8b8f740-73d0-4558-b785-95694e850a56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1280 microversion: 2.1 time: 0.366586 Jul 25 20:35:10.332806 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2394/4828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:09 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1280 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:10.717428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:10.723483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:10.737931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:10.738872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:10.739925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:10.743208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:11.359501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:11.362250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:11.376606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:11.379436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:11.380564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:11.383831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:12.187378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:12.197698 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3dae2f81-bbad-4ce0-b492-4d0d4225ccda tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 0.842048 Jul 25 20:35:12.210933 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2395/4829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:11 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:12.530501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:12.548715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c68b122-bf33-4929-b87c-c8bd866bb2cc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.836434 Jul 25 20:35:12.549960 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2435/4830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:10 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:13.231756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:13.235594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:13.260592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:13.261505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:13.267977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:13.269198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:13.575048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:13.576266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:13.605242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:13.617010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:13.624820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:13.625896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:13.626749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:13.629624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:13.792137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:14.725763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:14.759007 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1e588c7-2ef1-4b09-af08-5c6e46c2ef56 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.530206 Jul 25 20:35:14.761948 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2396/4831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:13 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:14.780538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-248388293", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccb379e4-5962-4bb6-9044-f2918dcfc410"}], "security_groups": [{"name": "tempest-securitygroup--1867597376"}], "key_name": "tempest-keypair-881787018", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:15.019649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:15.039899 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12bf58c3-70fb-49cc-8aa0-79ece9ec5071 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.468875 Jul 25 20:35:15.045576 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2436/4832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:13 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:15.160064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:15.784610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:15.785505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:15.817010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:15.817471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:15.819095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:15.823723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:16.132734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] validate_networks() for [('ccb379e4-5962-4bb6-9044-f2918dcfc410', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:35:17.735275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:17.742994 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e12ae248-ea59-4035-a1bd-79fb9e5fc79a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.962755 Jul 25 20:35:17.755501 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2437/4833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:15 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:17.769441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:17.771381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:17.776191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:35:17.777269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:35:17.777988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:35:17.778741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:35:17.779352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:35:17.796568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:17.799362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:17.801343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:17.803216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:17.803982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:17.804486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:17.805292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:17.810125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:17.860749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:35:17.877000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for user 5a9fe47530b24272b5cf96e66ec11ae1 and project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:35:17.897821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:35:17.900491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:18.023370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ff8830db-10a3-4da8-8b12-83737e052bf4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.255401 Jul 25 20:35:18.026447 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2397/4834] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:35:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:35:18.040289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b78f0578-da93-4dd8-a1f9-844291041e08 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:18.042506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b78f0578-da93-4dd8-a1f9-844291041e08 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:18.555016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b78f0578-da93-4dd8-a1f9-844291041e08 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:18.563044 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b78f0578-da93-4dd8-a1f9-844291041e08 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1236 microversion: 2.1 time: 0.530701 Jul 25 20:35:18.563637 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2398/4835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:18 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1236 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:18.766234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:18.767030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:18.783804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:18.784471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:18.785101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:18.787359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:19.089790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:19.111202 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0d146064-0b01-412e-ad30-30c62edec41b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 1.352298 Jul 25 20:35:19.131520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2438/4836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:17 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:19.589061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:19.589901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:19.601713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:19.602171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:19.615141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:19.617106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:19.957132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:19.971713 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c994f3f3-eb1a-4b9b-ba9d-c85ad99da6b9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1232 microversion: 2.1 time: 0.388244 Jul 25 20:35:19.981117 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2439/4837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:19 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1232 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:20.139912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:20.141387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:20.154362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:20.156338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:20.158890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:20.171667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:20.182042 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cbe6c4f-c89a-4865-a1a9-6eaa8cfb5119 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.419535 Jul 25 20:35:20.183984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:20.184586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:20.185498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2399/4838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:18 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:20.200851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:20.201745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-40e0ef8e-80c4-4968-8a97-5f63dab96ce7 req-12c12c60-72af-4a0c-bd01-b5d6b2ee086e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d695ee-9552-47cb-b36b-d9d6d66d3453", "tag": "7dbb1a3b-0b43-4fde-9d54-a470841a0ea8"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:20.226645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-40e0ef8e-80c4-4968-8a97-5f63dab96ce7 req-12c12c60-72af-4a0c-bd01-b5d6b2ee086e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:20.229226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-40e0ef8e-80c4-4968-8a97-5f63dab96ce7 req-12c12c60-72af-4a0c-bd01-b5d6b2ee086e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:20.258152 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-40e0ef8e-80c4-4968-8a97-5f63dab96ce7 req-12c12c60-72af-4a0c-bd01-b5d6b2ee086e service nova] Creating event network-changed:7dbb1a3b-0b43-4fde-9d54-a470841a0ea8 for instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 on n-h2-845775-3 Jul 25 20:35:20.269374 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-40e0ef8e-80c4-4968-8a97-5f63dab96ce7 req-12c12c60-72af-4a0c-bd01-b5d6b2ee086e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078024 Jul 25 20:35:20.270154 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2400/4839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:21.005493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:21.006306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:21.009248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:21.020587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:21.031375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:21.032536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:21.033121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:21.037156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=67 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:21.101002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:21.116913 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fed89607-a9cd-43de-b2df-4973c14b31e6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1735 microversion: 2.1 time: 0.981588 Jul 25 20:35:21.134493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2440/4840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:20 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1735 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:21.164753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-72a95af1-fa2c-4f71-808f-62cd46d1dd17 req-4d3b1605-0eae-488b-a3a9-acd54e8c32db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00bb3a2c-03b0-4089-808b-446c9ed46c99", "tag": "ce03173e-1ba2-4320-ad8d-150c1f5ac303"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:21.182835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-72a95af1-fa2c-4f71-808f-62cd46d1dd17 req-4d3b1605-0eae-488b-a3a9-acd54e8c32db service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:21.187581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-72a95af1-fa2c-4f71-808f-62cd46d1dd17 req-4d3b1605-0eae-488b-a3a9-acd54e8c32db service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:21.221353 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-72a95af1-fa2c-4f71-808f-62cd46d1dd17 req-4d3b1605-0eae-488b-a3a9-acd54e8c32db service nova] Creating event network-changed:ce03173e-1ba2-4320-ad8d-150c1f5ac303 for instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 on n-h2-845775-3 Jul 25 20:35:21.234739 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-72a95af1-fa2c-4f71-808f-62cd46d1dd17 req-4d3b1605-0eae-488b-a3a9-acd54e8c32db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075351 Jul 25 20:35:21.241310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2441/4841] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:35:21.252430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:21.253719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:21.274144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:21.277605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:21.279814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:21.281024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:21.347859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:21.370594 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-667e4f3d-5810-409b-b2f3-246a8ada572c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1294 microversion: 2.1 time: 0.369702 Jul 25 20:35:21.380068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2401/4842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:20 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1294 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:22.141449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:22.142120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:22.150189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:22.150910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:22.152708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:22.153922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:22.631270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:22.658280 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef58d443-9d1c-4b9c-aa62-00572e7cdb79 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.412642 Jul 25 20:35:22.660982 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2442/4843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:21 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:22.683939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:22.689880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:22.711345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:22.711885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:22.716931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:22.722266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.098444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:23.115309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:23.129578 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89e9e6f7-0693-4495-b490-70e05486dfa4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1294 microversion: 2.1 time: 0.465130 Jul 25 20:35:23.132078 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2443/4844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:22 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1294 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:23.134602 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36b47040-789b-46fb-9c53-103890e675b1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1715 microversion: 2.1 time: 0.995780 Jul 25 20:35:23.135491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2402/4845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:22 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1715 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:23.384881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:23.385615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:23.394930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.395564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.396737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.398281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.527478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a3737cbc-00f2-4b83-bc3c-f20530845a58 req-fa148a00-08e9-4d62-856f-43ee1ba088c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0", "tag": "d684560d-7a57-45d5-90bd-47a98f230b2d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:23.555243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a3737cbc-00f2-4b83-bc3c-f20530845a58 req-fa148a00-08e9-4d62-856f-43ee1ba088c5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.557285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a3737cbc-00f2-4b83-bc3c-f20530845a58 req-fa148a00-08e9-4d62-856f-43ee1ba088c5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.586309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a3737cbc-00f2-4b83-bc3c-f20530845a58 req-fa148a00-08e9-4d62-856f-43ee1ba088c5 service nova] Creating event network-changed:d684560d-7a57-45d5-90bd-47a98f230b2d for instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 on n-h1-845775-3 Jul 25 20:35:23.593037 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a3737cbc-00f2-4b83-bc3c-f20530845a58 req-fa148a00-08e9-4d62-856f-43ee1ba088c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070042 Jul 25 20:35:23.594307 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2403/4846] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:23.629211 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Cannot 'detach_volume' instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f while it is in vm_state rescued Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments/a217c3d5-37d3-44a6-8951-358530c58e01 HTTP/1.1 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'detach_volume' instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f while it is in vm_state rescued Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '9212921a-ba59-4504-9f8f-e7dd447a5b2f', 'id': 'a217c3d5-37d3-44a6-8951-358530c58e01'} Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f while it is in vm_state rescued Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:23.631436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f while it is in vm_state rescued Jul 25 20:35:23.636264 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:23.646496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 409 to user: Cannot 'detach_volume' instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f while it is in vm_state rescued {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:23.648303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62f742d2-fbbe-4f49-8443-7e8e1b490201 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments/a217c3d5-37d3-44a6-8951-358530c58e01" status: 409 len: 152 microversion: 2.1 time: 0.269059 Jul 25 20:35:23.649567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2444/4847] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:35:23 2022] DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments/a217c3d5-37d3-44a6-8951-358530c58e01 => generated 152 bytes in 272 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:35:23.661712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:23.662990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:23.682632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:23.683621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:23.689486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.695636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.699609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.700547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.759484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.764235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.767935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:23.771135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:23.978368 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b587ad9-0125-4b19-b4cf-3e4e60f78536 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/action" status: 202 len: 0 microversion: 2.1 time: 0.322914 Jul 25 20:35:23.979921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2404/4848] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:35:23 2022] POST /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:35:23.987850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1413129746", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "a70c2164-d7b0-47b4-b6fe-cfdeb1dc66fb"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1879585683", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d307024d-da2f-4ac2-aafb-c2e5d34f2d61"]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:24.135994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] validate_networks() for [('a70c2164-d7b0-47b4-b6fe-cfdeb1dc66fb', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:35:24.879439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:24.914330 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a1f3fbfe-9595-4a59-86fb-d60d7ff7d026 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.236014 Jul 25 20:35:24.917243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2445/4849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:23 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:24.934196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:24.947517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:24.968457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:24.974929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:24.976920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:24.977390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:26.752154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:35:26.752674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:35:26.753041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:35:26.753458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:35:26.753868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:35:26.784700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:26.785178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:26.786451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:26.786686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:26.807761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:26.821827 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf197b03-45ab-4522-96fd-86d6d74c5eda tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1723 microversion: 2.1 time: 1.897605 Jul 25 20:35:26.824548 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2446/4850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:24 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1723 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:26.838292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:26.840185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:26.869567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for project 9443339e53024f45b1b33a900e3aff18. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:35:26.870599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:26.871350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:26.872423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:26.873063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:26.895043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Getting quotas for user 04a0a5ec4bf54f7d86827862faa32386 and project 9443339e53024f45b1b33a900e3aff18. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:35:26.971962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:35:26.995993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:27.091825 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eae7cb17-3868-479d-ab91-8522506e0d64 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.110192 Jul 25 20:35:27.096687 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2405/4851] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:35:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 3116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:35:27.111240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:27.116402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:27.138851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:27.150610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:27.151814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:27.153351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:29.601906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:29.616761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:29.626949 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0d8ded99-bf18-416e-8a3c-d20f6b805683 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 2.527555 Jul 25 20:35:29.640072 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2406/4852] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:27 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:29.640267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05d1d1a6-9454-4698-9833-3aa195ca5640 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 2.810122 Jul 25 20:35:29.640267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2447/4853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:26 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 2813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:29.658708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:29.662483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:29.665090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:29.667584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:29.690422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:29.693163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:29.694206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:29.694674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:29.708360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:29.709511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:29.732459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:29.733139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:30.003958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:30.012397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-131bfdb2-53f4-438c-ad04-931dd605f5db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1312 microversion: 2.1 time: 0.379641 Jul 25 20:35:30.025053 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2407/4854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:29 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:30.656364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:30.657997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:30.688283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:30.693894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:30.696952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:30.699807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:30.714585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:30.717783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf4bbfb0-18a7-4709-ab7d-160e5dbcf3cf tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1723 microversion: 2.1 time: 1.077356 Jul 25 20:35:30.718545 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2448/4855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:29 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1723 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:30.733258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:30.740289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:30.774590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:30.776764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:30.784696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:30.785983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:31.584734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:31.605013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a799af11-6446-499f-8dfb-74769739486c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.876323 Jul 25 20:35:31.607829 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2449/4856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:30 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:31.616000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:31.617483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:31.650047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:31.651833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:31.654381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:31.655828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:31.797929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:31.806323 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42189223-1648-4a68-b8ba-099f296e08c3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 1.155161 Jul 25 20:35:31.807118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2408/4857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:30 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:31.840269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:31.841074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:31.854905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:31.855379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:31.856206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:31.860157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:31.882272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:31.894234 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ba40668-8e2c-4864-9d15-817a57d03cfc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.284864 Jul 25 20:35:31.904250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2450/4858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:31 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:32.213174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:32.231101 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e625185-7ac0-4241-9c4e-49a5ba00f8ad tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1729 microversion: 2.1 time: 0.405853 Jul 25 20:35:32.232412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2409/4859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:31 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1729 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:32.256105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:32.257203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:32.280763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.281433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.282288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.290814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.328433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4a263640-b5ea-422d-a2c5-f909ad7a3c0a req-1fd690be-a04e-4b5a-94e7-a56bd5b176b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "501074ac-0aa5-4617-9f93-0e1b33fd4d54", "tag": "ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:32.364827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4a263640-b5ea-422d-a2c5-f909ad7a3c0a req-1fd690be-a04e-4b5a-94e7-a56bd5b176b8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.365667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4a263640-b5ea-422d-a2c5-f909ad7a3c0a req-1fd690be-a04e-4b5a-94e7-a56bd5b176b8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.417970 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4a263640-b5ea-422d-a2c5-f909ad7a3c0a req-1fd690be-a04e-4b5a-94e7-a56bd5b176b8 service nova] Creating event network-changed:ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc for instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 on n-h1-845775-3 Jul 25 20:35:32.461881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4a263640-b5ea-422d-a2c5-f909ad7a3c0a req-1fd690be-a04e-4b5a-94e7-a56bd5b176b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135580 Jul 25 20:35:32.463007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2410/4860] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:32.531621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-89de6244-7a2f-47bd-b08e-64b2a655f9c1 req-32c9fa85-dbe9-45fc-a25d-a87c8aab73c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0", "name": "network-vif-plugged", "status": "completed", "tag": "d684560d-7a57-45d5-90bd-47a98f230b2d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:32.556860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-89de6244-7a2f-47bd-b08e-64b2a655f9c1 req-32c9fa85-dbe9-45fc-a25d-a87c8aab73c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.557458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-89de6244-7a2f-47bd-b08e-64b2a655f9c1 req-32c9fa85-dbe9-45fc-a25d-a87c8aab73c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.590439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-89de6244-7a2f-47bd-b08e-64b2a655f9c1 req-32c9fa85-dbe9-45fc-a25d-a87c8aab73c8 service nova] Creating event network-vif-plugged:d684560d-7a57-45d5-90bd-47a98f230b2d for instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 on n-h1-845775-3 Jul 25 20:35:32.612836 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-89de6244-7a2f-47bd-b08e-64b2a655f9c1 req-32c9fa85-dbe9-45fc-a25d-a87c8aab73c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091470 Jul 25 20:35:32.613618 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2411/4861] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:35:32.617296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dac78e53-f129-448b-bc61-2432b6427e06 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.365178 Jul 25 20:35:32.628949 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2451/4862] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:35:32 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:32.632902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:32.639580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:32.653281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.658959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.660135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.673796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.828229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:32.829098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:32.839364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.840075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:32.841036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:32.841634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:33.544967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:33.555760 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-40d80528-d99f-48ce-87ae-d6510aa0a0cb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.930401 Jul 25 20:35:33.558206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:33.576215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2412/4863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:32 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:33.577376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4e827306-3424-49d4-ace8-318ec14899be tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 0.754322 Jul 25 20:35:33.578309 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2452/4864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:32 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:33.581346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:33.581971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:33.590095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-227658616", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "3ee17ff1-f128-44c9-8acf-52feb0918d47"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:33.597590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:33.598058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:33.598856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:33.599302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:33.693906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] validate_networks() for [('3ee17ff1-f128-44c9-8acf-52feb0918d47', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:35:34.168163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:34.177095 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9b68d5c-7b5e-4e00-8c27-72a04246e465 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.599689 Jul 25 20:35:34.177702 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2413/4865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:33 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:34.580830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:34.581456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:34.596714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:34.597185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:34.598006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:34.601051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.042193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:35.051696 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bff580f-b305-4003-b7b7-82c5b11eae46 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.474988 Jul 25 20:35:35.052829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2414/4866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:34 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:35.060410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:35.061190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:35.069725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.070992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.072090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.072747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.218032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:35:35.221134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:35:35.221777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:35:35.222705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:35:35.223344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:35:35.236457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.237140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.238129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.238922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.263721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Getting quotas for project 150ed184096d42e7881b83885d79b351. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:35:35.280295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Getting quotas for user b1826f88ece04754a6b9a6eada79bbc9 and project 150ed184096d42e7881b83885d79b351. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:35:35.298166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:35:35.300983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:35:35.395618 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8f0a48b0-16d4-42c5-959e-17f160397c55 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813191 Jul 25 20:35:35.397593 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2453/4867] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:35:35.426643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9adb20fd-06cc-4740-8c10-87e204ebf5f8 req-27b45201-7126-4acf-98c9-8fcbfb70fbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bad2a0a-824f-4da0-b620-7ac9446df176", "tag": "f96e1352-619b-4e2d-aaaa-c744a7d94219"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:35.452724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9adb20fd-06cc-4740-8c10-87e204ebf5f8 req-27b45201-7126-4acf-98c9-8fcbfb70fbe2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.455666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9adb20fd-06cc-4740-8c10-87e204ebf5f8 req-27b45201-7126-4acf-98c9-8fcbfb70fbe2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.461809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:35.474108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a00a1166-9ac5-4468-a518-828a9805ae67 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 0.419837 Jul 25 20:35:35.475919 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2415/4868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:35 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:35.483216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d695ee-9552-47cb-b36b-d9d6d66d3453", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb1a3b-0b43-4fde-9d54-a470841a0ea8"}, {"server_uuid": "00bb3a2c-03b0-4089-808b-446c9ed46c99", "name": "network-vif-plugged", "status": "completed", "tag": "ce03173e-1ba2-4320-ad8d-150c1f5ac303"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:35.497652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.499576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.504076 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9adb20fd-06cc-4740-8c10-87e204ebf5f8 req-27b45201-7126-4acf-98c9-8fcbfb70fbe2 service nova] Creating event network-changed:f96e1352-619b-4e2d-aaaa-c744a7d94219 for instance 9bad2a0a-824f-4da0-b620-7ac9446df176 on n-h1-845775-3 Jul 25 20:35:35.518224 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9adb20fd-06cc-4740-8c10-87e204ebf5f8 req-27b45201-7126-4acf-98c9-8fcbfb70fbe2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116108 Jul 25 20:35:35.519018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2454/4869] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:35.521897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] Creating event network-vif-plugged:7dbb1a3b-0b43-4fde-9d54-a470841a0ea8 for instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 on n-h2-845775-3 Jul 25 20:35:35.522797 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] Creating event network-vif-plugged:ce03173e-1ba2-4320-ad8d-150c1f5ac303 for instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 on n-h2-845775-3 Jul 25 20:35:35.531124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:35.531829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:35.532540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ba12d687-1edb-4e9b-a05d-5c5387b4a36d req-61bb13eb-7d49-4489-92c9-f917142fd612 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052990 Jul 25 20:35:35.533916 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2416/4870] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:35.544301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12ca567b-dbc1-4f73-be13-011d1b3a8549 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:35.545506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-12ca567b-dbc1-4f73-be13-011d1b3a8549 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:35.560188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.560644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.561510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:35.561869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:35.781307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-12ca567b-dbc1-4f73-be13-011d1b3a8549 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:35.804155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12ca567b-dbc1-4f73-be13-011d1b3a8549 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1218 microversion: 2.1 time: 0.268744 Jul 25 20:35:35.804803 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2417/4871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:35 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1218 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:35.847262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:35.872374 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ebe21e5-aa68-4f99-b8b5-3bd352e542bc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.346422 Jul 25 20:35:35.884781 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2455/4872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:35 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:36.075071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:36.075924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:36.098535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:36.099799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:36.102165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:36.106825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:36.503304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:36.505196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:36.516719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:36.518728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:36.522119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:36.523860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:36.839688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:36.862976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:36.880824 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eff6ed55-15ea-4198-a119-ff9b8bf06b98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.811018 Jul 25 20:35:36.894720 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2418/4873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:36 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:36.899757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6d2a75b8-5519-4753-86f1-72262a118151 req-130117be-73d8-4615-ac34-f0f06a2cc397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:36.921187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6d2a75b8-5519-4753-86f1-72262a118151 req-130117be-73d8-4615-ac34-f0f06a2cc397 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:36.921923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6d2a75b8-5519-4753-86f1-72262a118151 req-130117be-73d8-4615-ac34-f0f06a2cc397 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:36.969589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6d2a75b8-5519-4753-86f1-72262a118151 req-130117be-73d8-4615-ac34-f0f06a2cc397 service nova] Creating event network-changed:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:35:36.991170 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6d2a75b8-5519-4753-86f1-72262a118151 req-130117be-73d8-4615-ac34-f0f06a2cc397 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088043 Jul 25 20:35:36.992146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2419/4874] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:37.005863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:37.013930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:37.024625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.025120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:37.026184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.026449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:37.066729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:37.096020 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22aed3be-6c16-4606-a159-4fbabb2e1a40 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1322 microversion: 2.1 time: 0.599580 Jul 25 20:35:37.096779 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2456/4875] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:36 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:37.108714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:37.109661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:37.150864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.151419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:37.152172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.152616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:37.300546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:37.322090 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7f08f90-6844-4579-9a86-52b0ebf31d9f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1222 microversion: 2.1 time: 0.327677 Jul 25 20:35:37.338107 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2420/4876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:36 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1222 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:37.383114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:37.393204 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c038af1c-139d-4449-81dc-7def9637e998 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.295258 Jul 25 20:35:37.393894 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2457/4877] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:37 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:37.901991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:37.903369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:37.923120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.924166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:37.925253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:37.925905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.120370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:38.120992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:38.141916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.142353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.152934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.154234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.575582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:38.578031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:38.585546 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd330ac0-57e5-42a0-9471-3e6b907d74ec tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.687495 Jul 25 20:35:38.608393 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2421/4878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:37 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:38.620531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:38.621869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:38.641445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.645453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.646570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.647038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.826475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:38.838162 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8037b5e5-5176-409c-8519-7387713d17f3 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1270 microversion: 2.1 time: 0.227021 Jul 25 20:35:38.839234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2422/4879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:38 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:38.839234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:38.859608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:38.874889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.875623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.876475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.877224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.903826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:38.917493 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-779f67c3-daa3-4254-a5c4-40dfd4d18e9b tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 200 len: 1514 microversion: 2.1 time: 0.803408 Jul 25 20:35:38.918746 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2458/4880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:38 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 1514 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:38.964934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:38.966059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:38.978604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.982867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:38.983953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:38.984723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.012722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:39.151025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:39.172358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-67d9ad97-431d-48ee-9706-c87cdf7d205a tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.328444 Jul 25 20:35:39.174374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2423/4881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:38 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:39.193352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6a6ff1a0-b02c-461c-9a24-253eb8b804cf req-45ee3ad5-5be3-4da2-b68e-6c947ac93950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:39.205667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6a6ff1a0-b02c-461c-9a24-253eb8b804cf req-45ee3ad5-5be3-4da2-b68e-6c947ac93950 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.206277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6a6ff1a0-b02c-461c-9a24-253eb8b804cf req-45ee3ad5-5be3-4da2-b68e-6c947ac93950 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.223229 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6a6ff1a0-b02c-461c-9a24-253eb8b804cf req-45ee3ad5-5be3-4da2-b68e-6c947ac93950 service nova] Creating event network-changed:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:35:39.229464 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6a6ff1a0-b02c-461c-9a24-253eb8b804cf req-45ee3ad5-5be3-4da2-b68e-6c947ac93950 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039967 Jul 25 20:35:39.230451 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2424/4882] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:39.361421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:39.383025 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1185977a-70e5-4e41-bbb1-e876ebfada13 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 200 len: 1515 microversion: 2.1 time: 0.423410 Jul 25 20:35:39.383660 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2459/4883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:38 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 1515 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:39.413151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:39.413904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:39.422356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.423188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.424263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.425091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.617159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:39.622068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:39.647307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.650616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.651626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.652471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.815790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:39.832775 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b2b4070d-c93e-400b-b5b7-35552b2b2dbf tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 200 len: 1515 microversion: 2.1 time: 0.429119 Jul 25 20:35:39.835524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2425/4884] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:39 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 1515 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:39.859501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:39.860024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:39.876788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.878260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.880069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:39.880697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:39.958089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:35:40.005712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:40.020911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-561bab38-a906-4fe8-9c40-d8ce15be4f35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.408830 Jul 25 20:35:40.021812 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2460/4885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:39 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:40.027688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:40.029379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:40.041137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.041851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.042938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.043592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.094215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1287a46-895c-4085-9480-2f1fa84c8600 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 204 len: 0 microversion: 2.1 time: 0.236701 Jul 25 20:35:40.095308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2426/4886] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:35:39 2022] DELETE /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:35:40.111671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:40.113349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:40.128247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.128746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.129991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.130443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.184020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:40.193401 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b84c6c1a-479e-43f7-8694-7930eeffe94a tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1276 microversion: 2.1 time: 0.170298 Jul 25 20:35:40.214515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2461/4887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:40 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:40.219497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b6896750-954e-4af8-bc35-5b814d9af4b1 req-e317806b-24c4-4a49-9c94-cbc535e2830f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501074ac-0aa5-4617-9f93-0e1b33fd4d54", "name": "network-vif-plugged", "status": "completed", "tag": "ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:40.247931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b6896750-954e-4af8-bc35-5b814d9af4b1 req-e317806b-24c4-4a49-9c94-cbc535e2830f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.248428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b6896750-954e-4af8-bc35-5b814d9af4b1 req-e317806b-24c4-4a49-9c94-cbc535e2830f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.272857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b6896750-954e-4af8-bc35-5b814d9af4b1 req-e317806b-24c4-4a49-9c94-cbc535e2830f service nova] Creating event network-vif-plugged:ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc for instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 on n-h1-845775-3 Jul 25 20:35:40.291696 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b6896750-954e-4af8-bc35-5b814d9af4b1 req-e317806b-24c4-4a49-9c94-cbc535e2830f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075772 Jul 25 20:35:40.293939 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2462/4888] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:40.300504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:40.300949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:40.310770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.311291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.312126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:40.312587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:40.512590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:40.525308 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c144ad4e-63e5-4d20-b5b9-d9961e6b6b97 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 200 len: 1521 microversion: 2.1 time: 0.415304 Jul 25 20:35:40.528552 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2427/4889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:40 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:40.728340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:40.810380 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e975712e-6447-4f47-a8e0-4172872b2ce8 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.514705 Jul 25 20:35:40.816241 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2463/4890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:40 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:41.052878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:41.054215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:41.073064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.074087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.075521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.078489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.215891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:41.217769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:41.234410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.237054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.238039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.238800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.403238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:41.414045 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9751a5ba-6da9-4421-9b55-d3e36f576e86 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1276 microversion: 2.1 time: 0.202593 Jul 25 20:35:41.415749 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2464/4891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:41 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:41.437311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:41.452934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-90bf3d50-dc16-48b3-bec4-6daa55df5cd4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1362 microversion: 2.1 time: 0.410427 Jul 25 20:35:41.454445 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2428/4892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:41 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:41.558607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:41.558852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:41.566126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.566599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.567978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.568574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.827347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:41.841031 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a0934ef4-cdb5-4b20-91a6-48bb1965892c tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 200 len: 1521 microversion: 2.1 time: 0.288477 Jul 25 20:35:41.842229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2465/4893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:41 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:41.855186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:41.856537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:41.863145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.863828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:41.864821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:41.865411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:42.110664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:42.130559 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a332fe2-fdb6-4865-ba66-c29bf8480005 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.293249 Jul 25 20:35:42.131165 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2429/4894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:41 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:42.315592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-393f7a96-9af6-45e5-a9da-54355f11e2a8 req-c9bc3381-37d4-4d11-bf4d-3ab903a005a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad2a0a-824f-4da0-b620-7ac9446df176", "name": "network-vif-plugged", "status": "completed", "tag": "f96e1352-619b-4e2d-aaaa-c744a7d94219"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:42.332413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-393f7a96-9af6-45e5-a9da-54355f11e2a8 req-c9bc3381-37d4-4d11-bf4d-3ab903a005a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:42.333655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-393f7a96-9af6-45e5-a9da-54355f11e2a8 req-c9bc3381-37d4-4d11-bf4d-3ab903a005a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:42.351229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-393f7a96-9af6-45e5-a9da-54355f11e2a8 req-c9bc3381-37d4-4d11-bf4d-3ab903a005a6 service nova] Creating event network-vif-plugged:f96e1352-619b-4e2d-aaaa-c744a7d94219 for instance 9bad2a0a-824f-4da0-b620-7ac9446df176 on n-h1-845775-3 Jul 25 20:35:42.359876 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-393f7a96-9af6-45e5-a9da-54355f11e2a8 req-c9bc3381-37d4-4d11-bf4d-3ab903a005a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052446 Jul 25 20:35:42.366765 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2466/4895] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:42.442605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:42.444521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:42.460376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:42.461187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:42.464327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:42.465792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:42.488183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:42.490004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:42.502145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:42.502998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:42.504118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:42.506515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.001890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:43.012151 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-269276be-09df-4321-988a-c3ee402088fb tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 0.577089 Jul 25 20:35:43.023081 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2430/4896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:42 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:43.040757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:43.044274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:43.094813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.096173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.098931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.101194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.154993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.155475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.155955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lazy-loading 'fault' on Instance uuid 00bb3a2c-03b0-4089-808b-446c9ed46c99 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:35:43.172994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:43.195977 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b5376230-f8f2-4700-9deb-6cc9eb52639c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1548 microversion: 2.1 time: 0.720078 Jul 25 20:35:43.198489 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2467/4897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:42 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1548 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:43.229890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-55fd52f7-ce86-4128-b9f7-0387ac263770 req-235ee934-6e74-42fa-ab82-531e3de758da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00bb3a2c-03b0-4089-808b-446c9ed46c99", "name": "network-vif-deleted", "tag": "ce03173e-1ba2-4320-ad8d-150c1f5ac303"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:43.253254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:43.261346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55fd52f7-ce86-4128-b9f7-0387ac263770 req-235ee934-6e74-42fa-ab82-531e3de758da service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.261796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-55fd52f7-ce86-4128-b9f7-0387ac263770 req-235ee934-6e74-42fa-ab82-531e3de758da service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.274309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-278cd490-4a19-425c-b55b-20f95cf424b8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 200 len: 1312 microversion: 2.1 time: 0.240810 Jul 25 20:35:43.277327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2431/4898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:43 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:43.293449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:43.294455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:43.307859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.312174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.312689 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-55fd52f7-ce86-4128-b9f7-0387ac263770 req-235ee934-6e74-42fa-ab82-531e3de758da service nova] Creating event network-vif-deleted:ce03173e-1ba2-4320-ad8d-150c1f5ac303 for instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 on n-h2-845775-3 Jul 25 20:35:43.317640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.318640 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-55fd52f7-ce86-4128-b9f7-0387ac263770 req-235ee934-6e74-42fa-ab82-531e3de758da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109477 Jul 25 20:35:43.319351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.319557 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2468/4899] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:43.325583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:43.326171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:43.334253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.335025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.335984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:43.341504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:43.455807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:43.476286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4121755-fd17-4616-8737-a3fb6923904f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1300 microversion: 2.1 time: 0.189672 Jul 25 20:35:43.479193 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2432/4900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:43 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:43.575544 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0f97db4-5814-4bc1-8584-e75098101e94 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254176 Jul 25 20:35:43.576574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2469/4901] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:35:43 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:44.042525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:44.043752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:44.052788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.053503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.054523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.055175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.116731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c9f11d51-5a60-4c04-a48e-7408448e9db4 req-3f3ee9d2-423f-49e7-a408-ddc297b5b6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6398a66-7044-467b-a9af-6c3d4697a74f", "tag": "04f47e43-e44a-4605-be0b-e62ad9e22547"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:44.139561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c9f11d51-5a60-4c04-a48e-7408448e9db4 req-3f3ee9d2-423f-49e7-a408-ddc297b5b6a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.140005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c9f11d51-5a60-4c04-a48e-7408448e9db4 req-3f3ee9d2-423f-49e7-a408-ddc297b5b6a2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.156702 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c9f11d51-5a60-4c04-a48e-7408448e9db4 req-3f3ee9d2-423f-49e7-a408-ddc297b5b6a2 service nova] Creating event network-changed:04f47e43-e44a-4605-be0b-e62ad9e22547 for instance d6398a66-7044-467b-a9af-6c3d4697a74f on n-h2-845775-3 Jul 25 20:35:44.173976 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c9f11d51-5a60-4c04-a48e-7408448e9db4 req-3f3ee9d2-423f-49e7-a408-ddc297b5b6a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061652 Jul 25 20:35:44.174910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2470/4902] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:44.337089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:44.338348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:44.364557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.369821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.371821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.372294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.395544 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] HTTP exception thrown: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 HTTP/1.1 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '00bb3a2c-03b0-4089-808b-446c9ed46c99'} Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:44.398919 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 404 to user: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:44.402750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5d56085-9e2e-42f1-bdfa-17354e0559a8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 404 len: 111 microversion: 2.1 time: 0.081829 Jul 25 20:35:44.406712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2471/4903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:44 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:35:44.414770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:44.423040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:44.424095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:44.431966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.432694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.433831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.434524 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.606334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a3fced8-dbe5-4e10-af90-81ecfe6bc681 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.198181 Jul 25 20:35:44.607460 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2472/4904] 10.222.0.48 () {58 vars in 1230 bytes} [Mon Jul 25 20:35:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:35:44.622823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:44.623765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:44.639146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.639711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.640713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:44.643703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:44.968314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:44.985435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfcde391-aa69-4d7f-97ae-3867b7b06fb7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 0.946493 Jul 25 20:35:44.986894 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2433/4905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:44 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:45.000534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbb4cead-9af1-4892-aae7-b7de55baceb8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbb4cead-9af1-4892-aae7-b7de55baceb8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 20:35:45.007457 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 25 20:35:45.011946 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.014142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dbb4cead-9af1-4892-aae7-b7de55baceb8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:45.018624 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dbb4cead-9af1-4892-aae7-b7de55baceb8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.030509 Jul 25 20:35:45.019393 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2434/4906] 10.222.0.48 () {58 vars in 1182 bytes} [Mon Jul 25 20:35:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:35:45.032787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.054465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.056285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:45.063014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.063649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.065140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.067585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.125680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:35:45.128212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.145933 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-110e503f-04ed-4638-977a-2ebf2d29ec4c tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1473 microversion: 2.1 time: 0.537225 Jul 25 20:35:45.146989 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2473/4907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:44 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1473 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:45.177353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.179179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:45.197268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.197936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.198884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.199644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.236536 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-040418d9-26b2-4dab-8d8a-fbc07f10f517 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.206043 Jul 25 20:35:45.237732 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2435/4908] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers => generated 681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:45.272871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.291302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.292430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:45.296745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.servers [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Removing options 'limit' from query {{(pid=119723) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 25 20:35:45.297750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:45.313277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.314474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.315507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.316193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.375717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:35:45.457278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa4bd21b-dc07-4f27-8f3b-f22eb3b890d5 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.204786 Jul 25 20:35:45.458770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2436/4909] 10.222.0.48 () {58 vars in 1144 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:45.476335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4cc3569-3933-435b-bd10-676bf48d4160 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4cc3569-3933-435b-bd10-676bf48d4160 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '-1' Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 20:35:45.488655 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 25 20:35:45.492446 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.496781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4cc3569-3933-435b-bd10-676bf48d4160 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:45.498837 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4cc3569-3933-435b-bd10-676bf48d4160 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.026962 Jul 25 20:35:45.503412 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2437/4910] 10.222.0.48 () {58 vars in 1142 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:35:45.520292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bc408da-3c90-4711-bf19-b43b4d8a5f9a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bc408da-3c90-4711-bf19-b43b4d8a5f9a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: action_args: {} Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi 'testing' Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 25 20:35:45.525211 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 25 20:35:45.530206 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:45.543954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bc408da-3c90-4711-bf19-b43b4d8a5f9a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:45.549059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bc408da-3c90-4711-bf19-b43b4d8a5f9a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.041079 Jul 25 20:35:45.559423 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2438/4911] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:35:45.577541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d122c3ef-f7e6-4d30-b162-bdf32e91936f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.607858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d122c3ef-f7e6-4d30-b162-bdf32e91936f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.613733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d122c3ef-f7e6-4d30-b162-bdf32e91936f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:45.630377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.servers [None req-d122c3ef-f7e6-4d30-b162-bdf32e91936f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Flavor 'non_existing_flavor' could not be found {{(pid=119723) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 25 20:35:45.634351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d122c3ef-f7e6-4d30-b162-bdf32e91936f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.065984 Jul 25 20:35:45.645308 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2439/4912] 10.222.0.48 () {58 vars in 1178 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:35:45.651935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.665667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.666961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:45.673491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.680975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.682002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.682577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.803964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:45.835128 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bbfa560-c22c-4e59-972c-332471929c05 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.187779 Jul 25 20:35:45.836549 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2440/4913] 10.222.0.48 () {58 vars in 1174 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:35:45.850131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.861679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.872281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:45.879436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:45.907294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8f6539ca-d8dd-4359-b7c6-94dd67bb4a54 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1473 microversion: 2.1 time: 0.738752 Jul 25 20:35:45.908397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:45.908546 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2474/4914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1473 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:45.914739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.924859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.925910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.926595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.935331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:45.936403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:45.967384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.969487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:45.971426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:45.973270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.173869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:46.319341 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bd2d924a-845f-4f9d-9338-7b2217b7230a tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.472711 Jul 25 20:35:46.320466 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2441/4915] 10.222.0.48 () {58 vars in 1184 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:35:46.366935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:46.369755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:46.379129 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bc36f2be-2775-4e6f-b11a-7cddf46ff6d5 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1624 microversion: 2.1 time: 0.450228 Jul 25 20:35:46.380744 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2475/4916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:45 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1624 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:46.389116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:46.395691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:46.396844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:46.405162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.406101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.407327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.408013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.417151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.424931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.433294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.434861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.453238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:35:46.514188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:46.525100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.525812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.920980 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48fca8b9-9e4c-41f8-9656-3be7a6f5dbe8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.538659 Jul 25 20:35:46.922264 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2476/4917] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:35:46 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:46.928161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-50c03e23-aeff-49d0-ad51-c6dd465e1533 req-ec916b30-704b-4949-b362-89da113d541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "501074ac-0aa5-4617-9f93-0e1b33fd4d54", "tag": "ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:46.974861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-50c03e23-aeff-49d0-ad51-c6dd465e1533 req-ec916b30-704b-4949-b362-89da113d541b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:46.978641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-50c03e23-aeff-49d0-ad51-c6dd465e1533 req-ec916b30-704b-4949-b362-89da113d541b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:46.996068 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-50c03e23-aeff-49d0-ad51-c6dd465e1533 req-ec916b30-704b-4949-b362-89da113d541b service nova] Creating event network-changed:ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc for instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 on n-h1-845775-3 Jul 25 20:35:47.004087 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-50c03e23-aeff-49d0-ad51-c6dd465e1533 req-ec916b30-704b-4949-b362-89da113d541b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079755 Jul 25 20:35:47.005473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2477/4918] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:47.012366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.014231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:47.023667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.026906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.027959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.029661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.244353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:47.256084 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-457793de-8c71-4c97-9281-cc8a12cb3f2b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 0.916119 Jul 25 20:35:47.259469 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2442/4919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:46 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:47.273051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db991dc6-bb9e-4eb4-a6c8-651802329701 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.312855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db991dc6-bb9e-4eb4-a6c8-651802329701 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:47.313988 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db991dc6-bb9e-4eb4-a6c8-651802329701 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.050040 Jul 25 20:35:47.319971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2443/4920] 10.222.0.48 () {58 vars in 1178 bytes} [Mon Jul 25 20:35:47 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:35:47.333588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.356132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:47.356733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Searching by: {'deleted': False, 'project_id': '35ac9159fa2f466b85363a93900f6c05'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 20:35:47.374117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.374578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.379286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.388982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.480664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 20:35:47.541792 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6a0f25e9-5cf3-4b58-8a19-8c732a5a1391 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.218433 Jul 25 20:35:47.542815 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2444/4921] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 20:35:47 2022] GET /compute/v2.1/servers => generated 681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:47.557430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.558285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:47.570850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.572623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.578337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.579237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.609958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] HTTP exception thrown: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 HTTP/1.1 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '00bb3a2c-03b0-4089-808b-446c9ed46c99'} Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:47.611924 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:47.615133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:47.620942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 404 to user: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:47.626731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01e80e57-53a8-43fb-b49f-60a14a40a5a4 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 404 len: 111 microversion: 2.1 time: 0.071073 Jul 25 20:35:47.634590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2445/4922] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:35:47 2022] DELETE /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:35:47.640995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.642416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:47.651016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.651469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.652296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.652899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.691510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:35:47.824700 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb82d9ab-e2c7-4e41-9426-338b383bb608 tempest-TestSecurityGroupsBasicOps-538255834 tempest-TestSecurityGroupsBasicOps-538255834-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1911 microversion: 2.1 time: 0.817768 Jul 25 20:35:47.825628 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2478/4923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:47 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1911 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:47.867158 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2e4b4f1-d4c6-407e-9ea3-78557f7f06b3 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 204 len: 0 microversion: 2.1 time: 0.230305 Jul 25 20:35:47.870169 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2446/4924] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:35:47 2022] DELETE /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:35:47.878840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.879737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:47.897879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.898530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.904612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:47.905920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:47.982165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:35:47.989341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:47.990043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:48.003888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.006005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.012831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.013373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.021434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:48.089202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:35:48.156688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:35:48.170329 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2e4a16c-5989-41d3-aebd-cd611c6543c8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 204 len: 0 microversion: 2.1 time: 0.295308 Jul 25 20:35:48.171365 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2479/4925] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:35:47 2022] DELETE /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:35:48.181589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:48.182726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 00bb3a2c-03b0-4089-808b-446c9ed46c99] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:48.201937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.202863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.203838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.204658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.254654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] HTTP exception thrown: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 HTTP/1.1 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '00bb3a2c-03b0-4089-808b-446c9ed46c99'} Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:48.257175 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 404 to user: Instance 00bb3a2c-03b0-4089-808b-446c9ed46c99 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d48f54b-185e-40d0-be6f-32947991b8d8 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99" status: 404 len: 111 microversion: 2.1 time: 0.082862 Jul 25 20:35:48.262819 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2480/4926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:48 2022] GET /compute/v2.1/servers/00bb3a2c-03b0-4089-808b-446c9ed46c99 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:35:48.270913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:48.280521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:48.302378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.303050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.303605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.304063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.427505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d34f7017-068d-4a2f-a767-9cf543ecc32f tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 204 len: 0 microversion: 2.1 time: 0.441788 Jul 25 20:35:48.434913 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2447/4927] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:35:47 2022] DELETE /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:35:48.484359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:48.488078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:48.504535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.506409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.508802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.512006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.726961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:48.759219 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0826cc3f-c612-4094-b73b-adf76db39cf0 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 200 len: 1521 microversion: 2.1 time: 0.493869 Jul 25 20:35:48.780593 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2481/4928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:48 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:48.801992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:48.802485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:48.827526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.828236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:48.828530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:48.829416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:49.103336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:49.118817 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6843fd8a-c7bf-4b57-8069-d224cd98b9cc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1479 microversion: 2.1 time: 0.336652 Jul 25 20:35:49.120022 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2482/4929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:48 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1479 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:49.121203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:49.138604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2b93e92-0fea-4d52-81a6-3759a4c1da42 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 0.685752 Jul 25 20:35:49.158051 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2448/4930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:48 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:49.807090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:49.809007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:49.823412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:49.824129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:49.825176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:49.825778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:50.142431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:50.143058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:50.159470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:50.161630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:50.162739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:50.165294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:50.211438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:50.220154 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d90721f-77af-4957-b56e-7d53dce40112 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 200 len: 1521 microversion: 2.1 time: 0.417390 Jul 25 20:35:50.227319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2483/4931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:49 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:50.241451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:50.242240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:50.250664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:50.257412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:50.258613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:50.259276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:50.599731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:50.609624 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9bf815d-3d80-4f42-a2de-d8d9bf9a28ab tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1479 microversion: 2.1 time: 0.471478 Jul 25 20:35:50.610799 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2449/4932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:50 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1479 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:51.052480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:51.067319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2a3518e-aa85-4cb0-8437-60caa63d8758 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 0.837953 Jul 25 20:35:51.074837 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2484/4933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:50 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:51.255231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:51.255896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:51.273992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:51.275218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:51.276219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:51.276827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:51.640271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:51.641499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:51.647923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:51.648619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:51.649667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:51.650265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:52.153621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:52.164580 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-be9d0062-af3a-44b5-b1c9-b6f2abe45322 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1479 microversion: 2.1 time: 0.530335 Jul 25 20:35:52.177147 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2485/4934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:51 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1479 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:35:52.201592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-03290df1-4a6e-40bd-a0de-858db6fbf830 req-e1e405f8-758b-4598-a17b-98b45d3f814e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6398a66-7044-467b-a9af-6c3d4697a74f", "name": "network-vif-plugged", "status": "completed", "tag": "04f47e43-e44a-4605-be0b-e62ad9e22547"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:52.232189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-03290df1-4a6e-40bd-a0de-858db6fbf830 req-e1e405f8-758b-4598-a17b-98b45d3f814e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:52.232647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-03290df1-4a6e-40bd-a0de-858db6fbf830 req-e1e405f8-758b-4598-a17b-98b45d3f814e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:52.249018 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-03290df1-4a6e-40bd-a0de-858db6fbf830 req-e1e405f8-758b-4598-a17b-98b45d3f814e service nova] Creating event network-vif-plugged:04f47e43-e44a-4605-be0b-e62ad9e22547 for instance d6398a66-7044-467b-a9af-6c3d4697a74f on n-h2-845775-3 Jul 25 20:35:52.254566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-03290df1-4a6e-40bd-a0de-858db6fbf830 req-e1e405f8-758b-4598-a17b-98b45d3f814e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075918 Jul 25 20:35:52.255174 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2486/4935] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:35:52.266204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:52.279189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:52.291596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:52.292363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:52.293328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:52.294040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:52.326147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:52.334395 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e1b2e00-1470-4c3b-81fc-0e340d01b18f tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 200 len: 1521 microversion: 2.1 time: 1.083189 Jul 25 20:35:52.334995 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2450/4936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:51 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 1521 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:53.125572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-64094a68-b107-4625-9ce6-8e84975cbca8 req-3d3f5413-8061-43c6-a66a-fa75c1a0716b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bad2a0a-824f-4da0-b620-7ac9446df176", "name": "network-vif-deleted", "tag": "f96e1352-619b-4e2d-aaaa-c744a7d94219"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:53.150351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-64094a68-b107-4625-9ce6-8e84975cbca8 req-3d3f5413-8061-43c6-a66a-fa75c1a0716b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.151116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-64094a68-b107-4625-9ce6-8e84975cbca8 req-3d3f5413-8061-43c6-a66a-fa75c1a0716b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.173827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-64094a68-b107-4625-9ce6-8e84975cbca8 req-3d3f5413-8061-43c6-a66a-fa75c1a0716b service nova] Creating event network-vif-deleted:f96e1352-619b-4e2d-aaaa-c744a7d94219 for instance 9bad2a0a-824f-4da0-b620-7ac9446df176 on n-h1-845775-3 Jul 25 20:35:53.201103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-64094a68-b107-4625-9ce6-8e84975cbca8 req-3d3f5413-8061-43c6-a66a-fa75c1a0716b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078588 Jul 25 20:35:53.217178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2451/4937] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:35:53.229184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:53.229906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:53.246153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.249417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.250458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.251628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.307332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:53.319592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.320276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.322078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lazy-loading 'fault' on Instance uuid 9bad2a0a-824f-4da0-b620-7ac9446df176 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:35:53.341831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b7b8a83-deac-4dc8-a42e-f9e12ac194fd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1318 microversion: 2.1 time: 1.080420 Jul 25 20:35:53.359366 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2487/4938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:52 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:53.368743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:53.380551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:53.392329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.393417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.395960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:53.397459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:53.614285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:53.660549 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3af1397-4d90-4627-9609-0ecf09b77397 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 200 len: 1332 microversion: 2.1 time: 0.437527 Jul 25 20:35:53.666638 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2452/4939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:53 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 1332 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:54.070592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50608c829ae42468feb019b4a56769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35ac9159fa2f466b85363a93900f6c05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:54.093043 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f1fe6528-3bea-41d6-98a9-aa833ed3e410 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 200 len: 1521 microversion: 2.1 time: 0.728537 Jul 25 20:35:54.093969 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2488/4940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:53 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 1521 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:54.288743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d5838152-b872-4612-bc6d-3a49525a93e8 req-ecdbca05-d4ac-4bc4-b581-bd2f7d1dfe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d695ee-9552-47cb-b36b-d9d6d66d3453", "name": "network-vif-unplugged", "status": "completed", "tag": "7dbb1a3b-0b43-4fde-9d54-a470841a0ea8"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:54.330236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d5838152-b872-4612-bc6d-3a49525a93e8 req-ecdbca05-d4ac-4bc4-b581-bd2f7d1dfe38 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:54.331281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d5838152-b872-4612-bc6d-3a49525a93e8 req-ecdbca05-d4ac-4bc4-b581-bd2f7d1dfe38 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:54.368721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d5838152-b872-4612-bc6d-3a49525a93e8 req-ecdbca05-d4ac-4bc4-b581-bd2f7d1dfe38 service nova] Creating event network-vif-unplugged:7dbb1a3b-0b43-4fde-9d54-a470841a0ea8 for instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 on n-h2-845775-3 Jul 25 20:35:54.387663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:54.389074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:54.404924 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d5838152-b872-4612-bc6d-3a49525a93e8 req-ecdbca05-d4ac-4bc4-b581-bd2f7d1dfe38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132974 Jul 25 20:35:54.407779 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2453/4941] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:35:54.440558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:54.444232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:54.445452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:54.452838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:54.700010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:54.706773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: 9bad2a0a-824f-4da0-b620-7ac9446df176] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:54.724890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:54.725346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:54.729426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:54.730776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:54.769524 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] HTTP exception thrown: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Request method failure captured: Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 HTTP/1.1 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v301YTbmMdwQAhMT4LEf3G3Q1i9-LZew2e4zeshk1JN80WmHLOkYnpb4mqdE5deTdF3RsrIwspqiRNDHdMrQJfLNoIoP4Zw8juLuLXtA8U4ibWzUEMfkv6EXmp5tP2V1rSocg6B0iDiw2HGLF53ENVzmOtpB6sJ12O_7MeSdvJYL2A Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 9443339e53024f45b1b33a900e3aff18 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9443339e53024f45b1b33a900e3aff18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9443339e53024f45b1b33a900e3aff18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9443339e53024f45b1b33a900e3aff18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9443339e53024f45b1b33a900e3aff18"}]}] Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 9443339e53024f45b1b33a900e3aff18 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestSecurityGroupsBasicOps-270132949-project Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 04a0a5ec4bf54f7d86827862faa32386 Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestSecurityGroupsBasicOps-270132949-project Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9bad2a0a-824f-4da0-b620-7ac9446df176'} Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:54.773955 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. Jul 25 20:35:54.780311 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:54.782149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Returning 404 to user: Instance 9bad2a0a-824f-4da0-b620-7ac9446df176 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:54.783454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-efa3d6f4-6280-4c45-aab4-6e2d25616271 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176" status: 404 len: 111 microversion: 2.1 time: 0.096665 Jul 25 20:35:54.788769 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2454/4942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:54 2022] GET /compute/v2.1/servers/9bad2a0a-824f-4da0-b620-7ac9446df176 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:35:54.815438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:35:54.825892 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28ea65f1-2150-4f78-b326-ed2bee41c955 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1507 microversion: 2.1 time: 0.447145 Jul 25 20:35:54.840227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2489/4943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:54 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:35:55.133884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:55.134733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:55.142456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:55.143255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:55.144409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:55.144998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:55.162843 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] HTTP exception thrown: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 HTTP/1.1 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0'} Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:55.164758 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. Jul 25 20:35:55.169466 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.169907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 404 to user: Instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:55.170399 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a1560b8e-d150-4b26-a33e-841842c0a3e2 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0" status: 404 len: 111 microversion: 2.1 time: 0.042015 Jul 25 20:35:55.171230 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2455/4944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:55 2022] GET /compute/v2.1/servers/ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:35:55.184015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:35:55.184811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] [instance: 95d695ee-9552-47cb-b36b-d9d6d66d3453] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:35:55.205349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:55.206080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:55.215659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:55.218366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:55.259752 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] HTTP exception thrown: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Request method failure captured: Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 HTTP/1.1 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v50dYFNrsnvdw6CwXdqRBxrQjftMZTcv8gZW8m9SLkZQIMH8At4T782UGulU2zMxaW4qzOoGVkjp8a1tFDPDFwJ66um9eN5uEZClf4zMIBdIJ31SZszY9AHYrnuh51WbqRVnCl5ITtNFbrpadS8A3D0m7xgdMvNTq6rV0h31vLLRNo Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/35ac9159fa2f466b85363a93900f6c05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/35ac9159fa2f466b85363a93900f6c05"}]}] Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 35ac9159fa2f466b85363a93900f6c05 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363166399 Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b50608c829ae42468feb019b4a56769a Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ListServersNegativeTestJSON-1363166399-project Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '95d695ee-9552-47cb-b36b-d9d6d66d3453'} Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:35:55.266634 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. Jul 25 20:35:55.271100 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:35:55.271567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d695ee-9552-47cb-b36b-d9d6d66d3453", "name": "network-vif-deleted", "tag": "7dbb1a3b-0b43-4fde-9d54-a470841a0ea8"}, {"server_uuid": "ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0", "name": "network-vif-deleted", "tag": "d684560d-7a57-45d5-90bd-47a98f230b2d"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:35:55.272569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] Returning 404 to user: Instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:35:55.274008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a7fbadd-1968-4c76-91bc-a0ec95ed5428 tempest-ListServersNegativeTestJSON-1363166399 tempest-ListServersNegativeTestJSON-1363166399-project] 10.222.0.48 "GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453" status: 404 len: 111 microversion: 2.1 time: 0.098837 Jul 25 20:35:55.277289 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2490/4945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:35:55 2022] GET /compute/v2.1/servers/95d695ee-9552-47cb-b36b-d9d6d66d3453 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:35:55.301661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:35:55.302133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:35:55.352904 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] Creating event network-vif-deleted:7dbb1a3b-0b43-4fde-9d54-a470841a0ea8 for instance 95d695ee-9552-47cb-b36b-d9d6d66d3453 on n-h2-845775-3 Jul 25 20:35:55.353441 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] Creating event network-vif-deleted:d684560d-7a57-45d5-90bd-47a98f230b2d for instance ae8b79d3-d41b-4ae6-92cc-6af33e9af6d0 on n-h1-845775-3 Jul 25 20:35:55.377692 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5791d2a2-9090-47eb-afd9-113d0876cfae req-c6b4abf2-044b-4c22-ae9e-558f47b55a87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114418 Jul 25 20:35:55.378328 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2456/4946] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:07.492070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:07.493743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:07.497625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.499632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.506784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=23 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.508908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.530492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:07.530492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:07.540469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:07.541499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:07.756841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'services' on Instance uuid 9212921a-ba59-4504-9f8f-e7dd447a5b2f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:36:07.926036 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb4e0c59-9b0c-4ced-8b80-1102e4483d50 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments/a217c3d5-37d3-44a6-8951-358530c58e01" status: 202 len: 0 microversion: 2.1 time: 0.435141 Jul 25 20:36:07.940340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2491/4947] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:36:07 2022] DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments/a217c3d5-37d3-44a6-8951-358530c58e01 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:36:07.948909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.950505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.951377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:07.959819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:07.970219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:08.005843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:08.006329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:08.007488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:08.008162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:08.120430 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-631d01a5-d8de-43ef-aecc-b78c5c8acbdd tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174682 Jul 25 20:36:08.128666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2457/4948] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:07 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:09.141523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:09.144800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:09.161850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:09.166564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:09.171165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:09.171852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:09.259601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f6600d53-0d58-4b2a-b05e-5d5052c7aa58 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122701 Jul 25 20:36:09.260238 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2492/4949] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:09 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:10.277330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:10.280949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:10.326220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:10.340976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:10.342350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:10.343415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:10.473660 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6efad9af-8a8d-44bf-8717-c412cde8d815 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203689 Jul 25 20:36:10.485731 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2458/4950] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:10 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:36:11.476006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:11.478217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:11.494196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:11.496911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:11.513124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:11.513801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:11.518515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:11.519011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:11.519721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:11.521705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:11.523622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:11.524215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:11.646600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:36:11.682800 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bf34673-780d-407c-8d85-9e4e877ca13a tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192809 Jul 25 20:36:11.694514 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2459/4951] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:11 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:11.702843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f59da171-5283-4b9b-9360-61cd3a499af2 req-80b30930-2f55-4d09-b477-4d67473aa200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d307024d-da2f-4ac2-aafb-c2e5d34f2d61", "tag": "72f2ba67-3251-409d-beee-64e48211dcb5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:11.759366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f59da171-5283-4b9b-9360-61cd3a499af2 req-80b30930-2f55-4d09-b477-4d67473aa200 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:11.766227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f59da171-5283-4b9b-9360-61cd3a499af2 req-80b30930-2f55-4d09-b477-4d67473aa200 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:11.853957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f59da171-5283-4b9b-9360-61cd3a499af2 req-80b30930-2f55-4d09-b477-4d67473aa200 service nova] Creating event network-changed:72f2ba67-3251-409d-beee-64e48211dcb5 for instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 on n-h2-845775-3 Jul 25 20:36:11.884855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f59da171-5283-4b9b-9360-61cd3a499af2 req-80b30930-2f55-4d09-b477-4d67473aa200 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188027 Jul 25 20:36:11.897130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2460/4952] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:12.031788 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14fe2580-d12d-418a-b936-32b6db6cbcd9 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 204 len: 0 microversion: 2.1 time: 0.563374 Jul 25 20:36:12.044135 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2493/4953] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:36:11 2022] DELETE /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:36:12.054724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:12.055496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:12.074828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:12.075339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:12.076598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:12.077356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:12.698420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:12.702713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:12.730650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:12.731522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:12.739413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:12.740676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:12.810907 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0a53c3f-cdca-4cc7-bb65-66cf37750d9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117790 Jul 25 20:36:12.811948 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2494/4954] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:12 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:12.946531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:12.968441 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-effdf974-ed7b-4c7e-82fc-77bd039323dc tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1766 microversion: 2.1 time: 0.916857 Jul 25 20:36:12.990398 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2461/4955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:12 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1766 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:13.824829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:13.827477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:13.863261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:13.863973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:13.866582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:13.868190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:13.968217 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-decdf7e0-8619-4fef-8393-48dbd45c0ea7 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149195 Jul 25 20:36:13.969657 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2495/4956] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:13 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:13.997717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:13.998344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:14.015258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:14.018935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:14.022087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:14.025420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:14.990721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:14.995314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:15.042491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:15.045342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:15.060480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:15.063271 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:15.134319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e61c11fa-4f9a-46bc-952a-5733489ccb1b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154214 Jul 25 20:36:15.139665 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2496/4957] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:14 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:15.385982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:15.421996 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4dbbc0da-913d-44a0-9b19-bfd16129f16b tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1766 microversion: 2.1 time: 1.428063 Jul 25 20:36:15.442697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2462/4958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:13 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1766 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:16.148529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:16.151649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:16.174489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:16.178517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:16.179800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:16.182960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:16.287205 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8099e4cd-be17-48ef-a971-30d2467ce151 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143811 Jul 25 20:36:16.298740 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2497/4959] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:16 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:16.410778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ce997aa3-63cd-4a38-99f2-422c2d3140d7 req-ae8d150d-0f26-43c3-9d37-e34f66324439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d307024d-da2f-4ac2-aafb-c2e5d34f2d61", "name": "network-vif-deleted", "tag": "72f2ba67-3251-409d-beee-64e48211dcb5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:16.440287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ce997aa3-63cd-4a38-99f2-422c2d3140d7 req-ae8d150d-0f26-43c3-9d37-e34f66324439 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:16.441762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ce997aa3-63cd-4a38-99f2-422c2d3140d7 req-ae8d150d-0f26-43c3-9d37-e34f66324439 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:16.455983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:16.456692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:16.474861 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ce997aa3-63cd-4a38-99f2-422c2d3140d7 req-ae8d150d-0f26-43c3-9d37-e34f66324439 service nova] Creating event network-vif-deleted:72f2ba67-3251-409d-beee-64e48211dcb5 for instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 on n-h2-845775-3 Jul 25 20:36:16.483667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:16.485968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:16.488008 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ce997aa3-63cd-4a38-99f2-422c2d3140d7 req-ae8d150d-0f26-43c3-9d37-e34f66324439 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082587 Jul 25 20:36:16.494092 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2463/4960] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:36:16.500910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:16.502440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:16.735008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a0a5ec4bf54f7d86827862faa32386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443339e53024f45b1b33a900e3aff18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:16.764367 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7db8c53-935f-49e4-a13c-3a87bc737694 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 200 len: 1379 microversion: 2.1 time: 0.308974 Jul 25 20:36:16.765674 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2498/4961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:16 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 1379 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:17.317356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:17.319775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:17.350672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:17.353011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:17.354659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:17.355981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:17.463475 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55c533cc-7c32-4570-be12-6f266047f5a0 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159930 Jul 25 20:36:17.471495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2464/4962] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:17 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:17.793726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:17.810875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] [instance: d307024d-da2f-4ac2-aafb-c2e5d34f2d61] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:17.816109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:17.824579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:17.825686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:17.826252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:17.876161 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] HTTP exception thrown: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Request method failure captured: Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 HTTP/1.1 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v301YTbmMdwQAhMT4LEf3G3Q1i9-LZew2e4zeshk1JN80WmHLOkYnpb4mqdE5deTdF3RsrIwspqiRNDHdMrQJfLNoIoP4Zw8juLuLXtA8U4ibWzUEMfkv6EXmp5tP2V1rSocg6B0iDiw2HGLF53ENVzmOtpB6sJ12O_7MeSdvJYL2A Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 9443339e53024f45b1b33a900e3aff18 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9443339e53024f45b1b33a900e3aff18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9443339e53024f45b1b33a900e3aff18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9443339e53024f45b1b33a900e3aff18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9443339e53024f45b1b33a900e3aff18"}]}] Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 9443339e53024f45b1b33a900e3aff18 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-270132949 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestSecurityGroupsBasicOps-270132949-project Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 04a0a5ec4bf54f7d86827862faa32386 Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestSecurityGroupsBasicOps-270132949-project Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd307024d-da2f-4ac2-aafb-c2e5d34f2d61'} Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:17.920173 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. Jul 25 20:36:17.926086 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:17.939395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Returning 404 to user: Instance d307024d-da2f-4ac2-aafb-c2e5d34f2d61 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:36:17.946170 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-776d72a7-887a-4baa-9d70-3bd3319444db tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61" status: 404 len: 111 microversion: 2.1 time: 0.156538 Jul 25 20:36:17.949242 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2499/4963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:17 2022] GET /compute/v2.1/servers/d307024d-da2f-4ac2-aafb-c2e5d34f2d61 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:36:18.481034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:18.496154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:18.522796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:18.523256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:18.532930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:18.533453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:18.619217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-558be076-a969-407e-b230-49e5bee50d4f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143703 Jul 25 20:36:18.624179 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2465/4964] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:18 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:19.631435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:19.635483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:19.656879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:19.657868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:19.658985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:19.665310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:19.770532 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b26305d9-26e0-48e8-81d3-3ad2b6d2cb9b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143466 Jul 25 20:36:19.771131 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2500/4965] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:36:19 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:36:19.923871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:19.926354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:19.998610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.000182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.002813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.004786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.168259 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Cannot 'reboot' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action HTTP/1.1 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 28 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: {"reboot": {"type": "HARD"}} Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: exception: Cannot 'reboot' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f903e64d-a941-4ad5-9601-d8186e5f079a', 'body': {'reboot': {'type': 'HARD'}}} Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f903e64d-a941-4ad5-9601-d8186e5f079a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:36:20.170344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.173978 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.176225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 409 to user: Cannot 'reboot' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:36:20.184923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d31ac1d-b15d-44d0-8720-e6ce7a7f0785 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action" status: 409 len: 145 microversion: 2.1 time: 0.271052 Jul 25 20:36:20.186223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2466/4966] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:36:19 2022] POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action => generated 145 bytes in 273 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:36:20.195705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:20.199651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:20.216761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.218168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.227798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.232985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.341783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Cannot 'rebuild' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action HTTP/1.1 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 65 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: exception: Cannot 'rebuild' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f903e64d-a941-4ad5-9601-d8186e5f079a', 'body': {'rebuild': {'imageRef': '152afe05-2c67-43aa-ad3c-bacbf2d878ba'}}} Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f903e64d-a941-4ad5-9601-d8186e5f079a in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:36:20.348762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued Jul 25 20:36:20.353103 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:20.359362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 409 to user: Cannot 'rebuild' instance f903e64d-a941-4ad5-9601-d8186e5f079a while it is in vm_state rescued {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:36:20.363069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99c7f5db-4f67-4daa-b838-b81946c7532e tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action" status: 409 len: 146 microversion: 2.1 time: 0.171698 Jul 25 20:36:20.366067 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2501/4967] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:36:20 2022] POST /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a/action => generated 146 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 20:36:20.376572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:20.377325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:20.389215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.404946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.420356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.421977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.561139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:36:20.918318 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e4e05f9d-5de3-47b1-8af2-ab37b5278e2b tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 204 len: 0 microversion: 2.1 time: 0.546317 Jul 25 20:36:20.927497 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2467/4968] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:36:20 2022] DELETE /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:36:20.936023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:20.937700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:20.958446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.961384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:20.964061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:20.972875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:21.851508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:21.852575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:21.871366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:21.873839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:21.886039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:21.894726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:21.979255 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53787ad8-4d78-4135-989c-9150ffe3f6a4 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/ips" status: 200 len: 146 microversion: 2.1 time: 0.139932 Jul 25 20:36:21.986744 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2468/4969] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:36:21 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/ips => generated 146 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:22.027624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:22.046166 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91d91169-37ba-42ef-9cd0-58e852942949 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1689 microversion: 2.1 time: 1.113916 Jul 25 20:36:22.059132 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2502/4970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:20 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1689 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:23.118643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:23.119450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:23.141999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:23.142466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:23.143277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:23.143732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:23.422339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:23.431438 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a7572d8c-7c68-4481-a20d-4857d0166cd1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1689 microversion: 2.1 time: 0.351539 Jul 25 20:36:23.432408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2469/4971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:23 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1689 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:23.871726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7e734ee-4a05-46e7-9408-a39e6813baca tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: .version_select at 0x7f19682d0d30>, body: {"keypair": {"name": "tempest-keypair-964714302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2jrIqFDm/gYTFMEKccO+Bh4H7mQ5WuZRx1CSB+Ilfqv/DrSEYsqKEPPaMqvtrfoYIaRtFfu7isdDs/oKNnkiUKxY3jOrPnLUHalmzNrFdxkk6+5ysmAkX75ZncUsagQg=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:23.950053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a7e734ee-4a05-46e7-9408-a39e6813baca tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for project 6a62d212782a413a9b3be1e165ebe057. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:36:23.981057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a7e734ee-4a05-46e7-9408-a39e6813baca tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for user 759ea03abd9848b8b0b5af5d3ea4c40d and project 6a62d212782a413a9b3be1e165ebe057. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:36:24.084679 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7e734ee-4a05-46e7-9408-a39e6813baca tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.516251 Jul 25 20:36:24.094865 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2503/4972] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:36:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 518 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:36:24.463760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:24.465348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:24.491907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:24.493200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:24.496549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:24.498319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:26.015386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:26.031586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e5aa110d-66e4-4818-b678-b9ca11bb67b4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1689 microversion: 2.1 time: 1.573069 Jul 25 20:36:26.052735 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2470/4973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:24 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1689 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:36:26.837004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06125fe5-2ac3-4324-b28b-c1be9afd1832"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:26.839413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:26.854348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:26.855708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:26.859932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:26.862496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:27.063325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:27.064601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:27.086535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:27.087334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:27.088506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:27.090792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:27.512906 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c53ce00-96e9-4f47-9ad2-6566b45774b7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674918 Jul 25 20:36:27.514483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2504/4974] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:36:26 2022] POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:36:29.362210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:29.379649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dabf62eb-cb82-4484-952f-70658b1055f4 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1689 microversion: 2.1 time: 2.318619 Jul 25 20:36:29.384212 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2471/4975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:27 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1689 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:30.448656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:30.449371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:30.516406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:30.539593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:30.544204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:30.544541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:31.076635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:31.091439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:31.099597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c31bfa7a-6bb1-4e73-ab39-26c05a90414f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1621 microversion: 2.1 time: 0.695900 Jul 25 20:36:31.103072 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2505/4976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:30 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1621 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:31.907815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6acb17c2-3183-4f0e-a457-784c2087e4c6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] Calling method '.version_select at 0x7f1969b641f0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:31.979500 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6acb17c2-3183-4f0e-a457-784c2087e4c6 tempest-TestSecurityGroupsBasicOps-270132949 tempest-TestSecurityGroupsBasicOps-270132949-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1879585683" status: 202 len: 0 microversion: 2.1 time: 0.076520 Jul 25 20:36:31.980483 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2472/4977] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Jul 25 20:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1879585683 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:36:32.126871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:32.129112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:32.169287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:32.172853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:32.178123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:32.180343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:32.605140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:32.650659 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b1ce33d-f966-4a51-b668-4a4c23bf23dc tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1621 microversion: 2.1 time: 0.532583 Jul 25 20:36:32.657745 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2506/4978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:32 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1621 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:33.065142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6f81d4ea-de1a-41fb-b8b0-5aef62bf1d76 req-8eabf0ef-c2a3-4c35-9f92-1cc6c69e3be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9212921a-ba59-4504-9f8f-e7dd447a5b2f", "name": "network-vif-deleted", "tag": "348c3f92-71da-47f4-95f0-dd0664c96bff"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:33.119529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6f81d4ea-de1a-41fb-b8b0-5aef62bf1d76 req-8eabf0ef-c2a3-4c35-9f92-1cc6c69e3be1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:33.119995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6f81d4ea-de1a-41fb-b8b0-5aef62bf1d76 req-8eabf0ef-c2a3-4c35-9f92-1cc6c69e3be1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:33.168810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6f81d4ea-de1a-41fb-b8b0-5aef62bf1d76 req-8eabf0ef-c2a3-4c35-9f92-1cc6c69e3be1 service nova] Creating event network-vif-deleted:348c3f92-71da-47f4-95f0-dd0664c96bff for instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f on n-h1-845775-3 Jul 25 20:36:33.188505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6f81d4ea-de1a-41fb-b8b0-5aef62bf1d76 req-8eabf0ef-c2a3-4c35-9f92-1cc6c69e3be1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134241 Jul 25 20:36:33.197737 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2473/4979] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:36:33.677168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:33.679818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:33.722540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:33.725755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:33.732160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:33.732650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:33.916623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:33.917001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:33.917470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lazy-loading 'fault' on Instance uuid 9212921a-ba59-4504-9f8f-e7dd447a5b2f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:36:34.020708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:34.036796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:34.047354 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8fe86b2-a693-4176-afea-c66331472d67 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 200 len: 1336 microversion: 2.1 time: 0.375191 Jul 25 20:36:34.058659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2507/4980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:33 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 1336 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:34.110516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-19245082", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b69bb5-f064-48af-9903-5eea90e5ead2"}], "security_groups": [{"name": "tempest-securitygroup--1582813860"}], "key_name": "tempest-keypair-964714302", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:34.441514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "273a672d-7120-4c07-9c31-76118cd3cc7b", "device": "/dev/sdb"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:34.448833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:34.455848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:34.456403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:34.459445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:34.460204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:34.532707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] validate_networks() for [('20b69bb5-f064-48af-9903-5eea90e5ead2', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:36:35.110014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c29bfc9c-ff6c-4193-90c6-90f0f738b9c0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "POST /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674762 Jul 25 20:36:35.115456 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2508/4981] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:36:34 2022] POST /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:36:35.123999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:35.125094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 9212921a-ba59-4504-9f8f-e7dd447a5b2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:35.142930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:35.143667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:35.144862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:35.145537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:35.167968 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f HTTP/1.1 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '9212921a-ba59-4504-9f8f-e7dd447a5b2f'} Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:35.170189 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. Jul 25 20:36:35.175915 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:36:35.180482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 404 to user: Instance 9212921a-ba59-4504-9f8f-e7dd447a5b2f could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:36:35.181817 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cedc3cce-844f-4100-b083-e31ec428b5a1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f" status: 404 len: 111 microversion: 2.1 time: 0.064635 Jul 25 20:36:35.183318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2509/4982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:35 2022] GET /compute/v2.1/servers/9212921a-ba59-4504-9f8f-e7dd447a5b2f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:36:35.194382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b26ef3b1-420a-4a0b-be34-c198dcd27c36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '.version_select at 0x7f19682c7e50>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:35.275897 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b26ef3b1-420a-4a0b-be34-c198dcd27c36 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304296872" status: 202 len: 0 microversion: 2.1 time: 0.087320 Jul 25 20:36:35.280500 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2510/4983] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:36:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304296872 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:36:37.691686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:36:37.692238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:36:37.692699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:36:37.693876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:36:37.694472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:36:37.715012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:37.719418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:37.720436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:37.720894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:37.771070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for project 6a62d212782a413a9b3be1e165ebe057. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:36:37.780581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for user 759ea03abd9848b8b0b5af5d3ea4c40d and project 6a62d212782a413a9b3be1e165ebe057. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:36:37.802573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:36:37.805427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:36:37.896818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7b36eb3-b584-42b5-bfae-9f9c71d6e723 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.791410 Jul 25 20:36:37.906072 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2474/4984] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:36:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 3802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 20:36:37.909275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:37.910988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:37.950169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:38.137480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:38.147857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:38.153183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:38.154360 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-850ce18b-b6b1-4d00-91c4-fb0c8ae62bcd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1279 microversion: 2.20 time: 0.249011 Jul 25 20:36:38.159533 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2511/4985] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:37 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:39.191029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:39.191656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:39.213509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:39.215429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:39.219628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:39.221419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:39.226534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:39.248914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:39.358247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:39.378126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:39.380025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:39.381330 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0125a757-cf0a-4107-80d8-68565fa0f4de tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1275 microversion: 2.20 time: 0.203536 Jul 25 20:36:39.399050 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2475/4986] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:39 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:40.407797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:40.410718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:40.425071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:40.427213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:40.428346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:40.432914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:40.730151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:40.742865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:40.748754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:40.749982 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-328c0c4e-40bd-426c-959f-00496323b945 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1337 microversion: 2.20 time: 0.348474 Jul 25 20:36:40.753418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2512/4987] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:40 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1337 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:41.781421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:41.782812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:41.796361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:41.798256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:41.799178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:41.799725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:41.935289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:41.945516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:41.947225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:41.948663 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60826c22-1a12-4af7-9b8a-ffa3683e56c9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1337 microversion: 2.20 time: 0.176515 Jul 25 20:36:41.949395 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2476/4988] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:41 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:42.975710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:42.976406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:42.991445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:42.992591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:42.993458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:42.995950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:43.435807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:43.454056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:43.455669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:43.457066 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d8d1384b-21b6-426b-8b91-dd722ad81246 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.485844 Jul 25 20:36:43.457679 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2513/4989] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:42 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:44.479342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:44.480622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:44.498714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:44.499191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:44.499985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:44.542043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:44.646124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-08e89d66-9c35-42cb-8959-a179f8c5aa98 req-5de7a337-e792-467f-a91c-ebf2babcd8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:44.683405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08e89d66-9c35-42cb-8959-a179f8c5aa98 req-5de7a337-e792-467f-a91c-ebf2babcd8f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:44.683866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08e89d66-9c35-42cb-8959-a179f8c5aa98 req-5de7a337-e792-467f-a91c-ebf2babcd8f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:44.711852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-08e89d66-9c35-42cb-8959-a179f8c5aa98 req-5de7a337-e792-467f-a91c-ebf2babcd8f2 service nova] Creating event network-changed:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h1-845775-3 Jul 25 20:36:44.735591 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-08e89d66-9c35-42cb-8959-a179f8c5aa98 req-5de7a337-e792-467f-a91c-ebf2babcd8f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096065 Jul 25 20:36:44.737805 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2514/4990] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:36:45.245677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:45.266397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:45.268735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:45.270571 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c47b9e61-4c0f-4e67-a0a9-019b09f9d0ce tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.795187 Jul 25 20:36:45.272602 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2477/4991] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:44 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:46.299249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:46.299994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:46.318111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:46.318961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:46.322556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:46.323237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:47.976817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:47.996582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:48.001690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:48.005627 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b25366ab-e3fa-47b5-bc77-b71230242f86 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 1.711543 Jul 25 20:36:48.019520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2515/4992] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:46 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:49.047605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:49.049534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:49.056903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:49.057767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:49.059807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:49.060767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:49.063388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:49.064545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:49.506926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:49.521615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:49.525937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:49.537460 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc245088-3681-4bd9-b8fe-d383b64a4961 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.498209 Jul 25 20:36:49.557301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2478/4993] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:49 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:49.709229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:50.074687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-727749239", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "8bcec6ff-cef0-4f1c-9ce5-b171de139ea5"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:50.432808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e802e92b-13a5-46ee-b49f-02426f340fd1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:50.455505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e802e92b-13a5-46ee-b49f-02426f340fd1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:50.459506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e802e92b-13a5-46ee-b49f-02426f340fd1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:50.549653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e802e92b-13a5-46ee-b49f-02426f340fd1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Going to try to stop instance {{(pid=119723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:36:50.620070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] validate_networks() for [('8bcec6ff-cef0-4f1c-9ce5-b171de139ea5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:36:50.699332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e802e92b-13a5-46ee-b49f-02426f340fd1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action" status: 202 len: 0 microversion: 2.1 time: 0.273155 Jul 25 20:36:50.699967 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2479/4994] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:36:50 2022] POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:36:50.721375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:50.726106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:50.742414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:50.747353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:50.748425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:50.749065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:51.134947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:51.152983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:51.154547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:51.155727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-382653f2-0044-4cdb-85fe-93be52c794b0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.453531 Jul 25 20:36:51.156347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2480/4995] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:50 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:51.171505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:51.172462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:51.181556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:51.193088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:51.194220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:51.195865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:51.823103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:51.832011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-797cbe9b-6d51-4e27-9b14-39ca42814fe3 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.674388 Jul 25 20:36:51.836253 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2481/4996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:51 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:51.953737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:36:51.954278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:36:51.954835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:36:51.955309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:36:51.955736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:36:51.979029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:51.979807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:51.981486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:51.982917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:52.014867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Getting quotas for project ea02e9b619494952898cfec39b375707. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:36:52.022161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Getting quotas for user 8458865e0dcb4b77a57590c160e877c2 and project ea02e9b619494952898cfec39b375707. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:36:52.040291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:36:52.043549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:36:52.104590 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73b6fb09-56c0-4fac-aa11-bf8d04d0a276 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.395896 Jul 25 20:36:52.105772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2516/4997] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:36:52.121416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc0d2b4f-6907-4241-90da-5dd61ec4735b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:52.123545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc0d2b4f-6907-4241-90da-5dd61ec4735b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:52.187030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:52.188329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:52.206380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:52.208110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:52.215445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc0d2b4f-6907-4241-90da-5dd61ec4735b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:52.232862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:52.235298 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc0d2b4f-6907-4241-90da-5dd61ec4735b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1214 microversion: 2.1 time: 0.122550 Jul 25 20:36:52.237908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:52.244526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2482/4998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:52 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:36:52.450577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:52.460472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:52.464738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:52.466727 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-90673d95-6072-48f3-8bef-417a6ff13d43 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.284371 Jul 25 20:36:52.476742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2517/4999] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:52 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:52.864507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:52.865962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:52.885256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:52.888643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:52.890911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:52.892753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:53.268475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:53.269099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:53.296318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:53.296878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:53.312981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:53.317323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:53.650193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:53.670910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f23b3f0c-1a99-49f6-9f14-947aa1fc55f8 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1210 microversion: 2.1 time: 0.395827 Jul 25 20:36:53.671945 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2518/5000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:53 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1210 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:36:53.695556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:53.697326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:53.717748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:53.718556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:53.719583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:53.720225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:53.900789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:53.914935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e04478a-b651-47c6-bdc1-ee5f0277b5e2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 1.052840 Jul 25 20:36:53.915581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2483/5001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:52 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:54.693724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:54.694457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:54.715341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:54.715905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:54.725200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:54.732589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:54.795429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:54.811072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:54.815764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:54.817400 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-955ebe90-5a5d-4fb5-a7f9-76f95636c1c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 1.137620 Jul 25 20:36:54.819586 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2519/5002] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:53 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:54.942312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:54.943889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:54.970004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:54.970696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:54.972645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:54.974286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:55.161025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:55.172622 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6602d6a-3f34-4334-bb62-e6e232185faf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1272 microversion: 2.1 time: 0.482961 Jul 25 20:36:55.196743 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2484/5003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:54 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:36:55.495634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:55.515408 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d67b4e43-4cd5-427d-b5bb-e2fdaef06ee6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.576898 Jul 25 20:36:55.525391 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2520/5004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:54 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:55.842960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:55.843578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:55.864641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:55.865111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:55.865935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:55.866454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.096367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-08a65ea6-42ae-49b8-b554-574b71cab7ed req-ee190ca6-9d47-4657-b832-16e8031b0e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "name": "network-vif-plugged", "status": "completed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:36:56.127332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08a65ea6-42ae-49b8-b554-574b71cab7ed req-ee190ca6-9d47-4657-b832-16e8031b0e47 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:56.131493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-08a65ea6-42ae-49b8-b554-574b71cab7ed req-ee190ca6-9d47-4657-b832-16e8031b0e47 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.170925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-08a65ea6-42ae-49b8-b554-574b71cab7ed req-ee190ca6-9d47-4657-b832-16e8031b0e47 service nova] Creating event network-vif-plugged:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h1-845775-3 Jul 25 20:36:56.222013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-08a65ea6-42ae-49b8-b554-574b71cab7ed req-ee190ca6-9d47-4657-b832-16e8031b0e47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129705 Jul 25 20:36:56.233521 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2521/5005] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:36:56.241423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:56.250682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:56.265644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:56.275535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:56.287792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:56.288183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:56.289701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.291291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a360bdf3-1fbf-4d3c-ac32-7a9624a41b90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 0.452282 Jul 25 20:36:56.293370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:56.293846 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2485/5006] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:55 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:56.294532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.518156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:56.533136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-659c53c1-ea4b-4ce5-a19b-f4aabcd28369 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1272 microversion: 2.1 time: 0.297936 Jul 25 20:36:56.548135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:56.548892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:56.552010 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2522/5007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:56 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:56.565865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:56.568396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.569475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:56.571520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:56.881962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:56.899961 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b85e1cb-1316-46e1-a3a9-88c474661231 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.359664 Jul 25 20:36:56.901445 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2486/5008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:56 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:57.313974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:57.314602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:57.346709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:57.347171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:57.347973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:57.348456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:57.560208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:57.561272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:57.582763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:57.583245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:57.592656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:57.620651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:58.289497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:58.308698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:58.316809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:58.318025 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a68e6a3c-87e8-435a-ab67-7d73c7ebef0f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1405 microversion: 2.20 time: 1.008016 Jul 25 20:36:58.319124 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2523/5009] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:57 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1405 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:36:58.348526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:58.349162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:58.366367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:58.368921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:58.370819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:58.372873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.163138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:59.176747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e6c22d3-ba23-4cf7-bf9a-3310b92f7c77 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 1.620378 Jul 25 20:36:59.177368 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2487/5010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:57 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:36:59.281795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:36:59.295008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8588570-a53b-42fe-bb45-29415afb2b8e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.974803 Jul 25 20:36:59.301114 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2524/5011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:58 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:36:59.343460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:59.344766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:59.366467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.371177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.372424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.373117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.522413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:59.525518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:59.547135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.547708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.548634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.549082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.647006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:36:59.654064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:36:59.838148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3e8dfc99-a46d-45c3-bd3f-e190434c95c1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 204 len: 0 microversion: 2.1 time: 0.321671 Jul 25 20:36:59.842286 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2525/5012] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:36:59 2022] DELETE /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:36:59.856197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:36:59.857150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:36:59.870047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.875562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:36:59.878187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:36:59.880197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.354364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:00.371057 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6744b31b-4a2d-4cd3-9c8f-002b66d56458 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1507 microversion: 2.1 time: 0.527097 Jul 25 20:37:00.371846 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2526/5013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:36:59 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:00.392549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:00.398680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:00.419888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:00.420603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.424835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:00.425315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.450302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:00.476537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:00.481545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:00.485919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e10fb6b-4e30-490b-8f0a-5edb6d9f199e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1597 microversion: 2.20 time: 1.146421 Jul 25 20:37:00.511077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2488/5014] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:36:59 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1597 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:00.535907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:00.541606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:00.570072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:00.576841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.584881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:00.585350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.823731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:00.840064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68dc49b8-c58a-47f0-a7a8-39079e58424c tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 0.450812 Jul 25 20:37:00.841519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2527/5015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:00 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:00.858085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-26c18161-8a5a-4dd3-bd3a-6961bbd023f6 req-f09c2093-7a44-4b35-83ed-30fe2b54e356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4313f66e-9fb3-4d60-947e-3d26039f3446", "tag": "b1fc2a55-7ff4-4776-8875-c31ba5af67c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:00.902192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-26c18161-8a5a-4dd3-bd3a-6961bbd023f6 req-f09c2093-7a44-4b35-83ed-30fe2b54e356 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:00.904895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-26c18161-8a5a-4dd3-bd3a-6961bbd023f6 req-f09c2093-7a44-4b35-83ed-30fe2b54e356 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:00.965950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-26c18161-8a5a-4dd3-bd3a-6961bbd023f6 req-f09c2093-7a44-4b35-83ed-30fe2b54e356 service nova] Creating event network-changed:b1fc2a55-7ff4-4776-8875-c31ba5af67c9 for instance 4313f66e-9fb3-4d60-947e-3d26039f3446 on n-h2-845775-3 Jul 25 20:37:01.004024 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-26c18161-8a5a-4dd3-bd3a-6961bbd023f6 req-f09c2093-7a44-4b35-83ed-30fe2b54e356 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158169 Jul 25 20:37:01.015899 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2528/5016] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:01.023002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:01.024057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:01.038157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:01.041330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:01.042470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:01.043247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:01.537752 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a697480-59fb-42aa-a83a-7192a53a3990 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.519900 Jul 25 20:37:01.538481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2529/5017] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:37:01 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-interface => generated 285 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:37:01.545293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:01.559981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:01.580525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:01.585386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:01.589418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:01.592596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:01.996700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:02.035577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:02.220530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:02.847301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:02.863095 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f919bd0e-537e-4a99-957c-d85d354ea081 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 2.349988 Jul 25 20:37:02.870626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2489/5018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:00 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:02.912052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:02.913630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:02.935049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:02.935832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:02.937515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:02.939891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:03.047113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:03.059910 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8dd504d-9676-43be-a417-f76c8745d681 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1507 microversion: 2.1 time: 1.519322 Jul 25 20:37:03.082635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2530/5019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:01 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1507 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:03.809749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:03.822351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aec0062c-a83e-45f3-be52-3abfd7cbd794 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 0.949973 Jul 25 20:37:03.837271 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2490/5020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:02 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:03.895063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:03.896212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:03.914505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:03.915238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:03.916224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:03.916949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:04.089689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:04.089994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:04.097266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:04.098017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:04.098979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:04.099582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:05.074520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:05.094629 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f341bd15-2dd8-4901-8cf6-9490784e7f17 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 1.203569 Jul 25 20:37:05.097195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2531/5021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:03 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:05.103419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:05.104387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:05.116405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:05.118083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:05.119019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:05.119749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:05.124812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:05.131585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:05.139778 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00a1ba7d-c4f6-414e-a7ac-69bc1f41dd1c tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1507 microversion: 2.1 time: 1.053881 Jul 25 20:37:05.142519 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2491/5022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:04 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1507 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:05.935960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:05.945991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6859cf6-1f12-4174-a3f7-f76222b562bf tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 0.846057 Jul 25 20:37:05.947498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2532/5023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:05 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:06.120738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:06.121357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:06.141121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.142101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.142514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.142868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.163274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:06.164739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:06.175486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.179021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.179981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.182817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.614184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:06.662358 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-08e15a97-a035-4293-8e8e-117b61fe2827 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 200 len: 1465 microversion: 2.1 time: 0.501619 Jul 25 20:37:06.667572 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2533/5024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:06 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 1465 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:06.728149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3c979afa-df46-4518-aa6a-1901c65b01c3 req-9831a820-ce16-4d37-8326-ca1e835953de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903e64d-a941-4ad5-9601-d8186e5f079a", "name": "network-vif-deleted", "tag": "2850f457-796e-4cbd-87a8-6c803ae6c7e0"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:06.789565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3c979afa-df46-4518-aa6a-1901c65b01c3 req-9831a820-ce16-4d37-8326-ca1e835953de service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.790095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3c979afa-df46-4518-aa6a-1901c65b01c3 req-9831a820-ce16-4d37-8326-ca1e835953de service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.825967 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3c979afa-df46-4518-aa6a-1901c65b01c3 req-9831a820-ce16-4d37-8326-ca1e835953de service nova] Creating event network-vif-deleted:2850f457-796e-4cbd-87a8-6c803ae6c7e0 for instance f903e64d-a941-4ad5-9601-d8186e5f079a on n-h2-845775-3 Jul 25 20:37:06.832847 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3c979afa-df46-4518-aa6a-1901c65b01c3 req-9831a820-ce16-4d37-8326-ca1e835953de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123706 Jul 25 20:37:06.834044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2534/5025] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:06.967598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:06.968264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:06.983906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.984404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:06.985203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:06.985652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:07.374135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:07.382656 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0e7cd554-7400-4973-a5b7-b51bf2a5e2ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 1.265733 Jul 25 20:37:07.388125 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2492/5026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:06 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:07.697326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:07.698168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: f903e64d-a941-4ad5-9601-d8186e5f079a] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:07.720194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:07.721620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:07.724191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:07.724826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:07.789313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a HTTP/1.1 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f903e64d-a941-4ad5-9601-d8186e5f079a'} Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:07.791187 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 404 to user: Instance f903e64d-a941-4ad5-9601-d8186e5f079a could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9c5e8a1-85a6-47ca-850d-ffd0a1e1ad38 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a" status: 404 len: 111 microversion: 2.1 time: 0.100075 Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2493/5027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:07 2022] GET /compute/v2.1/servers/f903e64d-a941-4ad5-9601-d8186e5f079a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:37:07.811688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:07.816675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:07.836478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:07.837042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:07.837876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:07.838324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:07.909537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:37:07.988503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:08.001713 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-784b331c-b046-44e1-9869-04755f22f1f0 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 1.037736 Jul 25 20:37:08.004140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2535/5028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:06 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:08.161440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c14621d-fe8f-4b9f-897a-ad1b9a86e90f tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 204 len: 0 microversion: 2.1 time: 0.354732 Jul 25 20:37:08.166295 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2494/5029] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:37:07 2022] DELETE /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:37:08.174428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:08.175064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:08.178204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:08.184962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:08.185761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:08.198544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:08.198544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:08.409539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:08.410256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:08.430802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:08.431265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:08.435898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:08.436786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:08.699053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:08.716956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0264b83f-53c4-4e09-94f1-10cccaf1e2f6 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.548761 Jul 25 20:37:08.718140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2536/5030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:08 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:09.030260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:09.033680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:09.068317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:09.069419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:09.080728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:09.081189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:09.282137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:09.300308 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18fd4800-fb27-4f4c-8f7e-e64d31463156 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.896832 Jul 25 20:37:09.302263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2495/5031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:08 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:09.317380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4dbd368a-c170-4358-afef-8fcbdd00d390 req-b6b46e5b-bab8-4953-ba45-1c5052ee398f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:09.333967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:09.350272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4dbd368a-c170-4358-afef-8fcbdd00d390 req-b6b46e5b-bab8-4953-ba45-1c5052ee398f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:09.353117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4dbd368a-c170-4358-afef-8fcbdd00d390 req-b6b46e5b-bab8-4953-ba45-1c5052ee398f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:09.398886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4dbd368a-c170-4358-afef-8fcbdd00d390 req-b6b46e5b-bab8-4953-ba45-1c5052ee398f service nova] Creating event network-changed:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h1-845775-3 Jul 25 20:37:09.434017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4dbd368a-c170-4358-afef-8fcbdd00d390 req-b6b46e5b-bab8-4953-ba45-1c5052ee398f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126373 Jul 25 20:37:09.437641 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2496/5032] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:09.741482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:09.743056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:09.757107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:09.757833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:09.758869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:09.759474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:10.233253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:10.262890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-110467c6-858a-4205-a567-11a2d2426860 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 1.237311 Jul 25 20:37:10.268662 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2537/5033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:09 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:10.334631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:10.335776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:10.347241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:10.351768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:10.356374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:10.358399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:10.442234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:10.457999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d917ab64-496d-4a53-85d5-fd094ae89ae9 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 0.716083 Jul 25 20:37:10.459149 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2497/5034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:09 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:10.788302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:10.818884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99674c0b-200f-4a8c-8a05-df1e708dd19d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.484545 Jul 25 20:37:10.857304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2538/5035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:10 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:11.292669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:11.293565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:11.315160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:11.316154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:11.317459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:11.318222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:11.487275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:11.488878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:11.514370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:11.517104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:11.525055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:11.525889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:12.849450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:12.887477 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dffe3ca5-e413-4b9b-b509-903bcacfdff4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 1.599469 Jul 25 20:37:12.905353 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2498/5036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:11 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:12.919478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:12.923534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:12.945052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:12.948719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:12.950450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:12.951095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:13.244175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:13.252757 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-af76d11d-877d-4bb4-bf3d-3f24154d0efa tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1520 microversion: 2.1 time: 1.769623 Jul 25 20:37:13.270636 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2539/5037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:11 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1520 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:13.291825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a24962d1-0a17-4ac2-8b0b-647c36cf0328 req-4cf33b64-6657-4b60-8a37-f6c6ce244b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4313f66e-9fb3-4d60-947e-3d26039f3446", "name": "network-vif-plugged", "status": "completed", "tag": "b1fc2a55-7ff4-4776-8875-c31ba5af67c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:13.310914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a24962d1-0a17-4ac2-8b0b-647c36cf0328 req-4cf33b64-6657-4b60-8a37-f6c6ce244b5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:13.314800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a24962d1-0a17-4ac2-8b0b-647c36cf0328 req-4cf33b64-6657-4b60-8a37-f6c6ce244b5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:13.357639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:13.366244 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a24962d1-0a17-4ac2-8b0b-647c36cf0328 req-4cf33b64-6657-4b60-8a37-f6c6ce244b5e service nova] Creating event network-vif-plugged:b1fc2a55-7ff4-4776-8875-c31ba5af67c9 for instance 4313f66e-9fb3-4d60-947e-3d26039f3446 on n-h2-845775-3 Jul 25 20:37:13.379268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df6749e0-06b0-475a-926b-8b2c3091ce35 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.471635 Jul 25 20:37:13.381488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a24962d1-0a17-4ac2-8b0b-647c36cf0328 req-4cf33b64-6657-4b60-8a37-f6c6ce244b5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109443 Jul 25 20:37:13.382549 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2540/5038] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:13.391467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2499/5039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:12 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:13.909578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:13.910439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:13.923377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:13.923765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:13.929982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:13.930730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.186012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a6a5a239-b146-4f1d-af78-b0fbeb2d3e85 req-dae9c8aa-c94f-4f7e-9938-c0a33ae7ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2", "name": "network-vif-deleted", "tag": "c7ef8d44-126b-4591-bc77-1d2f2568ce6e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:14.204277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a6a5a239-b146-4f1d-af78-b0fbeb2d3e85 req-dae9c8aa-c94f-4f7e-9938-c0a33ae7ae3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:14.205131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a6a5a239-b146-4f1d-af78-b0fbeb2d3e85 req-dae9c8aa-c94f-4f7e-9938-c0a33ae7ae3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.245959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a6a5a239-b146-4f1d-af78-b0fbeb2d3e85 req-dae9c8aa-c94f-4f7e-9938-c0a33ae7ae3b service nova] Creating event network-vif-deleted:c7ef8d44-126b-4591-bc77-1d2f2568ce6e for instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 on n-h2-845775-3 Jul 25 20:37:14.262916 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a6a5a239-b146-4f1d-af78-b0fbeb2d3e85 req-dae9c8aa-c94f-4f7e-9938-c0a33ae7ae3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080826 Jul 25 20:37:14.263928 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2500/5040] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:14.281175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:14.282675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:14.296118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:14.296689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.297605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:14.300737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.374201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:14.393200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80237d24-6437-4b36-a1fc-0346131cb12d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1314 microversion: 2.1 time: 0.487984 Jul 25 20:37:14.407975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2541/5041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:13 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:14.424523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:14.425297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:14.446178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:14.446640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.447436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:14.448068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:14.620687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6562bfb1c9db4ee9a53f4f1b987438d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '290f0da5c9e5416da747a013170e2580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:14.643724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5fa66f08-6ec7-4f09-9d9f-380b06627cc1 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 200 len: 1478 microversion: 2.1 time: 0.367096 Jul 25 20:37:14.656066 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2501/5042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:14 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 1478 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:14.955148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:14.962267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:14.970821 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f6cd4ce-56b9-45de-a6b4-56b9b311a357 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.557423 Jul 25 20:37:14.975445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2542/5043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:14 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:15.431188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:15.432857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:15.470683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:15.481239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:15.482104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:15.482554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:15.683770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:15.685539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] [instance: 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:15.701049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:15.701506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:15.702305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:15.702743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:15.743328 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] HTTP exception thrown: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Request method failure captured: Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 HTTP/1.1 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v17JUqStOkxEq_UL5P70y1lU1HsBZwAnY11J02YIjsSJ5C-OHGVie-pkVdsG6doVAKOnNN19YY9aHGpAXNBMKQePhGjRj8L1lbumY8-tWa8q-XuYv8rCyji8j1UvQLoUuCiQodr9pN3O2TbeNrcWwnCHsJkSsziLBdfGPa0zRaLRxQ Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_290f0da5c9e5416da747a013170e2580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/290f0da5c9e5416da747a013170e2580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/290f0da5c9e5416da747a013170e2580"}]}] Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 290f0da5c9e5416da747a013170e2580 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077118398 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 6562bfb1c9db4ee9a53f4f1b987438d1 Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077118398-project Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2'} Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:37:15.749396 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] Returning 404 to user: Instance 95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:37:15.755044 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8387f855-3b71-45a6-9ff7-165a626ac337 tempest-ServerRescueNegativeTestJSON-1077118398 tempest-ServerRescueNegativeTestJSON-1077118398-project] 10.222.0.48 "GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2" status: 404 len: 111 microversion: 2.1 time: 0.074732 Jul 25 20:37:15.758592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2543/5044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:15 2022] GET /compute/v2.1/servers/95a9a8ca-7cd7-4e09-8ff4-dbbe8b3be2b2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:37:16.005914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:16.006539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:16.022140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:16.024989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:16.026000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:16.026314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:16.026448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:16.039341 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-045f3537-ef94-499a-8232-23ed6fa7831d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1502 microversion: 2.1 time: 0.618904 Jul 25 20:37:16.040099 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2502/5045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:15 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1502 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:16.066515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:16.068844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:16.081721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:16.082809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:16.087207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:16.088050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:16.970456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:16.981975 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-27ba37db-fe88-488d-85e2-d7bd28c591fd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1723 microversion: 2.1 time: 0.982234 Jul 25 20:37:16.992161 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2544/5046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:15 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1723 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:17.061951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:17.074171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f18d725-0ee4-4c76-a0ae-8b7b836ca736 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1502 microversion: 2.1 time: 1.012139 Jul 25 20:37:17.084782 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2503/5047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:16 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1502 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:17.107916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:17.108941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:17.118605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:17.119056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:17.120258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:17.120871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:17.151998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lazy-loading 'flavor' on Instance uuid 4313f66e-9fb3-4d60-947e-3d26039f3446 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:17.247765 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a25fa35-360c-4895-9648-973458412efd tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action" status: 202 len: 0 microversion: 2.1 time: 0.145266 Jul 25 20:37:17.262545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:17.263517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:17.266397 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2545/5048] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:37:17 2022] POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:17.287581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:17.298176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:17.299584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:17.300275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:17.817701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:17.833821 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8a8af37d-092c-4487-81e8-74df0ec1a4c1 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1510 microversion: 2.1 time: 0.576787 Jul 25 20:37:17.848980 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2504/5049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:17 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:18.022246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:18.023013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:18.044102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:18.071341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:18.079671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:18.080206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:18.863428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:18.865937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:18.876559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:18.882789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:18.884344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:18.885361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:18.918892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:18.935744 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-abef9296-9083-461f-a7d4-66ec2d27bff6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1700 microversion: 2.1 time: 0.925404 Jul 25 20:37:18.939109 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2546/5050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:18 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1700 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:18.963727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bc9cf85-b8ec-43ae-b126-6a573c25ec01 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:18.979775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc9cf85-b8ec-43ae-b126-6a573c25ec01 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:18.981222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc9cf85-b8ec-43ae-b126-6a573c25ec01 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.081948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bc9cf85-b8ec-43ae-b126-6a573c25ec01 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Going to try to start instance {{(pid=119724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 20:37:19.197028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bc9cf85-b8ec-43ae-b126-6a573c25ec01 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action" status: 202 len: 0 microversion: 2.1 time: 0.237800 Jul 25 20:37:19.201532 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2547/5051] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:37:18 2022] POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:37:19.209055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:19.209769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:19.236286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.236739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.237528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.237966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.514951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:19.524776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d86006e-c618-4291-9a81-326d5bc960fa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1493 microversion: 2.1 time: 0.665824 Jul 25 20:37:19.529503 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2505/5052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:18 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1493 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:19.555816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:19.557055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:19.572564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.573695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.577042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.579754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.804814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51b5d419-4e12-43d9-bff0-2c4da998f69b tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action" status: 202 len: 0 microversion: 2.1 time: 0.252704 Jul 25 20:37:19.806046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2506/5053] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:37:19 2022] POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:19.818058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:19.821921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:19.844883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.859772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:19.862227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:19.863048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:20.013278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:20.029942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0e205c4-82bc-4168-8561-017414951c20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1709 microversion: 2.1 time: 0.826967 Jul 25 20:37:20.031318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2548/5054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:19 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1709 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:20.807031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:20.816983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:20.820930 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-561fc13c-ea03-4629-8305-6adf1d1906d4 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1499 microversion: 2.1 time: 1.008507 Jul 25 20:37:20.835257 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2507/5055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:19 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1499 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:21.055325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:21.056319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:21.080667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:21.081509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:21.084150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:21.084850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:21.816127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:21.832134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-317fadd7-c530-4726-a16d-f70b7bf62dca tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1709 microversion: 2.1 time: 0.783022 Jul 25 20:37:21.844222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:21.844807 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2549/5056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:21 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1709 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:21.846107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:21.862760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:21.865026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:21.868983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:21.871678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:22.643717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:22.653294 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33ecca6a-58a6-4930-9b67-ff7f2e6bf3d7 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1499 microversion: 2.1 time: 0.813969 Jul 25 20:37:22.657590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2508/5057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:21 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1499 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:22.856505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:22.857246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:22.867945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:22.873218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:22.880846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:22.882300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:23.290280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:23.316389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a123480-568e-4b63-83ce-053bf6ddb943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1709 microversion: 2.1 time: 0.465013 Jul 25 20:37:23.319911 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2550/5058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:22 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1709 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:23.700863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:23.701721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:23.719891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:23.724178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:23.726953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:23.727660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.055329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:24.064273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d04b50f4-0bc5-4bcf-8e6b-7ba5c74f9ada tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1502 microversion: 2.1 time: 0.375692 Jul 25 20:37:24.067362 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2509/5059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:23 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:24.102757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:24.104058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:24.121123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.121835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.122882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.123543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.183672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lazy-loading 'flavor' on Instance uuid 4313f66e-9fb3-4d60-947e-3d26039f3446 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:24.355330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:24.355969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:24.385123 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e46bcac7-f1ea-4625-8980-c1063243aefa tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action" status: 202 len: 0 microversion: 2.1 time: 0.296145 Jul 25 20:37:24.388427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.389159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.391730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2551/5060] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:37:24 2022] POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:24.404347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.405094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.408645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:24.409791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:24.433565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.434288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:24.435795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:24.440221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:25.857505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:25.896217 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6aedbb96-b94d-45e7-b8de-740b28129587 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1713 microversion: 2.1 time: 1.546627 Jul 25 20:37:25.909781 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2510/5061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:24 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1713 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:25.923106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:25.923964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:25.931998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:25.932786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:25.933759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:25.934712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:25.993396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:26.010231 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d51c509-67ed-4c85-b083-b0703a7721cc tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1510 microversion: 2.1 time: 1.614111 Jul 25 20:37:26.012007 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2552/5062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:24 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1510 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:26.095846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lazy-loading 'services' on Instance uuid d6398a66-7044-467b-a9af-6c3d4697a74f {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:26.268330 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b684014-4aac-4350-81a4-aacb70dd382f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f/os-volume_attachments/273a672d-7120-4c07-9c31-76118cd3cc7b" status: 202 len: 0 microversion: 2.1 time: 0.340719 Jul 25 20:37:26.275274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2511/5063] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:37:25 2022] DELETE /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f/os-volume_attachments/273a672d-7120-4c07-9c31-76118cd3cc7b => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:27.041155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:27.042863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:27.055008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.056262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:27.057719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.058539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:27.395236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:27.414875 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e652143-365f-4d77-9efb-7a1038e47513 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1493 microversion: 2.1 time: 0.381776 Jul 25 20:37:27.416227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2553/5064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:27 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1493 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:27.441134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:27.441784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:27.470303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.470767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:27.471563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.472010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:27.685219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe54ab66-cc5a-4998-a319-3b6cfb3b751f tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action" status: 202 len: 0 microversion: 2.1 time: 0.249562 Jul 25 20:37:27.686118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2512/5065] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:37:27 2022] POST /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:27.701804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:27.703526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:27.727609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.729797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:27.745137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:27.746540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:28.505031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:28.521419 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92b769a6-d1dd-4b6a-a9ef-f889e879de24 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1499 microversion: 2.1 time: 0.830682 Jul 25 20:37:28.522331 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2554/5066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:27 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1499 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:29.545448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:29.546906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:29.565109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:29.565902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:29.566903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:29.570588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:30.674563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:30.689769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d62fb95-1228-4372-b5da-981a29d4d85d tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1499 microversion: 2.1 time: 1.148897 Jul 25 20:37:30.690410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2513/5067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:29 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1499 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:31.714778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:31.715579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:31.733015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:31.736554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:31.737708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:31.740728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:32.288185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:32.291158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:32.316892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:32.317753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:32.318879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:32.320127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:32.456266 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec9e1357-0928-4107-9728-f68333bf9851 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/ips" status: 200 len: 152 microversion: 2.20 time: 0.180264 Jul 25 20:37:32.469956 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2514/5068] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Jul 25 20:37:32 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/ips => generated 152 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:37:32.485783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:32.498484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:32.508486 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-423161e2-d60a-498b-9cc9-1ac47cbcc832 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1499 microversion: 2.1 time: 0.799772 Jul 25 20:37:32.512954 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2555/5069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:31 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1499 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:33.539376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:33.549953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:33.597248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:33.604714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:33.605621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:33.614511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:34.014692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:34.023969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7668df3e-ae7a-40cb-aa93-ac7986d4b351 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1502 microversion: 2.1 time: 0.491232 Jul 25 20:37:34.024617 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2515/5070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:33 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:34.052347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:34.052948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:34.094948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:34.095193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:34.129977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:34.131423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:34.257260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:37:34.558298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-93382edc-4bb6-4778-84e2-ebc5f4066430 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 204 len: 0 microversion: 2.1 time: 0.509549 Jul 25 20:37:34.558945 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2556/5071] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:37:34 2022] DELETE /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:37:34.568199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:34.568944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:34.583338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:34.588930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:34.593443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:34.596585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:34.997106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:35.006238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f72a66a-e4ea-4927-bbdb-d311b5733043 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1508 microversion: 2.1 time: 0.442661 Jul 25 20:37:35.009193 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2516/5072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:34 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:36.036133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:36.038893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:36.050634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:36.051368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:36.052656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:36.053339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:36.696505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:36.721723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5930f90a-be17-438c-88bf-fd14b9bca642 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1508 microversion: 2.1 time: 0.689222 Jul 25 20:37:36.728426 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2557/5073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:36 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1508 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:37.425569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:37.426303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:37.438012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:37.449296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:37.450152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:37.450773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:37.515812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lazy-loading 'flavor' on Instance uuid b7eb81b8-62b7-4073-90be-cc5afe05a1ed {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:37.754004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:37.754004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:37.801453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:37.811431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:37.820797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:37.827523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:37.960285 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb2b5ae7-9f13-4242-9a03-56bdc2057ce1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/action" status: 202 len: 0 microversion: 2.20 time: 0.538556 Jul 25 20:37:37.971030 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2517/5074] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:37:37 2022] POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:37:38.004158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:38.005335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:38.034387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:38.034988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:38.035843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:38.040728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:38.387234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:38.397030 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8103c8d9-9fe5-41d2-83fb-a447ed53dd14 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1466 microversion: 2.1 time: 0.649044 Jul 25 20:37:38.411925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2558/5075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:37 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1466 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:38.832675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c16b0c6a-529a-4c4f-8268-ec37440e19b0 req-40456cc2-d660-4ff4-b7b8-e173fa3432a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4313f66e-9fb3-4d60-947e-3d26039f3446", "name": "network-vif-deleted", "tag": "b1fc2a55-7ff4-4776-8875-c31ba5af67c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:38.857485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:38.864098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c16b0c6a-529a-4c4f-8268-ec37440e19b0 req-40456cc2-d660-4ff4-b7b8-e173fa3432a4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:38.868624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c16b0c6a-529a-4c4f-8268-ec37440e19b0 req-40456cc2-d660-4ff4-b7b8-e173fa3432a4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:38.887188 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c16b0c6a-529a-4c4f-8268-ec37440e19b0 req-40456cc2-d660-4ff4-b7b8-e173fa3432a4 service nova] Creating event network-vif-deleted:b1fc2a55-7ff4-4776-8875-c31ba5af67c9 for instance 4313f66e-9fb3-4d60-947e-3d26039f3446 on n-h2-845775-3 Jul 25 20:37:38.896699 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c16b0c6a-529a-4c4f-8268-ec37440e19b0 req-40456cc2-d660-4ff4-b7b8-e173fa3432a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069849 Jul 25 20:37:38.898014 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2559/5076] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:37:38.922189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:38.938937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:38.941930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:38.947808 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25ad9fe1-df6e-4c0a-9b91-50f3159145db tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 0.973743 Jul 25 20:37:38.950587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2518/5077] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:37 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:39.077290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:39.094322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:39.115718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.124012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.125778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.126787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.197163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:37:39.420883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:39.421828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:39.436532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.436988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.437776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.438216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.450092 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e5336f59-907a-4e0d-8f6a-8b63b3930cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 204 len: 0 microversion: 2.1 time: 0.384476 Jul 25 20:37:39.457007 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2560/5078] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:37:39 2022] DELETE /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:37:39.478122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:39.479732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:39.495974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.498470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.501667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.502595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.543676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:39.545520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:39.546022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lazy-loading 'fault' on Instance uuid 4313f66e-9fb3-4d60-947e-3d26039f3446 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:39.642450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:39.660321 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22b12b5d-2c53-40ff-a38a-4f930258f0ce tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1304 microversion: 2.1 time: 0.242466 Jul 25 20:37:39.660321 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2519/5079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:39 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:37:39.971727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:39.972382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:39.997000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=50 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:40.009124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:40.010133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:40.011594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:40.012605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:40.121900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:40.160692 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c7f52a0-a2d0-498c-968c-58f3645512c6 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1513 microversion: 2.1 time: 0.698960 Jul 25 20:37:40.161581 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2561/5080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:39 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1513 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:40.456573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:40.460610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:40.472873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:40.475614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:40.477493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d8624b65-cf21-4942-a7af-844a4f945532 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 0.509708 Jul 25 20:37:40.478364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2520/5081] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:39 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:40.691048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:40.692226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:40.714604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:40.715235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:40.716408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:40.716967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:40.757623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:40.761029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:40.762594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lazy-loading 'fault' on Instance uuid 4313f66e-9fb3-4d60-947e-3d26039f3446 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:40.987511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8458865e0dcb4b77a57590c160e877c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea02e9b619494952898cfec39b375707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:41.006291 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd2c59f0-7f02-4db6-8fcd-cf28d0587e39 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 200 len: 1304 microversion: 2.1 time: 0.322301 Jul 25 20:37:41.014712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2562/5082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:40 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 1304 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:41.212637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:41.218794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:41.261979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:41.263291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:41.266755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:41.270010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:41.516893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:41.519571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:41.571201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:41.572106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:41.573335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:41.574543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:42.324620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:42.336021 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d561a4b-af0a-408d-b981-4f69e0809716 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1513 microversion: 2.1 time: 1.152509 Jul 25 20:37:42.338041 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2521/5083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:41 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1513 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:42.355017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:42.355571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] [instance: 4313f66e-9fb3-4d60-947e-3d26039f3446] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:42.364267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:42.364976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:42.366557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:42.367227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:42.386240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] HTTP exception thrown: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Request method failure captured: Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 HTTP/1.1 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v7bTJtXgodl2_htxcz_7UQEmlWtzulp0BpPNkgsKV1KySGpjHXMNeE3heOlnma4aSHbJJTv9aR8QzvX-zcRFqh2a6EFrazz_gyvKxn5aMVpme_j9nEUs65AW6n6Sc8pwjHN_hAZR7zcLqkbFQOjCCnpVpgZGqm9Y9DiALBdXCRHeto Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ea02e9b619494952898cfec39b375707 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestServerAdvancedOps-890976390 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea02e9b619494952898cfec39b375707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea02e9b619494952898cfec39b375707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea02e9b619494952898cfec39b375707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea02e9b619494952898cfec39b375707"}]}] Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestServerAdvancedOps-890976390 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ea02e9b619494952898cfec39b375707 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestServerAdvancedOps-890976390 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestServerAdvancedOps-890976390-project Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8458865e0dcb4b77a57590c160e877c2 Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestServerAdvancedOps-890976390-project Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4313f66e-9fb3-4d60-947e-3d26039f3446'} Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:42.388300 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. Jul 25 20:37:42.393379 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:42.395769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] Returning 404 to user: Instance 4313f66e-9fb3-4d60-947e-3d26039f3446 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:37:42.397016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-36ecd54f-528d-4531-8e5c-7efdee3d0f28 tempest-TestServerAdvancedOps-890976390 tempest-TestServerAdvancedOps-890976390-project] 10.222.0.48 "GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446" status: 404 len: 111 microversion: 2.1 time: 0.058008 Jul 25 20:37:42.397819 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2522/5084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:42 2022] GET /compute/v2.1/servers/4313f66e-9fb3-4d60-947e-3d26039f3446 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:37:42.504118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:42.519017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:42.522214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:42.523753 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70388a2a-e747-41a2-be2a-01eb46202614 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 1.024008 Jul 25 20:37:42.526524 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2563/5085] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:41 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:43.358564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:43.362153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:43.383147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:43.383653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:43.384449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:43.384899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:43.550127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:43.551253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:43.561220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:43.569967 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ce43bf5-40e5-462c-b397-dfdc23b748ea tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 200 len: 1471 microversion: 2.1 time: 0.214795 Jul 25 20:37:43.573765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:43.578282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:43.580001 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2523/5086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:43 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:43.581394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:43.582003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:43.616538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-88532b93-6cb5-4145-b6c4-fb50a4674ca3 req-ea9c9569-2fef-4be3-b80b-1dc3e673b5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6398a66-7044-467b-a9af-6c3d4697a74f", "name": "network-vif-deleted", "tag": "04f47e43-e44a-4605-be0b-e62ad9e22547"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:43.650456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-88532b93-6cb5-4145-b6c4-fb50a4674ca3 req-ea9c9569-2fef-4be3-b80b-1dc3e673b5f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:43.651217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-88532b93-6cb5-4145-b6c4-fb50a4674ca3 req-ea9c9569-2fef-4be3-b80b-1dc3e673b5f1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:43.681017 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-88532b93-6cb5-4145-b6c4-fb50a4674ca3 req-ea9c9569-2fef-4be3-b80b-1dc3e673b5f1 service nova] Creating event network-vif-deleted:04f47e43-e44a-4605-be0b-e62ad9e22547 for instance d6398a66-7044-467b-a9af-6c3d4697a74f on n-h2-845775-3 Jul 25 20:37:43.701725 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-88532b93-6cb5-4145-b6c4-fb50a4674ca3 req-ea9c9569-2fef-4be3-b80b-1dc3e673b5f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117363 Jul 25 20:37:43.704229 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2524/5087] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:37:44.108015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:44.119012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:44.122921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:44.126553 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9b533d2-501f-44a2-bfaf-7fa3b9ee8739 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 0.581086 Jul 25 20:37:44.130106 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2564/5088] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:43 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:44.613696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:44.614420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: d6398a66-7044-467b-a9af-6c3d4697a74f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:44.625530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:44.626150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:44.627064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:44.627771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:44.722011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] HTTP exception thrown: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Request method failure captured: Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f HTTP/1.1 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v4VWToZBUYp7aD67QqUTL-gzDyXMnURwKWaY8VOSpONE8bVzPeEQSilb2EyLCuCILHu_siK4co0lmHsnhBTxGS38qfUI19CADu1cWxyWqRM1rz6sBSZtP_Cb6YBEwfHCpEUTEPxZc1ee4qSEudH9BZx3ih-lK-mC0GZeWCP15C5qFk Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 150ed184096d42e7881b83885d79b351 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/150ed184096d42e7881b83885d79b351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_150ed184096d42e7881b83885d79b351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/150ed184096d42e7881b83885d79b351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/150ed184096d42e7881b83885d79b351"}]}] Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 150ed184096d42e7881b83885d79b351 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesSnapshotTestJSON-603273949-project Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: b1826f88ece04754a6b9a6eada79bbc9 Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesSnapshotTestJSON-603273949-project Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd6398a66-7044-467b-a9af-6c3d4697a74f'} Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:37:44.727441 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Returning 404 to user: Instance d6398a66-7044-467b-a9af-6c3d4697a74f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:37:44.731829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8cac1ae0-8bc3-4dbe-b7a4-2725276b61b7 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f" status: 404 len: 111 microversion: 2.1 time: 0.122745 Jul 25 20:37:44.732603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2525/5089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:44 2022] GET /compute/v2.1/servers/d6398a66-7044-467b-a9af-6c3d4697a74f => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:37:45.165175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:45.166166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:45.181360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:45.200965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:45.202082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:45.202773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:46.251949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:46.273394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:46.280962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:46.284914 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0d27fc5-fb6b-447d-929d-2be3f683502b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 1.124829 Jul 25 20:37:46.288484 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2565/5090] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:45 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:47.314004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:47.316558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:47.340604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:47.346142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:47.351843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:47.352982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:48.733205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:48.744138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:48.747025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:48.753428 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d577dd41-4afa-4cb1-93e7-ea5fff189a78 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 1.439814 Jul 25 20:37:48.764068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2526/5091] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:47 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:49.779662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:49.781364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:49.803265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:49.813824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:49.816087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:49.817446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:50.308357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:50.327216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:50.334430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:50.336716 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c54edfd-8ab2-458c-b80c-98763c71555e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 0.563110 Jul 25 20:37:50.337620 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2566/5092] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:49 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:51.363559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:51.364511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:51.378424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:51.378890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:51.385035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:51.385689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:52.476622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:52.531246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:52.539433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:52.539984 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-160f1ad1-4ba0-45e8-8b26-076fc65f209e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 1.183066 Jul 25 20:37:52.545199 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2527/5093] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:51 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:53.574266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:53.575436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:53.587994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:53.595319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:53.599067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:53.599899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:54.092316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2389547-431c-4b1e-b022-b69ac8773db5 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Action: 'create', calling method: .version_select at 0x7f1969821a60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1013766454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhfvuER2SUuYS8vXKbGOyDHfYL5JFZviuzp1FXFxH7xZoUB6dfYCxTZmaPCe2GIidZ8ijGm9I+oI/fxw3KTFmtfSfhkhqPqDTSTlMrQuetZ3TQirIRXaAVeAHJyDkWYfA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:54.138015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e2389547-431c-4b1e-b022-b69ac8773db5 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Getting quotas for project 6005f86937a94745bdb3f82b325f0dda. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:37:54.157245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e2389547-431c-4b1e-b022-b69ac8773db5 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Getting quotas for user 06b81917a86246818659ef2ef260a8ae and project 6005f86937a94745bdb3f82b325f0dda. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:37:54.232270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2389547-431c-4b1e-b022-b69ac8773db5 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.143737 Jul 25 20:37:54.238025 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2528/5094] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:37:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:37:54.502131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:54.515962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:54.518377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:54.525601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2872b98b-dd07-40ad-900f-8b801fb2a1f9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1743 microversion: 2.20 time: 0.956239 Jul 25 20:37:54.526431 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2567/5095] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:53 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1743 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:55.554749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:55.555384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:55.623252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:55.623406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:55.628801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:55.632875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:56.919975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-668817408", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "3ee17ff1-f128-44c9-8acf-52feb0918d47"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:37:56.933529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:56.945597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:56.958791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:56.963435 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2d311b3f-0cb9-4ecd-bba0-5dc367c6af3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.413513 Jul 25 20:37:56.969098 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2529/5096] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:55 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:37:57.036167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] validate_networks() for [('3ee17ff1-f128-44c9-8acf-52feb0918d47', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:37:57.994091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:57.997015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:58.019595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:58.021250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:58.024445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:58.028746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:58.810401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:58.824184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:58.826123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:58.830069 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d35f5823-bad1-4d89-9bf9-55a732413a33 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.842937 Jul 25 20:37:58.835060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2530/5097] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:57 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:37:58.876806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:37:58.878212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:37:58.878936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:37:58.879566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:37:58.880231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:37:58.896412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:58.901219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:58.905530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:58.906822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:58.957612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Getting quotas for project 150ed184096d42e7881b83885d79b351. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:37:58.971341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Getting quotas for user b1826f88ece04754a6b9a6eada79bbc9 and project 150ed184096d42e7881b83885d79b351. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:37:59.011217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:37:59.017909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:37:59.126294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0de302f1-5541-4a2a-9892-4a40b01a3957 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.208003 Jul 25 20:37:59.128852 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2568/5098] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:37:59.141283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f9328ae-075d-46e1-9613-9905595b3cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:59.143766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f9328ae-075d-46e1-9613-9905595b3cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:59.225997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:59.226965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:59.241711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:59.242513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:59.244024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:59.245585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:59.395846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f9328ae-075d-46e1-9613-9905595b3cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:37:59.415325 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f9328ae-075d-46e1-9613-9905595b3cbc tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1218 microversion: 2.1 time: 0.279165 Jul 25 20:37:59.415952 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2531/5099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:37:59 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:37:59.578882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lazy-loading 'services' on Instance uuid 501074ac-0aa5-4617-9f93-0e1b33fd4d54 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:37:59.615092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:37:59.774898 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ae61ea72-cc51-46e7-9f1a-6c7b9311e651 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments/06125fe5-2ac3-4324-b28b-c1be9afd1832" status: 202 len: 0 microversion: 2.1 time: 0.553792 Jul 25 20:37:59.779048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2569/5100] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:37:59 2022] DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments/06125fe5-2ac3-4324-b28b-c1be9afd1832 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:37:59.855970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:37:59.858459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:37:59.902471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:59.907551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:59.908525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:37:59.920335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:37:59.984650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1311514870", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "76ba9ee0-11ad-4a7e-abce-f1d92e41b50c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1013766454", "security_groups": [{"name": "tempest-secgroup-smoke-1575474089"}], "networks": [{"uuid": "a645b26d-a8c8-406c-8f0e-c69da176ba5d"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:00.474090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] validate_networks() for [('a645b26d-a8c8-406c-8f0e-c69da176ba5d', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:38:00.623368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:00.650011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:00.665262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:00.674572 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ac5a707-9b50-4f79-b253-de4ac8c61468 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.816057 Jul 25 20:38:00.675740 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2532/5101] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:37:59 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:38:00.681991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:00.684268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:00.710081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:00.711004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:00.712021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:00.712742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:00.889021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:00.937287 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87b361a8-b378-41fd-8081-b0fc3885b74b tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1222 microversion: 2.1 time: 0.254563 Jul 25 20:38:00.991518 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2533/5102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:00 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1222 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:01.338298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-15d5c66d-d536-4dac-bcd4-cb65319c75af req-cabc9012-49bb-4367-b70a-625ccc889ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "name": "network-vif-plugged", "status": "completed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:01.415715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-15d5c66d-d536-4dac-bcd4-cb65319c75af req-cabc9012-49bb-4367-b70a-625ccc889ec5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:01.420950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-15d5c66d-d536-4dac-bcd4-cb65319c75af req-cabc9012-49bb-4367-b70a-625ccc889ec5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:01.478397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-15d5c66d-d536-4dac-bcd4-cb65319c75af req-cabc9012-49bb-4367-b70a-625ccc889ec5 service nova] Creating event network-vif-plugged:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h1-845775-3 Jul 25 20:38:01.502347 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-15d5c66d-d536-4dac-bcd4-cb65319c75af req-cabc9012-49bb-4367-b70a-625ccc889ec5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169739 Jul 25 20:38:01.503952 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2534/5103] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:38:01.718979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:01.719859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:01.779229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:01.780623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:01.789952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:01.796141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:03.654766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:03.672969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:03.677419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:03.682145 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a07631ca-6107-4fb9-ab02-379e577a296f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.968282 Jul 25 20:38:03.684884 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2535/5104] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:01 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:03.703855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:03.711159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:03.727559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:03.731462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:03.735846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:03.736471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:03.980392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:03.998904 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7c85d69-3f14-4400-8773-c28b75449641 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1276 microversion: 2.1 time: 0.302699 Jul 25 20:38:04.002756 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2536/5105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:03 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:04.714568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:04.715250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:04.731275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:04.731891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:04.743575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:04.744071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:05.050438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:38:05.051475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:38:05.051475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:38:05.051697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:38:05.052292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:38:05.076791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:05.078433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:05.078433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:05.078889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:05.144454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Getting quotas for project 6005f86937a94745bdb3f82b325f0dda. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:38:05.158027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Getting quotas for user 06b81917a86246818659ef2ef260a8ae and project 6005f86937a94745bdb3f82b325f0dda. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:38:05.417751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:38:05.420692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76ba9ee0-11ad-4a7e-abce-f1d92e41b50c',volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:38:05.579518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:05.589959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:05.617255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:05.629649 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88bdc912-dd1f-4221-bd1e-db86bfe3a0df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.920180 Jul 25 20:38:05.630612 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2537/5106] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:04 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:38:05.662170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:05.672333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:05.706636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:05.708880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:05.730124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:05.732299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:05.909074 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8755ab8f-3648-4234-8f29-92cc2f02620c tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.915889 Jul 25 20:38:05.910167 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2570/5107] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:37:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 5933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:38:05.922846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58475a4c-c38b-473f-bb10-6024527ba5e1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:05.923758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58475a4c-c38b-473f-bb10-6024527ba5e1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:06.290875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:06.302636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-58376b62-8e34-4867-a5f2-fb8eb533fd88 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1276 microversion: 2.1 time: 0.670902 Jul 25 20:38:06.303786 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2538/5108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:05 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1276 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:06.321852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58475a4c-c38b-473f-bb10-6024527ba5e1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:06.332645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58475a4c-c38b-473f-bb10-6024527ba5e1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1099 microversion: 2.1 time: 0.414390 Jul 25 20:38:06.338445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2571/5109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:05 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1099 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:06.659631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:06.669113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:06.697808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:06.702730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:06.703728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:06.716825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:07.327586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:07.328342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:07.365689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:07.372609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:07.379347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:07.380102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:07.912736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:07.922111 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4b6181d-5a16-4b3e-9e04-5873bf265ac1 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1276 microversion: 2.1 time: 0.600549 Jul 25 20:38:07.949009 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2572/5110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:07 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1276 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:07.954361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:07.967401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:07.991411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:07.992856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:07.993685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:08.002754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:08.004794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:08.015837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:08.026252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:08.036337 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-34835800-719a-4d2e-87af-01c8711b7bbc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.381617 Jul 25 20:38:08.038895 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2539/5111] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:06 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:08.425085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:08.461534 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c81ce710-fffd-4558-80a1-81e547bc62fd tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1197 microversion: 2.1 time: 0.510926 Jul 25 20:38:08.471785 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2573/5112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:07 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1197 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:08.955911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:08.956730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:08.978806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:08.982392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:08.983495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:08.987428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:09.067673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:09.069445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:09.086959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:09.091616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:09.102150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:09.105967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:09.407389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:10.918342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:10.927611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:10.930078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:10.931567 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e9af6263-f43a-420d-a4ff-e4404312c1dc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.867914 Jul 25 20:38:10.947884 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2574/5113] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:09 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:10.954688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:10.955879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:10.962662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:10.968890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:10.970227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:10.971666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:10.972846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:11.184383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:11.196530 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3ae992c-2832-4b69-9b3f-a8a25b33183b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1215 microversion: 2.1 time: 0.247013 Jul 25 20:38:11.197990 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2575/5114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:10 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:11.427612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:11.432483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=92 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:11.445403 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64b53945-5302-4d29-a484-c1b3c890269d tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 2.493865 Jul 25 20:38:11.451629 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2540/5115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:08 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 2501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:11.606905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e0dd753-db24-447b-8200-5d3ef6e85fe8 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:11.625834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e0dd753-db24-447b-8200-5d3ef6e85fe8 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:11.627111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e0dd753-db24-447b-8200-5d3ef6e85fe8 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:11.700491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e0dd753-db24-447b-8200-5d3ef6e85fe8 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 20:38:11.857693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e0dd753-db24-447b-8200-5d3ef6e85fe8 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action" status: 202 len: 0 microversion: 2.1 time: 0.259733 Jul 25 20:38:11.863138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2576/5116] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:38:11 2022] POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:38:11.870855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:11.872289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:11.883083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:11.885150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:11.885974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:11.886980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:11.887621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:11.958223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:11.959219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:11.980389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:11.980860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:11.986445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:11.986915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:13.948849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:13.977276 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-957f3664-9a1c-4005-b874-554ee226e943 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1677 microversion: 2.1 time: 2.108325 Jul 25 20:38:13.978111 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2541/5117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:11 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1677 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:14.004924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:14.012358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:14.031411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:14.040089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:14.041474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:14.042275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:14.089304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:14.111742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:14.121650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:14.123472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f76292c2-c7eb-42dc-8070-e08ad36f9a69 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 2.170913 Jul 25 20:38:14.136516 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2577/5118] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:11 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:14.165494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:14.174137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:14.211287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:14.214710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:14.217968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:14.220193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:14.442244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:14.454446 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3bd6f524-b998-4a96-a4c1-cc746ce61184 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1215 microversion: 2.1 time: 0.455211 Jul 25 20:38:14.458373 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2542/5119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:13 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1215 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:14.669663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2add7753-8ba9-446c-ad6d-72f263cce980 req-adbaa3aa-0e20-4c34-ad5c-e0af582ff241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4786d8c-6b91-4c3d-a417-9a1b413f983c", "tag": "8af02972-6ac8-46be-8e97-9d5728f320e1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:14.724670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2add7753-8ba9-446c-ad6d-72f263cce980 req-adbaa3aa-0e20-4c34-ad5c-e0af582ff241 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:14.727617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2add7753-8ba9-446c-ad6d-72f263cce980 req-adbaa3aa-0e20-4c34-ad5c-e0af582ff241 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:14.783740 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2add7753-8ba9-446c-ad6d-72f263cce980 req-adbaa3aa-0e20-4c34-ad5c-e0af582ff241 service nova] Creating event network-changed:8af02972-6ac8-46be-8e97-9d5728f320e1 for instance a4786d8c-6b91-4c3d-a417-9a1b413f983c on n-h2-845775-3 Jul 25 20:38:14.805779 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2add7753-8ba9-446c-ad6d-72f263cce980 req-adbaa3aa-0e20-4c34-ad5c-e0af582ff241 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134371 Jul 25 20:38:14.806724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2543/5120] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:38:15.010209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:15.012479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:15.037072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:15.040254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:15.042564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:15.044792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:15.115322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:15.711422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:15.723965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6123a58-8e31-4c94-99d4-1b994a4c0b83 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 1.579728 Jul 25 20:38:15.725848 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2578/5121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:14 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:15.740992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:15.743610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:15.755021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:15.755584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:15.757258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:15.757782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:16.332607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:16.453037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:16.463667 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cbf11548-25ba-4214-90d3-b9d0a2a670a1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1677 microversion: 2.1 time: 1.461382 Jul 25 20:38:16.464318 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2544/5122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:15 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1677 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:16.488087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:16.488743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:16.506473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:16.508086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:16.508958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:16.509402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:18.175358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:18.248835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:18.250595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:18.251835 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a92afcc8-459b-463a-a986-6785643ad55f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 2.518438 Jul 25 20:38:18.269972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2579/5123] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:15 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:18.298546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:18.299251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:18.341882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:18.343117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:18.346217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:18.355575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:18.470219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:18.491130 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09a3641c-a44c-4e2f-917a-4ca0cfe92a82 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1283 microversion: 2.1 time: 2.007766 Jul 25 20:38:18.496791 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2545/5124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:16 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1283 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:18.526520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:18.531500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:18.552268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:18.554258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:18.558281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:18.559301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:19.005282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:19.013792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c2d8419-0039-487a-a3b9-a1098cee375f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 0.742535 Jul 25 20:38:19.030966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2580/5125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:18 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:19.284477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:19.285777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:19.303121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:19.303578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:19.304415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:19.304900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:19.338332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:19.370752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63032fc8-8296-40fc-9ca7-bfc3d707a37d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1677 microversion: 2.1 time: 0.868554 Jul 25 20:38:19.372971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2546/5126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:18 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1677 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:19.517108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:19.517802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:19.548804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:19.557112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:19.558248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:19.559586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:20.653522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:20.672241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:20.684269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:20.689120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-039e25e5-aad8-4d5d-9331-d8a63e01c91f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.406659 Jul 25 20:38:20.709772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2581/5127] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:19 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:38:20.718245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:20.719354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:20.741385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:20.742700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:20.744433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:20.745757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:21.732644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:21.783206 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7af00399-b65e-407e-93e7-606b849f943d tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1283 microversion: 2.1 time: 2.271833 Jul 25 20:38:21.797350 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2547/5128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:19 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1283 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:21.817813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:21.818732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:21.830167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:21.831659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:21.832815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:21.834910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:22.194726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:22.236870 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-406f0bf1-ec25-4c75-b1c4-e63d2c210ecd tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 1.539392 Jul 25 20:38:22.263622 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2582/5129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:20 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:22.275824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:22.290163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:22.314835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:22.317177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:22.321474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:22.323993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:23.481547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:23.504660 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b1fb838-cc06-4e3d-9df6-52f1a309703f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1677 microversion: 2.1 time: 1.700477 Jul 25 20:38:23.508216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2548/5130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:21 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1677 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:23.531223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:23.531636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:23.555970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:23.562688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:23.563559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:23.574544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:23.654365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:23.671542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:23.676229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:23.682343 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-153ac77e-831e-4390-96c4-aa506d59420a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 1.412508 Jul 25 20:38:23.684811 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2583/5131] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:22 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:23.705876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-12c0c355-87a3-437b-9e77-262fc2161e19 req-790c525c-27b9-4018-9716-183d818b2178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:23.748490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12c0c355-87a3-437b-9e77-262fc2161e19 req-790c525c-27b9-4018-9716-183d818b2178 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:23.749342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12c0c355-87a3-437b-9e77-262fc2161e19 req-790c525c-27b9-4018-9716-183d818b2178 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:23.800320 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-12c0c355-87a3-437b-9e77-262fc2161e19 req-790c525c-27b9-4018-9716-183d818b2178 service nova] Creating event network-changed:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:38:23.825528 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-12c0c355-87a3-437b-9e77-262fc2161e19 req-790c525c-27b9-4018-9716-183d818b2178 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135448 Jul 25 20:38:23.827320 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2584/5132] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:23.865302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:23.867857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:23.900794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:23.901262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:23.907865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:23.908376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:26.450682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:26.459380 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c098e446-aa8e-41e1-8940-3046a9e6ba11 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 2.626197 Jul 25 20:38:26.459928 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2585/5133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:23 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:26.492086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:26.505395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:26.529127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:26.529691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:26.542697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:26.543278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:26.595013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:26.605688 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6475f70e-e355-4d98-bda8-caac7f731027 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 3.096405 Jul 25 20:38:26.609268 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2549/5134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:23 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 3100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:26.625681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:26.630499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:26.649799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:26.652244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:26.657177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:26.657640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:27.209229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:27.236772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:27.241672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:27.250093 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-991d24c4-0203-44ba-8c64-cf552a0e4a28 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.638070 Jul 25 20:38:27.261810 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2550/5135] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:26 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:27.384529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:27.400080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e8201fd3-54ce-42c2-981c-db799d6f51b2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1654 microversion: 2.1 time: 0.918533 Jul 25 20:38:27.401276 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2586/5136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:26 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1654 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:27.438126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2296ff6d-36d1-4db7-bada-e34abec8f518 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:27.447815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2296ff6d-36d1-4db7-bada-e34abec8f518 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:27.448507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2296ff6d-36d1-4db7-bada-e34abec8f518 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:27.517548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2296ff6d-36d1-4db7-bada-e34abec8f518 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Going to try to start instance {{(pid=119723) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 20:38:27.626619 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2296ff6d-36d1-4db7-bada-e34abec8f518 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action" status: 202 len: 0 microversion: 2.1 time: 0.193317 Jul 25 20:38:27.634097 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2551/5137] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:38:27 2022] POST /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:38:27.647630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:27.652701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:27.666131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:27.667086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:27.668120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:27.668723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.072547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:28.073778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:28.080675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.088704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.089715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.092678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.145999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:28.449265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:28.459080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e89dda3-c369-43c9-b54c-ff85a58004bc tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 0.823364 Jul 25 20:38:28.463363 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2552/5138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:27 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:28.480370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:28.483524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:28.497888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.501007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.506801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.507608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.545650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:28.562894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f7cc7e1-6c10-456b-8543-5ce6cc845ac4 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 1.082290 Jul 25 20:38:28.579045 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2587/5139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:27 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:28.589768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:28.590728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:28.599305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.600200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:28.601250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:28.601913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:29.488217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:29.511640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:29.519834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:29.522191 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e553035a-d8fa-402c-a04e-dc6187a6b327 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.937734 Jul 25 20:38:29.526836 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2588/5140] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:28 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:29.530969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:29.545736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:29.546671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:29.557823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1cb81a0-f21b-40e7-9f6c-1b8cf3cb63ad tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1663 microversion: 2.1 time: 1.086237 Jul 25 20:38:29.561471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:29.561704 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2553/5141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:28 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1663 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:29.563788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:29.569665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:29.570452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:29.594319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:29.602411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:29.643682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:29.645959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:29.647969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:29.650609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:30.548672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:30.561819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c271307b-63d5-4e76-919b-c5ff7bbcfb51 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 1.033540 Jul 25 20:38:30.562427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2589/5142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:29 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:30.590455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:30.591104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:30.600508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:30.605263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:30.606248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:30.606708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:30.628085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:30.640580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65693c0a-5c2d-49a4-b4ba-dac4160b6802 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 1.052633 Jul 25 20:38:30.641411 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2554/5143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:29 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:30.651767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:30.656027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:30.669319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:30.670204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:30.671202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:30.676756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:31.146033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:31.154682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6af2261-4564-45e6-9981-f42c8afdb155 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1663 microversion: 2.1 time: 0.511391 Jul 25 20:38:31.186852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2555/5144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:30 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1663 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:31.218245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:31.226961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:31.250917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:31.270120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-469812ee-f750-47dc-9ff9-73f60d60dd16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1738 microversion: 2.20 time: 0.706520 Jul 25 20:38:31.270758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2590/5145] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:30 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1738 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:31.584448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:31.585342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:31.602869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:31.603720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:31.608770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:31.609695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:31.665127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:31.666927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:31.681057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:31.681893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:31.682903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:31.687163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:32.275217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:32.291683 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a378b89f-0c6c-40d7-b72a-ab7056299d8f tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 0.627473 Jul 25 20:38:32.295372 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2591/5146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:31 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:32.302631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:32.309246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:32.322769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:32.323260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:32.329188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:32.329953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:32.934875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:32.956601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aff25db6-47b6-4c0e-a0e6-fb8b9eb8cc05 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 1.376949 Jul 25 20:38:32.957213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2556/5147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:31 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:32.979265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:32.980874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:33.010838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:33.011380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:33.012245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:33.012698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:33.067190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:33.358773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:33.376832 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36249254-3750-4051-9531-a4c2bf952c99 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1667 microversion: 2.1 time: 1.080409 Jul 25 20:38:33.377527 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2592/5148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:32 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1667 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:33.528250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:33.548747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:33.550457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:33.554035 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-287d3799-e8e4-4134-bb4b-85aa33a90533 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1720 microversion: 2.20 time: 0.591914 Jul 25 20:38:33.571531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-020ba11b-543e-4182-84c0-ab7241950c8f req-635fc897-cee0-471f-a970-ffd198b007f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4786d8c-6b91-4c3d-a417-9a1b413f983c", "name": "network-vif-plugged", "status": "completed", "tag": "8af02972-6ac8-46be-8e97-9d5728f320e1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:33.575467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2557/5149] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:32 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1720 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:33.586394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:33.588001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-020ba11b-543e-4182-84c0-ab7241950c8f req-635fc897-cee0-471f-a970-ffd198b007f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:33.588482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-020ba11b-543e-4182-84c0-ab7241950c8f req-635fc897-cee0-471f-a970-ffd198b007f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:33.589088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:33.607124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:33.608799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:33.610364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:33.611088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:33.625385 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-020ba11b-543e-4182-84c0-ab7241950c8f req-635fc897-cee0-471f-a970-ffd198b007f9 service nova] Creating event network-vif-plugged:8af02972-6ac8-46be-8e97-9d5728f320e1 for instance a4786d8c-6b91-4c3d-a417-9a1b413f983c on n-h2-845775-3 Jul 25 20:38:33.637495 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-020ba11b-543e-4182-84c0-ab7241950c8f req-635fc897-cee0-471f-a970-ffd198b007f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257133 Jul 25 20:38:33.638422 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2593/5150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:33.985939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:33.987022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:34.000742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:34.001512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:34.004433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:34.005111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:34.175372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:34.184162 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d593dc09-9314-41e1-b781-ec89c321581e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 0.607419 Jul 25 20:38:34.187810 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2558/5151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:33 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:34.470210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:34.482177 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c89aea09-09b4-4c63-9938-cc8855374177 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 0.503170 Jul 25 20:38:34.484219 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2594/5152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:33 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:34.584585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:34.585977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:34.593543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:34.594371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:34.595314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:34.595936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:35.030606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:35.047120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:35.049109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:35.052078 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-989ac825-8d6d-4d56-aae8-74ba7ba58b7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1720 microversion: 2.20 time: 0.473555 Jul 25 20:38:35.064114 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2559/5153] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:34 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1720 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:35.206456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:35.207083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:35.226513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:35.227353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:35.228484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:35.230635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:35.510958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:35.513244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:35.558450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:35.560436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:35.562692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:35.563939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:35.564109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:35.575358 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b940dd9-c50d-4c2d-bf90-70b98c6acc46 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1318 microversion: 2.1 time: 0.373271 Jul 25 20:38:35.577329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2595/5154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:35 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:35.942967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-54b41b5f-dbdc-4339-9732-663d1cf6c9d0 req-d144c2cf-79c3-4503-8a92-48ec4d12e310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "name": "network-vif-unplugged", "status": "completed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:35.978873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-54b41b5f-dbdc-4339-9732-663d1cf6c9d0 req-d144c2cf-79c3-4503-8a92-48ec4d12e310 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:35.982398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-54b41b5f-dbdc-4339-9732-663d1cf6c9d0 req-d144c2cf-79c3-4503-8a92-48ec4d12e310 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:36.018243 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-54b41b5f-dbdc-4339-9732-663d1cf6c9d0 req-d144c2cf-79c3-4503-8a92-48ec4d12e310 service nova] Creating event network-vif-unplugged:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h1-845775-3 Jul 25 20:38:36.034835 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-54b41b5f-dbdc-4339-9732-663d1cf6c9d0 req-d144c2cf-79c3-4503-8a92-48ec4d12e310 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092669 Jul 25 20:38:36.038245 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2596/5155] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:38:36.089942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:36.090904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:36.102188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:36.102646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:36.103889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:36.112600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:36.346236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:36.374274 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a16988cd-0934-4579-87f9-400a0831f412 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 0.869040 Jul 25 20:38:36.374929 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2560/5156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:35 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:36.506970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:36.520257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:36.527184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:36.529192 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05ca0e9b-eef8-4307-9d54-b2d511b8df31 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1720 microversion: 2.20 time: 0.443046 Jul 25 20:38:36.532014 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2597/5157] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:36 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1720 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:38:36.602192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:36.602939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:36.621351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:36.622063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:36.625424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:36.627750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.118223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:37.132777 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfc25505-dd51-408f-9195-3eaf54bcff4e tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1506 microversion: 2.1 time: 0.536387 Jul 25 20:38:37.136249 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2561/5158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:36 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:37.155909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04557782-ad1c-47c0-9eab-a62d32925f21", "device": "/dev/sdb"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:37.159420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:37.167901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.168664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.169965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.172385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.414512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:37.420776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:37.446951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.448138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.455599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.456446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.723038 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a03e6503-016b-4849-9ddf-ab4a8ed9f490 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "POST /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.540706 Jul 25 20:38:37.724022 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2598/5159] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:38:37 2022] POST /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:37.756347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:37.757073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:37.782308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.787678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.801141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:37.812642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:37.921869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:37.953940 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f160979-f1e8-46a1-a073-78a5ff86151f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 0.550630 Jul 25 20:38:37.955024 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2562/5160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:37 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:38.449915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:38.498064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:38.506641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:38.509723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d361c3bd-8cd4-4880-8e8c-afdc4d3805c5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1663 microversion: 2.20 time: 0.765256 Jul 25 20:38:38.517200 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2599/5161] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:37 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1663 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:38.538978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8178959-ad85-4ccf-89f1-6ca28b6e3476"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:38.541698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:38.555326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.558287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:38.560072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.563351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:38.863528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:38.865810 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:38:38.865810 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:38:38.867489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.868380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:38.869508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.871377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:38.946260 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8630f9d9-c515-4ab4-b2ca-8252dc64f003 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.557447 Jul 25 20:38:38.965048 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2563/5162] 10.222.0.48 () {58 vars in 1185 bytes} [Mon Jul 25 20:38:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:38:38.980705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:38.981338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:38.993268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.993732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:38.994534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:38.994983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:39.267153 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9535f2a1-ce75-4723-a361-048dccfcca27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.733287 Jul 25 20:38:39.276204 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2600/5163] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Jul 25 20:38:38 2022] POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 188 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:38:39.293289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-490581890", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "availability_zone": "nova:n-h1-845775-3", "networks": [{"uuid": "e29320f0-a9e9-4148-acb7-e3698ab1b1e5"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:39.423402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] validate_networks() for [('e29320f0-a9e9-4148-acb7-e3698ab1b1e5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:38:39.979223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:39.993685 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a71c1969-184d-4def-b652-79cfd2d44637 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 1.017050 Jul 25 20:38:40.011279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2564/5164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:38 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:40.020422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9064cee2-bfa3-4965-86cd-ea930cc21d31 req-5d4c4a31-1210-4ce2-9ee0-f885be1de8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "name": "network-vif-plugged", "status": "completed", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:40.037330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9064cee2-bfa3-4965-86cd-ea930cc21d31 req-5d4c4a31-1210-4ce2-9ee0-f885be1de8d7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.037753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9064cee2-bfa3-4965-86cd-ea930cc21d31 req-5d4c4a31-1210-4ce2-9ee0-f885be1de8d7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.058229 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9064cee2-bfa3-4965-86cd-ea930cc21d31 req-5d4c4a31-1210-4ce2-9ee0-f885be1de8d7 service nova] Creating event network-vif-plugged:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:38:40.072593 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9064cee2-bfa3-4965-86cd-ea930cc21d31 req-5d4c4a31-1210-4ce2-9ee0-f885be1de8d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057545 Jul 25 20:38:40.074425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2565/5165] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:40.094173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:40.094866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:40.112375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.114196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.116319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.116889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.371995 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6664af36-0f84-4bd8-bc88-fe802a4c03eb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/action" status: 202 len: 0 microversion: 2.20 time: 0.291167 Jul 25 20:38:40.378971 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2566/5166] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:38:40 2022] POST /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:38:40.398708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:40.399724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:40.421915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.422747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.430219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.431093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.465100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:38:40.465677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:38:40.465978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:38:40.466391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:38:40.467005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:38:40.485932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.488824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.490873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:40.491506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:40.513162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Getting quotas for project a951cec7913843a2adf6d6890ff789a0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:38:40.519829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Getting quotas for user b7624168d8154c1283e2a27ba267f558 and project a951cec7913843a2adf6d6890ff789a0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:38:40.535395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:38:40.538876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:38:40.607825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c74a757-5741-4795-891b-842cc22111e9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328852 Jul 25 20:38:40.609128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2601/5167] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:38:40.625053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3366651-18b0-4e5f-840e-b028879293a9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:40.633745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3366651-18b0-4e5f-840e-b028879293a9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:40.883492 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3366651-18b0-4e5f-840e-b028879293a9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1328 microversion: 2.1 time: 0.267724 Jul 25 20:38:40.884085 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2602/5168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:40 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:40.974571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:40.986005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:40.993379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:40.997274 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a40f2b07-2c66-48e4-b0f6-dcb7ccd807dd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1749 microversion: 2.20 time: 0.613138 Jul 25 20:38:41.000241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2567/5169] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:40 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1749 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:41.022309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:41.023197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:41.036289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:41.036503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:41.038548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:41.056499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:41.145363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:41.698463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:41.751535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d01a18e4-28b7-4fd8-afe6-a013a20fb8d7 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1271 microversion: 2.1 time: 0.732641 Jul 25 20:38:41.756501 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2603/5170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:41 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1271 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:41.914619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8139f85f-a5bd-4019-b38a-533c503e61c6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:41.914619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8139f85f-a5bd-4019-b38a-533c503e61c6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:41.924739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=58 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:42.033126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:42.035839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:42.063677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:42.075306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:42.083448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:42.085078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:42.085674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:42.224106 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8139f85f-a5bd-4019-b38a-533c503e61c6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1328 microversion: 2.1 time: 0.322294 Jul 25 20:38:42.225537 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2568/5171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:41 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1328 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:42.550579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:42.569279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:42.570790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:42.571983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2938313d-8182-447a-af8b-06b4e7a2dc1c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1749 microversion: 2.20 time: 0.546106 Jul 25 20:38:42.596491 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2604/5172] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:42 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1749 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:43.255567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:43.258039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:43.282862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.285802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:43.292438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.296115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:43.314453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:43.315083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:43.344886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.346654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:43.354590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.355349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:43.632357 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6e5b4e9d-825f-435e-8bf7-f9fea5e81661 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1423 microversion: 2.1 time: 0.389617 Jul 25 20:38:43.642754 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2605/5173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:43 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1423 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:43.650262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:43.664930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:43.685409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.687446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:43.688412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:43.691695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:44.355292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:44.368653 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c1e97035-c988-47f9-bc8d-44e707e60b66 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1460 microversion: 2.1 time: 1.592319 Jul 25 20:38:44.373105 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2569/5174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:42 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1460 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:44.395720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:44.397183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:44.405636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:44.410952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:44.414740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:44.416239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:44.585532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:44.606700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:44.613086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:44.615670 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7a03c0d-3157-4487-bdf8-747b73630063 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.970967 Jul 25 20:38:44.621301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2606/5175] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:43 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:44.659972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:44.662450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:44.691475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:44.698574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:44.700263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:44.700954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:45.059051 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-636c9d06-e552-4024-aaef-c2f810c2d222 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1421 microversion: 2.1 time: 0.405134 Jul 25 20:38:45.060173 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2607/5176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:44 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1421 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:45.520358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:45.531331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9c3051d7-1695-4f07-9d6a-4c518bf9b11b tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1460 microversion: 2.1 time: 1.139664 Jul 25 20:38:45.548160 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2570/5177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:44 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1460 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:45.645349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:45.647229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:45.662514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:45.663714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:45.668386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:45.669116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:46.083396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:46.086831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:46.107046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:46.112901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:46.114265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:46.115647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:46.625873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:46.645437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:46.655568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:46.658194 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-65c4577d-7e2c-405c-aa01-272b43fdcf53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 1.017093 Jul 25 20:38:46.670493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2608/5178] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:45 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:47.368751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8346a1d5-b8a3-44a8-a74c-4acc93bad71f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 1.289731 Jul 25 20:38:47.374227 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2571/5179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:46 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:47.689540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:47.696156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:47.711816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:47.712304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:47.721870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:47.722766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:48.261943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:48.272638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:48.290893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:48.292209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29498117-2fcc-40c0-a06d-c60a65a39f39 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.608471 Jul 25 20:38:48.295048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2609/5180] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:47 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:48.394667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:48.395183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:48.409172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:48.409868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:48.410826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:48.411463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:48.649795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9d0e5720-3053-4cc5-a5dd-03158be98136 req-938a0211-a0d4-4937-8d79-23779ad65c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07bd37d-f259-4d9d-843e-3f1a6951b9f4", "tag": "38a6c626-9b9e-4f10-ae01-e3042b3ff907"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:48.679050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9d0e5720-3053-4cc5-a5dd-03158be98136 req-938a0211-a0d4-4937-8d79-23779ad65c02 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:48.679943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9d0e5720-3053-4cc5-a5dd-03158be98136 req-938a0211-a0d4-4937-8d79-23779ad65c02 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:48.705738 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9d0e5720-3053-4cc5-a5dd-03158be98136 req-938a0211-a0d4-4937-8d79-23779ad65c02 service nova] Creating event network-changed:38a6c626-9b9e-4f10-ae01-e3042b3ff907 for instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 on n-h1-845775-3 Jul 25 20:38:48.728295 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9d0e5720-3053-4cc5-a5dd-03158be98136 req-938a0211-a0d4-4937-8d79-23779ad65c02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.497869 Jul 25 20:38:48.729408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2572/5181] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:48.964927 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9220e0c-f6fc-4ad9-a776-317f5bded1cc tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.573792 Jul 25 20:38:48.980430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2610/5182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:48 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:49.318451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:49.325188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:49.326053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:49.353586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:49.362157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:49.364515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:49.367114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:49.951574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:49.972747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:49.978251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:49.981309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b2f608ad-fed1-4657-a7de-20022ef53b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.663917 Jul 25 20:38:49.990030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:49.990662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:49.997478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2573/5183] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:49 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:50.010571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:50.011223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:50.012274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:50.012791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:50.504926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:50.667779 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c052d47-d850-4c85-aef2-0f4b2668e653 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.684519 Jul 25 20:38:50.668348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2611/5184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:49 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:51.009371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:51.010389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:51.018599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:51.019058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:51.019843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:51.035082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:51.688707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:51.689334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:51.691826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:51.706913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:51.713768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:51.714291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:51.715455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:51.715850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:51.725762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:51.729425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:51.734686 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a900674-cec8-4cc4-8bfc-be74c09a6787 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.729956 Jul 25 20:38:51.738741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2574/5185] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:51 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:52.137792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63da7c7b-deb9-42c5-a2a0-e8f4eeead52c tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.451884 Jul 25 20:38:52.140267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2612/5186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:51 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:52.772468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:52.773754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:52.791625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:52.801643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:52.802308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:52.803182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:52.803641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:53.159254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:53.160434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:53.176836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:53.180431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:53.182090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:53.182266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:53.484331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:53.486803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:38:53.507335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:53.509899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:53.511729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-990736c7-bb4c-464e-8673-281bc5e8924d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.745478 Jul 25 20:38:53.512698 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2575/5187] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:52 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:53.970833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1beae88d-ee4a-486a-8711-ebc1b3f81e3f tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.815626 Jul 25 20:38:53.971846 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2613/5188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:53 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:54.545040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:54.545689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:54.579394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:54.579997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:54.581071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:54.583069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:54.992966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:54.994151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:55.006868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:55.007344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:55.009799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:55.010298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:55.246726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:55.266328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:55.273352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:55.282111 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c86971e-200e-4576-b5f2-013ab1db4020 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1751 microversion: 2.20 time: 0.734605 Jul 25 20:38:55.285110 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2576/5189] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:54 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1751 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:55.347811 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-933ac7a8-d3c2-4b1c-96f3-319a8f645fc2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.340020 Jul 25 20:38:55.369400 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2614/5190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:54 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:55.531123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6206fbba-57e2-4ce9-a4b1-e32f84dc9027 req-e25b82d7-6f1a-420b-86fb-6efdb7706b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07bd37d-f259-4d9d-843e-3f1a6951b9f4", "name": "network-vif-plugged", "status": "completed", "tag": "38a6c626-9b9e-4f10-ae01-e3042b3ff907"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:55.558721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6206fbba-57e2-4ce9-a4b1-e32f84dc9027 req-e25b82d7-6f1a-420b-86fb-6efdb7706b56 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:55.559414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6206fbba-57e2-4ce9-a4b1-e32f84dc9027 req-e25b82d7-6f1a-420b-86fb-6efdb7706b56 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:55.580433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6206fbba-57e2-4ce9-a4b1-e32f84dc9027 req-e25b82d7-6f1a-420b-86fb-6efdb7706b56 service nova] Creating event network-vif-plugged:38a6c626-9b9e-4f10-ae01-e3042b3ff907 for instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 on n-h1-845775-3 Jul 25 20:38:55.602144 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6206fbba-57e2-4ce9-a4b1-e32f84dc9027 req-e25b82d7-6f1a-420b-86fb-6efdb7706b56 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076539 Jul 25 20:38:55.605214 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2577/5191] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:55.695581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-06de8644-da5d-4485-a9c0-7a1071389a1b req-cb237ac4-1661-4547-8fc9-3f00ec38d09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:55.736723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-06de8644-da5d-4485-a9c0-7a1071389a1b req-cb237ac4-1661-4547-8fc9-3f00ec38d09a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:55.737365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-06de8644-da5d-4485-a9c0-7a1071389a1b req-cb237ac4-1661-4547-8fc9-3f00ec38d09a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:55.763085 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-06de8644-da5d-4485-a9c0-7a1071389a1b req-cb237ac4-1661-4547-8fc9-3f00ec38d09a service nova] Creating event network-changed:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:38:55.768806 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-06de8644-da5d-4485-a9c0-7a1071389a1b req-cb237ac4-1661-4547-8fc9-3f00ec38d09a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078326 Jul 25 20:38:55.775069 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2615/5192] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:56.321368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:56.322191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:56.340293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:56.340999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:56.342101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:56.343791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:56.380320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:56.381323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:56.416559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:56.417475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:56.419444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:56.423484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:57.103450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:57.118791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:57.121248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:57.123009 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f83e34bd-7ecc-4464-a90c-8efd47a20403 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.812819 Jul 25 20:38:57.136969 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2578/5193] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:56 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:57.198649 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5e49a13-a140-41ef-bb10-fd7f298fba51 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1463 microversion: 2.1 time: 0.826941 Jul 25 20:38:57.200695 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2616/5194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:56 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1463 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:38:58.147637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:58.149171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:58.172176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:58.174755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:58.176796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:58.182274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:58.221811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:58.223091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:58.254387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:58.260339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:58.261982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:58.264070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:59.223645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:59.250091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:59.257870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:38:59.261861 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-900e9b8a-df7a-484a-b367-3382261d84ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.118871 Jul 25 20:38:59.271453 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2579/5195] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:38:58 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:38:59.294096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4e4a95c1-3b6e-48e1-a5c7-b45a1b24a65c req-1ae8691d-18b3-4477-9a72-731f2491a8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:38:59.328722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e4a95c1-3b6e-48e1-a5c7-b45a1b24a65c req-1ae8691d-18b3-4477-9a72-731f2491a8c1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:59.334669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4e4a95c1-3b6e-48e1-a5c7-b45a1b24a65c req-1ae8691d-18b3-4477-9a72-731f2491a8c1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:59.404751 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4e4a95c1-3b6e-48e1-a5c7-b45a1b24a65c req-1ae8691d-18b3-4477-9a72-731f2491a8c1 service nova] Creating event network-changed:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:38:59.434607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4e4a95c1-3b6e-48e1-a5c7-b45a1b24a65c req-1ae8691d-18b3-4477-9a72-731f2491a8c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160328 Jul 25 20:38:59.440417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2580/5196] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:38:59.506241 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-efa00931-5933-4fc6-99ae-5fe2637fa486 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1647 microversion: 2.1 time: 1.286176 Jul 25 20:38:59.508898 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2617/5197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:58 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1647 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:38:59.542925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:38:59.544287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:38:59.603676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:59.604820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:38:59.610454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:38:59.611858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:00.307699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:00.308349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:00.325170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:00.325620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:00.326577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:00.327114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:00.625987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d8344954-a3af-4ba2-b9ed-5777ab3da62e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1647 microversion: 2.1 time: 1.097719 Jul 25 20:39:00.636222 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2581/5198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:38:59 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1647 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:00.651629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:00.652634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:00.669866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:00.670366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:00.671209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:00.671667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:01.127241 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-acbb5da3-95b6-4fe9-8489-346caceed7c2 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1647 microversion: 2.1 time: 0.479244 Jul 25 20:39:01.128180 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2582/5199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:00 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1647 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:01.273408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:01.296706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:01.299074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:01.300364 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca374172-302a-4f17-8e65-6aa06068e83d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.996735 Jul 25 20:39:01.306953 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2618/5200] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:00 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:01.424464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1863597634", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "availability_zone": "nova:n-h2-845775-3", "networks": [{"uuid": "e29320f0-a9e9-4148-acb7-e3698ab1b1e5"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:01.455163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7f2d8460-606f-4b7d-9fa4-2bcffe25e1c2 req-e8632f06-9c0c-4dc5-9f27-60bff3b98028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:01.490772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7f2d8460-606f-4b7d-9fa4-2bcffe25e1c2 req-e8632f06-9c0c-4dc5-9f27-60bff3b98028 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:01.497651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7f2d8460-606f-4b7d-9fa4-2bcffe25e1c2 req-e8632f06-9c0c-4dc5-9f27-60bff3b98028 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:01.556209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7f2d8460-606f-4b7d-9fa4-2bcffe25e1c2 req-e8632f06-9c0c-4dc5-9f27-60bff3b98028 service nova] Creating event network-changed:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:39:01.584198 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7f2d8460-606f-4b7d-9fa4-2bcffe25e1c2 req-e8632f06-9c0c-4dc5-9f27-60bff3b98028 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134340 Jul 25 20:39:01.599338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2619/5201] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:39:01.742914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1a95b637-a49b-4f76-b6e6-282e54d1be5f req-85d02105-8230-487f-9882-59cee37b3ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:01.819311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] validate_networks() for [('e29320f0-a9e9-4148-acb7-e3698ab1b1e5', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:39:01.826764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1a95b637-a49b-4f76-b6e6-282e54d1be5f req-85d02105-8230-487f-9882-59cee37b3ad9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:01.832588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1a95b637-a49b-4f76-b6e6-282e54d1be5f req-85d02105-8230-487f-9882-59cee37b3ad9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:01.859338 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1a95b637-a49b-4f76-b6e6-282e54d1be5f req-85d02105-8230-487f-9882-59cee37b3ad9 service nova] Creating event network-changed:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h2-845775-3 Jul 25 20:39:01.874789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1a95b637-a49b-4f76-b6e6-282e54d1be5f req-85d02105-8230-487f-9882-59cee37b3ad9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150532 Jul 25 20:39:01.876158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2620/5202] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:02.352382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:02.354276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:02.380527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:02.381607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:02.383617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:02.387137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:03.662215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:03.671502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:03.675124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:03.690022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:03.691518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c62506b-1051-455c-ba0b-32ab8398c6e2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.359109 Jul 25 20:39:03.692323 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2621/5203] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:02 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:04.310094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:39:04.310894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:39:04.312343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:39:04.313814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:39:04.315055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:39:04.348050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:04.348543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:04.363632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:04.363934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:04.433986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Getting quotas for project a951cec7913843a2adf6d6890ff789a0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:39:04.475770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Getting quotas for user b7624168d8154c1283e2a27ba267f558 and project a951cec7913843a2adf6d6890ff789a0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:39:04.528803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:39:04.531621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:39:04.666654 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-081f5e03-f65e-4557-8577-cc10e501c1ac tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.254974 Jul 25 20:39:04.673538 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2583/5204] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:39:04.691601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c48da1e-f97e-4036-80a5-6247645a1a19 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:04.693829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c48da1e-f97e-4036-80a5-6247645a1a19 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:04.717360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:04.718133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:04.726557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:04.727461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:04.728725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:04.729967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:05.142774 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c48da1e-f97e-4036-80a5-6247645a1a19 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1329 microversion: 2.1 time: 0.455844 Jul 25 20:39:05.145232 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2622/5205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:04 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1329 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:05.510284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:05.571919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:05.578530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:05.584488 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5f4626d-3ab0-42a2-a9f6-775e35d170ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.869363 Jul 25 20:39:05.586948 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2584/5206] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:04 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:06.184889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:06.186197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:06.201184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.217829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.221785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.225000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.502918 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f2557b20-0702-4704-8545-887d6ec81cfb tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1346 microversion: 2.1 time: 0.323259 Jul 25 20:39:06.512066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2623/5207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:06 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1346 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:06.640433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:06.646325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:06.647795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:06.665830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:06.680936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.681411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.684395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.686000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.687461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.688371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.689369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.689825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.768086 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c35f898-3eb3-4ddb-aa8f-d59ebd8bcc3f tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134580 Jul 25 20:39:06.773229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2624/5208] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:39:06 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:39:06.939188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:06.940274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:06.964336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.966396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:06.971587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:06.984901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:07.131419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:39:07.261954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:07.349371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:07.360438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:07.372089 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6867b4ee-06a7-4d0d-b9ec-0c160780bd3f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.738200 Jul 25 20:39:07.375667 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2585/5209] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:06 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:07.550869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:07.553710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:07.576893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2cc5ffb-0cca-4e5c-abda-85e3474b3ccc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 204 len: 0 microversion: 2.1 time: 0.640813 Jul 25 20:39:07.585808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2625/5210] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:39:06 2022] DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:39:07.630001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:07.631410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:07.632440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:07.643886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:07.648584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:07.649390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:07.686312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:07.690631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:07.700108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:07.705516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:08.380171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8736704b-2848-43d8-bb0c-1f8fc141adc9 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1416 microversion: 2.1 time: 0.841874 Jul 25 20:39:08.384398 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2586/5211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:07 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1416 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:08.424977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:08.429012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:08.467050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:08.469845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:08.479328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:08.480271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:08.563916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:08.623884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e8f551f-3fa3-4120-a3a3-01840bc53e14 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1673 microversion: 2.1 time: 1.033640 Jul 25 20:39:08.624975 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2626/5212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:07 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1673 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:09.425280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:09.427300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:09.458990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:09.466028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:09.467500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:09.475087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:09.646303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:09.670224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:09.671928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:09.677561 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a46bc68-8442-48d2-80d1-137cd840ebbf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.259905 Jul 25 20:39:09.679814 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0e62b43f-2748-4e1b-ab41-40f88802bbbe tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1422 microversion: 2.1 time: 0.257666 Jul 25 20:39:09.693202 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2627/5213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:09 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1422 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:09.698003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2587/5214] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:08 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:09.713694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:09.716327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:09.748733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:09.751568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:09.757246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:09.761810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:10.707462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:10.709243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:10.740564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:10.743486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:10.744643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:10.748842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:13.006835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:13.059277 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-029ea342-af92-45fe-93f0-3f1e1299320a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1673 microversion: 2.1 time: 3.351395 Jul 25 20:39:13.080104 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2628/5215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:09 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1673 bytes in 3374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:13.111441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:13.120002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:13.129364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:13.159833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:13.163895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:13.167914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:13.170771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:13.267972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64014154-26f3-4bfd-bc97-eeea52b4b91e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 2.561652 Jul 25 20:39:13.276655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2588/5216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:10 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:13.452655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5263ad55-7cb9-4361-a6d8-e58ed787416f req-55fe1f0c-580a-4028-9d00-fd85ad8fde5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501074ac-0aa5-4617-9f93-0e1b33fd4d54", "name": "network-vif-unplugged", "status": "completed", "tag": "ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:13.483600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:13.513220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5263ad55-7cb9-4361-a6d8-e58ed787416f req-55fe1f0c-580a-4028-9d00-fd85ad8fde5f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:13.514236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5263ad55-7cb9-4361-a6d8-e58ed787416f req-55fe1f0c-580a-4028-9d00-fd85ad8fde5f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:13.572721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5263ad55-7cb9-4361-a6d8-e58ed787416f req-55fe1f0c-580a-4028-9d00-fd85ad8fde5f service nova] Creating event network-vif-unplugged:ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc for instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 on n-h1-845775-3 Jul 25 20:39:13.602586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5263ad55-7cb9-4361-a6d8-e58ed787416f req-55fe1f0c-580a-4028-9d00-fd85ad8fde5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159437 Jul 25 20:39:13.603223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2589/5217] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:14.101091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:14.107431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:14.108646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:14.141508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:14.142175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:14.142400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:14.143267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:14.143998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:14.145293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:14.155133 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fe65dad1-40fe-419a-8ce6-6ddbecad446e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.081769 Jul 25 20:39:14.164838 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2629/5218] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:13 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:14.311834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:14.315557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:14.356858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:14.361510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:14.368341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:14.369157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:14.401721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:14.518751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:15.136575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:15.593476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:15.665087 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-70300227-7c77-4304-be0d-bdfea85e067b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1605 microversion: 2.1 time: 1.555352 Jul 25 20:39:15.680149 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2590/5219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:14 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1605 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:15.738689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:15.746392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:15.799480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:15.806725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:15.831985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:15.840566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:16.220869 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf23af6b-b2f3-47fb-854e-e255111982a0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 1.915912 Jul 25 20:39:16.226382 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2630/5220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:14 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:16.699979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:16.701169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:16.750535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:16.751968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:16.758801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:16.761644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:17.433940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:17.443569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92ca4e82-fc1d-4ca1-b6c8-ca7e49990a69 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1605 microversion: 2.1 time: 0.751221 Jul 25 20:39:17.449578 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2631/5221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:16 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1605 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:17.468327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:17.475614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:17.508568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:17.509626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:17.511071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:17.513940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:17.550628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:17.562930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:17.578429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:17.580159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9a3622d-9167-409e-8e15-5c03763953cf tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.904071 Jul 25 20:39:17.581250 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2591/5222] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:15 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:18.138048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5aa491da-9d47-454f-a709-c5e300c5d192 req-4f932cbb-32e2-46f4-804e-14cbdea64074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36c63fe-2c9f-4e72-91e4-a7a1faa2721c", "tag": "4aaba766-12dd-4e02-9f60-a63d35b33de3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:18.227329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5aa491da-9d47-454f-a709-c5e300c5d192 req-4f932cbb-32e2-46f4-804e-14cbdea64074 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:18.228287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5aa491da-9d47-454f-a709-c5e300c5d192 req-4f932cbb-32e2-46f4-804e-14cbdea64074 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:18.331669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6dfb3b4-ceae-4f82-be03-a1c827b25b27 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 0.873968 Jul 25 20:39:18.335349 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2632/5223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:17 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:18.358361 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5aa491da-9d47-454f-a709-c5e300c5d192 req-4f932cbb-32e2-46f4-804e-14cbdea64074 service nova] Creating event network-changed:4aaba766-12dd-4e02-9f60-a63d35b33de3 for instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c on n-h2-845775-3 Jul 25 20:39:18.421358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5aa491da-9d47-454f-a709-c5e300c5d192 req-4f932cbb-32e2-46f4-804e-14cbdea64074 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291108 Jul 25 20:39:18.425305 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2592/5224] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:18.472158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:18.473116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:18.491733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:18.495531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:18.504441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:18.507867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:18.622256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:18.636494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:18.660851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:18.667781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:18.669082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:18.670214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:18.815821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:18.830130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80f481c5-b2fa-4b75-bb04-df5db47b083c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 200 len: 1321 microversion: 2.1 time: 0.362801 Jul 25 20:39:18.839420 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2633/5225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:18 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:19.360320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:19.361073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:19.373004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:19.381081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:19.387079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:19.390393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:19.857810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:19.903543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:19.905200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:19.906607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-660364cf-c356-4038-b267-67781353af73 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.295080 Jul 25 20:39:19.907205 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2593/5226] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:18 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:19.932908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:19.946251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:19.966220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:19.975215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:19.977987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:19.980457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:20.029855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 HTTP/1.1 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '501074ac-0aa5-4617-9f93-0e1b33fd4d54'} Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:20.037003 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:39:20.042585 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:39:20.044759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:39:20.046011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5d900c37-78f2-4048-9651-8f0fbfd8f72a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 404 len: 111 microversion: 2.1 time: 0.137642 Jul 25 20:39:20.050676 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2594/5227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:19 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:39:20.057150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08d7cae6-0c36-4d80-b441-7a9dfb4beba2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '.version_select at 0x7f19697be550>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:20.112595 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08d7cae6-0c36-4d80-b441-7a9dfb4beba2 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881787018" status: 202 len: 0 microversion: 2.1 time: 0.059996 Jul 25 20:39:20.118438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2595/5228] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881787018 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:39:20.476926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-fc0082a0-d997-4d0a-829c-db8e81df69b7 req-1ba85fcc-d6f0-457e-8e95-acd06c794b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501074ac-0aa5-4617-9f93-0e1b33fd4d54", "name": "network-vif-deleted", "tag": "ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:20.493307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fc0082a0-d997-4d0a-829c-db8e81df69b7 req-1ba85fcc-d6f0-457e-8e95-acd06c794b4d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:20.494050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fc0082a0-d997-4d0a-829c-db8e81df69b7 req-1ba85fcc-d6f0-457e-8e95-acd06c794b4d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:20.525471 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-fc0082a0-d997-4d0a-829c-db8e81df69b7 req-1ba85fcc-d6f0-457e-8e95-acd06c794b4d service nova] Creating event network-vif-deleted:ed9a0fd4-c59a-4ccf-b8ee-e2a0bba932cc for instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 on n-h1-845775-3 Jul 25 20:39:20.534030 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-fc0082a0-d997-4d0a-829c-db8e81df69b7 req-1ba85fcc-d6f0-457e-8e95-acd06c794b4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062206 Jul 25 20:39:20.535263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2596/5229] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:39:20.668855 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b3232a3-ef80-4c19-86bb-82bb3076f57d tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 1.313229 Jul 25 20:39:20.693991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2634/5230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:19 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:20.945474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:20.949730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:20.971946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:20.973054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:20.974413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:20.975234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:21.699480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:21.700462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:21.706588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:21.756098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:21.758650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:21.768076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:21.780205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-086ed12f-4e72-4a89-8de8-bdce6dc626b4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.844932 Jul 25 20:39:21.782493 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2597/5231] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:20 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:39:21.784838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:21.785867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:21.786901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:22.639815 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92d2aec2-39af-4f84-b531-1f2c2b3bcfee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 0.944751 Jul 25 20:39:22.688225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2635/5232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:21 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:22.810875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:22.811691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:22.824284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:22.831883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:22.835454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:22.836318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:22.882964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:23.695879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:23.696910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:23.714218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:23.714689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:23.715571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:23.724956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:23.851004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:23.863866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:23.871685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:23.872881 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3e07bc83-587e-4bac-b185-9babe9135ddd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.066199 Jul 25 20:39:23.901703 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2598/5233] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:22 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:24.091721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:24.092634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:24.105045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:24.112921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:24.121281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:24.121760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:24.315317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lazy-loading 'services' on Instance uuid a4786d8c-6b91-4c3d-a417-9a1b413f983c {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:39:24.493902 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26ab1101-927b-4a4c-9c62-55d8261c8071 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c/os-volume_attachments/04557782-ad1c-47c0-9eab-a62d32925f21" status: 202 len: 0 microversion: 2.1 time: 0.406564 Jul 25 20:39:24.495171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2599/5234] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:39:24 2022] DELETE /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c/os-volume_attachments/04557782-ad1c-47c0-9eab-a62d32925f21 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:39:24.903471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:24.914882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:24.958117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:24.961788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:24.969351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:24.969351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:25.751371 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad22392f-6ceb-418a-9564-b0e07c17fbc5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 2.059315 Jul 25 20:39:25.776071 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2636/5235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:23 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:26.024147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:26.044851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:26.046705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:26.048402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-de53dd8e-3e36-42ca-8870-550453836f90 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.150120 Jul 25 20:39:26.048954 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2600/5236] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:24 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:39:26.275154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cca8a206-2d44-42b3-990f-77645de58574 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: .version_select at 0x7f19681d9d30>, body: {"keypair": {"name": "tempest-keypair-627840960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWHjCGPvOsXfw3+/c9ISlWcHQQPGdJsMtqKDbW3KrmQrMXKUSiiKgOzxROchzmZCMbEcADw20zCvRMJ+qSIG4Q/ZR0mJSpGcSfSjL5P0rRzByRCbtpmbSbveITYGHvJEw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:26.319647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cca8a206-2d44-42b3-990f-77645de58574 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:39:26.358482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-cca8a206-2d44-42b3-990f-77645de58574 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for user 5a9fe47530b24272b5cf96e66ec11ae1 and project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:39:26.412535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cca8a206-2d44-42b3-990f-77645de58574 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141516 Jul 25 20:39:26.422692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2637/5237] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:39:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:26.789964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:26.790588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:26.822689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:26.841700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:26.847906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:26.853941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:27.076749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:27.078245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:27.095910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:27.103853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:27.109670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:27.112767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:27.765310 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76c86938-a722-41de-91f7-47e70e6a0137 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 0.977001 Jul 25 20:39:27.769797 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2601/5238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:26 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:27.784932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-7e91f5c9-80ad-4755-8525-d3488203b502 req-b4f8e32f-5155-42e1-9989-6a3d3ab743ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c63fe-2c9f-4e72-91e4-a7a1faa2721c", "name": "network-vif-plugged", "status": "completed", "tag": "4aaba766-12dd-4e02-9f60-a63d35b33de3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:27.807420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7e91f5c9-80ad-4755-8525-d3488203b502 req-b4f8e32f-5155-42e1-9989-6a3d3ab743ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:27.809057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7e91f5c9-80ad-4755-8525-d3488203b502 req-b4f8e32f-5155-42e1-9989-6a3d3ab743ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:27.838040 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-7e91f5c9-80ad-4755-8525-d3488203b502 req-b4f8e32f-5155-42e1-9989-6a3d3ab743ab service nova] Creating event network-vif-plugged:4aaba766-12dd-4e02-9f60-a63d35b33de3 for instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c on n-h2-845775-3 Jul 25 20:39:27.838234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:27.842500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:27.852454 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-7e91f5c9-80ad-4755-8525-d3488203b502 req-b4f8e32f-5155-42e1-9989-6a3d3ab743ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079095 Jul 25 20:39:27.853112 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2602/5239] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:27.858880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:27.863738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:27.866207 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04014791-c19c-451b-8724-8a32e5226978 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.795378 Jul 25 20:39:27.866778 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2638/5240] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:27 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:39:28.478730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:28.479492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:28.487601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-09777df7-2a3c-4875-8c6b-eebffbbfd36e req-a12479b0-bbd3-43eb-94ad-8a20bee58854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:28.504147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.507131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.511101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.517139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.547391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-09777df7-2a3c-4875-8c6b-eebffbbfd36e req-a12479b0-bbd3-43eb-94ad-8a20bee58854 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.547908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-09777df7-2a3c-4875-8c6b-eebffbbfd36e req-a12479b0-bbd3-43eb-94ad-8a20bee58854 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.570971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-09777df7-2a3c-4875-8c6b-eebffbbfd36e req-a12479b0-bbd3-43eb-94ad-8a20bee58854 service nova] Creating event network-changed:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:39:28.584911 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-09777df7-2a3c-4875-8c6b-eebffbbfd36e req-a12479b0-bbd3-43eb-94ad-8a20bee58854 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104218 Jul 25 20:39:28.592572 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2639/5241] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:28.613350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:39:28.796259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:28.797238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:28.807086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.811284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.814392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.817746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.861413 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7f580802-1274-4003-a37b-d8f8f1ccdd3f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 204 len: 0 microversion: 2.1 time: 0.389037 Jul 25 20:39:28.867306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2603/5242] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:39:28 2022] DELETE /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:39:28.894499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:28.899754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:28.909336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.909813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:28.910617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:28.919927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:29.730103 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:29.750926 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c07e3baf-e7e7-47a6-915c-6ac9ca31aa48 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1585 microversion: 2.1 time: 0.882104 Jul 25 20:39:29.752657 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1891b511-21e4-4cea-b7a4-5264b77c7a2b tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1464 microversion: 2.1 time: 0.961342 Jul 25 20:39:29.773209 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2604/5243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:28 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1585 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:29.773898 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2640/5244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:28 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1464 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:29.790943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:29.791778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:29.803742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:29.810298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:29.811470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:29.812180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:30.499686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:30.528485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:30.531972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:30.538355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d70f01ca-52ff-48a5-9b94-4fb7cf1340e0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.759652 Jul 25 20:39:30.542170 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2605/5245] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:29 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:30.781916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:30.782662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:30.783544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:30.784489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:30.797012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:30.798002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:30.798648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:30.803847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:30.804767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:30.806879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:30.807846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:30.808330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:31.884448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:31.895027 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-836be7eb-c0de-4c31-a1e8-cf9c25f4e992 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1585 microversion: 2.1 time: 1.116245 Jul 25 20:39:31.898877 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2606/5246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:30 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1585 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:31.909471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:31.913477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:31.927956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:31.931280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:31.933612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:31.939717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:32.153618 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-284cf74e-555a-4922-801f-36dde0e9f3c0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1649 microversion: 2.1 time: 1.375068 Jul 25 20:39:32.178154 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2641/5247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:30 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1649 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:32.190711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:32.191447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:32.217226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:32.221132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:32.222193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:32.229350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:33.285025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:33.315814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:33.318446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:33.321692 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5486090c-4433-4066-8e91-7d944cbe2f7d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.421515 Jul 25 20:39:33.323951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2607/5248] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:31 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:33.367007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef9b321e-a4bb-42fb-bf61-ac87eed044b5 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1649 microversion: 2.1 time: 1.181200 Jul 25 20:39:33.367868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:33.368830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:33.374840 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2642/5249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:32 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1649 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:33.395013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:33.398606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:33.407755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:33.412577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:33.413548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:33.414588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:33.445330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:33.446635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:33.452414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:33.453562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:33.884456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:33.919029 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8ec0e43-7847-4c97-8e7a-f0ea329e7163 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1398 microversion: 2.1 time: 0.592096 Jul 25 20:39:33.920372 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2608/5250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:33 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1398 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:33.937815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1021669056", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccb379e4-5962-4bb6-9044-f2918dcfc410"}], "security_groups": [{"name": "tempest-securitygroup--1472938911"}], "key_name": "tempest-keypair-627840960", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:34.430619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] validate_networks() for [('ccb379e4-5962-4bb6-9044-f2918dcfc410', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:39:34.591121 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16072b14-8aed-4d6a-936b-1186669fb393 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1649 microversion: 2.1 time: 1.197989 Jul 25 20:39:34.591734 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2643/5251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:33 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1649 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:34.637429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f29ac6dc-052e-4217-ab02-b2f8c8f81c69 req-55848a70-2af8-4340-9543-6317cdb44846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c", "name": "network-vif-deleted", "tag": "1eb2a5ff-771e-4927-ba74-15a74edd122f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:34.680273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f29ac6dc-052e-4217-ab02-b2f8c8f81c69 req-55848a70-2af8-4340-9543-6317cdb44846 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:34.680931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f29ac6dc-052e-4217-ab02-b2f8c8f81c69 req-55848a70-2af8-4340-9543-6317cdb44846 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:34.711128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f29ac6dc-052e-4217-ab02-b2f8c8f81c69 req-55848a70-2af8-4340-9543-6317cdb44846 service nova] Creating event network-vif-deleted:1eb2a5ff-771e-4927-ba74-15a74edd122f for instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c on n-h1-845775-3 Jul 25 20:39:34.722828 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f29ac6dc-052e-4217-ab02-b2f8c8f81c69 req-55848a70-2af8-4340-9543-6317cdb44846 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116291 Jul 25 20:39:34.725770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2644/5252] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:34.739788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:34.741577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:34.760778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:34.764385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:34.776511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:34.783376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.298626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:35.314307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:35.320301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:35.324014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a41db18f-cf4b-49eb-b281-8913f3ec447b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.594658 Jul 25 20:39:35.336069 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2645/5253] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:34 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:35.350958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:35.352004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:35.369862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.370332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.373571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.375920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.484521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:39:35.672443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:39:35.674247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:39:35.675569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:39:35.677264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:39:35.677956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:39:35.688635 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dcba9632-b206-4c31-9304-1fcf0aa33d64 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 204 len: 0 microversion: 2.1 time: 0.349353 Jul 25 20:39:35.690644 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2646/5254] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:39:35 2022] DELETE /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:39:35.696773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.698013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.699158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.700236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.718162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:35.719191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:35.731178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.731891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.732935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.733535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.764874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:39:35.780533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Getting quotas for user 5a9fe47530b24272b5cf96e66ec11ae1 and project 2a5d4bd3dc2d43a79e843bced5acd619. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:39:35.815920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:39:35.830476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:39:35.884580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:35.894224 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99fcb5fd-00b5-4236-8dae-893fbdeb3e8e tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.199437 Jul 25 20:39:35.899068 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2647/5255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:35 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:35.923810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:35.924493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:35.933616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.935840 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4bd87687-515d-427a-9c09-68ecad0e9160 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.011336 Jul 25 20:39:35.940790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.941687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:35.942196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:35.942343 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2609/5256] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:39:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:39:35.954656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99f7903b-72a4-4bd5-b69b-2044f5c4d60c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:35.980824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99f7903b-72a4-4bd5-b69b-2044f5c4d60c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:36.170657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-99f7903b-72a4-4bd5-b69b-2044f5c4d60c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:36.183522 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99f7903b-72a4-4bd5-b69b-2044f5c4d60c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1237 microversion: 2.1 time: 0.233771 Jul 25 20:39:36.190907 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2610/5257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:35 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1237 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:36.349240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:36.349812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:36.363516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.363797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.366591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.370546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.380455 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-153fc681-e436-45e8-a374-6c46269195f6 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1655 microversion: 2.1 time: 0.479387 Jul 25 20:39:36.391240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2648/5258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:35 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1655 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:36.391240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:36.428650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:36.433411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:39:36.435044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:36.449857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.450499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.451382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.452059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.684880 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6fa79439-1d33-4c30-ac3a-052a9e6321a0 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 204 len: 0 microversion: 2.1 time: 0.361569 Jul 25 20:39:36.689922 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2611/5259] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:39:36 2022] DELETE /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:39:36.698909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:36.699634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:36.712305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.713606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.717399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.718212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.896414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:36.905638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:36.914160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:36.917643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e758287a-610d-4402-aa4c-b38a77ee1d8f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.533770 Jul 25 20:39:36.929106 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2649/5260] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:36 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:36.945814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:36.954110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:36.968795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.980288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:36.981546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:36.983610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.156532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:37.171868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00414549-737d-4368-ad38-17a8a353c1c8 tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1558 microversion: 2.1 time: 0.478571 Jul 25 20:39:37.176992 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2612/5261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:36 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1558 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:37.220662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:37.227074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:37.230158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:37.245035 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ca0afb0-0378-4482-9eb9-9e1b55a7bb30 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.312807 Jul 25 20:39:37.248214 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2650/5262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:36 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:37.249547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.250381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.251657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.252638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.263787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:37.412336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:37.415360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:37.455533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.463497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:37.468779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.474833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.477224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.495268 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61997bc1-9b0f-4d93-a180-f07944b221c1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1241 microversion: 2.1 time: 0.279348 Jul 25 20:39:37.512648 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2613/5263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:37 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1241 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:37.755179 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8305d9a4-e40e-45bf-829b-db710930fc87 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1655 microversion: 2.1 time: 0.349155 Jul 25 20:39:37.767773 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2651/5264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:37 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1655 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:37.966969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:37.967801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:37.979380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.980012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:37.980948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:37.981591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.211803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:38.212487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:38.223554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.224470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.227630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.228450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.501640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:38.522576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:38.526959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:38.531453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a412713-7ed4-48a7-b42e-0af27c694484 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.568139 Jul 25 20:39:38.533274 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2614/5265] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:37 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:38.546669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:38.550181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:38.568566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.571671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.572763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.576263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.774253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:38.788299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1e4799b-97dd-4f90-a4a7-b2c02b329650 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.251171 Jul 25 20:39:38.801100 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2615/5266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:38 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:38.830981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:38.832182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:38.844853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.845630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.846891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:38.848013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:38.935164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:38.960833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9873b944-bd64-4d0f-8acc-7caedee695ac tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1512 microversion: 2.1 time: 0.755775 Jul 25 20:39:38.964830 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2652/5267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:38 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:38.983494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:38.984886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:39.006389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:39.011377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:39.015105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:39.017915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:39.028644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:39.056457 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55080c20-54ee-4cf3-92c7-cebf067ce20a tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1295 microversion: 2.1 time: 0.237604 Jul 25 20:39:39.072516 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2616/5268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:38 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:39.513768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-40e0c898-41a3-45e2-a299-0ef76dd7c87d req-4ce6cb6a-7621-4b2b-bab3-dc197725630c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "name": "network-vif-plugged", "status": "completed", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:39.563642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-40e0c898-41a3-45e2-a299-0ef76dd7c87d req-4ce6cb6a-7621-4b2b-bab3-dc197725630c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:39.564433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-40e0c898-41a3-45e2-a299-0ef76dd7c87d req-4ce6cb6a-7621-4b2b-bab3-dc197725630c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:39.649213 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-40e0c898-41a3-45e2-a299-0ef76dd7c87d req-4ce6cb6a-7621-4b2b-bab3-dc197725630c service nova] Creating event network-vif-plugged:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h2-845775-3 Jul 25 20:39:39.670993 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-40e0c898-41a3-45e2-a299-0ef76dd7c87d req-4ce6cb6a-7621-4b2b-bab3-dc197725630c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164381 Jul 25 20:39:39.672434 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2617/5269] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:39:39.694853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:39.700140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:39.717476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:39.722341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:39.731470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:39.732182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:40.012791 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bda606a1-b7d4-4cb6-a94d-83896c8031e0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 200 len: 1655 microversion: 2.1 time: 1.046121 Jul 25 20:39:40.024529 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2653/5270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:38 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 1655 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:40.049784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:40.051429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:40.063625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:40.064688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:40.066249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:40.067304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:40.591722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:40.606513 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4be96772-044b-4771-9cb2-d78c248d2a0f tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.580342 Jul 25 20:39:40.622181 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2654/5271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:40 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:40.630431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:40.655336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:40.672563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:40.673428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:40.675513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:40.676663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:40.682472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:41.532641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:41.561481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:41.563602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:41.566356 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62cbe35b-7ef2-4430-92a2-12c2e00f4070 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 1.892182 Jul 25 20:39:41.568207 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2618/5272] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:39 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:41.593178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:41.611892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:41.633914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:41.634429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:41.635246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:41.635823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:41.936068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1826f88ece04754a6b9a6eada79bbc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150ed184096d42e7881b83885d79b351', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:41.950241 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-777ab3b5-2a89-403f-9668-02982013c45c tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 200 len: 1512 microversion: 2.1 time: 1.326683 Jul 25 20:39:41.964261 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2655/5273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:40 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 1512 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:42.438704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-113b8880-279c-44a0-8e43-53de9134df64 req-b5d653f4-657d-4717-a53d-49f7e3976c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c63fe-2c9f-4e72-91e4-a7a1faa2721c", "name": "network-vif-deleted", "tag": "4aaba766-12dd-4e02-9f60-a63d35b33de3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:42.458633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-113b8880-279c-44a0-8e43-53de9134df64 req-b5d653f4-657d-4717-a53d-49f7e3976c50 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.459263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-113b8880-279c-44a0-8e43-53de9134df64 req-b5d653f4-657d-4717-a53d-49f7e3976c50 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.495013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-113b8880-279c-44a0-8e43-53de9134df64 req-b5d653f4-657d-4717-a53d-49f7e3976c50 service nova] Creating event network-vif-deleted:4aaba766-12dd-4e02-9f60-a63d35b33de3 for instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c on n-h2-845775-3 Jul 25 20:39:42.517167 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-113b8880-279c-44a0-8e43-53de9134df64 req-b5d653f4-657d-4717-a53d-49f7e3976c50 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.546171 Jul 25 20:39:42.518386 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2656/5274] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:42.528266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:42.529163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: a36c63fe-2c9f-4e72-91e4-a7a1faa2721c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:42.550147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.550831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.552450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.555565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.556896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:42.568991 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84f81570-af81-4c74-975c-9c5c569d04c6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1295 microversion: 2.1 time: 0.983650 Jul 25 20:39:42.576682 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2619/5275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:41 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1295 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:42.601387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5658b077-44f6-4d0e-b150-f0ce9aa24a18 req-7b382b87-721c-48f5-abf2-5583602a73eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4786d8c-6b91-4c3d-a417-9a1b413f983c", "name": "network-vif-deleted", "tag": "8af02972-6ac8-46be-8e97-9d5728f320e1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:42.615569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] HTTP exception thrown: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Request method failure captured: Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c HTTP/1.1 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v9O_yTZEA8cJOmDdZ6ypdPHY9L0TaAxkPpf-uYDsvza3VYTRr_aWjFpMvanrVH1Qct13vgYoxSeniCTfp8k690yjPY6gwJRTp3313c8KBnKnY6ESaR85iJxI06CetKeemb6jmRrZTkmBDPejWBfJU9x_kQVxw9TD6wcefnXTPwrehw Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a951cec7913843a2adf6d6890ff789a0 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestServerMultinode-164790380 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a951cec7913843a2adf6d6890ff789a0"}]}] Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestServerMultinode-164790380 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a951cec7913843a2adf6d6890ff789a0 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestServerMultinode-164790380 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestServerMultinode-164790380-project-admin Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b7624168d8154c1283e2a27ba267f558 Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestServerMultinode-164790380-project-admin Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a36c63fe-2c9f-4e72-91e4-a7a1faa2721c'} Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:42.617318 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. Jul 25 20:39:42.622825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:42.624998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Returning 404 to user: Instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:39:42.626527 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e216af31-d670-4eb2-b466-3dfbd53e2e61 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c" status: 404 len: 111 microversion: 2.1 time: 0.106553 Jul 25 20:39:42.627268 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2657/5276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:42 2022] GET /compute/v2.1/servers/a36c63fe-2c9f-4e72-91e4-a7a1faa2721c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:39:42.646184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:42.647314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:42.657477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5658b077-44f6-4d0e-b150-f0ce9aa24a18 req-7b382b87-721c-48f5-abf2-5583602a73eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.658116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5658b077-44f6-4d0e-b150-f0ce9aa24a18 req-7b382b87-721c-48f5-abf2-5583602a73eb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.658664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.659507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.661314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.664853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.693678 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5658b077-44f6-4d0e-b150-f0ce9aa24a18 req-7b382b87-721c-48f5-abf2-5583602a73eb service nova] Creating event network-vif-deleted:8af02972-6ac8-46be-8e97-9d5728f320e1 for instance a4786d8c-6b91-4c3d-a417-9a1b413f983c on n-h2-845775-3 Jul 25 20:39:42.709219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5658b077-44f6-4d0e-b150-f0ce9aa24a18 req-7b382b87-721c-48f5-abf2-5583602a73eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125580 Jul 25 20:39:42.710719 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2620/5277] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:42.726920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-7c1178c6-179a-4d8c-a5b1-9a02b4231341 req-af163ecd-99cc-4d43-99b7-bdff5e872f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36c63fe-2c9f-4e72-91e4-a7a1faa2721c", "name": "network-vif-unplugged", "status": "completed", "tag": "4aaba766-12dd-4e02-9f60-a63d35b33de3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:42.760991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7c1178c6-179a-4d8c-a5b1-9a02b4231341 req-af163ecd-99cc-4d43-99b7-bdff5e872f78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.762724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7c1178c6-179a-4d8c-a5b1-9a02b4231341 req-af163ecd-99cc-4d43-99b7-bdff5e872f78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.808846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-7c1178c6-179a-4d8c-a5b1-9a02b4231341 req-af163ecd-99cc-4d43-99b7-bdff5e872f78 service nova] Creating event network-vif-unplugged:4aaba766-12dd-4e02-9f60-a63d35b33de3 for instance a36c63fe-2c9f-4e72-91e4-a7a1faa2721c on n-h2-845775-3 Jul 25 20:39:42.850428 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-7c1178c6-179a-4d8c-a5b1-9a02b4231341 req-af163ecd-99cc-4d43-99b7-bdff5e872f78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134292 Jul 25 20:39:42.856168 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2621/5278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:42.875388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:42.877987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:42.901550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:42.902692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.905680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.908995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.909790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.910970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-539e379e-1002-44ce-8b9e-7ae1035ccc73 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.277897 Jul 25 20:39:42.927336 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2658/5279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:42 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:42.934227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:42.935198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:42.943241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.944515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.945573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:42.946234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:42.978021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:39:43.114636 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8061a70c-6279-4b38-b9a8-5f2c7773ba28 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 204 len: 0 microversion: 2.1 time: 0.181888 Jul 25 20:39:43.119102 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2659/5280] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:39:42 2022] DELETE /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:39:43.143855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:43.151383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] [instance: a4786d8c-6b91-4c3d-a417-9a1b413f983c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:43.174331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.175387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:43.178079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.178669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:43.217206 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] HTTP exception thrown: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Request method failure captured: Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c HTTP/1.1 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v4VWToZBUYp7aD67QqUTL-gzDyXMnURwKWaY8VOSpONE8bVzPeEQSilb2EyLCuCILHu_siK4co0lmHsnhBTxGS38qfUI19CADu1cWxyWqRM1rz6sBSZtP_Cb6YBEwfHCpEUTEPxZc1ee4qSEudH9BZx3ih-lK-mC0GZeWCP15C5qFk Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 150ed184096d42e7881b83885d79b351 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/150ed184096d42e7881b83885d79b351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_150ed184096d42e7881b83885d79b351"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/150ed184096d42e7881b83885d79b351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/150ed184096d42e7881b83885d79b351"}]}] Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 150ed184096d42e7881b83885d79b351 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-603273949 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesSnapshotTestJSON-603273949-project Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b1826f88ece04754a6b9a6eada79bbc9 Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesSnapshotTestJSON-603273949-project Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a4786d8c-6b91-4c3d-a417-9a1b413f983c'} Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:43.219543 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:43.224436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] Returning 404 to user: Instance a4786d8c-6b91-4c3d-a417-9a1b413f983c could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:39:43.228528 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7868a827-4490-434a-86a9-ca2c248791ce tempest-VolumesSnapshotTestJSON-603273949 tempest-VolumesSnapshotTestJSON-603273949-project] 10.222.0.48 "GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c" status: 404 len: 111 microversion: 2.1 time: 0.105891 Jul 25 20:39:43.229686 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2660/5281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:43 2022] GET /compute/v2.1/servers/a4786d8c-6b91-4c3d-a417-9a1b413f983c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:39:43.246926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:43.247750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:43.262890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:43.282428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.284184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:43.289371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.289923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:43.602464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:43.620817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:43.631537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:43.632999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aada9d25-fe55-4a3a-831d-586a04184416 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1807 microversion: 2.20 time: 0.774017 Jul 25 20:39:43.635845 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2622/5282] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:42 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1807 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:43.647593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:43.648574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:43.661659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:43.671026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.674569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:43.675893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:43.676612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:44.696824 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0af1d79e-1331-406d-afa9-7991e413020e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1653 microversion: 2.1 time: 1.465563 Jul 25 20:39:44.699954 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2661/5283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:43 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1653 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:44.713220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:44.718660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:44.732167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:44.738052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:44.741235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:44.747705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:44.941041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:44.952990 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dfa7f0ee-2de5-42e7-ac5b-b073a255f3f1 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.250395 Jul 25 20:39:44.953580 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2662/5284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:44 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:44.967383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:44.970225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:44.985865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:44.986562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:44.987495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:44.993308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:45.478806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:45.490617 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6756846c-0e53-4dcd-bfac-1ccace942c56 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 1.853333 Jul 25 20:39:45.493104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2623/5285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:43 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:45.745518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:45.746516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:45.752408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:45.770714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:45.771258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:45.773292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:45.774234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:45.894568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:45.922103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:45.943095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:45.946762 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-70aa2977-2d82-48fc-9d19-52c5ec1cde15 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1794 microversion: 2.20 time: 0.989884 Jul 25 20:39:45.951822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2663/5286] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:39:44 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1794 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:39:45.986595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:45.987406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:45.996863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:45.997799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:45.998830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:45.999507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:46.175654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:39:46.252341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b81917a86246818659ef2ef260a8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6005f86937a94745bdb3f82b325f0dda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:46.258277 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e3942e83-22e3-428e-bfe4-f09cb0218de0 tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1611 microversion: 2.1 time: 0.517126 Jul 25 20:39:46.261029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2624/5287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:45 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1611 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:46.261459 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7eea21da-42d1-45bf-9547-5e3ed20ed4c6 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 200 len: 1230 microversion: 2.1 time: 0.281035 Jul 25 20:39:46.264668 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2664/5288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:45 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 1230 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:46.372857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1cb0d913-87fa-4334-80ad-24a5afaff835 req-f500b516-1681-49fa-bb4e-9a781189909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07bd37d-f259-4d9d-843e-3f1a6951b9f4", "name": "network-vif-deleted", "tag": "38a6c626-9b9e-4f10-ae01-e3042b3ff907"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:46.421248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1cb0d913-87fa-4334-80ad-24a5afaff835 req-f500b516-1681-49fa-bb4e-9a781189909d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:46.442734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1cb0d913-87fa-4334-80ad-24a5afaff835 req-f500b516-1681-49fa-bb4e-9a781189909d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:46.517475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:46.518321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:46.529919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1cb0d913-87fa-4334-80ad-24a5afaff835 req-f500b516-1681-49fa-bb4e-9a781189909d service nova] Creating event network-vif-deleted:38a6c626-9b9e-4f10-ae01-e3042b3ff907 for instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 on n-h1-845775-3 Jul 25 20:39:46.543285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:46.543885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:46.544765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:46.545211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:46.546124 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1cb0d913-87fa-4334-80ad-24a5afaff835 req-f500b516-1681-49fa-bb4e-9a781189909d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176683 Jul 25 20:39:46.547261 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2625/5289] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:39:47.303388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:47.304454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:47.321437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:47.322348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:47.328199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:47.330534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:47.416963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:47.426883 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-78f8dbd7-1937-4d5e-ad55-3c36a50b77ef tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 0.913026 Jul 25 20:39:47.437193 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2665/5290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:46 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:47.452437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:47.453641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] [instance: fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:47.486582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:47.487042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:47.488022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:47.488644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:47.498875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:47.499503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:47.503292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lazy-loading 'fault' on Instance uuid d07bd37d-f259-4d9d-843e-3f1a6951b9f4 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:39:47.552890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] HTTP exception thrown: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Request method failure captured: Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c HTTP/1.1 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v4P4C8E-rWFlsfcHNd3JnxoAOLHwcJxjMidu3R_RNkGGya4wHr5m9Yuk2tvHBH3F98khgnyQZbFB18k9upWljY7ugHPyngiZLJ1K9wALbx6FX4F88TuqsJWEx6-X5ZChJcaKW4lhiGlXp8fF1FZexMZX1lf7s1FiLQJSrI6MuTRQ3c Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6005f86937a94745bdb3f82b325f0dda Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBackupRestore-428716834 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6005f86937a94745bdb3f82b325f0dda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6005f86937a94745bdb3f82b325f0dda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6005f86937a94745bdb3f82b325f0dda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6005f86937a94745bdb3f82b325f0dda"}]}] Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBackupRestore-428716834 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6005f86937a94745bdb3f82b325f0dda Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBackupRestore-428716834 Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBackupRestore-428716834-project Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 06b81917a86246818659ef2ef260a8ae Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBackupRestore-428716834-project Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c'} Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:47.555126 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. Jul 25 20:39:47.559606 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:47.561244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Returning 404 to user: Instance fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:39:47.565112 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0de51d4-96dc-45a5-a819-2fe229926fff tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c" status: 404 len: 111 microversion: 2.1 time: 0.126626 Jul 25 20:39:47.570359 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2666/5291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:47 2022] GET /compute/v2.1/servers/fa7f6a04-f12a-4c13-8d1e-8a54a6c7399c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:39:47.711325 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54d552ca-c904-4b1a-9810-e73036acda1e tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 200 len: 1453 microversion: 2.1 time: 0.410987 Jul 25 20:39:47.712415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2626/5292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:47 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 1453 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:48.381379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8af703b-9bbc-41f3-a902-9615f878a784 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] Calling method '.version_select at 0x7f19681c6c10>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:48.445480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8af703b-9bbc-41f3-a902-9615f878a784 tempest-TestVolumeBackupRestore-428716834 tempest-TestVolumeBackupRestore-428716834-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1013766454" status: 202 len: 0 microversion: 2.1 time: 0.068458 Jul 25 20:39:48.453513 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2667/5293] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Jul 25 20:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1013766454 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:39:48.482031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:48.484005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:48.506494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:48.509259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:48.511803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:48.512962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:48.736876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:48.738258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] [instance: d07bd37d-f259-4d9d-843e-3f1a6951b9f4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:48.794600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:48.821616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:48.824617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:48.825709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:48.943889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] HTTP exception thrown: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Request method failure captured: Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 HTTP/1.1 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v9O_yTZEA8cJOmDdZ6ypdPHY9L0TaAxkPpf-uYDsvza3VYTRr_aWjFpMvanrVH1Qct13vgYoxSeniCTfp8k690yjPY6gwJRTp3313c8KBnKnY6ESaR85iJxI06CetKeemb6jmRrZTkmBDPejWBfJU9x_kQVxw9TD6wcefnXTPwrehw Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a951cec7913843a2adf6d6890ff789a0 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestServerMultinode-164790380 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a951cec7913843a2adf6d6890ff789a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a951cec7913843a2adf6d6890ff789a0"}]}] Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestServerMultinode-164790380 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a951cec7913843a2adf6d6890ff789a0 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestServerMultinode-164790380 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestServerMultinode-164790380-project-admin Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: b7624168d8154c1283e2a27ba267f558 Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestServerMultinode-164790380-project-admin Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd07bd37d-f259-4d9d-843e-3f1a6951b9f4'} Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:39:48.973093 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. Jul 25 20:39:48.979002 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:39:48.983299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] Returning 404 to user: Instance d07bd37d-f259-4d9d-843e-3f1a6951b9f4 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:39:48.998326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9901ac2d-6e94-4434-97a9-614d461240ee tempest-TestServerMultinode-164790380 tempest-TestServerMultinode-164790380-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4" status: 404 len: 111 microversion: 2.1 time: 0.260527 Jul 25 20:39:49.000084 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2668/5294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:48 2022] GET /compute/v2.1/servers/d07bd37d-f259-4d9d-843e-3f1a6951b9f4 => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:39:49.236677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:49.245500 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d28e8da7-7b69-4fc8-802a-9cfcdc7e67d9 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 0.792291 Jul 25 20:39:49.250589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2627/5295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:48 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:49.633975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e4fe1a05-ec60-4136-863d-6b0ee6abb620 req-7f7934b1-4a14-4923-ad23-98e951f3229b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb27001c-a2df-4dd4-bec1-6715b43f3c4d", "tag": "515f6b9f-72a0-432d-b315-c9c7e29cb4e6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:39:49.667021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e4fe1a05-ec60-4136-863d-6b0ee6abb620 req-7f7934b1-4a14-4923-ad23-98e951f3229b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:49.667361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e4fe1a05-ec60-4136-863d-6b0ee6abb620 req-7f7934b1-4a14-4923-ad23-98e951f3229b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:49.715628 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e4fe1a05-ec60-4136-863d-6b0ee6abb620 req-7f7934b1-4a14-4923-ad23-98e951f3229b service nova] Creating event network-changed:515f6b9f-72a0-432d-b315-c9c7e29cb4e6 for instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d on n-h1-845775-3 Jul 25 20:39:49.741474 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e4fe1a05-ec60-4136-863d-6b0ee6abb620 req-7f7934b1-4a14-4923-ad23-98e951f3229b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112306 Jul 25 20:39:49.742097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2669/5296] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:39:50.280263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:50.281431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:50.335668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:50.356706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:50.359873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:50.361500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:51.371957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:51.386817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-094f4cf2-4d92-45ce-8d67-de93854e8bee tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 1.106457 Jul 25 20:39:51.390968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2628/5297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:50 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:52.416866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:52.418206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:52.455190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:52.471280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:52.472650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:52.476149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:54.844411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:54.883288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-17192e07-631b-43f0-a6e4-552c180665f5 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 2.473564 Jul 25 20:39:54.900015 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2670/5298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:52 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:39:55.933001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:55.934940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:55.979471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:55.983306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:55.987506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:55.992509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:58.530087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:39:58.571207 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a3688d4a-4be5-4905-9bef-b11b3ee7f69d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 2.638386 Jul 25 20:39:58.573272 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2629/5299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:55 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:39:59.604098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:39:59.605928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:39:59.623588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:59.627278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:39:59.630413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:39:59.635957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:00.076222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a86d0e9b-9672-46e6-aed5-e8874628459d req-8487f4a7-6bf2-4f70-af6d-a80ed42eaddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb27001c-a2df-4dd4-bec1-6715b43f3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "515f6b9f-72a0-432d-b315-c9c7e29cb4e6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:00.113274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a86d0e9b-9672-46e6-aed5-e8874628459d req-8487f4a7-6bf2-4f70-af6d-a80ed42eaddd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:00.114161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a86d0e9b-9672-46e6-aed5-e8874628459d req-8487f4a7-6bf2-4f70-af6d-a80ed42eaddd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:00.157177 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a86d0e9b-9672-46e6-aed5-e8874628459d req-8487f4a7-6bf2-4f70-af6d-a80ed42eaddd service nova] Creating event network-vif-plugged:515f6b9f-72a0-432d-b315-c9c7e29cb4e6 for instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d on n-h1-845775-3 Jul 25 20:40:00.188578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a86d0e9b-9672-46e6-aed5-e8874628459d req-8487f4a7-6bf2-4f70-af6d-a80ed42eaddd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123249 Jul 25 20:40:00.204694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2630/5300] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:40:00.870492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:00.902347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b545f366-3041-41ec-8ab5-1042276c1ffc tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 1.298692 Jul 25 20:40:00.906412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2671/5301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:39:59 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:40:01.936988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:01.938581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:01.958952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:01.960607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:01.968767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:01.969597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:02.880141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:02.898962 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc8a1ffb-62af-464e-9c77-e05722f06bb7 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1363 microversion: 2.1 time: 0.969199 Jul 25 20:40:02.902122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2631/5302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:40:01 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1363 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:40:04.540396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:04.542096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:04.560626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:04.579015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:04.587679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:04.590821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:05.495534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:05.530318 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a0bc96e-7ef5-49c1-84f7-4e2edba9383e tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1549 microversion: 2.1 time: 1.606817 Jul 25 20:40:05.531329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2672/5303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:40:03 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1549 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:40:05.575917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:05.578203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:05.632421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:05.636193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:05.640281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:05.646595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:05.893666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d4a1642-49fa-4527-b90a-aa68f3e52f7b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323629 Jul 25 20:40:05.900507 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2632/5304] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:40:05 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:40:10.622410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a3ec9a13-ca49-441c-a3a7-d026cfbf4158 req-72dfb1d7-90dd-404a-9cb4-78f08e3fed67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb27001c-a2df-4dd4-bec1-6715b43f3c4d", "tag": "515f6b9f-72a0-432d-b315-c9c7e29cb4e6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:10.672626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a3ec9a13-ca49-441c-a3a7-d026cfbf4158 req-72dfb1d7-90dd-404a-9cb4-78f08e3fed67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:10.673297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a3ec9a13-ca49-441c-a3a7-d026cfbf4158 req-72dfb1d7-90dd-404a-9cb4-78f08e3fed67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:10.741023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:10.755613 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a3ec9a13-ca49-441c-a3a7-d026cfbf4158 req-72dfb1d7-90dd-404a-9cb4-78f08e3fed67 service nova] Creating event network-changed:515f6b9f-72a0-432d-b315-c9c7e29cb4e6 for instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d on n-h1-845775-3 Jul 25 20:40:10.769243 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a3ec9a13-ca49-441c-a3a7-d026cfbf4158 req-72dfb1d7-90dd-404a-9cb4-78f08e3fed67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146827 Jul 25 20:40:10.771493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2673/5305] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:40:27.599845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=21 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:27.601611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=99 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:27.616389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:27.621356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:27.674554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:27.678935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:27.687556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:27.698773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:27.888669 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-407e5187-697f-4a1a-a07d-feb82ecebbf7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments/f8178959-ad85-4ccf-89f1-6ca28b6e3476" status: 200 len: 194 microversion: 2.20 time: 0.289303 Jul 25 20:40:27.892539 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2633/5306] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Jul 25 20:40:27 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments/f8178959-ad85-4ccf-89f1-6ca28b6e3476 => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:28.095516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:28.096997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:28.125231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:28.132918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:28.134258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:28.139304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:28.141227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:28.353965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lazy-loading 'services' on Instance uuid b7eb81b8-62b7-4073-90be-cc5afe05a1ed {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:40:28.524007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-945e7502-bd6f-4742-989c-3bbe1168730b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments/f8178959-ad85-4ccf-89f1-6ca28b6e3476" status: 202 len: 0 microversion: 2.20 time: 0.434331 Jul 25 20:40:28.525551 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2674/5307] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Jul 25 20:40:28 2022] DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments/f8178959-ad85-4ccf-89f1-6ca28b6e3476 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:40:28.536387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:28.538856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:28.557936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:28.559730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:28.563950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:28.566932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:28.686483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5974fb3f-0c88-454b-986f-daec34dfa426 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155915 Jul 25 20:40:28.688533 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2634/5308] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:28 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:29.708948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:29.717807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:29.755904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:29.760278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:29.770882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:29.772698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:30.596585 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bec75cf7-0f29-4692-aa7c-def1aad36896 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.888215 Jul 25 20:40:30.598860 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2675/5309] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:29 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:31.612878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:31.621914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:31.654897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:31.656697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:31.663657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:31.665579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:31.782968 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0674df7-4d00-45da-9594-2bd30c22d090 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175920 Jul 25 20:40:31.788621 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2635/5310] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:31 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:40:32.796717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:32.798808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:32.822088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:32.824183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:32.832320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:32.835009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:32.936928 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-38418e02-3830-4a78-9512-a3b28256ac22 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144184 Jul 25 20:40:32.944747 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2676/5311] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:32 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:33.951419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:33.953687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:33.986547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:33.987016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:33.987813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:33.988318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:34.147380 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-278580b7-ee86-43bb-bf3f-8fa535b0c652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200084 Jul 25 20:40:34.160565 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2636/5312] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:33 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:35.174336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:35.179065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:35.225611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:35.226349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:35.227204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:35.227648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:35.397182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f41a2f8d-1e36-4eb1-a48d-f3e157ca4f53 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.226741 Jul 25 20:40:35.409735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2677/5313] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:35 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:36.411591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:36.417443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:36.450844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:36.456939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:36.458101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:36.458719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:36.624434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b8573bb-4e57-4eb0-bc4d-582b22293444 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.218555 Jul 25 20:40:36.629094 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2637/5314] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:36 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:37.642681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:37.646499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:37.662658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:37.663452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:37.665192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:37.667421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:37.744742 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c293b74-e7a6-4c45-85b3-1e890bb206f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107684 Jul 25 20:40:37.749752 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2678/5315] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:37 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:38.765301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:38.767591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:38.789879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:38.796803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:38.807369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:38.808163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:38.919650 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6268ffad-bd5c-4506-b61f-fc83ecdf139b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161825 Jul 25 20:40:38.925134 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2638/5316] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:38 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:39.941224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:39.943460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:39.963877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:39.976520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:39.981891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:39.992773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:40.095070 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-413f31ad-1dbe-4dbf-871e-13964fd8e18d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.162275 Jul 25 20:40:40.098454 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2679/5317] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:39 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:40:41.109613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:41.112407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:41.139431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.161949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:41.165673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.166217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:41.293019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6022a87e-36c6-4aaa-a66f-11147e8a4ec8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.188213 Jul 25 20:40:41.310881 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2639/5318] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:40:41 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:40:41.542867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:41.543565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:41.567638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.579085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:41.580108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.580572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:41.726151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:40:41.907058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fdcac0f-b80b-4cba-9a16-fa347387990b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 204 len: 0 microversion: 2.20 time: 0.373213 Jul 25 20:40:41.907984 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2680/5319] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:40:41 2022] DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:40:41.920618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:41.921639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:41.939518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.940356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:41.942408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:41.944877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:42.740611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:42.758777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:42.765458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:42.774604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd2bb14d-0da9-4231-a3cb-1b34e970340a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 0.859559 Jul 25 20:40:42.792220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2640/5320] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:40:41 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:40:42.792394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:42.792394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:42.810484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:42.814413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:42.815367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:42.820988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:42.945022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64d964c3-e865-4506-8860-eb0bbb46d149 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/ips" status: 200 len: 146 microversion: 2.1 time: 0.165397 Jul 25 20:40:42.945734 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2681/5321] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:40:42 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/ips => generated 146 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:40:43.807178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:43.807843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:43.841649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:43.862667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:43.866612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:43.872451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:45.785284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:45.808384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:45.810478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:45.811765 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fba668c4-4a04-42b1-bda9-a816b99fc652 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1722 microversion: 2.20 time: 2.010406 Jul 25 20:40:45.854235 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2641/5322] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:40:43 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1722 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:40:46.890023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:46.891304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:46.916026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:46.916703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:46.918305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:46.919110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:46.951840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-25fce694-c08d-409b-9d53-8f32ded7cb35 req-c7eb60de-4500-4061-9620-33efafebf8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eb81b8-62b7-4073-90be-cc5afe05a1ed", "name": "network-vif-deleted", "tag": "597ac18e-3230-40b9-bbd4-d737dc14fdca"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:47.013208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25fce694-c08d-409b-9d53-8f32ded7cb35 req-c7eb60de-4500-4061-9620-33efafebf8f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:47.013594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-25fce694-c08d-409b-9d53-8f32ded7cb35 req-c7eb60de-4500-4061-9620-33efafebf8f6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:47.081194 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-25fce694-c08d-409b-9d53-8f32ded7cb35 req-c7eb60de-4500-4061-9620-33efafebf8f6 service nova] Creating event network-vif-deleted:597ac18e-3230-40b9-bbd4-d737dc14fdca for instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed on n-h2-845775-3 Jul 25 20:40:47.112254 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-25fce694-c08d-409b-9d53-8f32ded7cb35 req-c7eb60de-4500-4061-9620-33efafebf8f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163849 Jul 25 20:40:47.124452 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2642/5323] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:40:47.155710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:47.174275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:47.177935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:47.183856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4c23597f-30a6-4f81-be07-5a10c3187ffd tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1654 microversion: 2.20 time: 0.306155 Jul 25 20:40:47.186914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2682/5324] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:40:46 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1654 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:40:47.496141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05036835-39f9-433f-9e74-b9a9fb3f76ae"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:47.500508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:47.520809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:47.521280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:47.522204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:47.524323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:48.223209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:48.225273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:48.264921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:48.267400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:48.270917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:48.278520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:48.282778 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52755b73-dae6-4556-84e0-06bb6786ce78 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791469 Jul 25 20:40:48.295986 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2643/5325] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:40:47 2022] POST /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 194 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:40:48.504666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:48.514774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:48.521945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lazy-loading 'fault' on Instance uuid b7eb81b8-62b7-4073-90be-cc5afe05a1ed {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:40:48.757682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:48.766422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:48.778333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:40:48.785520 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b47f1e9-baee-4d9a-ba0c-762acea03700 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 200 len: 1369 microversion: 2.20 time: 0.567270 Jul 25 20:40:48.788452 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2683/5326] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:40:48 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 1369 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:40:49.814514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:49.815239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:40:49.837709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:49.837932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:49.844539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:40:49.845010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:40:49.883927 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed HTTP/1.1 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b7eb81b8-62b7-4073-90be-cc5afe05a1ed'} Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:40:49.901685 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:40:49.910543 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c4ad219-35db-44af-ae0f-f9704efd180b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 404 len: 111 microversion: 2.20 time: 0.097140 Jul 25 20:40:49.916458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-147f9a0d-773c-4f89-bd07-da63ae608f4c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '.version_select at 0x7f196824ab80>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:40:49.928302 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2644/5327] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:40:49 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:40:49.978572 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-147f9a0d-773c-4f89-bd07-da63ae608f4c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964714302" status: 204 len: 0 microversion: 2.20 time: 0.067422 Jul 25 20:40:49.979168 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2684/5328] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Jul 25 20:40:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964714302 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 20:40:52.311706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1ac199d-6e5d-4a29-85ea-8f8cf688c7a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: .version_select at 0x7f196a827d30>, body: {"keypair": {"name": "tempest-keypair-1774148670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdzRlp3JPcmiKbm1+6RUCs+kUI6FOFR5KnI7saRvdoQuTqBTZ8VUrLEIWUBdNf67ULIX3GN//SS5onGo8n6jBfH3BWzxrybfkRAlw7Cjilk+UYmUcZZ8jvfJ//KutYdsw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:52.395083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e1ac199d-6e5d-4a29-85ea-8f8cf688c7a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for project 6a62d212782a413a9b3be1e165ebe057. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:40:52.411727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-e1ac199d-6e5d-4a29-85ea-8f8cf688c7a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for user 759ea03abd9848b8b0b5af5d3ea4c40d and project 6a62d212782a413a9b3be1e165ebe057. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:40:52.492355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1ac199d-6e5d-4a29-85ea-8f8cf688c7a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.193315 Jul 25 20:40:52.493998 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2645/5329] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Jul 25 20:40:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 20:40:58.451367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2736221", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ac9d85f7-d69a-4e96-96c5-6dafb2200933", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:40:58.485374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:58.765442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:40:58.779543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:41:00.186335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-465491276", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20b69bb5-f064-48af-9903-5eea90e5ead2"}], "security_groups": [{"name": "tempest-securitygroup--2046619386"}], "key_name": "tempest-keypair-1774148670", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:00.230719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:00.232406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:00.455503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:41:00.456096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:41:00.456501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:41:00.457044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:41:00.457527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:41:00.483344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:00.483894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:00.486484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:00.487179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:00.548957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:41:00.563844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:41:00.743468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:41:00.745895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac9d85f7-d69a-4e96-96c5-6dafb2200933',volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:41:00.862574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] validate_networks() for [('20b69bb5-f064-48af-9903-5eea90e5ead2', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:41:01.239320 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [aa5c4945-65ce-4ea3-b10a-8c9e1459467b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 20:41:02.265007 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [aa5c4945-65ce-4ea3-b10a-8c9e1459467b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 37902. Jul 25 20:41:02.274797 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fdbc15e-9b9e-4401-a805-bcbc7140fc9d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.829215 Jul 25 20:41:02.285712 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2685/5330] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:41:02.296347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:41:02.296849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-babec825-3699-4df3-b8ff-462f655b01c6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:02.297368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-babec825-3699-4df3-b8ff-462f655b01c6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:02.297506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:41:02.298469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:41:02.299538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:41:02.300498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:41:02.315922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:02.316656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:02.350796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:02.351953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:02.432242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for project 6a62d212782a413a9b3be1e165ebe057. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:41:02.445561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Getting quotas for user 759ea03abd9848b8b0b5af5d3ea4c40d and project 6a62d212782a413a9b3be1e165ebe057. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:41:02.474330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:41:02.496195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:41:02.549144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-babec825-3699-4df3-b8ff-462f655b01c6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:02.560491 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-babec825-3699-4df3-b8ff-462f655b01c6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1054 microversion: 2.1 time: 0.267501 Jul 25 20:41:02.569902 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2686/5331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:02 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1054 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:02.661249 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-57d1e8d9-5dad-48d5-96ef-84dc71387807 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.478474 Jul 25 20:41:02.669410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2646/5332] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Jul 25 20:41:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 20:41:02.685589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:02.686207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:02.814390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:02.831268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:02.838064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:02.840196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-397f1d58-1092-4e22-8aec-9914d61ad68e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1281 microversion: 2.20 time: 0.169400 Jul 25 20:41:02.842367 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2687/5333] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:02 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:03.594972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:03.596616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:03.623289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:03.623987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:03.625932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:03.629174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:03.869305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:03.870251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:03.876079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:03.891153 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebd6801a-ea28-4c0c-a464-7ddf570df859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1104 microversion: 2.1 time: 0.302246 Jul 25 20:41:03.900289 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2647/5334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:03 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1104 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:03.927507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:03.934792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:03.940065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:03.940571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:04.170638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:04.189900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:04.198131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:04.202941 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2886852-fb1a-44b0-81d6-f5d4e29d57df tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1285 microversion: 2.20 time: 0.340330 Jul 25 20:41:04.216059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2688/5335] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:03 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:04.922187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:04.923503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:04.947969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:04.950735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:04.954481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:04.965914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:05.132781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:05.174663 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c33b3a1-6461-453a-a79c-a38be4e1503f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1152 microversion: 2.1 time: 0.256858 Jul 25 20:41:05.179254 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2648/5336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:04 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1152 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:05.231303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:05.231933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:05.251064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:05.256126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:05.257179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:05.257642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:05.481220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:05.502585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:05.516805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:05.517485 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-91bc9ee6-bf70-45aa-848b-b22bdcba1b7f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1341 microversion: 2.20 time: 0.290114 Jul 25 20:41:05.528491 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2689/5337] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:05 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:06.199586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:06.200316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:06.213608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:06.215973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:06.218148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:06.221177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:06.547579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:06.548103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:06.562901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:06.563368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:06.575733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:06.576159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:06.712475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:06.726056 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed4435e4-1833-4ee9-9c47-346e3be1b2dd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1170 microversion: 2.1 time: 0.531050 Jul 25 20:41:06.729089 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2649/5338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:06 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1170 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:07.059789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:07.077811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:07.086221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:07.091880 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea29ac77-e57e-4dd3-8a66-ced0c9413c7c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1339 microversion: 2.20 time: 0.548469 Jul 25 20:41:07.093793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2690/5339] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:06 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1339 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:07.754138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:07.755092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:07.769409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:07.770110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:07.778272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:07.778977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:08.115374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:08.115995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:08.128428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:08.140742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:08.142317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:08.142934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:08.536553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:08.560220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:08.562712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:08.565139 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9fefee53-7496-446c-9bde-db60ea07d490 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1339 microversion: 2.20 time: 0.452700 Jul 25 20:41:08.566853 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2691/5340] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:08 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1339 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:41:08.952177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:08.969959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad5d05fe-1852-4534-8973-49970e0f69c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 1.215923 Jul 25 20:41:08.971245 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2650/5341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:07 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:09.600234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:09.604437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:09.624312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:09.625095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:09.629318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:09.630859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:09.992945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:09.993634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:10.007706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:10.009821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:10.012612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:10.014436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:10.524095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:11.681737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:11.693079 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb07163a-1973-42fd-9c14-9c87e91e0294 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 1.704352 Jul 25 20:41:11.700085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2651/5342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:09 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:41:11.709287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:11.712891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:11.720575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:11.727777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.729692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.731148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.734019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.735184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:11.736902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:11.738203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-adcd56e7-f3be-4318-8fe5-737901ee0988 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 2.147106 Jul 25 20:41:11.759353 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2692/5343] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:09 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:11.773230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-44447403-c5b6-4991-98a5-452d2f6ec782 req-ff26edc8-1637-4db8-9eee-ceb16068f92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:11.801249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-44447403-c5b6-4991-98a5-452d2f6ec782 req-ff26edc8-1637-4db8-9eee-ceb16068f92a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.801712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-44447403-c5b6-4991-98a5-452d2f6ec782 req-ff26edc8-1637-4db8-9eee-ceb16068f92a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.812670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1aabad1-5d42-4c6e-ab33-d116a534b157 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117227 Jul 25 20:41:11.819149 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2652/5344] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:41:11 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:11.824499 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-44447403-c5b6-4991-98a5-452d2f6ec782 req-ff26edc8-1637-4db8-9eee-ceb16068f92a service nova] Creating event network-changed:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:41:11.827129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1e462440-db34-4380-88de-a060a1174afd req-5d90eb04-c644-4c82-b963-cb4afe64e5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce52746-fb4d-460b-a6b1-af4e15209ae8", "tag": "a73130f3-7059-42f4-9a35-d7c1ac0bead5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:11.832956 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-44447403-c5b6-4991-98a5-452d2f6ec782 req-ff26edc8-1637-4db8-9eee-ceb16068f92a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072236 Jul 25 20:41:11.833575 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2693/5345] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:11.839153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e462440-db34-4380-88de-a060a1174afd req-5d90eb04-c644-4c82-b963-cb4afe64e5b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.839885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e462440-db34-4380-88de-a060a1174afd req-5d90eb04-c644-4c82-b963-cb4afe64e5b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.849513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:11.850112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:11.864499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1e462440-db34-4380-88de-a060a1174afd req-5d90eb04-c644-4c82-b963-cb4afe64e5b4 service nova] Creating event network-changed:a73130f3-7059-42f4-9a35-d7c1ac0bead5 for instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 on n-h2-845775-3 Jul 25 20:41:11.865044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.865549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.866313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:11.866764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:11.875646 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1e462440-db34-4380-88de-a060a1174afd req-5d90eb04-c644-4c82-b963-cb4afe64e5b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052035 Jul 25 20:41:11.878974 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2653/5346] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:11.951741 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb2b2ebf-02d6-474c-9219-b61c599e7d73 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae" status: 200 len: 194 microversion: 2.1 time: 0.106588 Jul 25 20:41:11.952432 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2694/5347] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Jul 25 20:41:11 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:12.716680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:12.717497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:12.740440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:12.745235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:12.756899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:12.757508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:12.758376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:12.758829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:12.767440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:12.769361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:12.798049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:12.799327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:12.806061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:12.806894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:12.840092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:13.218249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:13.229719 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-92dec5b3-7279-4765-b17f-fec5307ec233 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 0.518662 Jul 25 20:41:13.231692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2654/5348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:12 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:13.402726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:13.413337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:13.429800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:13.434737 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ef1c289-e6ec-433e-af02-4ff9abccc7c0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.671855 Jul 25 20:41:13.435434 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2695/5349] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:12 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:14.256547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:14.257163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:14.288052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:14.293848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:14.294936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:14.304798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:14.460374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:14.461104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:14.483593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:14.484295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:14.486970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:14.489179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:15.050374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:15.058806 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3afb0e89-5aaa-4140-99aa-235193c8e58b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 0.807755 Jul 25 20:41:15.059433 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2655/5350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:14 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:15.167512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:15.181225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:15.183127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:15.186681 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c8e33655-9f00-4bf4-89e3-63798497b92d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.731402 Jul 25 20:41:15.188705 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2696/5351] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:14 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:41:15.237222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c34d436-de28-4c3e-ac7a-3abb6ce72176"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:15.239818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:15.265834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:15.270023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:15.274602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:15.275307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:15.762793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75c30304-6403-4c4b-9045-401c7dd715ae tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "POST /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530195 Jul 25 20:41:15.764788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2656/5352] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:41:15 2022] POST /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:16.082785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:16.083595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:16.105931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:16.106731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:16.107812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:16.116753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:16.216621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:16.218955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:16.236416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:16.237150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:16.240191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:16.240845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:16.705451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:16.726987 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18d17d2b-3436-4361-9401-43736187f8d7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 0.647965 Jul 25 20:41:16.743520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2697/5353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:16 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:16.955444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:16.968534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:16.970077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:16.971278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db3c8c18-258e-4ccd-b5d2-3e8e3a2a0487 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.761311 Jul 25 20:41:17.001301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2657/5354] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:16 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:41:17.750423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:17.751818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:17.775813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:17.776568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:17.778077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:17.778935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:18.006011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:18.007379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:18.031477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:18.032436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:18.035136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:18.035615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:18.037813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:18.052860 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72675edc-77d9-411a-a79e-328a2778c6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1212 microversion: 2.1 time: 0.306407 Jul 25 20:41:18.053844 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2698/5355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:17 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1212 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:18.412462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:18.434907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:18.443456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:18.448340 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-febb3421-8440-4fc0-8ae7-3e0365d77ab8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.445449 Jul 25 20:41:18.449839 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2658/5356] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:17 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:19.094559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:19.098972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:19.130715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:19.131867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:19.140127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:19.141657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:19.476573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:19.477222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:19.504170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:19.512090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:19.512842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:19.527814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:19.603371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:19.615266 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b92c6c2-b127-4da6-ae3d-43f72efce45c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.529324 Jul 25 20:41:19.624656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2699/5357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:19 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:19.947978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:19.972932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:19.975429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:19.977296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e8e7c66-388b-4665-a45c-ab47b148ebb5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.506408 Jul 25 20:41:19.989968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2659/5358] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:19 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:41:20.613833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d8c60918-a473-4a50-8f98-48c16965d29b req-50c12481-fffb-4fa3-810e-cf3d72db0375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "name": "network-vif-plugged", "status": "completed", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:20.642961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d8c60918-a473-4a50-8f98-48c16965d29b req-50c12481-fffb-4fa3-810e-cf3d72db0375 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:20.646390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d8c60918-a473-4a50-8f98-48c16965d29b req-50c12481-fffb-4fa3-810e-cf3d72db0375 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:20.652494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:20.654025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:20.678893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d8c60918-a473-4a50-8f98-48c16965d29b req-50c12481-fffb-4fa3-810e-cf3d72db0375 service nova] Creating event network-vif-plugged:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:41:20.689870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:20.692476 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d8c60918-a473-4a50-8f98-48c16965d29b req-50c12481-fffb-4fa3-810e-cf3d72db0375 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082382 Jul 25 20:41:20.693914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:20.695298 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2700/5359] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:20.699616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:20.705362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:21.012130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:21.015832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:21.040930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:21.041411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:21.042337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:21.042788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:21.155244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:21.165883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f56b39a7-d1c3-4810-b2cb-e86d548a6ae8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.520533 Jul 25 20:41:21.166615 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2660/5360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:20 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:41:21.387959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:21.399264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:21.401249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:21.403645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f85d44b-efb5-403b-b4b2-d46245e69b27 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.395981 Jul 25 20:41:21.405517 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2701/5361] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:21 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:22.203134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:22.204678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:22.220741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:22.221481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:22.223085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:22.223864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:22.431445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:22.436207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:22.454169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:22.455566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:22.463020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:22.463981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:22.685167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:22.697661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aa2da2fe-40e7-4079-bb24-e9deb7a66bff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.508122 Jul 25 20:41:22.711724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2661/5362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:22 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:22.757092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:22.766358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:22.769293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:22.770735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cdd2fa1e-5d4e-41c1-830d-0aa457299b54 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1407 microversion: 2.20 time: 0.345849 Jul 25 20:41:22.773128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2702/5363] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:22 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:41:23.720296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:23.721218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:23.732586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:23.733805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:23.735509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:23.736583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:23.763654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:23.961244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:23.969047 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d36e697d-3c75-46f0-84ab-51b81d5cc338 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.253655 Jul 25 20:41:23.972591 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2662/5364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:23 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:24.096953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:24.097663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:24.109585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:24.115136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:24.116392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:24.116993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:24.353944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:24.365715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:24.367751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:24.369233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1c9b2503-bcbe-4855-95ff-a8b45b2666d4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1598 microversion: 2.20 time: 0.578301 Jul 25 20:41:24.384059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2703/5365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:41:23 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1598 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:41:24.392597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:24.393375 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:24.400836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:24.401487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:24.402452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:24.403045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:24.549107 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93cc6901-7535-4497-9701-9759e2dd3b8e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160221 Jul 25 20:41:24.551820 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2663/5366] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Jul 25 20:41:24 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:41:24.997161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:24.998374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:25.020634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:25.021178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:25.025671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:25.026452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:25.378788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:25.388309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b801b3f2-e775-4b16-bb8e-d48a9b4b8216 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.398611 Jul 25 20:41:25.391277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2704/5367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:24 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:26.418424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:26.419757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:26.439791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:26.440329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:26.441129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:26.441577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:26.983239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-582f5339-82de-4ef4-9711-d341a13484e7 req-05a26803-db0e-4590-9902-c91279d42a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:27.025041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-582f5339-82de-4ef4-9711-d341a13484e7 req-05a26803-db0e-4590-9902-c91279d42a33 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:27.026409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-582f5339-82de-4ef4-9711-d341a13484e7 req-05a26803-db0e-4590-9902-c91279d42a33 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:27.077108 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-582f5339-82de-4ef4-9711-d341a13484e7 req-05a26803-db0e-4590-9902-c91279d42a33 service nova] Creating event network-changed:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:41:27.089728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:27.095066 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-582f5339-82de-4ef4-9711-d341a13484e7 req-05a26803-db0e-4590-9902-c91279d42a33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115494 Jul 25 20:41:27.098310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2705/5368] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:27.102515 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2b04572-4aff-4e40-9668-69e996a5a08a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.695441 Jul 25 20:41:27.103619 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2664/5369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:26 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:28.140435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:28.142367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:28.162504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:28.167610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:28.172538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:28.173308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:28.195390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:28.535682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:28.567145 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8fd47675-7b54-4199-9d01-34f217b9169b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.443451 Jul 25 20:41:28.582260 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2706/5370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:28 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:29.608124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:29.610227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:29.622137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:29.622993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:29.624010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:29.624758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:29.990686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:30.000412 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3eadd6c1-6002-408f-a391-52caba2be1e3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 0.397545 Jul 25 20:41:30.001589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2665/5371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:29 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:30.491127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5a6591bc-3003-4910-b67f-4ed22b374f43 req-9715408a-c24f-4fb5-83db-6380a240b6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce52746-fb4d-460b-a6b1-af4e15209ae8", "name": "network-vif-plugged", "status": "completed", "tag": "a73130f3-7059-42f4-9a35-d7c1ac0bead5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:30.520792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:30.541059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5a6591bc-3003-4910-b67f-4ed22b374f43 req-9715408a-c24f-4fb5-83db-6380a240b6e6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:30.542009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5a6591bc-3003-4910-b67f-4ed22b374f43 req-9715408a-c24f-4fb5-83db-6380a240b6e6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:30.562970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5a6591bc-3003-4910-b67f-4ed22b374f43 req-9715408a-c24f-4fb5-83db-6380a240b6e6 service nova] Creating event network-vif-plugged:a73130f3-7059-42f4-9a35-d7c1ac0bead5 for instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 on n-h2-845775-3 Jul 25 20:41:30.578135 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5a6591bc-3003-4910-b67f-4ed22b374f43 req-9715408a-c24f-4fb5-83db-6380a240b6e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091946 Jul 25 20:41:30.580111 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2707/5372] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:41:31.024127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:31.024888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:31.031914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:41:31.063922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:31.068102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:31.071622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:31.072610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:32.056928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:32.091766 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6a29ad0-c961-4032-b2a2-2a7a3b9dccc7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1200 microversion: 2.1 time: 1.071530 Jul 25 20:41:32.093216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2666/5373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:31 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1200 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:33.134946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:33.139721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:33.162841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:33.171032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:33.179777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:33.180314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:33.593769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:33.620624 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-414b877e-82ce-4244-b0be-8d02221a695b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1388 microversion: 2.1 time: 0.494080 Jul 25 20:41:33.621252 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2708/5374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:33 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1388 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:33.645547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:33.646430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:33.659223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:33.661680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:33.666602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:33.670877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:34.134930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:34.151607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-552f9901-ddbf-4818-8304-2b49fbcfd081 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1388 microversion: 2.1 time: 0.511005 Jul 25 20:41:34.160408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2667/5375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:33 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1388 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:34.205182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:34.206423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:34.234720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:34.235908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:34.238244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:34.244969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:34.737251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:34.756664 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6800bb7-c8c4-4458-b9f6-760e1040fc1f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1388 microversion: 2.1 time: 0.564041 Jul 25 20:41:34.758250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2709/5376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:34 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1388 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:34.787284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:34.790631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:34.808501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:34.809298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:34.810631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:34.811402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:34.931465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:41:35.099129 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09776846-5476-4fbc-8021-7a032b5addc5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 204 len: 0 microversion: 2.1 time: 0.323164 Jul 25 20:41:35.103678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2668/5377] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:41:34 2022] DELETE /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:41:35.111669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:35.113071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:35.125860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:35.126325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:35.127120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:35.127608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:35.469975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:35.483215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0d1f641-decc-44d9-b486-d71e0b484240 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1394 microversion: 2.1 time: 0.377533 Jul 25 20:41:35.484154 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2710/5378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:35 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1394 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:36.517579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:36.519315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:36.539789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:36.542196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:36.544495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:36.551522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:37.127208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:37.144853 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d27c7dcd-e4a1-456d-bcfc-6191a8a79783 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1394 microversion: 2.1 time: 0.632273 Jul 25 20:41:37.147482 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2669/5379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:36 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1394 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:38.177519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:38.178898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:38.193409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:38.194260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:38.195198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:38.195654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:38.416776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:38.437822 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-abd55576-b737-4d77-a332-e89d9dbda5db tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1352 microversion: 2.1 time: 0.264552 Jul 25 20:41:38.438858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2711/5380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:38 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:38.609316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a049f9a2-556e-4295-ab9c-a17d5b9f390a req-c36a5afc-2df0-4d2e-8798-92ff1f538fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce52746-fb4d-460b-a6b1-af4e15209ae8", "name": "network-vif-deleted", "tag": "a73130f3-7059-42f4-9a35-d7c1ac0bead5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:41:38.627882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a049f9a2-556e-4295-ab9c-a17d5b9f390a req-c36a5afc-2df0-4d2e-8798-92ff1f538fd9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:38.628784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a049f9a2-556e-4295-ab9c-a17d5b9f390a req-c36a5afc-2df0-4d2e-8798-92ff1f538fd9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:38.666507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a049f9a2-556e-4295-ab9c-a17d5b9f390a req-c36a5afc-2df0-4d2e-8798-92ff1f538fd9 service nova] Creating event network-vif-deleted:a73130f3-7059-42f4-9a35-d7c1ac0bead5 for instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 on n-h2-845775-3 Jul 25 20:41:38.690634 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a049f9a2-556e-4295-ab9c-a17d5b9f390a req-c36a5afc-2df0-4d2e-8798-92ff1f538fd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082316 Jul 25 20:41:38.692135 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2670/5381] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:39.465860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:39.466479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:39.473917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:39.474373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:39.475152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:39.475590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:39.621302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:39.631682 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f07f212-6473-4b15-8978-2d09ca908b6f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.169685 Jul 25 20:41:39.635916 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2712/5382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:39 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:40.670127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:40.670867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:40.709406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:40.709884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:40.710700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:40.711165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:40.952840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:40.957213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:40.966237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:40.967016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:40.968772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:40.969463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:41.043539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98ecde9e-e03e-4e0e-b4ef-0075242db770 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.093440 Jul 25 20:41:41.051543 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2713/5383] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:41:40 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:41:41.060421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:41.075797 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64813550-aff7-4e95-b16c-6a944d804cae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.422735 Jul 25 20:41:41.077463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2671/5384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:40 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:41.217961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:41.218970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:41.226659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:41.227479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:41.229138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:41.229845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:41.267322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bd997de0-9a14-4fb5-a843-64bd24b1dc85 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae" status: 200 len: 194 microversion: 2.1 time: 0.060360 Jul 25 20:41:41.268604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2714/5385] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Jul 25 20:41:41 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:41:41.280935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:41.281486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:41.294534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:41.295808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:41.298939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:41.300679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:41.554190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lazy-loading 'services' on Instance uuid fb27001c-a2df-4dd4-bec1-6715b43f3c4d {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:41:41.758025 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-af01291c-67b3-4d27-baa2-b8ae27f7a07b tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae" status: 202 len: 0 microversion: 2.1 time: 0.482151 Jul 25 20:41:41.764557 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2672/5386] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:41:41 2022] DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/05036835-39f9-433f-9e74-b9a9fb3f76ae => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:41:42.103559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:42.109063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:42.127434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:42.127924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:42.128789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:42.129238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:42.467112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:42.503148 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc64dda7-a592-4f9f-9819-07e1cd07500c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.403356 Jul 25 20:41:42.516667 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2715/5387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:42 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:43.532886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:43.534122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:43.554917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:43.555302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:43.556417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:43.556610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:43.878415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:43.892441 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4d66f57-70a2-4b07-adf7-6c7ff112bba9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.365366 Jul 25 20:41:43.893410 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2673/5388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:43 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:44.920958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:44.922040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:44.931838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:44.939321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:44.940529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:44.941246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:45.138667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:45.151333 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6dc2106-01b1-4b60-91be-9e87869d7485 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.234797 Jul 25 20:41:45.161822 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2716/5389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:44 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:46.184939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:46.186278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:46.206992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:46.208242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:46.209559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:46.210253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:46.410691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:46.457545 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f63e64a8-1c5f-4aa8-ae26-f3b236e994d9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.260091 Jul 25 20:41:46.458750 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2674/5390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:46 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:47.485698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:47.486323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:47.498102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:47.502116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:47.503716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:47.508880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:47.791131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:47.800600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eaa13a4b-cd0f-495c-a415-203039b5e9ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.318502 Jul 25 20:41:47.809231 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2717/5391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:47 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:48.827414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:48.828066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:48.869304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:48.870153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:48.873332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:48.874020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:49.005629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:49.018589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0d5cc70-f9e9-40cb-a297-5ed8f827d312 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1185 microversion: 2.1 time: 0.194992 Jul 25 20:41:49.020180 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2675/5392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:48 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:41:50.046347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:50.047238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:50.078458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:50.079860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:50.080905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:50.082813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:50.185473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:50.187777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:50.188925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lazy-loading 'fault' on Instance uuid 7ce52746-fb4d-460b-a6b1-af4e15209ae8 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:41:50.267471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:41:50.278015 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-256f1553-8d9e-4700-b8a6-36b39e356aad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 200 len: 1190 microversion: 2.1 time: 0.236556 Jul 25 20:41:50.281219 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2718/5393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:50 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 1190 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:41:51.310067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:41:51.324944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 7ce52746-fb4d-460b-a6b1-af4e15209ae8] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:41:51.363325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:51.378334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:51.381251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:41:51.383935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:41:51.450986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 HTTP/1.1 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7ce52746-fb4d-460b-a6b1-af4e15209ae8'} Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:41:51.455204 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. Jul 25 20:41:51.463658 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:41:51.467263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 7ce52746-fb4d-460b-a6b1-af4e15209ae8 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:41:51.477155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-468f4616-fa5a-44e7-98df-e7c99be0ddda tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8" status: 404 len: 111 microversion: 2.1 time: 0.171626 Jul 25 20:41:51.479248 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2676/5394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:41:51 2022] GET /compute/v2.1/servers/7ce52746-fb4d-460b-a6b1-af4e15209ae8 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:42:05.920562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:05.922866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:05.939868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=25 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:05.972991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=74 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:05.983812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:05.984312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:05.996369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:05.996964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:06.083628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:06.086244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:06.139691 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-059b68aa-01ec-4c2a-9842-4508e24b91df tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/4c34d436-de28-4c3e-ac7a-3abb6ce72176" status: 200 len: 194 microversion: 2.1 time: 0.227390 Jul 25 20:42:06.176112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2719/5395] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Jul 25 20:42:05 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/4c34d436-de28-4c3e-ac7a-3abb6ce72176 => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:42:06.184969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:06.185487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:06.222491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:06.222958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:06.223887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:06.224372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:06.543271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7768d94-1cb4-4a5e-a8f2-e02b9c61be07 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Action: 'create', calling method: .version_select at 0x7f196ea89ca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-66873659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW/W5md+YQTMiNyHc2HHrRAjNtxyW/PouVtpLlCqAoG43MZg36GjnGS+ujfQvXioDc+L83cCt4bS+wXV0ZZbaXpY51RgWGO+rUJJxMY8qccMobrkzvwBJocTJ2mqtmaxA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:06.576947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b7768d94-1cb4-4a5e-a8f2-e02b9c61be07 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for project ca87fab28d7549579e93c64089ebd0a2. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:42:06.587816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b7768d94-1cb4-4a5e-a8f2-e02b9c61be07 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for user 307ba31f42144fea97c9ffbb0850cc20 and project ca87fab28d7549579e93c64089ebd0a2. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:42:06.633047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lazy-loading 'services' on Instance uuid fb27001c-a2df-4dd4-bec1-6715b43f3c4d {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:42:06.640403 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7768d94-1cb4-4a5e-a8f2-e02b9c61be07 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.567131 Jul 25 20:42:06.641102 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2677/5396] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:42:06 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:42:06.806965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-440b1456-14a4-4011-863f-754318dbec5c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/4c34d436-de28-4c3e-ac7a-3abb6ce72176" status: 202 len: 0 microversion: 2.1 time: 0.620491 Jul 25 20:42:06.816750 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2720/5397] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:42:06 2022] DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments/4c34d436-de28-4c3e-ac7a-3abb6ce72176 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:42:11.125508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2130521942", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-66873659", "security_groups": [{"name": "tempest-secgroup-smoke-560202264"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "03802f76-26eb-4cce-b364-3d0d2d005e16"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:11.758608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:11.759793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:11.807169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:11.809429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:11.817783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:11.821932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:11.876536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] validate_networks() for [('03802f76-26eb-4cce-b364-3d0d2d005e16', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:42:11.941084 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d699528-f5ba-436b-8613-44031ad442f3 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/ips" status: 200 len: 151 microversion: 2.20 time: 0.188890 Jul 25 20:42:11.948214 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2721/5398] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Jul 25 20:42:11 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/ips => generated 151 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:42:13.322359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for project ca87fab28d7549579e93c64089ebd0a2. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:42:13.350186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for user 307ba31f42144fea97c9ffbb0850cc20 and project ca87fab28d7549579e93c64089ebd0a2. Resources: dict_keys(['metadata_items']) {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:42:13.375435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:42:13.376271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:42:13.378194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:42:13.378938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:42:13.379830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:42:13.397370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:13.401155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:13.402777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:13.405948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:13.454204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for project ca87fab28d7549579e93c64089ebd0a2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:42:13.462909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Getting quotas for user 307ba31f42144fea97c9ffbb0850cc20 and project ca87fab28d7549579e93c64089ebd0a2. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:42:13.479965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:42:13.484299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:42:13.562721 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b09ecad-48fe-4b03-803d-b22e05aeb82a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.441954 Jul 25 20:42:13.574805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e15e9314-d026-4b4d-a5e0-88f8217e1985 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:13.575561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e15e9314-d026-4b4d-a5e0-88f8217e1985 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:13.580584 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2678/5399] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:42:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:42:13.713566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e15e9314-d026-4b4d-a5e0-88f8217e1985 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:13.725096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e15e9314-d026-4b4d-a5e0-88f8217e1985 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1301 microversion: 2.1 time: 0.154375 Jul 25 20:42:13.740844 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2722/5400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:13 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:14.773326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d2d631f-74f4-4a11-96ef-556c5fca456d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:14.773983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d2d631f-74f4-4a11-96ef-556c5fca456d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:15.138722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8d2d631f-74f4-4a11-96ef-556c5fca456d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:15.156722 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d2d631f-74f4-4a11-96ef-556c5fca456d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1301 microversion: 2.1 time: 0.403416 Jul 25 20:42:15.173540 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2679/5401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:14 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1301 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:16.187614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:16.190899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:16.243012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:16.252877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:16.275732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:16.276616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:16.627413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:16.647326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61a1c764-6038-4bca-a57c-705c05d91ded tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1361 microversion: 2.1 time: 0.466138 Jul 25 20:42:16.653920 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2723/5402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:16 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:42:17.100521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:17.101096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:17.136463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.136941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:17.137893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.138361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:17.258016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lazy-loading 'flavor' on Instance uuid f5f6cbb2-d338-4f58-ad95-dc474053dae5 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:42:17.676062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:17.677379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:17.696111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.699047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:17.700239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.700945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:17.849116 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3af912f4-125e-43ac-9d30-3b0fe0e571d7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/action" status: 202 len: 0 microversion: 2.20 time: 0.754469 Jul 25 20:42:17.854266 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2680/5403] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:42:17 2022] POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:42:17.891499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:17.894243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:17.917399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.922946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:17.924452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:17.926223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:18.177428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:18.202367 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89dbb0dd-8e22-46c6-8224-0062ae7370db tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1359 microversion: 2.1 time: 0.530720 Jul 25 20:42:18.209739 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2724/5404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:17 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:19.247756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:19.250720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:19.270701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:19.275795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:19.280415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:19.285964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:19.716423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:19.734196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-03a3a1aa-8ade-4184-a9d7-aa3fb2db0ef8 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1359 microversion: 2.1 time: 0.497208 Jul 25 20:42:19.739702 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2725/5405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:19 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1359 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:19.926463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:19.956668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:19.971059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:19.972812 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a96b68f-5775-41d1-8b97-8d0366968097 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 2.115345 Jul 25 20:42:19.973964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2681/5406] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:17 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:20.765027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:20.766590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:20.785379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:20.793450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:20.795600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:20.800338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:21.002678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:21.003309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:21.025004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:21.025493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:21.043816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:21.047053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:21.495401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:21.512123 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24b12d45-2ed9-4122-af4e-306fae58546c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.748327 Jul 25 20:42:21.529097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2726/5407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:20 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:21.623409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:21.630943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:21.647206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:21.647589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:21.652301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:21.654963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:21.734715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1fb95a8e-bed3-4bd3-aa5b-9637c54cf41c tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114135 Jul 25 20:42:21.737839 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2727/5408] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:42:21 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:42:21.813914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:21.835853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:21.840053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:21.840053 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffd5fa12-e888-49b7-8d27-28b26a4007a6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 0.841614 Jul 25 20:42:21.840053 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2682/5409] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:20 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:42:21.989649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:21.993325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:22.023883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.024386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.025205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.025743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.114704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-536d7d91-74bf-4b50-9548-ba734270f9d6 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131254 Jul 25 20:42:22.121311 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2728/5410] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:42:21 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:42:22.265056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:22.266151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:22.274406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.275201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.276277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.277160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.324838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:42:22.543113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:22.544014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:22.558360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.561387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1f729740-e57c-4d69-9711-b1a666f72246 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 204 len: 0 microversion: 2.1 time: 0.299269 Jul 25 20:42:22.564852 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2683/5411] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:42:22 2022] DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:42:22.575502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.575969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.578504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.588673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:22.590119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:22.600292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.600890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:22.602242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:22.602242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:23.177635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:23.187570 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c60008c9-3804-412a-8f7c-23a21b1dacbd tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.649508 Jul 25 20:42:23.193152 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2729/5412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:22 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:23.208612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:23.209236 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:23.218444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:23.218889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:23.219684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:23.220176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:23.240061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:23.252493 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b9169ad-45cb-446e-b26c-ea0866d95d20 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1674 microversion: 2.1 time: 0.682049 Jul 25 20:42:23.253973 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2684/5413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:22 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1674 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:42:23.721885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:23.755912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3592fb73-6a1a-4503-81b5-94242719dc65 req-02185678-8b5d-4724-a757-3ab0a2c2c3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb54585-9977-4322-8249-3d1bc5783a57", "tag": "e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:23.766615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:23.785955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3592fb73-6a1a-4503-81b5-94242719dc65 req-02185678-8b5d-4724-a757-3ab0a2c2c3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:23.788633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3592fb73-6a1a-4503-81b5-94242719dc65 req-02185678-8b5d-4724-a757-3ab0a2c2c3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:23.826771 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3592fb73-6a1a-4503-81b5-94242719dc65 req-02185678-8b5d-4724-a757-3ab0a2c2c3ba service nova] Creating event network-changed:e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854 for instance 1fb54585-9977-4322-8249-3d1bc5783a57 on n-h2-845775-3 Jul 25 20:42:23.839016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3592fb73-6a1a-4503-81b5-94242719dc65 req-02185678-8b5d-4724-a757-3ab0a2c2c3ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087497 Jul 25 20:42:23.841655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2685/5414] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:42:24.166424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:24.181618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:24.199001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:24.202322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c19a244c-36ec-4001-adc2-4f1691fd4ff0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 1.006794 Jul 25 20:42:24.203146 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2730/5415] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:23 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:24.221762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:24.222841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:24.246921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:24.247951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:24.248969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:24.249591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:24.279862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:24.281351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:24.295100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:24.302002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:24.303094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:24.303686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:24.977937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:24.991974 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-acb34a27-a3f3-4b2f-ab9c-d90ede899fdd tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1674 microversion: 2.1 time: 0.718546 Jul 25 20:42:25.012232 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2731/5416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:24 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1674 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:25.099189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:25.113377 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69d038ac-d998-4eab-8101-25bc68b8eedf tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.896086 Jul 25 20:42:25.126054 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2686/5417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:24 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:25.230695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:25.231508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:25.245962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:25.246360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:25.247182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:25.247625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:26.021742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:26.023439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:26.046405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:26.074136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:26.079459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:26.082924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:26.086635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:26.538811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:26.559880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:26.568631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:26.570594 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-391bc522-5495-451d-ad73-11fb32b073f5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 1.344400 Jul 25 20:42:26.577687 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2732/5418] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:25 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:26.586046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:26.590642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:26.606498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:26.607361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:26.608423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:26.609113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:26.686245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:26.701270 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7815b7c4-72ce-4203-91b7-28304131653d tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1674 microversion: 2.1 time: 0.683188 Jul 25 20:42:26.704819 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2687/5419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:26 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1674 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:27.149471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:27.163833 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e01e9cf-38f1-4d98-833e-bf05763eb085 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.584570 Jul 25 20:42:27.167268 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2733/5420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:26 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:27.585515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d16c1cf9-f89d-41a5-869a-2ad4d67127ec req-bbb518a4-52f7-4300-ab76-7f7f6293e668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb27001c-a2df-4dd4-bec1-6715b43f3c4d", "name": "network-vif-deleted", "tag": "515f6b9f-72a0-432d-b315-c9c7e29cb4e6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:27.608812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:27.611492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:27.625005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d16c1cf9-f89d-41a5-869a-2ad4d67127ec req-bbb518a4-52f7-4300-ab76-7f7f6293e668 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:27.625460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d16c1cf9-f89d-41a5-869a-2ad4d67127ec req-bbb518a4-52f7-4300-ab76-7f7f6293e668 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:27.647718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:27.650227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:27.652185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:27.656063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:27.678575 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d16c1cf9-f89d-41a5-869a-2ad4d67127ec req-bbb518a4-52f7-4300-ab76-7f7f6293e668 service nova] Creating event network-vif-deleted:515f6b9f-72a0-432d-b315-c9c7e29cb4e6 for instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d on n-h1-845775-3 Jul 25 20:42:27.685253 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d16c1cf9-f89d-41a5-869a-2ad4d67127ec req-bbb518a4-52f7-4300-ab76-7f7f6293e668 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103316 Jul 25 20:42:27.685884 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2688/5421] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:42:27.726776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:27.728226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:27.744508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:27.745269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:27.746278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:27.756822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:28.142314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9fe47530b24272b5cf96e66ec11ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5d4bd3dc2d43a79e843bced5acd619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:28.156382 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d4baf47-883d-4990-9718-6c97dc730178 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 200 len: 1322 microversion: 2.1 time: 0.430416 Jul 25 20:42:28.157237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2689/5422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:27 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:42:28.187177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:28.187799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:28.212674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:28.213229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:28.214075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:28.214521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:28.609922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:28.639740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:28.641300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:28.642900 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e8114e0-7ab4-424f-9896-dd66873204aa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 1.041756 Jul 25 20:42:28.643770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2734/5423] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:27 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:28.753558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:28.766262 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79946d02-3872-41df-8493-44be3fb70c3a tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.583163 Jul 25 20:42:28.766926 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2690/5424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:28 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:29.185603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:29.186252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:29.213673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.221639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:29.223331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.229533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:29.300756 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d HTTP/1.1 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'fb27001c-a2df-4dd4-bec1-6715b43f3c4d'} Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:29.303185 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:29.308193 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:29.311565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:42:29.312939 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14cc0f5d-1c52-4b6c-b8f6-cad556bec778 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 404 len: 111 microversion: 2.1 time: 0.132832 Jul 25 20:42:29.319092 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2735/5425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:29 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:42:29.324762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-38cf8c97-dd8d-4671-8258-0643529e00f1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '.version_select at 0x7f1968c03040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:29.390016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-38cf8c97-dd8d-4671-8258-0643529e00f1 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627840960" status: 202 len: 0 microversion: 2.1 time: 0.070469 Jul 25 20:42:29.394088 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2691/5426] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627840960 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:42:29.666029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:29.667253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:29.683175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.697029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:29.698314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.705899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:29.788841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:29.790407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:29.808748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.810532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:29.816323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:29.819435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:30.543735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:30.554868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:30.574655 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-883001a7-146a-4467-93b9-5e14be6fc3b5 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.791421 Jul 25 20:42:30.582049 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2692/5427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:29 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:42:30.583573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:30.602619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:30.608820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:30.613414 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2241b9ad-f61f-40c9-b88d-880c02c2a2b7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1744 microversion: 2.20 time: 0.951833 Jul 25 20:42:30.615978 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2736/5428] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:29 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1744 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:31.618162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:31.619910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:31.647079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:31.647440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:31.659120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:31.659697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:31.662742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:31.675379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:31.691115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:31.692660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:31.694647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:31.699150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:32.512742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:32.527006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:32.529175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:32.534723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:32.536000 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-360a24bd-4a83-4b6a-bd83-e0fda44ed024 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.884368 Jul 25 20:42:32.539400 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2737/5429] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:31 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:32.565667 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cea3990f-7412-46f6-bb26-5387889b460c tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.953057 Jul 25 20:42:32.594622 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2693/5430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:31 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:33.565621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:33.566684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:33.578606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:33.585306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:33.587537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:33.591221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:33.597649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:33.598897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:33.620837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:33.621596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:33.622880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:33.627025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:34.902512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:34.917923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:34.921115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:34.927136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dafebe75-f33f-4904-b3fc-c9db697b5beb tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 1.367764 Jul 25 20:42:34.932423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2738/5431] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:33 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:35.141083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:35.150369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:35.158481 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f53a2da8-c496-45c0-b052-b0a0dfcd72ec tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 1.563108 Jul 25 20:42:35.177391 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2694/5432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:33 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:42:35.955402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:35.957368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:35.995984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:36.004869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:36.009829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:36.011191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:36.012170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-07eb91c6-9de2-40a1-ba04-7f244d1e858b req-96b78250-ba07-4421-af1d-f4b25d5c9d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb54585-9977-4322-8249-3d1bc5783a57", "name": "network-vif-plugged", "status": "completed", "tag": "e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:36.041134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-07eb91c6-9de2-40a1-ba04-7f244d1e858b req-96b78250-ba07-4421-af1d-f4b25d5c9d63 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:36.042726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-07eb91c6-9de2-40a1-ba04-7f244d1e858b req-96b78250-ba07-4421-af1d-f4b25d5c9d63 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:36.085549 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-07eb91c6-9de2-40a1-ba04-7f244d1e858b req-96b78250-ba07-4421-af1d-f4b25d5c9d63 service nova] Creating event network-vif-plugged:e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854 for instance 1fb54585-9977-4322-8249-3d1bc5783a57 on n-h2-845775-3 Jul 25 20:42:36.106159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-07eb91c6-9de2-40a1-ba04-7f244d1e858b req-96b78250-ba07-4421-af1d-f4b25d5c9d63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094662 Jul 25 20:42:36.111756 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2695/5433] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 25 20:42:36.203846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:36.204786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:36.217730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:36.221860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:36.233016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:36.238766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:36.240655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:36.945955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:36.969214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:36.971266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:36.997218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e885586f-b9de-4a99-96a9-f05795b17e05 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 1.046090 Jul 25 20:42:37.001966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:37.006451 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2739/5434] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:35 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:37.010933 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e350f45-21d9-48bd-a835-5caeeaa0147e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.827809 Jul 25 20:42:37.016144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2696/5435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:36 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:38.048513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:38.049950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:38.050922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:38.051670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:38.064971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=45 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:42:38.072602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:38.078737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:38.081207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:38.082003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:38.082853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:38.083301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:38.084841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:38.087944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:38.643877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:38.697546 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c567a148-884b-49a2-b26c-fad5f28c6515 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1426 microversion: 2.1 time: 0.642212 Jul 25 20:42:38.698248 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2740/5436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:38 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1426 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:38.715532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9919fad2-c22e-4446-8b49-4994e1d6bdfd req-31467976-d80f-48d9-814d-2ae56e1e6c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "name": "network-vif-plugged", "status": "completed", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:38.745917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:38.764758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9919fad2-c22e-4446-8b49-4994e1d6bdfd req-31467976-d80f-48d9-814d-2ae56e1e6c52 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:38.765186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9919fad2-c22e-4446-8b49-4994e1d6bdfd req-31467976-d80f-48d9-814d-2ae56e1e6c52 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:38.772023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:38.786885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:38.788226 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-367b1a3f-c356-4162-8e65-ac6d51e7fbfc tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.744926 Jul 25 20:42:38.788788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2697/5437] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:38 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:38.833058 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9919fad2-c22e-4446-8b49-4994e1d6bdfd req-31467976-d80f-48d9-814d-2ae56e1e6c52 service nova] Creating event network-vif-plugged:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:42:38.854565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9919fad2-c22e-4446-8b49-4994e1d6bdfd req-31467976-d80f-48d9-814d-2ae56e1e6c52 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150495 Jul 25 20:42:38.859105 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2741/5438] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:42:39.725009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:39.740966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:39.798413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:39.799971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:39.801698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:39.840419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:39.864208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:39.880856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:39.967379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:39.968720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:39.981557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:39.985788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:40.596253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:40.613302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:40.616005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:40.620750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:40.631695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4a323313-61f8-461e-95c7-bda4320aa94b tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1606 microversion: 2.1 time: 0.916277 Jul 25 20:42:40.633450 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-db2466a9-5cda-4af6-9d52-0401637d664e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.822214 Jul 25 20:42:40.650730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2698/5439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:39 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1606 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:40.651044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2742/5440] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:39 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:40.678099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:40.678862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:40.705201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:40.712150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:40.731179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:40.735623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:41.256786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:41.275408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7a46b5d-ee46-41d4-bf34-feaca5578fd9 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1606 microversion: 2.1 time: 0.604224 Jul 25 20:42:41.277603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2699/5441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:40 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1606 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:41.305327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:41.306097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:41.324362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:41.326890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:41.329791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:41.333580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:41.659045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:41.659990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:41.675281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:41.676001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:41.677064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:41.678712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:42.153939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:42.172350 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d67e33a7-c051-459a-b93e-712f0b0e4583 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1606 microversion: 2.1 time: 0.868296 Jul 25 20:42:42.175994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2743/5442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:41 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1606 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:42:42.397628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:42.417135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:42.418761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:42.420006 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e6c0ea1e-6577-44b0-a13e-0888456c2cf2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.765229 Jul 25 20:42:42.437147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2700/5443] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:41 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:42:43.464792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:43.465646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:43.502660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:43.503207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:43.504069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:43.504527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:44.271389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:44.289822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:44.292186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:44.294143 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ef930ee-9509-4287-b476-6a8728f2b056 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.833671 Jul 25 20:42:44.308195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2744/5444] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:43 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:45.322498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:45.323769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:45.364194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:45.365659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:45.367631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:45.367984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:46.314061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:46.363905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:46.365838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:46.367076 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0419463-1197-45fe-84f8-e8fb7c6ecc19 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 1.049179 Jul 25 20:42:46.367652 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2701/5445] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:45 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:47.394430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:47.395060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:47.416617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:47.436189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:47.437140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:47.437593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:49.724301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:49.737915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:49.756581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:49.760537 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5047d93f-5c11-4068-b31b-ef3320fe19b2 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 2.371178 Jul 25 20:42:49.765118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2745/5446] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:47 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:50.128816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-05c37cf5-e6b2-49bc-94c5-47e5bd9b440e req-6b33c239-8fc5-4355-aae6-67f1e94f7f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb54585-9977-4322-8249-3d1bc5783a57", "tag": "e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:42:50.149798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-05c37cf5-e6b2-49bc-94c5-47e5bd9b440e req-6b33c239-8fc5-4355-aae6-67f1e94f7f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:50.153049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-05c37cf5-e6b2-49bc-94c5-47e5bd9b440e req-6b33c239-8fc5-4355-aae6-67f1e94f7f5c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:50.180733 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-05c37cf5-e6b2-49bc-94c5-47e5bd9b440e req-6b33c239-8fc5-4355-aae6-67f1e94f7f5c service nova] Creating event network-changed:e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854 for instance 1fb54585-9977-4322-8249-3d1bc5783a57 on n-h2-845775-3 Jul 25 20:42:50.195240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-05c37cf5-e6b2-49bc-94c5-47e5bd9b440e req-6b33c239-8fc5-4355-aae6-67f1e94f7f5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070581 Jul 25 20:42:50.201855 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2702/5447] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:42:50.793063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:50.793774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:50.816513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:50.817312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:50.818492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:50.819173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:51.570019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:51.589652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:51.591238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:51.592551 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6268a3e-e9d4-4c75-afae-4ab0313e01ad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.806820 Jul 25 20:42:51.603470 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2746/5448] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:50 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:52.623318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:52.624069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:52.651517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:52.656603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:52.657841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:52.659732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:53.175639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:53.176223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:53.204882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:53.207765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:53.209989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:53.212567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:53.265983 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d HTTP/1.1 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'fb27001c-a2df-4dd4-bec1-6715b43f3c4d'} Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:42:53.268427 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.273024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:42:53.274366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7347cd56-f799-4431-8684-1c2fc4a2cfab tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 404 len: 111 microversion: 2.1 time: 0.098301 Jul 25 20:42:53.275820 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2747/5449] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:42:53 2022] DELETE /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:42:53.291574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:53.303692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: fb27001c-a2df-4dd4-bec1-6715b43f3c4d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:53.322397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:53.323201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:53.327996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:53.329373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:53.364469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:53.377672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:53.382304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:53.393586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11cef2d9-cbea-4c9d-bf0a-f5983c5c7ea5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.776554 Jul 25 20:42:53.394950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2703/5450] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:52 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:53.400377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d HTTP/1.1 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'fb27001c-a2df-4dd4-bec1-6715b43f3c4d'} Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:42:53.401981 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. Jul 25 20:42:53.408170 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:42:53.416072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance fb27001c-a2df-4dd4-bec1-6715b43f3c4d could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:42:53.417100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a97c7e2b-533e-4d44-a95e-7919dd5309eb tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d" status: 404 len: 111 microversion: 2.1 time: 0.137393 Jul 25 20:42:53.420925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2748/5451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:42:53 2022] GET /compute/v2.1/servers/fb27001c-a2df-4dd4-bec1-6715b43f3c4d => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:42:54.423595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:54.424292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:54.439443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:54.439905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:54.443911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:54.444416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:55.399094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:55.419039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:55.421262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:55.423087 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-24ed0430-2364-4d69-a929-3c0a347f3cfa tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 1.003795 Jul 25 20:42:55.444024 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2704/5452] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:54 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:56.451253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:56.452768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:56.465670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:56.471245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:56.472521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:56.473206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:57.369204 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:57.392644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:57.398083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:57.399410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d5d8d45e-cccb-41d3-83f7-a1d8b1b54bd0 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.955335 Jul 25 20:42:57.406094 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2749/5453] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:56 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:58.423793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:58.424490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:58.438899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:58.439368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:58.448377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:58.448970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:58.884976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:58.905556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:58.922030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:42:58.924886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8a7f65ec-cbb7-4f7c-816c-c460e0e2700f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.504993 Jul 25 20:42:58.942289 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2705/5454] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:58 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:42:59.953993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:42:59.955234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:42:59.977661 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:59.982839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:42:59.985466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:42:59.989147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:00.338668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:00.361240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:00.367883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:00.372238 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c9fa4e0-45b7-499a-8b46-08b3d52df16a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.422865 Jul 25 20:43:00.395847 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2750/5455] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:42:59 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:01.407525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:01.415338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:01.499631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:01.502081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:01.508370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:01.512659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:01.924373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:01.939189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:01.949595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:01.950888 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb7fc65f-eaed-4e5e-8913-a7c2a6e38776 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.551822 Jul 25 20:43:01.951477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2706/5456] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:01 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:02.979503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:02.980789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:02.997177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:02.997918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:02.998912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:03.002980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:03.009008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=73 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:03.648915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:03.671247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:03.677239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:03.683834 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2173bb60-78ea-459e-b322-0d336e2161c1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.705037 Jul 25 20:43:03.702518 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2751/5457] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:02 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:04.715724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:04.727292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:04.757984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:04.758452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:04.759256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:04.759702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:05.004796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:05.017794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:05.019716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:05.022686 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1357f4a7-ae53-4224-aa40-ddcf54972f0b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1739 microversion: 2.20 time: 0.311803 Jul 25 20:43:05.027003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2707/5458] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:04 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:05.098831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:05.100020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:05.113213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:05.114725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:05.116105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:05.117006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:05.135928 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 HTTP/1.1 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '501074ac-0aa5-4617-9f93-0e1b33fd4d54'} Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:43:05.137887 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.142810 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.145653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:43:05.146312 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d3a6b9e-21bd-4df9-be38-c72cdd7a7f98 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 404 len: 111 microversion: 2.1 time: 0.052875 Jul 25 20:43:05.150802 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2752/5459] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:43:05 2022] DELETE /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:43:05.157568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:05.158555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] [instance: 501074ac-0aa5-4617-9f93-0e1b33fd4d54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:05.167695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:05.168526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:05.170544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:05.171261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:05.193290 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] HTTP exception thrown: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Request method failure captured: Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 HTTP/1.1 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v53-o-ns4zA672KLTxYbSIQJusal-UsoDqW7NZDT_CWo0-uKlLE67IQ9MaBiFIEYPUUdQe2bHr9fkrxJl7-ZOKQWDYhlUqB_ubfo--KxidXFjkfKsvyzjs6SYNjSWajNELVJNjnbB1ZyE4NmDGlQ4kMJsAvN9xMqAgLnzBs5em_E2c Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2a5d4bd3dc2d43a79e843bced5acd619"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2a5d4bd3dc2d43a79e843bced5acd619"}]}] Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 2a5d4bd3dc2d43a79e843bced5acd619 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-264809043 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 5a9fe47530b24272b5cf96e66ec11ae1 Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeTestJSON-264809043-project Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '501074ac-0aa5-4617-9f93-0e1b33fd4d54'} Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:43:05.195205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] Returning 404 to user: Instance 501074ac-0aa5-4617-9f93-0e1b33fd4d54 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb858444-2472-48d0-9785-4673be71cdf0 tempest-AttachVolumeTestJSON-264809043 tempest-AttachVolumeTestJSON-264809043-project] 10.222.0.48 "GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54" status: 404 len: 111 microversion: 2.1 time: 0.044430 Jul 25 20:43:05.203439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2708/5460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:05 2022] GET /compute/v2.1/servers/501074ac-0aa5-4617-9f93-0e1b33fd4d54 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:43:06.048463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:06.049441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:06.061530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:06.064529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:06.065658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:06.067433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:07.048434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:07.063262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:07.065479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:07.071765 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-985e8f60-4064-494c-a9a4-633297b321e7 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1721 microversion: 2.20 time: 1.027607 Jul 25 20:43:07.088993 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2753/5461] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:06 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1721 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:07.725659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-905947730", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f4355ff1-e686-4790-8d0b-273fa3702833", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:07.757555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=26 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:07.898216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:43:08.102181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:08.103031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:08.107191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=28 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:08.118523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:08.120806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:08.127126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:08.127930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:08.501971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:08.512227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:08.514610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:08.516079 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd22f61c-091b-4ef6-90bd-81e0d7baa251 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1721 microversion: 2.20 time: 0.418397 Jul 25 20:43:08.517105 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2754/5462] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:08 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1721 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:08.777663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:43:08.778169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:43:08.778558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:43:08.778971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:43:08.779385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:43:08.801861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:08.802047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:08.802866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:08.804925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:08.825991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=73 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:08.871957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:43:08.890311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:43:08.943371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:43:08.946092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f4355ff1-e686-4790-8d0b-273fa3702833',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:43:09.132105 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53190a9b-a860-42de-9fb2-21fbed755940 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409904 Jul 25 20:43:09.139220 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2709/5463] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:43:09.148084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2ee3474-cc35-4c30-b075-6b7ea2085ffe tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:09.149160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c2ee3474-cc35-4c30-b075-6b7ea2085ffe tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:09.256972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c2ee3474-cc35-4c30-b075-6b7ea2085ffe tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:09.275037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2ee3474-cc35-4c30-b075-6b7ea2085ffe tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1056 microversion: 2.1 time: 0.127529 Jul 25 20:43:09.276444 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2755/5464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:09 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1056 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:09.554364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:09.555036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:09.579542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:09.580028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:09.580863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:09.581314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:09.697677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0b5c757d-6dbf-451e-b325-9e6096cee73d req-8f101f2b-fc23-4da5-b4a5-46d827df25b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "name": "network-vif-unplugged", "status": "completed", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:09.729563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0b5c757d-6dbf-451e-b325-9e6096cee73d req-8f101f2b-fc23-4da5-b4a5-46d827df25b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:09.730480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0b5c757d-6dbf-451e-b325-9e6096cee73d req-8f101f2b-fc23-4da5-b4a5-46d827df25b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:09.769212 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0b5c757d-6dbf-451e-b325-9e6096cee73d req-8f101f2b-fc23-4da5-b4a5-46d827df25b4 service nova] Creating event network-vif-unplugged:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:43:09.783584 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0b5c757d-6dbf-451e-b325-9e6096cee73d req-8f101f2b-fc23-4da5-b4a5-46d827df25b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090091 Jul 25 20:43:09.790260 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2756/5465] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:43:10.073811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:10.102753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:10.104486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:10.106005 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a951be7d-14bc-447f-a6cc-6890884a3f47 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1721 microversion: 2.20 time: 0.565657 Jul 25 20:43:10.108260 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2710/5466] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:09 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1721 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:10.334105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14e1fcc1-2ee9-43b8-93b2-c4a5e20fad5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:10.335650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-14e1fcc1-2ee9-43b8-93b2-c4a5e20fad5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:10.541448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-14e1fcc1-2ee9-43b8-93b2-c4a5e20fad5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:10.560658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14e1fcc1-2ee9-43b8-93b2-c4a5e20fad5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1056 microversion: 2.1 time: 0.254728 Jul 25 20:43:10.563473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2757/5467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:10 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1056 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:11.148931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:11.148931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:11.186641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.187102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.188662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.189108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.574688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:11.597764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:11.597764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:11.601125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:11.602653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:11.603846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-abc0fe8c-e55a-4299-9f90-d213d50e456b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1664 microversion: 2.20 time: 0.473714 Jul 25 20:43:11.629887 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2711/5468] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:11 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1664 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:11.630174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.632829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.633740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.634190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.692946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "444599d0-1fcc-41de-aa6b-656a232a3817"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:11.696750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:11.709113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.710284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.718028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:11.720393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:11.807939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:11.821004 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8862e83-3769-4a5b-a89f-f7dd67788f51 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1108 microversion: 2.1 time: 0.234627 Jul 25 20:43:11.826149 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2758/5469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:11 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1108 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:12.373195 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-123a61d7-d61d-4df8-a70e-3a431eed8434 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.701855 Jul 25 20:43:12.380275 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2712/5470] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Jul 25 20:43:11 2022] POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments => generated 188 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:43:12.608907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:12.610170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:12.622940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:12.623440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:12.628854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:12.629326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:12.844514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:12.845658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:12.855362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:12.856340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:12.858777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:12.860088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:12.968220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:12.978934 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-952b7b63-69c1-4a5a-952b-474eb1444548 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1126 microversion: 2.1 time: 0.139426 Jul 25 20:43:12.984056 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2713/5471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:12 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1126 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:13.082942 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66d65d3d-60db-4788-940f-099a4bad5ba6 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments/444599d0-1fcc-41de-aa6b-656a232a3817" status: 202 len: 0 microversion: 2.20 time: 0.476577 Jul 25 20:43:13.084577 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2759/5472] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Jul 25 20:43:12 2022] DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments/444599d0-1fcc-41de-aa6b-656a232a3817 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:43:13.182943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:13.183549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:13.196679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:13.197921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:13.198843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:13.205635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:13.357339 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21430c65-8f49-47c3-a466-90899500a5ea tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/action" status: 202 len: 0 microversion: 2.20 time: 0.178722 Jul 25 20:43:13.359992 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2714/5473] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Jul 25 20:43:13 2022] POST /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:43:13.369303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:13.370615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:13.382814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:13.383923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:13.386227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:13.388549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:14.005052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:14.006200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:14.018727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:14.019906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:14.022629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:14.023463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:14.225108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:14.237659 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d90d965a-db5c-421a-a41a-7e6881aee6a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1126 microversion: 2.1 time: 0.239010 Jul 25 20:43:14.240697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2715/5474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:13 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1126 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:14.322651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:14.346877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:14.350044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:14.356856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49244f9f-1960-4e3e-906d-0a2ed3e8d07e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1672 microversion: 2.20 time: 0.991817 Jul 25 20:43:14.360910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2760/5475] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:13 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1672 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:15.265666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:15.267527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:15.284432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:15.285187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:15.286288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:15.286952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:15.384101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:15.385473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:15.402679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:15.403786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:15.406537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:15.407789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:16.022321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:16.031700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:16.041394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:16.043628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9e051ba1-2f62-4446-a81f-73c226424c5c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.783257 Jul 25 20:43:16.050611 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2716/5476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:15 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:16.053289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:16.055075 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a73c8a7b-bd9a-4db8-aad3-d31056098bc4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.675437 Jul 25 20:43:16.056242 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2761/5477] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:15 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:43:17.088571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:17.089268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:17.092459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:17.093092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:17.110641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:17.113378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:17.113845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:17.114648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:17.115092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:17.120596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:17.130268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:17.131170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:17.852245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:17.865527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:17.868580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:17.871905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4436b7cd-7c22-4381-a420-701f7392582c tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.788894 Jul 25 20:43:17.873477 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2762/5478] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:17 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:17.886503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6397629f-69f7-4482-8db8-4fd1b20b10e2 req-ef4f8a66-448b-4bda-bb32-2bca1b008c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ca25e1-ac42-4308-8caf-fff5a5c512d3", "tag": "f67fee60-2fbe-4749-842b-5cea1e939e81"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:17.909436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6397629f-69f7-4482-8db8-4fd1b20b10e2 req-ef4f8a66-448b-4bda-bb32-2bca1b008c22 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:17.910883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6397629f-69f7-4482-8db8-4fd1b20b10e2 req-ef4f8a66-448b-4bda-bb32-2bca1b008c22 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:17.962808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6397629f-69f7-4482-8db8-4fd1b20b10e2 req-ef4f8a66-448b-4bda-bb32-2bca1b008c22 service nova] Creating event network-changed:f67fee60-2fbe-4749-842b-5cea1e939e81 for instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 on n-h1-845775-3 Jul 25 20:43:17.991044 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6397629f-69f7-4482-8db8-4fd1b20b10e2 req-ef4f8a66-448b-4bda-bb32-2bca1b008c22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114068 Jul 25 20:43:17.994489 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2763/5479] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:43:18.131529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:18.175747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eab090fd-9eca-43a7-bd6b-4d8d751a0f9a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 1.095660 Jul 25 20:43:18.178635 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2717/5480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:17 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:18.900356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:18.901732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:18.927851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:18.931439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:18.938098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:18.941562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:19.218905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:19.220000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:19.222733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:19.234064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:19.273194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:19.280335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:19.282613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:19.283433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:19.845585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:19.889170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:19.893951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:19.897731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-766e720e-c769-4cd2-af8c-2f11ab3be2b5 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 1.003943 Jul 25 20:43:19.901165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2764/5481] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:18 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:19.969885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:19.986947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4805a3c7-839b-4fa9-a13e-c40d9df96eae tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.790483 Jul 25 20:43:19.990147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2718/5482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:19 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:20.954378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:20.956082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:20.978573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:21.005536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:21.005536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:21.012559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:21.013792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:21.026934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:21.027446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:21.031599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:21.036025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:21.041250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:21.042007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:21.417754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:21.442534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:21.450751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:21.453822 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eff668d5-e04f-462d-9c62-3ab8c85bf8ec tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.506816 Jul 25 20:43:21.468925 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2765/5483] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:20 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:21.559372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:21.587373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-544b7ee4-ded9-4295-9772-eebe0f56c7ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.575767 Jul 25 20:43:21.635084 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2719/5484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:21 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:22.533447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:22.539856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:22.614237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:22.618183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:22.619611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:22.620513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:22.638744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:22.641050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:22.666815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:22.674145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:22.679415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:22.680517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:23.148318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:23.161484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:23.163213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:23.165216 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23981e51-7ca8-4c7d-8b9e-72a486b66925 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.655851 Jul 25 20:43:23.177018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2766/5485] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:22 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:23.264333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:23.278801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a864441d-d106-4239-beec-4c08845e212d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.645679 Jul 25 20:43:23.288218 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2720/5486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:22 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:24.216606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:24.225868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:24.286112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:24.297979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:24.303129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:24.310031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:24.311394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:24.314953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:24.352313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:24.352776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:24.353663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:24.354112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:25.241675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:25.256694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:25.267260 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77ad2dea-955f-4f8e-9948-f816f18cf5d8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.963443 Jul 25 20:43:25.285103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2721/5487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:24 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:25.320437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:25.332839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:25.342473 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-76fd2c1f-62b9-45df-a1c7-89e29bcfbead tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 1.134587 Jul 25 20:43:25.360446 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2767/5488] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:24 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:26.299215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:26.299839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:26.348977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:26.353066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:26.364403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:26.365323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:26.390327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:26.392818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:26.412845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:26.413884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:26.415023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:26.418002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:26.860264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:26.889936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:26.896472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:26.899269 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b41599d9-e9e7-492c-aa0d-1d5a6befc712 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.516641 Jul 25 20:43:26.900541 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2768/5489] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:26 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:27.649399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:27.659144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:27.667432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a824e3d3-d9e5-465e-a71b-007f2ddc5457 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 1.372591 Jul 25 20:43:27.675319 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2722/5490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:26 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:27.929276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:27.931752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:27.963620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:27.964194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:27.969180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:27.969684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:27.981624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:28.204545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:28.205598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:28.224770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:28.225627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:28.226852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:28.227529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:28.323731 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebfdb0f4-1a69-49f9-b7a0-de161fd86876 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.125904 Jul 25 20:43:28.360028 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2723/5491] 10.222.0.48 () {58 vars in 1293 bytes} [Mon Jul 25 20:43:28 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57/os-server-password => generated 116 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:43:28.712105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:28.715532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:28.731493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:28.735861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:28.737447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:28.737637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:28.741371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:28.757321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:28.759595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:28.761116 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-69b4884f-b0df-4786-bae6-5f305ebe355b tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.838034 Jul 25 20:43:28.772066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2769/5492] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:27 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:29.259712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:29.280492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebb442c0-c8ef-42b1-b96a-6b77ac5a5fc6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.578133 Jul 25 20:43:29.282715 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2724/5493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:28 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:29.794687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:29.796393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:29.824422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:29.830908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:29.844325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:29.845246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:30.328911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:30.331096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:30.364488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:30.367395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:30.371161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:30.371889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:30.372626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:30.396534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:30.398173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:30.399435 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-908270c0-ca92-428d-8a4e-e7c821e41f16 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.614917 Jul 25 20:43:30.400025 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2770/5494] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:29 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:30.775345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:30.786724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-78fbe430-5397-4fce-b310-0e59c81ef732 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.484402 Jul 25 20:43:30.801201 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2725/5495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:30 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:31.427902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:31.428766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:31.487324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:31.487840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:31.489230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:31.490702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:31.812356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:31.815240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:31.847922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:31.848912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:31.850091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:31.850866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:31.970780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:31.983734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:31.985772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:31.987239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30807dbc-b075-4981-90fe-0bd663f77762 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.564293 Jul 25 20:43:31.988957 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2771/5496] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:31 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:32.567897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:32.586348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b76d10a2-dab3-47bd-9129-752884bf0832 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.780797 Jul 25 20:43:32.590115 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2726/5497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:31 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:33.015791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:33.016851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:33.038933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:33.039366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:33.049825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:33.049825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:33.395331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:33.419371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:33.424315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:33.428426 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30133c98-4cd3-4d90-9782-1b1905b6b6f4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.417342 Jul 25 20:43:33.429336 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2772/5498] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:33 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 20:43:33.610695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:33.611968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:33.624082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:33.627493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:33.629102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:33.631768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:34.150548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:34.171526 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cfbd137c-1d51-47ad-9047-79f9654aa71d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.564374 Jul 25 20:43:34.175393 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2727/5499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:33 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:34.457184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:34.457952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:34.476740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:34.483180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:34.488051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:34.490824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:34.849328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:34.869148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:34.872018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:34.874325 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b926d62c-166a-4379-aa1c-d910c7dd75d9 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.422135 Jul 25 20:43:34.888088 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2773/5500] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:34 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:35.200164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:35.200977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:35.217106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:35.217570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:35.234303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:35.235889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:35.542478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:35.552310 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e21fca5-4ebf-41c4-bbaa-eeed0a508e24 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.357259 Jul 25 20:43:35.552907 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2728/5501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:35 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:35.899684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:35.900491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:35.915933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:35.916650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:35.917684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:35.918326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:36.182571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:36.196645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:36.202856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:36.204394 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ab490b4-66d1-4dee-9398-6cb19c70c6d1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.309315 Jul 25 20:43:36.205775 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2774/5502] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:35 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:36.575588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:36.578067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:36.587628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:36.588383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:36.589441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:36.590107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:36.787445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:36.803944 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ecbb8bc-fcc2-4c8c-ab5b-8b6d7ce3ca29 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.232923 Jul 25 20:43:36.817372 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2729/5503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:36 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:37.231515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:37.234124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:37.245860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:37.251072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:37.251888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:37.252370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:37.459310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:37.479021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:37.483034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:37.484881 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6e82981b-81ad-496e-8f73-85c4d0890a34 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.258882 Jul 25 20:43:37.499896 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2775/5504] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:37 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:37.826767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:37.827424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:37.831493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:37.844464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:37.845253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:37.846407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:37.847363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:38.121893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:38.140580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fab5696e-9ab2-4034-a7b0-1d72ce88c93a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.308167 Jul 25 20:43:38.157692 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2730/5505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:37 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:38.511981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:38.513383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:38.526922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=48 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:38.531050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:38.531511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:38.532331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:38.532771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:38.750085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:38.760411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:38.763334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:38.764849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30a1ea0d-cdea-4b0d-8c01-fa3a6858a1f1 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.258185 Jul 25 20:43:38.777572 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2776/5506] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:38 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:39.175554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:39.176706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:39.192098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:39.192902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:39.194114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:39.195910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:39.514290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:39.523631 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-add881dc-faeb-4333-9fc9-97ff1461ddf0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1168 microversion: 2.1 time: 0.361060 Jul 25 20:43:39.525216 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2731/5507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:39 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1168 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:39.787812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:39.788447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:39.796966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:39.797412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:39.810047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:39.812000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:40.132769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:40.143207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:40.144761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:40.145985 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb914b30-77f1-4bd9-885e-ba2f2c816fad tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.362103 Jul 25 20:43:40.156581 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2777/5508] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:39 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:40.555443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:40.560346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:40.572633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:40.573720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:40.575775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:40.576513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:40.744384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:40.752551 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2cfdd01-0066-4e1a-8672-431d3ca15f5b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.203357 Jul 25 20:43:40.753476 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2732/5509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:40 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:41.171255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:41.171868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:41.183401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:41.183859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:41.185034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:41.185485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:41.451599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:41.521359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:41.529666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:41.530970 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cd4018cf-1d98-43b8-8a81-05ff45af1c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.363940 Jul 25 20:43:41.531563 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2778/5510] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:41 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:41.745674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b102ea1e-09fc-4edf-bc46-ed55248424d7 req-f831cea5-5f1d-4dbf-9fa5-15496452fc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "name": "network-vif-plugged", "status": "completed", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:41.760473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b102ea1e-09fc-4edf-bc46-ed55248424d7 req-f831cea5-5f1d-4dbf-9fa5-15496452fc2a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:41.760933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b102ea1e-09fc-4edf-bc46-ed55248424d7 req-f831cea5-5f1d-4dbf-9fa5-15496452fc2a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:41.775065 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b102ea1e-09fc-4edf-bc46-ed55248424d7 req-f831cea5-5f1d-4dbf-9fa5-15496452fc2a service nova] Creating event network-vif-plugged:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:43:41.775388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:41.776117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:41.783059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:41.783588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:41.784703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:41.785418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:41.787394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b102ea1e-09fc-4edf-bc46-ed55248424d7 req-f831cea5-5f1d-4dbf-9fa5-15496452fc2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.411114 Jul 25 20:43:41.793018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2733/5511] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:43:41.949278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:41.957640 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-39765255-5cc3-4ae3-be6a-55b47b57b263 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.186712 Jul 25 20:43:41.958234 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2779/5512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:41 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:42.560502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:42.561493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:42.570005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:42.570561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:42.571450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:42.574120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:42.799276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:42.811157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:42.813314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:42.815103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aab1a133-2d55-4c04-bce2-b4995e883c9a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.259629 Jul 25 20:43:42.816728 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2734/5513] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:42 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:42.982675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:42.983684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:42.994555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:42.995387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:42.996693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:42.997455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:43.267706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:43.278955 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-088d9637-bc90-4d24-975e-b4c43f4ed235 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.303149 Jul 25 20:43:43.302101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2780/5514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:42 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:43.840732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:43.842519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:43.854396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:43.854900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:43.855772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:43.856247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:44.060754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:44.075108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:44.080347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:44.082883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8305a81c-3789-4f68-a92b-2caa0039ca2a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1730 microversion: 2.20 time: 0.244753 Jul 25 20:43:44.083460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2735/5515] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:43 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:44.300870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:44.301478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:44.313924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:44.315618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:44.316467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:44.316921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:44.563004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:44.572728 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac0a26ee-6ee9-4ab7-ba54-c1a17502ee98 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.275661 Jul 25 20:43:44.573270 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2781/5516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:44 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:45.107654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:45.109086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:45.121427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:45.130414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:45.131399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:45.132238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:45.302197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:45.316934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:45.318871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:45.320319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1eb64354-56db-41cf-a94b-2206950279a4 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1717 microversion: 2.20 time: 0.217401 Jul 25 20:43:45.321483 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2736/5517] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:43:45 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1717 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:43:45.608354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:45.609087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:45.617736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:45.618260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:45.619070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:45.619567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:45.803517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:45.812366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89578dd4-89ba-4964-b873-ad611117b69c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.220150 Jul 25 20:43:45.813595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2782/5518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:45 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:46.845764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:46.846362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:46.853478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:46.854145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:46.855118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:46.855735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:47.050834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:47.060724 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63c80f1f-ac22-4be3-b009-e3f3cab552ff tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.219456 Jul 25 20:43:47.061280 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2737/5519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:46 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:48.091550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:48.092320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:48.100675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:48.101470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:48.102964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:48.103926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:48.294076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:48.307398 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-21dfa777-c318-465f-b194-a9639b084dcd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.227474 Jul 25 20:43:48.321949 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2783/5520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:48 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:49.339582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:49.341751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:49.357649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:49.357990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:49.359582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:49.360692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:49.567752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:49.579531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74989dad-ea93-4c11-b798-6a1db1d060a9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.253320 Jul 25 20:43:49.580741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2738/5521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:49 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:50.486089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4098e1c4-cf69-4b7a-90d5-d8cf2784d234 req-4d00f6d9-3c88-4d9d-9a37-c3ea5f812edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ca25e1-ac42-4308-8caf-fff5a5c512d3", "name": "network-vif-plugged", "status": "completed", "tag": "f67fee60-2fbe-4749-842b-5cea1e939e81"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:50.517347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4098e1c4-cf69-4b7a-90d5-d8cf2784d234 req-4d00f6d9-3c88-4d9d-9a37-c3ea5f812edc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:50.518026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4098e1c4-cf69-4b7a-90d5-d8cf2784d234 req-4d00f6d9-3c88-4d9d-9a37-c3ea5f812edc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:50.541051 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4098e1c4-cf69-4b7a-90d5-d8cf2784d234 req-4d00f6d9-3c88-4d9d-9a37-c3ea5f812edc service nova] Creating event network-vif-plugged:f67fee60-2fbe-4749-842b-5cea1e939e81 for instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 on n-h1-845775-3 Jul 25 20:43:50.557697 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4098e1c4-cf69-4b7a-90d5-d8cf2784d234 req-4d00f6d9-3c88-4d9d-9a37-c3ea5f812edc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075738 Jul 25 20:43:50.558489 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2784/5522] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:43:50.609026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:50.610369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:50.621240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:50.621994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:50.622954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:50.623679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:50.871553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:50.880397 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f91d8927-0b5d-42b9-b6c2-330eb0845717 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.275889 Jul 25 20:43:50.886252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2739/5523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:50 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:51.911152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:51.911972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:51.959395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:51.964648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:51.969374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:51.969850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:52.286132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:52.297845 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f498bbf-4a43-473b-8885-ba0d8bdb5492 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1202 microversion: 2.1 time: 0.398254 Jul 25 20:43:52.311559 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2785/5524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:51 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:53.319602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:53.320549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:53.327378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.328360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:53.333158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.335286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:53.367137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:53.570344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:53.583140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81d3d01b-00a8-4e1f-8529-5fa2b45fb3bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1390 microversion: 2.1 time: 0.267731 Jul 25 20:43:53.584352 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2740/5525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:53 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1390 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:53.608639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:53.611120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:53.624434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.625726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:53.627297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.636861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:53.663302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:43:53.816091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:53.825707 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c72c4b20-eeda-4fcd-84f7-c8a18ffc76ef tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1390 microversion: 2.1 time: 0.225089 Jul 25 20:43:53.826318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2786/5526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:53 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:53.849114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:53.850037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:53.857722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.858978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:53.860482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:53.861222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:54.072456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:54.084067 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65bbf48e-ac18-4bc4-8219-9e5636886506 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1390 microversion: 2.1 time: 0.238626 Jul 25 20:43:54.085825 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2741/5527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:53 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:43:54.210214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:54.211840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:54.232990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:54.233463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:54.234270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:54.234714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:54.281067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:43:54.406440 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-abb94e3e-20e8-44c5-b3e9-8d1b02e18e94 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 204 len: 0 microversion: 2.1 time: 0.203173 Jul 25 20:43:54.407247 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2787/5528] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:43:54 2022] DELETE /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:43:54.420252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:54.421505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:54.433572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:54.434392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:54.435377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:54.438730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:54.662129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:54.673739 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a2f0b39b-9260-4696-b649-3374ca026edb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1396 microversion: 2.1 time: 0.260141 Jul 25 20:43:54.675494 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2742/5529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:54 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1396 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:55.700664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:55.703991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:55.720550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:55.725915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:55.727397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:55.730090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:56.079807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:56.105052 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa517d16-c6ce-4264-b423-42a59152242b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1396 microversion: 2.1 time: 0.402429 Jul 25 20:43:56.105052 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2788/5530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:55 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1396 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:57.121548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:57.121548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:57.134367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:57.135707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:57.138777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:57.142288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:57.321260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:57.343888 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-360036c1-42b9-4b3d-b599-28a3a4d93b03 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.232459 Jul 25 20:43:57.357390 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2789/5531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:57 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:57.378920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-db292d0b-9e2f-4ca0-887c-74d82ca3b757 req-e3801c65-a56d-49be-a5c1-4f4ea5b456d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ca25e1-ac42-4308-8caf-fff5a5c512d3", "name": "network-vif-deleted", "tag": "f67fee60-2fbe-4749-842b-5cea1e939e81"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:43:57.392329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-db292d0b-9e2f-4ca0-887c-74d82ca3b757 req-e3801c65-a56d-49be-a5c1-4f4ea5b456d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:57.393025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-db292d0b-9e2f-4ca0-887c-74d82ca3b757 req-e3801c65-a56d-49be-a5c1-4f4ea5b456d4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:57.410766 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-db292d0b-9e2f-4ca0-887c-74d82ca3b757 req-e3801c65-a56d-49be-a5c1-4f4ea5b456d4 service nova] Creating event network-vif-deleted:f67fee60-2fbe-4749-842b-5cea1e939e81 for instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 on n-h1-845775-3 Jul 25 20:43:57.416607 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-db292d0b-9e2f-4ca0-887c-74d82ca3b757 req-e3801c65-a56d-49be-a5c1-4f4ea5b456d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354808 Jul 25 20:43:57.417536 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2743/5532] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:43:58.367933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:58.368675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:58.377097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:58.377664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:58.378545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:58.379056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:58.464446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:58.475526 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7d384bc-8877-4b7e-b3f0-accc1c29e74c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.111639 Jul 25 20:43:58.476137 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2790/5533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:58 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:43:59.501616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:43:59.502583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:43:59.521819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:59.522260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:59.523482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:43:59.529454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:43:59.699827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:43:59.718782 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60fde4ac-3370-4592-88cc-67e66a1545ac tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.223665 Jul 25 20:43:59.719675 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2744/5534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:43:59 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:00.740808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:00.742576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:00.750924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:00.751732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:00.752976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:00.753851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:00.874847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:00.897760 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-008daa10-cbf3-4eac-ab6f-643a033fb42d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.161009 Jul 25 20:44:00.898495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2791/5535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:00 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:01.919356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:01.920828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:01.931890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:01.932391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:01.933190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:01.934214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:02.034688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:02.045405 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d398718-c30e-43e1-b2d7-559e93a85bf3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.130005 Jul 25 20:44:02.052256 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2745/5536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:01 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:03.070134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:03.073385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:03.090006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:03.090720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:03.093767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:03.096245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:03.230725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:03.243989 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-56082f8c-9beb-4734-9a37-e07cf0e4f3a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.179503 Jul 25 20:44:03.260380 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2792/5537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:03 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:04.268329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:04.268928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:04.283377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:04.283979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:04.285272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:04.285676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:04.408931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:04.418234 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-567f9bd9-9c52-476b-ace5-92730e2811f8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1187 microversion: 2.1 time: 0.154126 Jul 25 20:44:04.432529 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2746/5538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:04 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1187 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:05.441079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:05.442595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:05.455919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:05.456660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:05.471754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:05.476338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:05.599500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:05.606594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:05.607564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lazy-loading 'fault' on Instance uuid 16ca25e1-ac42-4308-8caf-fff5a5c512d3 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:44:05.856778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:05.904495 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04d10831-9dd5-4d01-80c9-d6d459878acf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 200 len: 1192 microversion: 2.1 time: 0.468543 Jul 25 20:44:05.909934 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2793/5539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:05 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 1192 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:06.939727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:06.939727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:06.943868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:06.944372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:06.945554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:06.945751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:06.973677 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 HTTP/1.1 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '16ca25e1-ac42-4308-8caf-fff5a5c512d3'} Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:06.982060 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:06.987880 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:06.992959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:06.994130 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f910dfe6-c10f-4e9f-abf0-7d28c44fa988 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 404 len: 111 microversion: 2.1 time: 0.063859 Jul 25 20:44:06.996407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2747/5540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:06 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:44:10.429172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:10.430538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:10.444650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:10.448841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:10.452897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:10.454094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:10.454553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:10.490378 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 HTTP/1.1 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '16ca25e1-ac42-4308-8caf-fff5a5c512d3'} Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:10.492797 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.497359 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.504357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:10.507016 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb9d6a20-c26a-423c-9239-02a14ef1de32 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 404 len: 111 microversion: 2.1 time: 0.084677 Jul 25 20:44:10.507392 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2794/5541] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:44:10 2022] DELETE /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:44:10.518690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:10.519346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 16ca25e1-ac42-4308-8caf-fff5a5c512d3] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:10.523994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=36 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:10.528797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:10.529316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:10.530850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:10.535561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:10.573003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 HTTP/1.1 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '16ca25e1-ac42-4308-8caf-fff5a5c512d3'} Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:10.574594 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 16ca25e1-ac42-4308-8caf-fff5a5c512d3 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:10.580849 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52a72af1-815c-4aa4-815e-d48881f07461 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3" status: 404 len: 111 microversion: 2.1 time: 0.064558 Jul 25 20:44:10.588418 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2748/5542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:10 2022] GET /compute/v2.1/servers/16ca25e1-ac42-4308-8caf-fff5a5c512d3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:44:21.142376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:21.143528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:21.446494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Calling method '.version_select at 0x7f19689ad550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:21.448392 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:44:21.448392 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:44:21.449993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:21.450601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:21.471531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:21.471993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:21.488418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:21.489179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:21.497267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4f3d72f7-f319-4e3a-a7a1-ee30cb9c9cc7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1951251091-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.362109 Jul 25 20:44:21.500108 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2795/5543] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:44:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:44:24.934899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:24.949864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:24.968726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:24.970136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=39 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:24.974108 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:24.975129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:24.976306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:24.977441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:25.025443 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac5e0e38-c67f-4faf-b0f1-808b07d4d0a8 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113740 Jul 25 20:44:25.027301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2749/5544] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Jul 25 20:44:24 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:25.144630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:25.146376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:25.163966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:25.166080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:25.167854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:25.169357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:25.238243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:44:25.495734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c807aaf4-c544-453e-ae70-8b19bae91c0d tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 204 len: 0 microversion: 2.20 time: 0.355479 Jul 25 20:44:25.496797 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2796/5545] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:44:25 2022] DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:44:25.506345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:25.507389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:25.525698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:25.526279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:25.527414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:25.527937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:25.761049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:25.776395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:25.782049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:25.789474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31813c36-a608-4d43-bd33-8c2a39f9df41 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 0.286791 Jul 25 20:44:25.790565 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2750/5546] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:25 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:44:26.833416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:26.834853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:26.847817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:26.848885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:26.850145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:26.854549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:27.216053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:27.231451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:27.235158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:27.236516 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34878f36-2dd4-4040-8c42-f612aec2563a tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 0.413776 Jul 25 20:44:27.237169 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2797/5547] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:26 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:44:28.261035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:28.261665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:28.272894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:28.273351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:28.277629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:28.278092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:28.633454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:28.642357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:28.644415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:28.647025 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e777e7b2-17e1-48b9-ad84-15115127ea6e tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1723 microversion: 2.20 time: 0.390218 Jul 25 20:44:28.648125 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2751/5548] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:28 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:44:29.218535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-47548865", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:29.316141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] validate_networks() for None {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:44:29.617869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-dccfa8b0-1042-42aa-8839-2a8ba2fcb139 req-5bfcbbbf-83e9-4a1d-846e-f0802e4cb7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6cbb2-d338-4f58-ad95-dc474053dae5", "name": "network-vif-deleted", "tag": "5af684bb-8e73-4321-8110-ca75c1d17f24"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:29.651906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dccfa8b0-1042-42aa-8839-2a8ba2fcb139 req-5bfcbbbf-83e9-4a1d-846e-f0802e4cb7e1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:29.652934 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dccfa8b0-1042-42aa-8839-2a8ba2fcb139 req-5bfcbbbf-83e9-4a1d-846e-f0802e4cb7e1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:29.732661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dccfa8b0-1042-42aa-8839-2a8ba2fcb139 req-5bfcbbbf-83e9-4a1d-846e-f0802e4cb7e1 service nova] Creating event network-vif-deleted:5af684bb-8e73-4321-8110-ca75c1d17f24 for instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 on n-h2-845775-3 Jul 25 20:44:29.763682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-dccfa8b0-1042-42aa-8839-2a8ba2fcb139 req-5bfcbbbf-83e9-4a1d-846e-f0802e4cb7e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152651 Jul 25 20:44:29.772098 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2752/5549] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:44:29.791650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:29.793689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:29.826600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:29.831863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:29.845153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:29.847547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:29.961498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:29.962229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:29.963416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lazy-loading 'fault' on Instance uuid f5f6cbb2-d338-4f58-ad95-dc474053dae5 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:44:30.011021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:44:30.011741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:44:30.012564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:44:30.013578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:44:30.014421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:44:30.036759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:30.037750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:30.039052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:30.040578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:30.042940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:30.058875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:30.060881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '759ea03abd9848b8b0b5af5d3ea4c40d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a62d212782a413a9b3be1e165ebe057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:30.062324 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d140c56-8c11-4040-875c-1b3b3b03d017 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 200 len: 1371 microversion: 2.20 time: 0.286161 Jul 25 20:44:30.063130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2753/5550] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:29 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 20:44:30.087448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Getting quotas for project 268161374b8b4e42a79f723ed85c1101. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:44:30.094062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Getting quotas for user a8c123d20e9f4d798474eaaa7f7b5941 and project 268161374b8b4e42a79f723ed85c1101. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:44:30.116949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:44:30.119455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:44:30.193111 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5fe825bb-faae-43bc-a9d3-5e5ff157afbf tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978817 Jul 25 20:44:30.194801 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2798/5551] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:44:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:44:30.214386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79ef74ad-a7af-4846-b400-62f69400e472 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:30.215912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79ef74ad-a7af-4846-b400-62f69400e472 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:30.469587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79ef74ad-a7af-4846-b400-62f69400e472 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:30.497073 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79ef74ad-a7af-4846-b400-62f69400e472 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1213 microversion: 2.1 time: 0.289784 Jul 25 20:44:30.498050 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2754/5552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:30 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:31.088459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:31.089026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:31.106898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:31.107371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:31.108220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:31.108676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:31.142968 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 HTTP/1.1 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f5f6cbb2-d338-4f58-ad95-dc474053dae5'} Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:31.145313 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:31.150306 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:31.158832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:31.160508 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da93ed62-5873-46c4-a3a3-1b6d0d03b64f tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 404 len: 111 microversion: 2.20 time: 0.077223 Jul 25 20:44:31.161675 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2799/5553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:31 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:44:31.171513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6caea370-c522-4b4b-9af0-4a1305909011 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '.version_select at 0x7f19685ebc10>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:31.213507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6caea370-c522-4b4b-9af0-4a1305909011 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774148670" status: 204 len: 0 microversion: 2.20 time: 0.046872 Jul 25 20:44:31.219951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2755/5554] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Jul 25 20:44:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774148670 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 20:44:31.533499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:31.534290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:31.543305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:31.552506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:31.555940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:31.556561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:31.738580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:31.752581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-687f163e-c086-4e64-ab9a-b9f686959dda tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1209 microversion: 2.1 time: 0.223347 Jul 25 20:44:31.753195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2800/5555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:31 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1209 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:32.781536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:32.782841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:32.796317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:32.800148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:32.801455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:32.802342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:33.010730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:33.020082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0e8b430-6391-4f09-baeb-a0c320c6e029 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1271 microversion: 2.1 time: 0.242250 Jul 25 20:44:33.021310 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2756/5556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:32 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:34.045655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:34.046545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:34.075664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:34.075664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:34.075664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:34.075664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:34.478549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:34.492370 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7836277-9496-44f0-9d8a-e670ba240864 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.453617 Jul 25 20:44:34.495599 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2801/5557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:34 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:35.476840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5d986b4c-1e6d-4f0f-9217-cf9564f3cda8 req-960f33fc-c13b-4ac1-8dea-c10a45b6a230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "992b6b4b-3078-4906-a034-465cd50d9ade", "tag": "8fad1936-ce83-4e4a-8a84-58266c3183f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:35.504388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d986b4c-1e6d-4f0f-9217-cf9564f3cda8 req-960f33fc-c13b-4ac1-8dea-c10a45b6a230 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:35.505211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d986b4c-1e6d-4f0f-9217-cf9564f3cda8 req-960f33fc-c13b-4ac1-8dea-c10a45b6a230 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:35.522833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:35.524245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:35.542267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:35.544735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:35.550838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:35.551860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:35.592094 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5d986b4c-1e6d-4f0f-9217-cf9564f3cda8 req-960f33fc-c13b-4ac1-8dea-c10a45b6a230 service nova] Creating event network-changed:8fad1936-ce83-4e4a-8a84-58266c3183f9 for instance 992b6b4b-3078-4906-a034-465cd50d9ade on n-h1-845775-3 Jul 25 20:44:35.615508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5d986b4c-1e6d-4f0f-9217-cf9564f3cda8 req-960f33fc-c13b-4ac1-8dea-c10a45b6a230 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142849 Jul 25 20:44:35.618471 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2757/5558] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:36.124422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:36.141193 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07a0b8bd-82dc-4ee7-9895-d46863fafd8c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.622806 Jul 25 20:44:36.142065 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2802/5559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:35 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:37.008380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:37.008990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:37.017708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.018175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.018984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.019437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.053641 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 HTTP/1.1 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f5f6cbb2-d338-4f58-ad95-dc474053dae5'} Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:37.055402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93e03d6a-2c03-4995-9260-c537770bf893 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 404 len: 111 microversion: 2.20 time: 0.055024 Jul 25 20:44:37.065484 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2758/5560] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:44:37 2022] DELETE /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:44:37.070298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:37.070931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: f5f6cbb2-d338-4f58-ad95-dc474053dae5] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:37.083823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.083987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.090943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.091626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.110132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 HTTP/1.1 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'f5f6cbb2-d338-4f58-ad95-dc474053dae5'} Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.111859 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance f5f6cbb2-d338-4f58-ad95-dc474053dae5 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-33f32bc4-2d94-42c6-b1ae-e719d10f5690 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5" status: 404 len: 111 microversion: 2.20 time: 0.051442 Jul 25 20:44:37.118209 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2803/5561] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:37 2022] GET /compute/v2.1/servers/f5f6cbb2-d338-4f58-ad95-dc474053dae5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:44:37.163020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:37.164589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:37.173634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.174619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.176123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:37.176639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:37.438146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:37.452209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98007c2e-fc28-4d94-b383-1b38a0cc9e6e tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.292940 Jul 25 20:44:37.458929 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2759/5562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:37 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:38.481152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:38.483175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:38.527449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:38.529458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:38.535289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:38.535763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:38.864010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:38.876196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e4eea713-3fee-4b5c-ae55-707ed208449c tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.401039 Jul 25 20:44:38.877614 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2804/5563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:38 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:39.373005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Calling method '.version_select at 0x7f1968662430>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:39.374958 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:44:39.374958 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:44:39.377020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:39.377759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:39.398763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:39.399479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:39.413097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:39.413639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:39.422459 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f54c31d3-bdce-4d12-b17b-cdb1337355b8 tempest-PortsAdminExtendedAttrsTestJSON-978588798 tempest-PortsAdminExtendedAttrsTestJSON-978588798-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.478843 Jul 25 20:44:39.429374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2760/5564] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:44:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:39.905950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:39.906790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:39.929735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:39.930206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:39.948891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:39.949500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:40.070567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:40.105743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:40.301708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:40.330337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6f7a5c3-e78d-428e-a00d-42dfc6456fb2 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.428936 Jul 25 20:44:40.345844 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2805/5565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:39 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:40.702909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-12713983-47a8-44f3-8ac1-b1d0a05442ce req-9cb46a3a-2b19-41b1-b950-3a92ae753f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992b6b4b-3078-4906-a034-465cd50d9ade", "name": "network-vif-plugged", "status": "completed", "tag": "8fad1936-ce83-4e4a-8a84-58266c3183f9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:40.714519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:40.751987 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-12713983-47a8-44f3-8ac1-b1d0a05442ce req-9cb46a3a-2b19-41b1-b950-3a92ae753f42 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:40.752477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-12713983-47a8-44f3-8ac1-b1d0a05442ce req-9cb46a3a-2b19-41b1-b950-3a92ae753f42 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:40.797200 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-12713983-47a8-44f3-8ac1-b1d0a05442ce req-9cb46a3a-2b19-41b1-b950-3a92ae753f42 service nova] Creating event network-vif-plugged:8fad1936-ce83-4e4a-8a84-58266c3183f9 for instance 992b6b4b-3078-4906-a034-465cd50d9ade on n-h1-845775-3 Jul 25 20:44:40.807562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-12713983-47a8-44f3-8ac1-b1d0a05442ce req-9cb46a3a-2b19-41b1-b950-3a92ae753f42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109459 Jul 25 20:44:40.816770 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2761/5566] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:41.353259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:41.354632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:41.363419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.364303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.365498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.366207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.570056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-331866715", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:41.574870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:41.586107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3128999f-b0e9-4a29-9e75-7de537e922aa tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1313 microversion: 2.1 time: 0.234439 Jul 25 20:44:41.588244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2806/5567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:41 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:41.615971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:41.620444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:41.631414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.632266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.633875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.634343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.664687 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed HTTP/1.1 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'b7eb81b8-62b7-4073-90be-cc5afe05a1ed'} Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:41.666818 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f18bde50-5f8f-4916-908a-2bb9f0708287 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 404 len: 111 microversion: 2.20 time: 0.058067 Jul 25 20:44:41.673310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2807/5568] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Jul 25 20:44:41 2022] DELETE /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:44:41.677688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:41.678360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] [instance: b7eb81b8-62b7-4073-90be-cc5afe05a1ed] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:41.685313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:44:41.694715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.695311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.696537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.697482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.739855 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] HTTP exception thrown: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Request method failure captured: Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed HTTP/1.1 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v7HZlWeQk4CHIZEyWS0rMfB9AIz9UX7-424VbZF7iLZuQ6mQXWRm-neOpixstOag61WxpCJeOyAe6R4tuaERYguS29KVo6181WXiPYf322CSSoQfB8q_uhgGPaDIOhgcr6akENVO8wI6XyQhbUZUvguAmQIxU_wHj5CNFfnC8b4USo Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6a62d212782a413a9b3be1e165ebe057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6a62d212782a413a9b3be1e165ebe057"}]}] Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6a62d212782a413a9b3be1e165ebe057 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-497038349 Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 759ea03abd9848b8b0b5af5d3ea4c40d Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-497038349-project Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'b7eb81b8-62b7-4073-90be-cc5afe05a1ed'} Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.744716 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. Jul 25 20:44:41.751280 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:41.752142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] Returning 404 to user: Instance b7eb81b8-62b7-4073-90be-cc5afe05a1ed could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:41.753164 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a415f31-fb89-40c4-bc46-88d24b42ab68 tempest-AttachVolumeShelveTestJSON-497038349 tempest-AttachVolumeShelveTestJSON-497038349-project] 10.222.0.48 "GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed" status: 404 len: 111 microversion: 2.20 time: 0.079278 Jul 25 20:44:41.754778 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2808/5569] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Jul 25 20:44:41 2022] GET /compute/v2.1/servers/b7eb81b8-62b7-4073-90be-cc5afe05a1ed => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:44:41.977235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:44:41.978518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:44:41.979259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:44:41.979931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:44:41.980649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:44:41.993958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.994825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:41.995894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:41.996647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:42.029772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Getting quotas for project d70415334c3d4fa7a8ae42613a24c806. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:44:42.037509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Getting quotas for user 58ade541d3404766900563e5eb231e81 and project d70415334c3d4fa7a8ae42613a24c806. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:44:42.057013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:44:42.062155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:44:42.121250 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6e0f53d-ecf0-4cf0-bec3-1840e7c64bd0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563084 Jul 25 20:44:42.128551 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2762/5570] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:44:42.135884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00378f60-f385-4dc4-abe8-bb0ed269456c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:42.140413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00378f60-f385-4dc4-abe8-bb0ed269456c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:42.242960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-00378f60-f385-4dc4-abe8-bb0ed269456c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:42.266931 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00378f60-f385-4dc4-abe8-bb0ed269456c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1213 microversion: 2.1 time: 0.136660 Jul 25 20:44:42.269770 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2809/5571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:42 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:42.614643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:42.614643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:42.628391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:42.629606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:42.631595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:42.632617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:42.823516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:42.837171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ff7f4dc-1c56-460b-aea1-2733c1c483f0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1461 microversion: 2.1 time: 0.228521 Jul 25 20:44:42.848085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2763/5572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:42 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1461 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:42.891751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:42.893247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:42.903047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:42.903856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:42.905221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:42.906390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:42.948690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:44:43.126474 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6be0952-e4a1-4272-a472-a4f8e7952367 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "DELETE /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 204 len: 0 microversion: 2.1 time: 0.239094 Jul 25 20:44:43.127097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2810/5573] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:44:42 2022] DELETE /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:44:43.137539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:43.138436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:43.149944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:43.153118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:43.154116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:43.154732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:43.292819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:43.294563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:43.305282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:43.308695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:43.310651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:43.314191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:43.374223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:43.388774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-53feb670-49a1-4066-a3f9-293f7108d8ef tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1467 microversion: 2.1 time: 0.255775 Jul 25 20:44:43.405566 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2764/5574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:43 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1467 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:43.438206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:43.447581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a6b1f1c-18f0-4a09-bd5a-562c09e4efb4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1265 microversion: 2.1 time: 0.160290 Jul 25 20:44:43.448210 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2811/5575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:43 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:44.414000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:44.414813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:44.436267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:44.437206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:44.438447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:44.439146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:44.474557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:44.475307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:44.495159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:44.495544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:44.496585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:44.497144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:44.534104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:44.707959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:44.724028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9425484f-519c-4a66-a22c-bc9f4a3844b5 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1271 microversion: 2.1 time: 0.254658 Jul 25 20:44:44.726040 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2812/5576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:44 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:44.942973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:44.953313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb0856a1-7fec-46db-8bc9-a916761314dc tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1467 microversion: 2.1 time: 0.544502 Jul 25 20:44:44.954378 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2765/5577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:44 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1467 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:45.730115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-46f31c80-71f3-406d-b5d4-e74546e5e76c req-f7f735b2-2c04-4012-b0c6-209d4f38f095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "992b6b4b-3078-4906-a034-465cd50d9ade", "name": "network-vif-deleted", "tag": "8fad1936-ce83-4e4a-8a84-58266c3183f9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:45.746289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:45.747581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:45.758079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:45.765535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:45.767627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-46f31c80-71f3-406d-b5d4-e74546e5e76c req-f7f735b2-2c04-4012-b0c6-209d4f38f095 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:45.768975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-46f31c80-71f3-406d-b5d4-e74546e5e76c req-f7f735b2-2c04-4012-b0c6-209d4f38f095 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:45.771013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:45.774214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:45.819603 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-46f31c80-71f3-406d-b5d4-e74546e5e76c req-f7f735b2-2c04-4012-b0c6-209d4f38f095 service nova] Creating event network-vif-deleted:8fad1936-ce83-4e4a-8a84-58266c3183f9 for instance 992b6b4b-3078-4906-a034-465cd50d9ade on n-h1-845775-3 Jul 25 20:44:45.841958 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-46f31c80-71f3-406d-b5d4-e74546e5e76c req-f7f735b2-2c04-4012-b0c6-209d4f38f095 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131699 Jul 25 20:44:45.855891 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2813/5578] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:45.983556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:45.986830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:46.005817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:46.009145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:46.015539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:46.016990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:46.128434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:46.129283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:46.130018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lazy-loading 'fault' on Instance uuid 992b6b4b-3078-4906-a034-465cd50d9ade {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:44:46.433974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c123d20e9f4d798474eaaa7f7b5941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268161374b8b4e42a79f723ed85c1101', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:46.447277 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45d801ee-cea5-4283-a6d1-58992e2d7ab3 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 200 len: 1303 microversion: 2.1 time: 0.474961 Jul 25 20:44:46.452192 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2814/5579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:45 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 1303 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:46.604420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:46.625014 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-adcd1cc2-c9e8-414f-9a6d-9f90f92593f9 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 0.879782 Jul 25 20:44:46.625985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2766/5580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:45 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:47.479063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:47.480840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] [instance: 992b6b4b-3078-4906-a034-465cd50d9ade] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:47.512282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:47.513794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:47.517516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:47.522907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:47.582409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] HTTP exception thrown: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Request method failure captured: Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade HTTP/1.1 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wCpa4hapWdjmjVrlcpxqMzAyLUo4i1w06mS1zTgqU2c-o3rLtNqYZTKd0o6NRTy7FyAVM1tXrzt3P8tgyHcz32imQsjKq1Cq8J_s_UnEGEvODh_hOTZlXJMnQbs9hvcui_3j9YcwKsqw2qIOYgTKsbEyfruM2U9o47qO2vCrcFjA_I Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 268161374b8b4e42a79f723ed85c1101 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesNegativeTest-2026122499 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/268161374b8b4e42a79f723ed85c1101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_268161374b8b4e42a79f723ed85c1101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/268161374b8b4e42a79f723ed85c1101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/268161374b8b4e42a79f723ed85c1101"}]}] Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesNegativeTest-2026122499 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 268161374b8b4e42a79f723ed85c1101 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesNegativeTest-2026122499 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesNegativeTest-2026122499-project Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: a8c123d20e9f4d798474eaaa7f7b5941 Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesNegativeTest-2026122499-project Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '992b6b4b-3078-4906-a034-465cd50d9ade'} Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:44:47.597939 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. Jul 25 20:44:47.607325 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:44:47.614094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] Returning 404 to user: Instance 992b6b4b-3078-4906-a034-465cd50d9ade could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:44:47.615754 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-19c7b24d-86bc-4abe-adea-2d808a7e42e0 tempest-VolumesNegativeTest-2026122499 tempest-VolumesNegativeTest-2026122499-project] 10.222.0.48 "GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade" status: 404 len: 111 microversion: 2.1 time: 0.145171 Jul 25 20:44:47.616873 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2815/5581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:47 2022] GET /compute/v2.1/servers/992b6b4b-3078-4906-a034-465cd50d9ade => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:44:47.662383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:47.670547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:47.735522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:47.736090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:47.736867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:47.737331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:47.941221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d479d443-4285-49a3-ad4e-b14de5a8349e req-d49c7906-3189-4220-9e90-a2ee97d0a765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f9ce8e-97b0-4fdd-afbd-b47d0877c260", "tag": "e5981bd5-7cf0-4bad-93b9-a22a6742c888"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:48.011183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d479d443-4285-49a3-ad4e-b14de5a8349e req-d49c7906-3189-4220-9e90-a2ee97d0a765 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:48.016642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d479d443-4285-49a3-ad4e-b14de5a8349e req-d49c7906-3189-4220-9e90-a2ee97d0a765 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:48.098849 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d479d443-4285-49a3-ad4e-b14de5a8349e req-d49c7906-3189-4220-9e90-a2ee97d0a765 service nova] Creating event network-changed:e5981bd5-7cf0-4bad-93b9-a22a6742c888 for instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 on n-h2-845775-3 Jul 25 20:44:48.105748 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d479d443-4285-49a3-ad4e-b14de5a8349e req-d49c7906-3189-4220-9e90-a2ee97d0a765 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175318 Jul 25 20:44:48.108693 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2816/5582] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:48.900905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:48.921134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00d09971-ba99-4256-b3bf-1e302b4fae40 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 1.277109 Jul 25 20:44:48.934442 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2767/5583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:47 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:49.961026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:49.962447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:49.983466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:49.984307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:49.985740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:50.004381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:50.435736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:50.473839 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-48c126ac-644b-4f5e-9dc6-8318fdded6a0 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 0.535023 Jul 25 20:44:50.475459 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2817/5584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:49 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:50.991275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1522868397", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c689f677-d7bd-411f-863f-e26a43f996a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:51.112381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:44:51.497214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:51.498461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:51.512156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:51.519711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:51.520392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:51.539109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:51.539109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:51.936455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:44:51.937252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:44:51.938162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:44:51.938803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:44:51.939609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:44:51.954830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:51.955300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:51.960864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:51.961498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:52.030092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:52.041555 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b6bd221-0088-44af-a63c-6029e6202a9c tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 0.550242 Jul 25 20:44:52.042680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:44:52.043470 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2818/5585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:51 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:52.061652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:44:52.146841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:44:52.149247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c689f677-d7bd-411f-863f-e26a43f996a3',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:44:52.409540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71c72207-46d1-40da-9637-292f50bc2609 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413952 Jul 25 20:44:52.418460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2768/5586] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:44:52.425866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6515bda4-4d1c-48c8-968f-3c665ae01b3d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:52.426616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6515bda4-4d1c-48c8-968f-3c665ae01b3d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:52.433603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:52.584799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6515bda4-4d1c-48c8-968f-3c665ae01b3d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:52.602137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6515bda4-4d1c-48c8-968f-3c665ae01b3d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1071 microversion: 2.1 time: 0.182351 Jul 25 20:44:52.605112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2819/5587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:52 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1071 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:53.071010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:53.072776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:53.083721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:53.084464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:53.085564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:53.085951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:53.443879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:53.457827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-800f4031-9608-48ad-a701-890a26a0da76 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 0.394380 Jul 25 20:44:53.472096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2769/5588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:53 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:53.641316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:53.642011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:53.661760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:53.662229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:53.663038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:53.663488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:53.729608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f6682afe-2819-4d38-8157-6ad3b6cbf9e9 req-f27e1cd6-fcb6-4517-8a52-c1ae04bde640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f9ce8e-97b0-4fdd-afbd-b47d0877c260", "name": "network-vif-plugged", "status": "completed", "tag": "e5981bd5-7cf0-4bad-93b9-a22a6742c888"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:53.742631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f6682afe-2819-4d38-8157-6ad3b6cbf9e9 req-f27e1cd6-fcb6-4517-8a52-c1ae04bde640 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:53.743148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f6682afe-2819-4d38-8157-6ad3b6cbf9e9 req-f27e1cd6-fcb6-4517-8a52-c1ae04bde640 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:53.771905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f6682afe-2819-4d38-8157-6ad3b6cbf9e9 req-f27e1cd6-fcb6-4517-8a52-c1ae04bde640 service nova] Creating event network-vif-plugged:e5981bd5-7cf0-4bad-93b9-a22a6742c888 for instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 on n-h2-845775-3 Jul 25 20:44:53.779309 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f6682afe-2819-4d38-8157-6ad3b6cbf9e9 req-f27e1cd6-fcb6-4517-8a52-c1ae04bde640 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055846 Jul 25 20:44:53.781200 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2770/5589] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:44:53.868368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:53.888984 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3bfc2a1c-06ee-477e-a2ea-37c0b8c3f3cc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1169 microversion: 2.1 time: 0.256571 Jul 25 20:44:53.890211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2820/5590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:53 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:54.489182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:54.492687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:54.514380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:54.515259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:54.516317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:54.521670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:54.916749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:54.920196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:54.946253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:54.947091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:54.952805 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:54.954823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:55.436354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:55.482801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-823e6794-2b87-44e1-ba00-0016cc56279a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1187 microversion: 2.1 time: 0.574698 Jul 25 20:44:55.510211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2821/5591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:54 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1187 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:55.817320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:55.822502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=99 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:55.845489 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebce082b-2e7e-4096-a568-762699769a8f tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1313 microversion: 2.1 time: 1.360714 Jul 25 20:44:55.868502 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2771/5592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:54 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1313 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:44:56.536025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:56.553864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:56.578026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:56.585333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:56.589663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:56.592740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:56.887555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:56.888381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:56.890725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:44:56.911502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:56.912287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:56.913298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:56.913912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:57.151374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:57.162768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3af9190-3b26-484b-8c3e-342f6e264b01 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.634618 Jul 25 20:44:57.169761 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2822/5593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:56 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:57.726666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:57.741941 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55754d7e-39fb-4637-8c68-cb108d21edd4 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1461 microversion: 2.1 time: 0.859148 Jul 25 20:44:57.742703 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2772/5594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:56 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1461 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:44:57.766963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5892c941-5016-47ef-b3ba-02d3dd3f659f", "device": "/dev/sdb"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:57.769712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:57.796729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:57.797199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:57.798007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:57.798451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:58.130145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-247a7c0a-f57e-4779-af95-b92930584c0f req-c93a66ba-7bf9-46f4-9896-a8a936a15027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bcffe2e-7038-4274-a924-fb704f5ad702", "tag": "30b21b39-1a27-49af-8105-897dce521b5c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:44:58.167324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-247a7c0a-f57e-4779-af95-b92930584c0f req-c93a66ba-7bf9-46f4-9896-a8a936a15027 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:58.169775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-247a7c0a-f57e-4779-af95-b92930584c0f req-c93a66ba-7bf9-46f4-9896-a8a936a15027 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:58.256299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-247a7c0a-f57e-4779-af95-b92930584c0f req-c93a66ba-7bf9-46f4-9896-a8a936a15027 service nova] Creating event network-changed:30b21b39-1a27-49af-8105-897dce521b5c for instance 2bcffe2e-7038-4274-a924-fb704f5ad702 on n-h1-845775-3 Jul 25 20:44:58.275453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-247a7c0a-f57e-4779-af95-b92930584c0f req-c93a66ba-7bf9-46f4-9896-a8a936a15027 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148673 Jul 25 20:44:58.282206 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2773/5595] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:58.304732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:44:58.306767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:44:58.346825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:58.347592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:58.351217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:44:58.356946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:44:58.525518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9472a63f-e040-4a8b-98dc-45c42de45e8d tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "POST /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765722 Jul 25 20:44:58.550597 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2823/5596] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:44:57 2022] POST /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:44:59.033158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:44:59.042719 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b225ddf0-2e2c-4f67-a8b1-618acfc614ce tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.758938 Jul 25 20:44:59.048285 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2774/5597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:44:58 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:00.076412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:00.077724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:00.123054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:00.126706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:00.136843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:00.142392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:00.789871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:00.802082 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-964a155b-ec7e-442e-a64c-c11578f79b2f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.736628 Jul 25 20:45:00.807816 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2824/5598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:00 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:01.837786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:01.839033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:01.862728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:01.863322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:01.864228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:01.867370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:01.995338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:02.075941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:02.216342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:02.233386 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ba3b1ae-8818-4b54-998d-92463e0cfea5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.399804 Jul 25 20:45:02.234326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2775/5599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:01 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:02.993597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:03.194263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a2b2665-9456-47c1-a3a7-e81b0d6cc1b7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: .version_select at 0x7f196ebb6e50>, body: {"keypair": {"name": "tempest-keypair-351808605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGau7H+UmnMV3UU52umyFiF8x3agLTg4g8UCapYrVxXYJNdp0hB8yW6+gejZIuWKzZfWZjoeNUqdsXZeFMtCkRtdUG3iGJSmJU+s1e5dZAjCYj7oTk+TkR5EPdMoLEY1Ow=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:03.219681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9a2b2665-9456-47c1-a3a7-e81b0d6cc1b7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:45:03.226809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-9a2b2665-9456-47c1-a3a7-e81b0d6cc1b7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:45:03.254518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:03.255143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:03.263798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:03.264566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:03.266026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:03.266473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:03.271891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a2b2665-9456-47c1-a3a7-e81b0d6cc1b7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.285226 Jul 25 20:45:03.273213 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2825/5600] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:45:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:45:03.527368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:03.539871 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5e27723-c10c-4505-93ed-4638b7be3770 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.289375 Jul 25 20:45:03.541442 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2776/5601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:03 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:04.566387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:04.567621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:04.579157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:04.585575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:04.586730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:04.588915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:05.166395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:05.195919 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5dd630e8-b56c-4986-853a-cf6cfc1549b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.637723 Jul 25 20:45:05.197310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2826/5602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:04 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:05.519303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1339942772", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f71a1d-bbf9-4b41-88b5-61ab23da3479"}], "security_groups": [{"name": "tempest-securitygroup--2044294624"}], "key_name": "tempest-keypair-351808605", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:05.774069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] validate_networks() for [('98f71a1d-bbf9-4b41-88b5-61ab23da3479', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:45:06.222665 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:06.223579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:06.244588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:06.245284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:06.246312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:06.247512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:07.029123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:45:07.029984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:45:07.030890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:45:07.031643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:45:07.032430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:45:07.049312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:07.057821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:07.059257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:07.059556 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09ed4001-b8c8-4855-b263-6bc881c7f9b5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.841069 Jul 25 20:45:07.060220 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2827/5603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:06 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:07.062185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:07.064964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:07.143502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:45:07.167485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:45:07.217931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:45:07.228832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:45:07.388437 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a612bd6-ad0d-4775-ba47-21983cf217db tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.876893 Jul 25 20:45:07.389543 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2777/5604] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:45:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:45:07.401098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f5b88fa-1082-418a-964f-9c607a431a51 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:07.401843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f5b88fa-1082-418a-964f-9c607a431a51 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:07.645360 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f5b88fa-1082-418a-964f-9c607a431a51 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:07.655735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f5b88fa-1082-418a-964f-9c607a431a51 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1241 microversion: 2.1 time: 0.258484 Jul 25 20:45:07.664178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2828/5605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:07 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1241 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:08.095185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:08.096402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:08.131645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:08.144398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:08.148599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:08.149453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:08.663014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:08.688845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:08.689614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:08.712219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6062592a-550e-4f58-81b4-11d6a3b9bb3a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1229 microversion: 2.1 time: 0.607861 Jul 25 20:45:08.719160 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2778/5606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:08 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1229 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:08.726873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:08.729468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:08.730584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:08.743571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:08.925605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:08.964723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8f946291-0076-4072-8cdc-77a134119737 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1245 microversion: 2.1 time: 0.279581 Jul 25 20:45:08.969952 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2829/5607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:08 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1245 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:09.756211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:09.760684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:09.798542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:09.799729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:09.805618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:09.806092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:09.993362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:09.994309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:10.030915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:10.039963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:10.044719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:10.046137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:10.240127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:10.253706 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07e7f493-a2b4-44dc-8a2f-ad65ff7dc062 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1293 microversion: 2.1 time: 0.265423 Jul 25 20:45:10.255281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2830/5608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:09 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1293 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:10.267885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:10.282971 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-21a53d36-276e-4c3a-918f-32887adb71e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.536505 Jul 25 20:45:10.284935 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2779/5609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:09 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:11.281034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:11.281714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:11.289822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:11.290544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:11.291345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:11.291968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:11.330158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:11.332017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:11.352857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:11.353637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:11.354437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:11.354893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:11.417533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:11.427077 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dfc7c55d-4cf9-4b59-a8db-1e32340663ec tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1299 microversion: 2.1 time: 0.150556 Jul 25 20:45:11.427678 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2831/5610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:11 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:11.587659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:11.596850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-90226d1d-300e-4063-9818-9cd40a19b447 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.285852 Jul 25 20:45:11.608883 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2780/5611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:11 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:12.450648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:12.451543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:12.463461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:12.464115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:12.469490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:12.469490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:12.518502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:12.618854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:12.620831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:12.639618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:12.640583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:12.641547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:12.643649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:12.716834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:12.733698 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-515cd6f1-ab0e-4d32-9976-58b73f1fe851 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1367 microversion: 2.1 time: 0.287687 Jul 25 20:45:12.734556 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2832/5612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:12 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:12.902659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:12.914661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e9161b9-27a0-4593-ab26-f1d09f86a47e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.299811 Jul 25 20:45:12.928812 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2781/5613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:12 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:13.003786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-023f0357-1b14-4cbf-9e15-1292e1bdede8 req-15e80e65-47a7-4905-9ec7-82e4ec1ed933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c21314-1e1c-4422-995d-74129498debd", "tag": "4ce626ca-57ed-4685-92e2-078016778ff6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:13.066706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-023f0357-1b14-4cbf-9e15-1292e1bdede8 req-15e80e65-47a7-4905-9ec7-82e4ec1ed933 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:13.068774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-023f0357-1b14-4cbf-9e15-1292e1bdede8 req-15e80e65-47a7-4905-9ec7-82e4ec1ed933 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:13.114915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-023f0357-1b14-4cbf-9e15-1292e1bdede8 req-15e80e65-47a7-4905-9ec7-82e4ec1ed933 service nova] Creating event network-changed:4ce626ca-57ed-4685-92e2-078016778ff6 for instance 01c21314-1e1c-4422-995d-74129498debd on n-h1-845775-3 Jul 25 20:45:13.137998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-023f0357-1b14-4cbf-9e15-1292e1bdede8 req-15e80e65-47a7-4905-9ec7-82e4ec1ed933 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136992 Jul 25 20:45:13.139018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2833/5614] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:45:13.759135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:13.759752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:13.768142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:13.768902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:13.770458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:13.771160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:13.941768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:13.942692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:13.967277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:13.969228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:13.971873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:13.972881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:14.523874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:14.537144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1edd0f6-07af-407e-a6c8-eb6e49619335 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.601357 Jul 25 20:45:14.537808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2834/5615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:13 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:14.570827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:14.578999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc954d00-ca8a-49b4-ad87-c5eb2dd581b8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1367 microversion: 2.1 time: 0.823787 Jul 25 20:45:14.579798 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2782/5616] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:13 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1367 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:15.563355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:15.564629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:15.579327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:15.580265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:15.581272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:15.584104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:15.601464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:15.602230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:15.616853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:15.617322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:15.624018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:15.629540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:16.009063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:16.029623 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e831f360-b13c-4207-acc9-574cec26c0a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1367 microversion: 2.1 time: 0.433303 Jul 25 20:45:16.030436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2783/5617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:15 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:16.037159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:16.048161 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-87ad7986-fb5a-46b7-9f03-166a8ebe291e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.488774 Jul 25 20:45:16.056153 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2835/5618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:15 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:17.051405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:17.052950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:17.061556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:17.062355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:17.063275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:17.063922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:17.072845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:17.074929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:17.100375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:17.101329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:17.102910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:17.103656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:17.113530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:17.205221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:17.393931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:17.410422 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61cbbb7a-f836-4c01-86c2-b3e77c80a531 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1367 microversion: 2.1 time: 0.361059 Jul 25 20:45:17.411052 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2784/5619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:17 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:17.422532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-eafe23eb-8097-4a86-92ae-553a6d2c6357 req-4effa4ad-fea2-42c9-836d-81cc39cc9944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c21314-1e1c-4422-995d-74129498debd", "name": "network-vif-plugged", "status": "completed", "tag": "4ce626ca-57ed-4685-92e2-078016778ff6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:17.450294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eafe23eb-8097-4a86-92ae-553a6d2c6357 req-4effa4ad-fea2-42c9-836d-81cc39cc9944 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:17.454517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eafe23eb-8097-4a86-92ae-553a6d2c6357 req-4effa4ad-fea2-42c9-836d-81cc39cc9944 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:17.479741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-eafe23eb-8097-4a86-92ae-553a6d2c6357 req-4effa4ad-fea2-42c9-836d-81cc39cc9944 service nova] Creating event network-vif-plugged:4ce626ca-57ed-4685-92e2-078016778ff6 for instance 01c21314-1e1c-4422-995d-74129498debd on n-h1-845775-3 Jul 25 20:45:17.490246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-eafe23eb-8097-4a86-92ae-553a6d2c6357 req-4effa4ad-fea2-42c9-836d-81cc39cc9944 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073417 Jul 25 20:45:17.497301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2785/5620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:45:17.501865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:17.549723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f6c5f2a4-b762-4d73-b864-3ada10010edd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.479166 Jul 25 20:45:17.553382 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2836/5621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:17 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:18.436703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:18.437699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:18.453076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:18.456376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:18.457346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:18.457920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:18.579158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:18.580477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:18.588237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:18.594784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:18.595486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:18.596823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:18.597428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:18.863110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:18.878998 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d2909b4-9895-45b7-bab2-28f03b71f699 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1367 microversion: 2.1 time: 0.446765 Jul 25 20:45:18.890799 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2786/5622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:18 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:19.007105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:19.025166 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a8fe165b-b6c9-4363-941c-48c36a765478 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.449261 Jul 25 20:45:19.026841 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2837/5623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:18 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:19.535070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-eb7056f7-16ef-4328-83b3-a3d23f91fb9e req-eed7641e-a4e4-42c4-bf9b-d719b4b78131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bcffe2e-7038-4274-a924-fb704f5ad702", "name": "network-vif-plugged", "status": "completed", "tag": "30b21b39-1a27-49af-8105-897dce521b5c"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:19.555680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eb7056f7-16ef-4328-83b3-a3d23f91fb9e req-eed7641e-a4e4-42c4-bf9b-d719b4b78131 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:19.563360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-eb7056f7-16ef-4328-83b3-a3d23f91fb9e req-eed7641e-a4e4-42c4-bf9b-d719b4b78131 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:19.581506 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-eb7056f7-16ef-4328-83b3-a3d23f91fb9e req-eed7641e-a4e4-42c4-bf9b-d719b4b78131 service nova] Creating event network-vif-plugged:30b21b39-1a27-49af-8105-897dce521b5c for instance 2bcffe2e-7038-4274-a924-fb704f5ad702 on n-h1-845775-3 Jul 25 20:45:19.590583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-eb7056f7-16ef-4328-83b3-a3d23f91fb9e req-eed7641e-a4e4-42c4-bf9b-d719b4b78131 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062952 Jul 25 20:45:19.599797 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2787/5624] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:45:19.967425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:19.971829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:19.997820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:19.998287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:19.999197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:20.001280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:20.057671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:20.059338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:20.070655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:20.071905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:20.073846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:20.074884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:20.567290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:20.577168 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-86ca5941-39f4-47f8-ad43-aa892e9443b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1217 microversion: 2.1 time: 0.531136 Jul 25 20:45:20.584496 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2788/5625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:20 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1217 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:20.596938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:20.606430 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbfa28d0-19b0-4e34-b9a6-0e046e21276d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1556 microversion: 2.1 time: 0.692375 Jul 25 20:45:20.607024 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2838/5626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:19 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1556 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:20.629808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:20.634214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:20.655630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:20.656248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:20.657083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:20.657523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:20.951170 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35b65256-9bbf-4fcb-9ef7-f8c8e6926a36 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326598 Jul 25 20:45:20.951787 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2789/5627] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:45:20 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:45:21.606964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:21.607799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:21.613700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:21.626052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:21.628905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:21.632403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:21.632960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:22.006733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:22.026781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e716ce67-81d0-407e-a294-b8e714cffe55 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1404 microversion: 2.1 time: 0.425310 Jul 25 20:45:22.032174 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2839/5628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:21 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:22.053699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:22.054347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:22.061823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:22.062527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:22.063474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:22.064129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:22.412846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:22.425526 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc9e94ed-d86c-4e4c-abf1-8471926bc23b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1404 microversion: 2.1 time: 0.376297 Jul 25 20:45:22.430482 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2790/5629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:22 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1404 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:22.458555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-655917369"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:22.466750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:22.485641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:22.488062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:22.490457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:22.491815 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:22.720789 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Attempting to quiesce instance before volume snapshot. Jul 25 20:45:22.785658 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 25 20:45:22.989818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Creating snapshot from volume c689f677-d7bd-411f-863f-e26a43f996a3. {{(pid=119724) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 25 20:45:23.413277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-970e388d-cf6a-4820-baa8-410867162619 req-ad6ee3e3-d133-48bf-b28d-4e69f23c8993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c21314-1e1c-4422-995d-74129498debd", "tag": "4ce626ca-57ed-4685-92e2-078016778ff6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:23.441272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-970e388d-cf6a-4820-baa8-410867162619 req-ad6ee3e3-d133-48bf-b28d-4e69f23c8993 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:23.441819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-970e388d-cf6a-4820-baa8-410867162619 req-ad6ee3e3-d133-48bf-b28d-4e69f23c8993 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:23.487631 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-970e388d-cf6a-4820-baa8-410867162619 req-ad6ee3e3-d133-48bf-b28d-4e69f23c8993 service nova] Creating event network-changed:4ce626ca-57ed-4685-92e2-078016778ff6 for instance 01c21314-1e1c-4422-995d-74129498debd on n-h1-845775-3 Jul 25 20:45:23.508226 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-970e388d-cf6a-4820-baa8-410867162619 req-ad6ee3e3-d133-48bf-b28d-4e69f23c8993 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096867 Jul 25 20:45:23.512941 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2791/5630] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:45:24.896994 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7df8c2a0-8bd2-4fe2-bdf7-9da0cd277a7f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702/action" status: 202 len: 0 microversion: 2.1 time: 2.442236 Jul 25 20:45:24.899570 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2840/5631] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:45:22 2022] POST /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702/action => generated 0 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 20:45:27.242612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2111430404", "imageRef": "f963d2ee-18fc-435f-89d8-3501db6192bb", "flavorRef": "452", "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:27.257274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:27.339035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:45:28.463414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:45:28.464093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:45:28.465332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:45:28.466155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:45:28.466338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:45:28.481133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:28.481621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:28.484203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:28.486559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:28.494937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:28.512477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:45:28.518434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:45:28.535560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:45:28.538558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='61b13978-46f3-4227-8abc-06c7ee8effd2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:45:28.673344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d168d8c8-c0b3-42b7-ac99-4713e98f96a2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435966 Jul 25 20:45:28.674477 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2792/5632] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:45:28.690270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3075c6b9-0ddb-4a24-b694-dc907a1840c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:28.691312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3075c6b9-0ddb-4a24-b694-dc907a1840c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:28.844283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3075c6b9-0ddb-4a24-b694-dc907a1840c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:28.853928 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3075c6b9-0ddb-4a24-b694-dc907a1840c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1230 microversion: 2.1 time: 0.169952 Jul 25 20:45:28.855939 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2841/5633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:28 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1230 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:29.878766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:29.879530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:29.889687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:29.891024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:29.892292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:29.893420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:29.987731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:30.008133 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b91768b-728e-40be-9314-5a500312f86f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1282 microversion: 2.1 time: 0.133289 Jul 25 20:45:30.010823 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2793/5634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:29 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:31.037029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:31.038273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:31.056749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:31.060781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:31.064218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:31.064909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:31.305455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:31.320917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d84b4442-fd2f-4032-baf3-524ed8136562 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1300 microversion: 2.1 time: 0.287837 Jul 25 20:45:31.323441 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2842/5635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:31 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:32.352753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:32.353378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:32.369666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:32.370567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:32.373121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:32.373589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:32.898706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:32.914173 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-575f87b4-e40e-4d70-8e16-cc343a3a2d1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.570261 Jul 25 20:45:32.916504 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2794/5636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:32 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:33.828970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4e80ef98-82b0-49a1-8df6-da8d1e04c8c5 req-422d96f2-be23-459b-9bc2-1efd399083f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96776813-5020-43d7-9d90-dba551bd4d84", "tag": "64b48fa9-3f77-4614-b2af-470f9902de00"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:45:33.877170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4e80ef98-82b0-49a1-8df6-da8d1e04c8c5 req-422d96f2-be23-459b-9bc2-1efd399083f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:33.878338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4e80ef98-82b0-49a1-8df6-da8d1e04c8c5 req-422d96f2-be23-459b-9bc2-1efd399083f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:33.906836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4e80ef98-82b0-49a1-8df6-da8d1e04c8c5 req-422d96f2-be23-459b-9bc2-1efd399083f5 service nova] Creating event network-changed:64b48fa9-3f77-4614-b2af-470f9902de00 for instance 96776813-5020-43d7-9d90-dba551bd4d84 on n-h2-845775-3 Jul 25 20:45:33.924061 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4e80ef98-82b0-49a1-8df6-da8d1e04c8c5 req-422d96f2-be23-459b-9bc2-1efd399083f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098570 Jul 25 20:45:33.925522 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2843/5637] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:45:33.951528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:33.955116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:33.966776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:33.967827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:33.971307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:33.971985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:34.476234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:34.485380 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-de55b06b-3b88-46c0-9dfb-30191a67e1cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.546404 Jul 25 20:45:34.498677 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2795/5638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:33 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:35.512834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:35.513807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:35.530564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:35.531290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:35.532368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:35.533041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:35.841954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:35.860899 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d351f5a-72e6-4701-bbf2-aba0b7d6044b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.352783 Jul 25 20:45:35.861505 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2844/5639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:35 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:36.886484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:36.903521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:36.919624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:36.920658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:36.926310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:36.927445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:37.319636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:37.330525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da50d3b2-06d0-4712-8a22-5305f9d167cd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.451906 Jul 25 20:45:37.331654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2796/5640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:36 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:38.375765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:38.377923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:38.390375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:38.391487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:38.392544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:38.393469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:38.675934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:38.699138 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d0c5158b-b151-46c8-a59e-e832d3ba28fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.333361 Jul 25 20:45:38.713520 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2845/5641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:38 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:39.728754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:39.729579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:39.742727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:39.744610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:39.764628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:39.765533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:39.769202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:39.769878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:40.298130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:40.321199 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07f1a99a-9d83-4297-818b-662e2a2b9e99 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.596627 Jul 25 20:45:40.322575 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2797/5642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:39 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:41.400545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:41.401232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:41.412101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:41.420319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:41.421030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:41.422020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:41.422903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:41.636725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:41.661163 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5046e6a-8c88-4514-ae43-674a4951db8c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.306641 Jul 25 20:45:41.662481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2846/5643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:41 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:42.682422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:42.683710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:42.691127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:42.691588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:42.703885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:42.704597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:42.954866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:42.966185 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b6aa2a2-f899-425b-be0e-cd1ac463eb6a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.286806 Jul 25 20:45:42.966626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2798/5644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:42 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:43.991487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:43.992588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:44.013680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:44.014207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:44.015810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:44.016484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:44.029041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:44.371178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:44.380086 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99759f80-197e-46e2-8820-b29d607497b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.392981 Jul 25 20:45:44.391112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2847/5645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:43 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:45.406396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:45.407643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:45.418418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:45.419281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:45.420778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:45.421717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:45.693025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:45.705642 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-afb367e9-0ccc-40f2-9f0b-019aa1cf70a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.303955 Jul 25 20:45:45.710561 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2799/5646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:45 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:46.735017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:46.735658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:46.748409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:46.749459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:46.750980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:46.751681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:47.017427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:47.029810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ed418a0-0544-4d4d-b274-5afee3b37fed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.302497 Jul 25 20:45:47.043281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2848/5647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:46 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:48.059208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:48.059887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:48.080884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:48.081390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:48.082293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:48.082766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:48.507616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:48.524349 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6eb6c92-f3a2-4cc7-9602-1a0724363e36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.474295 Jul 25 20:45:48.526429 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2800/5648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:48 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:49.547469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:49.549281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:49.567768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:49.569379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:49.570341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:49.570979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:49.826286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:49.856222 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a7aac8d-e3f9-446f-b0b1-1b11a97366c0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.309312 Jul 25 20:45:49.871189 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2849/5649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:49 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:50.891860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:50.894726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:50.909142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:50.909935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:50.911036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:50.911622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:51.478056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:51.490293 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23a305fe-8799-4776-90da-e7b11dbd4993 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.614694 Jul 25 20:45:51.506156 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2801/5650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:50 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:45:52.515041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:52.515683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:52.519156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=24 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:52.535585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:52.536287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:52.537253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:52.537918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:52.778864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:52.788598 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b29db5e-405a-406b-b660-be8eccda40ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1342 microversion: 2.1 time: 0.277397 Jul 25 20:45:52.789592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2850/5651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:52 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:53.812078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:53.813312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:53.825130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:53.830078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:53.831298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:53.833712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:54.239594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:54.262873 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d223044-6250-4aca-8dbf-ffd09192423a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1388 microversion: 2.1 time: 0.455467 Jul 25 20:45:54.273492 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2802/5652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:53 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1388 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:55.477489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:55.480498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:55.491919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:55.493160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:55.495634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:55.498741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:55.783575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:55.796458 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-094c63b6-fce4-47ba-b28a-63ea2012ee66 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.509231 Jul 25 20:45:55.797550 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2851/5653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:55 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:56.830443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:56.831800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:56.840279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:56.840815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:56.841663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:56.842402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:57.441836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:57.453930 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84246b71-755a-4170-ab9d-ee9fe56b2107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.627764 Jul 25 20:45:57.457353 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2803/5654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:56 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:58.181292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:58.181898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:58.189175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:58.189892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:58.191772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:58.191772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:58.220220 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-684063b6-4344-4e55-b693-92f56de3a2ae tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/ips" status: 200 len: 149 microversion: 2.1 time: 0.043339 Jul 25 20:45:58.221411 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2852/5655] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:45:58 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:45:58.480872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:58.483454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:58.521307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:58.524382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:58.524908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:58.528101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:58.531615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:58.548827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=68 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:45:58.832618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:45:58.852771 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0c2d430c-cdea-4c23-8dc3-09f0e88cef08 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.374968 Jul 25 20:45:58.852985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2804/5656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:58 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:45:59.879766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:45:59.881312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:45:59.898896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:59.899447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:45:59.900778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:45:59.901759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:00.210560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:00.226431 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2ecc8cc-b888-41d0-bd46-d3faf648dfc3 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.351219 Jul 25 20:46:00.230661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2853/5657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:45:59 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:00.967132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "176b57b2-652b-411b-b12f-f67602664671"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:00.973361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:00.983427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:00.984195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:00.985156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:00.987688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:01.257653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:01.258440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:01.272907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:01.273987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:01.281803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:01.282670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:01.380614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e2efbc86-497b-4f42-9738-a0cfecda9000 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403845 Jul 25 20:46:01.381879 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2805/5658] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:46:00 2022] POST /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:01.611648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:01.627640 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58ee685c-78fd-4fcc-b94c-1bc8153bb9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.375950 Jul 25 20:46:01.631035 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2854/5659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:01 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:02.658311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:02.659457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:02.683673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:02.684728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:02.686253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:02.686960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:02.962557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:02.975259 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6db3b834-a62d-46d0-a80f-213ba98a8eb9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.328889 Jul 25 20:46:02.976724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2806/5660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:02 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:04.002146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7cc8ce8c-6764-4e96-86fd-053b7819911f req-771a92ed-70f3-445a-b723-e639c588fb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96776813-5020-43d7-9d90-dba551bd4d84", "name": "network-vif-plugged", "status": "completed", "tag": "64b48fa9-3f77-4614-b2af-470f9902de00"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:04.007342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:04.008595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:04.037459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:04.038547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:04.039675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:04.054615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:04.063671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7cc8ce8c-6764-4e96-86fd-053b7819911f req-771a92ed-70f3-445a-b723-e639c588fb10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:04.064387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7cc8ce8c-6764-4e96-86fd-053b7819911f req-771a92ed-70f3-445a-b723-e639c588fb10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:04.105571 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7cc8ce8c-6764-4e96-86fd-053b7819911f req-771a92ed-70f3-445a-b723-e639c588fb10 service nova] Creating event network-vif-plugged:64b48fa9-3f77-4614-b2af-470f9902de00 for instance 96776813-5020-43d7-9d90-dba551bd4d84 on n-h2-845775-3 Jul 25 20:46:04.120488 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7cc8ce8c-6764-4e96-86fd-053b7819911f req-771a92ed-70f3-445a-b723-e639c588fb10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127391 Jul 25 20:46:04.123227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2855/5661] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:04.643474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:04.654015 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e035b1f7-ccfa-4ae1-9e8c-b5a3bf91b920 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.655254 Jul 25 20:46:04.654968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2807/5662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:03 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:05.682730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:05.683520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:05.704192 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:05.706381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:05.708559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:05.710067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:06.029571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:06.058527 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b64deab-6c35-435b-8ab0-1f9e04086a8a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1376 microversion: 2.1 time: 0.380859 Jul 25 20:46:06.061292 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2856/5663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:05 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1376 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:07.098822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:07.099387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:07.114758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:07.115225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:07.116028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:07.116505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:07.451554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:07.469013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-462711ed-11dc-4f88-a5b1-41d1f6baefd2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1564 microversion: 2.1 time: 0.374239 Jul 25 20:46:07.470176 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2808/5664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:07 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1564 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:07.494013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:07.496320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:07.509409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:07.510753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:07.511744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:07.512579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:07.833339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:07.844792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9cd7469e-d638-498f-957e-2d8d753922de tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1564 microversion: 2.1 time: 0.355175 Jul 25 20:46:07.845393 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2857/5665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:07 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1564 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:08.053946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:08.054524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:08.065020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:08.074633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:08.075749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:08.076382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:08.128708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:46:08.445603 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f7e5b6b-c40e-4569-8c6e-e47ee11bb787 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 204 len: 0 microversion: 2.1 time: 0.386364 Jul 25 20:46:08.457407 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2809/5666] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:46:08 2022] DELETE /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:46:08.462932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:08.464444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:08.478981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:08.481753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:08.483674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:08.486006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:08.931668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:08.949742 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab124837-8308-40ab-a2a7-8f724d3c0e69 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1570 microversion: 2.1 time: 0.490362 Jul 25 20:46:08.962365 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2858/5667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:08 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1570 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:09.985033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:09.986095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:09.999248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:10.000286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:10.001625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:10.003858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:10.231120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:10.246787 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a3f38e0-6d32-47ef-b859-41fbe3a232a8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1570 microversion: 2.1 time: 0.266333 Jul 25 20:46:10.248104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2810/5668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:09 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:11.285659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:11.286327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:11.304738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:11.305541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:11.313819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:11.315216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:11.876458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:11.904196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d345d631-7ca8-4be7-a2b6-f71adc51f5a5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1570 microversion: 2.1 time: 0.630680 Jul 25 20:46:11.911329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2859/5669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:11 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1570 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:12.261393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-0db4a1a5-6062-43c7-9cb9-91cc9c871d67 req-0f174b95-daf7-4df6-bb0e-04aa7eee5a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96776813-5020-43d7-9d90-dba551bd4d84", "name": "network-vif-deleted", "tag": "64b48fa9-3f77-4614-b2af-470f9902de00"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:12.289877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0db4a1a5-6062-43c7-9cb9-91cc9c871d67 req-0f174b95-daf7-4df6-bb0e-04aa7eee5a11 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:12.298591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-0db4a1a5-6062-43c7-9cb9-91cc9c871d67 req-0f174b95-daf7-4df6-bb0e-04aa7eee5a11 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:12.326186 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-0db4a1a5-6062-43c7-9cb9-91cc9c871d67 req-0f174b95-daf7-4df6-bb0e-04aa7eee5a11 service nova] Creating event network-vif-deleted:64b48fa9-3f77-4614-b2af-470f9902de00 for instance 96776813-5020-43d7-9d90-dba551bd4d84 on n-h2-845775-3 Jul 25 20:46:12.333961 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-0db4a1a5-6062-43c7-9cb9-91cc9c871d67 req-0f174b95-daf7-4df6-bb0e-04aa7eee5a11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076474 Jul 25 20:46:12.340690 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2811/5670] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:46:12.939642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:12.940311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:12.956022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:12.957522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:12.959482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:12.960750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:13.114181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:13.128962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b22b8b71-fdc4-4a3a-b333-99b14a4b178f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1361 microversion: 2.1 time: 0.194119 Jul 25 20:46:13.129899 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2860/5671] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:12 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:14.170881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:14.172371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:14.190157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:14.190826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:14.191748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:14.192238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:14.359781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:14.369927 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3313c072-e425-4920-86b0-b35c0c53f1bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1361 microversion: 2.1 time: 0.222140 Jul 25 20:46:14.380286 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2812/5672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:14 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:15.392206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:15.392830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:15.413601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:15.414354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:15.415627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:15.416319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:15.419940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=78 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:15.643188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:15.654736 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a084196c-3418-42e8-b877-bf801fd7cad7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1361 microversion: 2.1 time: 0.266379 Jul 25 20:46:15.662957 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2861/5673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:15 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:16.478228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6a92617-389e-4d67-b5a9-8d8cb66afd8b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: .version_select at 0x7f1968cd6e50>, body: {"keypair": {"name": "tempest-keypair-1599488955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6P9LKCAIN2eNMjKxBhAWPVA9/k3Zgfvjn12gaZNXpp+GwMDTDD0Uf13F6YflE4lq3b/Ngfz0mI35yNuHA4lCXlaO0Dumsfpi0dq6MCRD8gGNQ3tErA4sbvlgaxstVjhw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:16.522537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c6a92617-389e-4d67-b5a9-8d8cb66afd8b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:46:16.533330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-c6a92617-389e-4d67-b5a9-8d8cb66afd8b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:46:16.586527 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6a92617-389e-4d67-b5a9-8d8cb66afd8b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112392 Jul 25 20:46:16.587463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2813/5674] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:46:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:16.686385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:16.687203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:16.704548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:16.705510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:16.707381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:16.708811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:16.847604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:16.868951 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12769b4f-3808-4ade-b2e4-2854eaac4c36 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1361 microversion: 2.1 time: 0.186580 Jul 25 20:46:16.868951 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2862/5675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:16 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:17.895665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:17.897055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:17.912490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:17.912958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:17.913763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:17.914218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:18.033128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:18.050584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b976449-83bb-49d5-86ca-78a7bb608d33 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 200 len: 1361 microversion: 2.1 time: 0.158677 Jul 25 20:46:18.051556 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2814/5676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:17 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:19.074022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:19.074825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:19.093758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:19.095228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:19.099556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:19.101690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:19.142233 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 HTTP/1.1 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '96776813-5020-43d7-9d90-dba551bd4d84'} Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:19.148476 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:19.154219 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d19989b5-b99c-48b7-a6e0-9f5da07b62b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 404 len: 111 microversion: 2.1 time: 0.081097 Jul 25 20:46:19.155922 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2863/5677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:19 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:19.414331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1276183298", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f71a1d-bbf9-4b41-88b5-61ab23da3479"}], "security_groups": [{"name": "tempest-securitygroup--681888848"}], "key_name": "tempest-keypair-1599488955", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:19.632389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] validate_networks() for [('98f71a1d-bbf9-4b41-88b5-61ab23da3479', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:46:20.514495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:46:20.515087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:46:20.515580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:46:20.516221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:46:20.516736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:46:20.542181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:20.551452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:20.553917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:20.555549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:20.587046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:46:20.607280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:46:20.633020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:46:20.636625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:46:20.701941 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cea829c9-045a-4f6d-87ce-9570ed955f68 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.292664 Jul 25 20:46:20.702808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2815/5678] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:46:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:46:20.714039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a7ab9ed-f408-4b4e-ab2d-c26448ca6494 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:20.715393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a7ab9ed-f408-4b4e-ab2d-c26448ca6494 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:20.803878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a7ab9ed-f408-4b4e-ab2d-c26448ca6494 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:20.816452 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a7ab9ed-f408-4b4e-ab2d-c26448ca6494 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1242 microversion: 2.1 time: 0.106382 Jul 25 20:46:20.817248 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2864/5679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:20 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:21.841179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:21.843944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:21.851008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:21.851728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:21.852723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:21.853321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:21.938466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:21.952394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f114a473-ea8b-4766-b183-c1048aff4395 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1294 microversion: 2.1 time: 0.115841 Jul 25 20:46:21.953660 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2816/5680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:21 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:22.982177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:22.983218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:22.992384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=32 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:22.997089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:22.998792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:22.999743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:23.008956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:23.409480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:23.420673 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c3d9b838-5afe-4525-8e89-fab402f9155a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1300 microversion: 2.1 time: 0.442343 Jul 25 20:46:23.437188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2865/5681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:22 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1300 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:24.443483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:24.444275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:24.460737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:24.460854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:24.461571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:24.462191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:24.815985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:24.828793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7b6ad49-f109-4412-9689-882da48dd697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.389209 Jul 25 20:46:24.829550 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2817/5682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:24 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:25.139058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-677f8cf1-7b8d-4612-b3df-86dd4224ce84 req-ed35641a-431f-4a18-9c7a-9e100d543917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ea8995-6c34-4cf0-843c-9f3bee5f5b35", "tag": "a1e319cd-d581-45b4-979a-f9564427895f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:25.164522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-677f8cf1-7b8d-4612-b3df-86dd4224ce84 req-ed35641a-431f-4a18-9c7a-9e100d543917 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:25.164988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-677f8cf1-7b8d-4612-b3df-86dd4224ce84 req-ed35641a-431f-4a18-9c7a-9e100d543917 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:25.202873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-677f8cf1-7b8d-4612-b3df-86dd4224ce84 req-ed35641a-431f-4a18-9c7a-9e100d543917 service nova] Creating event network-changed:a1e319cd-d581-45b4-979a-f9564427895f for instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 on n-h2-845775-3 Jul 25 20:46:25.213458 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-677f8cf1-7b8d-4612-b3df-86dd4224ce84 req-ed35641a-431f-4a18-9c7a-9e100d543917 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079121 Jul 25 20:46:25.214918 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2866/5683] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:25.837189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:25.838296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:25.847081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:25.847679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:25.851941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:25.851941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:25.854044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:25.854989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:25.863117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:25.863615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:25.864637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:25.865103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:25.905632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:46:25.967944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:26.019554 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bca6572b-0a65-41f9-b67c-afb8bbb7eaa8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 204 len: 0 microversion: 2.1 time: 0.185673 Jul 25 20:46:26.026552 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2818/5684] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:46:25 2022] DELETE /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:46:26.033510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:26.034648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:26.044548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:26.045561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:26.046814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:26.047739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:26.096319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:26.112598 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8913b61b-542e-4f6a-9e03-8ac869c2c72a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.264802 Jul 25 20:46:26.114815 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2867/5685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:25 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:26.328884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:26.337752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77031896-86bb-41ea-9fc9-25eed443f90e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1410 microversion: 2.1 time: 0.309428 Jul 25 20:46:26.338939 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2819/5686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:26 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1410 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:27.137491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:27.139722 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:27.151019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:27.151970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:27.153917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:27.155124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:27.359600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:27.360447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:27.372347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:27.374240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:27.375662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:27.376627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:27.458539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:27.465715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb8f43b1-8d91-4dba-ab36-ee00d5b103cf tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.334947 Jul 25 20:46:27.466311 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2868/5687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:27 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:27.624914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:27.637403 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-49a3e222-1b57-4d7b-8a77-ada997734128 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1410 microversion: 2.1 time: 0.281335 Jul 25 20:46:27.644819 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2820/5688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:27 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1410 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:28.426494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ba36a083-20a3-4d54-8808-7e760fbf81ad req-f7dc589d-8711-4119-a3de-445c43f0725c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bcffe2e-7038-4274-a924-fb704f5ad702", "name": "network-vif-deleted", "tag": "30b21b39-1a27-49af-8105-897dce521b5c"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:28.439481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ba36a083-20a3-4d54-8808-7e760fbf81ad req-f7dc589d-8711-4119-a3de-445c43f0725c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:28.440345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ba36a083-20a3-4d54-8808-7e760fbf81ad req-f7dc589d-8711-4119-a3de-445c43f0725c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:28.455181 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ba36a083-20a3-4d54-8808-7e760fbf81ad req-f7dc589d-8711-4119-a3de-445c43f0725c service nova] Creating event network-vif-deleted:30b21b39-1a27-49af-8105-897dce521b5c for instance 2bcffe2e-7038-4274-a924-fb704f5ad702 on n-h1-845775-3 Jul 25 20:46:28.465223 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ba36a083-20a3-4d54-8808-7e760fbf81ad req-f7dc589d-8711-4119-a3de-445c43f0725c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042898 Jul 25 20:46:28.466943 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2869/5689] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:28.487263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:28.487942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:28.506047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:28.506514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:28.508768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:28.509226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:28.670278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:28.671560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:28.691322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:28.693501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:28.699490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:28.700562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:28.722710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:28.736241 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-448fe34d-a9b7-4dd3-8a40-a61bc5ab3007 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.253457 Jul 25 20:46:28.743255 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2821/5690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:28 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:28.847950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:28.862110 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a9028958-3a32-499b-b243-bc6bea48883f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1202 microversion: 2.1 time: 0.200594 Jul 25 20:46:28.867745 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2870/5691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:28 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1202 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:29.765631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:29.766274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:29.771810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:29.782627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:29.787223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:29.788616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:29.789407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:29.892290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:29.894481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:29.912150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:29.912760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:29.917711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:29.918288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:29.980708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:29.993919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb52b0cb-82f1-40e3-a9df-76b9f21324c3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.232508 Jul 25 20:46:30.000121 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2822/5692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:29 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:30.090254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:30.103283 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-855f211e-b775-4eef-8d1d-a7fb39aa6eed tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1202 microversion: 2.1 time: 0.215877 Jul 25 20:46:30.104842 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2871/5693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:29 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1202 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:30.333857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-315b1ed5-29e5-429e-8279-451694c96f49 req-061fce03-d4bc-43b5-9a10-ed2ad96fccab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ea8995-6c34-4cf0-843c-9f3bee5f5b35", "name": "network-vif-plugged", "status": "completed", "tag": "a1e319cd-d581-45b4-979a-f9564427895f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:30.357369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-315b1ed5-29e5-429e-8279-451694c96f49 req-061fce03-d4bc-43b5-9a10-ed2ad96fccab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:30.357838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-315b1ed5-29e5-429e-8279-451694c96f49 req-061fce03-d4bc-43b5-9a10-ed2ad96fccab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:30.386201 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-315b1ed5-29e5-429e-8279-451694c96f49 req-061fce03-d4bc-43b5-9a10-ed2ad96fccab service nova] Creating event network-vif-plugged:a1e319cd-d581-45b4-979a-f9564427895f for instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 on n-h2-845775-3 Jul 25 20:46:30.394432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-315b1ed5-29e5-429e-8279-451694c96f49 req-061fce03-d4bc-43b5-9a10-ed2ad96fccab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067112 Jul 25 20:46:30.395962 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2823/5694] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:31.025252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:31.028575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:31.034827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:31.054780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:31.056175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:31.058137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:31.059162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:31.130102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:31.132354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:31.152935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:31.155638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:31.161886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:31.166220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:31.168844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:31.169295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:31.318938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:31.320947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:31.334056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6a6cf974-27b7-4606-bf00-869d68637e28 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1367 microversion: 2.1 time: 0.318964 Jul 25 20:46:31.334955 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2872/5695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:31 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:31.348509 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5bd5d1bd-94fb-4823-99e1-0d380eefd404 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1202 microversion: 2.1 time: 0.223331 Jul 25 20:46:31.348509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2824/5696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:31 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1202 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:32.355979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:32.356624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:32.366804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.367572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.369501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.370305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.374334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:32.383635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:32.391984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.393114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.394345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.395690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.533188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:32.546007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-15354e32-ca8f-4cd2-a924-ae28f638d0e0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1202 microversion: 2.1 time: 0.179024 Jul 25 20:46:32.546847 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2873/5697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:32 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:46:32.661154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:32.679134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b9e4fd3-2528-405f-8fbe-2f6c6fcb4d4b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1556 microversion: 2.1 time: 0.327666 Jul 25 20:46:32.679711 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2825/5698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:32 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1556 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:32.703198 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:32.704518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:32.715186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.716106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.717135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:32.717590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:32.834711 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ea06e85-ff65-4f92-af5c-0feee668ce9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135977 Jul 25 20:46:32.835397 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2874/5699] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:46:32 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:46:33.577591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:33.578222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:33.586248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:33.586760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:33.588283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:33.588676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:33.653035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:33.654169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:33.662376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:33.663460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:33.664538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:33.665728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:33.690560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:33.699459 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e7dabcc2-8ad8-4e70-afaa-9c2f31950544 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1202 microversion: 2.1 time: 0.126020 Jul 25 20:46:33.700647 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2826/5700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:33 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1202 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:33.816759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lazy-loading 'services' on Instance uuid c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:46:33.922134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3d473eca-2d74-4cd2-87b5-55a3ea4927ba tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260/os-volume_attachments/5892c941-5016-47ef-b3ba-02d3dd3f659f" status: 202 len: 0 microversion: 2.1 time: 0.274281 Jul 25 20:46:33.923100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2875/5701] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:46:33 2022] DELETE /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260/os-volume_attachments/5892c941-5016-47ef-b3ba-02d3dd3f659f => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:46:34.429456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1668af0b-03ae-401a-91cc-1c1414454cf2 req-ebd159ee-1be1-4dcf-bca9-e8d82c891c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ea8995-6c34-4cf0-843c-9f3bee5f5b35", "tag": "a1e319cd-d581-45b4-979a-f9564427895f"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:34.444387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1668af0b-03ae-401a-91cc-1c1414454cf2 req-ebd159ee-1be1-4dcf-bca9-e8d82c891c76 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:34.445389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1668af0b-03ae-401a-91cc-1c1414454cf2 req-ebd159ee-1be1-4dcf-bca9-e8d82c891c76 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:34.465947 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1668af0b-03ae-401a-91cc-1c1414454cf2 req-ebd159ee-1be1-4dcf-bca9-e8d82c891c76 service nova] Creating event network-changed:a1e319cd-d581-45b4-979a-f9564427895f for instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 on n-h2-845775-3 Jul 25 20:46:34.477492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1668af0b-03ae-401a-91cc-1c1414454cf2 req-ebd159ee-1be1-4dcf-bca9-e8d82c891c76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050618 Jul 25 20:46:34.483730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2827/5702] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:34.772893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:34.778778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:34.786397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:34.786885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:34.788459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:34.789286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:34.843425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:34.844234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:34.844878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lazy-loading 'fault' on Instance uuid 2bcffe2e-7038-4274-a924-fb704f5ad702 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:46:35.079467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:35.090314 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c199abf-32d2-4239-8027-eaafa8006858 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 200 len: 1161 microversion: 2.1 time: 0.371123 Jul 25 20:46:35.095187 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2876/5703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:34 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:36.122716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:36.124131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:36.131135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:36.131873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:36.132884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:36.133523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:36.149637 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 HTTP/1.1 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2bcffe2e-7038-4274-a924-fb704f5ad702'} Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:36.152205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:36.156598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:36.179117 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6441390-5b98-4fdf-b198-14b5ab382c74 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 404 len: 111 microversion: 2.1 time: 0.062336 Jul 25 20:46:36.185475 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2828/5704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:36 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:39.583205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:39.583864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:39.606658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:39.611686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:39.613408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:39.616016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:39.664819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 HTTP/1.1 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '96776813-5020-43d7-9d90-dba551bd4d84'} Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:39.666989 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.671127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:39.671912 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ba9eddc6-a04f-4f7b-82fc-2f1c1ef0444d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 404 len: 111 microversion: 2.1 time: 0.091529 Jul 25 20:46:39.672752 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2877/5705] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:46:39 2022] DELETE /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:39.681921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:39.682553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 96776813-5020-43d7-9d90-dba551bd4d84] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:39.697453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:39.697931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:39.698718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:39.699165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:39.722099 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 HTTP/1.1 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '96776813-5020-43d7-9d90-dba551bd4d84'} Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:39.724001 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. Jul 25 20:46:39.728366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:39.729781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 96776813-5020-43d7-9d90-dba551bd4d84 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:39.730813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07b33aaa-7cea-4185-8cf7-30c275e94aa2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84" status: 404 len: 111 microversion: 2.1 time: 0.053724 Jul 25 20:46:39.731857 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2829/5706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:39 2022] GET /compute/v2.1/servers/96776813-5020-43d7-9d90-dba551bd4d84 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:40.425393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:40.426517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:40.436419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:40.437065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:40.438027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:40.438627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:40.455869 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 HTTP/1.1 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '2bcffe2e-7038-4274-a924-fb704f5ad702'} Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:40.457796 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-967e81af-4ad1-4e3e-8433-62fc1a4d51a6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 404 len: 111 microversion: 2.1 time: 0.037988 Jul 25 20:46:40.461762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2878/5707] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:46:40 2022] DELETE /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:40.468915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:40.469627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 2bcffe2e-7038-4274-a924-fb704f5ad702] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:40.477109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:40.477607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:40.479215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:40.479831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:40.498628 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 HTTP/1.1 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2bcffe2e-7038-4274-a924-fb704f5ad702'} Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:40.500231 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 2bcffe2e-7038-4274-a924-fb704f5ad702 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6043a9e7-7211-4342-90d7-fb1e4333003b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702" status: 404 len: 111 microversion: 2.1 time: 0.036691 Jul 25 20:46:40.504205 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2830/5708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:40 2022] GET /compute/v2.1/servers/2bcffe2e-7038-4274-a924-fb704f5ad702 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:46:40.637652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f48f241-3269-4d51-956e-99d6c6d68fa4 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: .version_select at 0x7f19681ae820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1625105149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMMa/1A6MRBibrcmEaiOeqUfZhlQQ5y4hSABL8uIvGqNl2gPTApoKt0hAgKWFHa0wEZ1DEu7TVLf61VMvTeMssBuk9bqMBoVFBn1F8WLSuc/Ed236gSeayTbq5ZKbgQmA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:40.656448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0f48f241-3269-4d51-956e-99d6c6d68fa4 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:46:40.662508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0f48f241-3269-4d51-956e-99d6c6d68fa4 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:46:40.689286 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f48f241-3269-4d51-956e-99d6c6d68fa4 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.058820 Jul 25 20:46:40.692204 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2879/5709] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:46:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:41.728716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:41.729473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:41.738008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:41.738464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:41.739163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:41.739817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:41.816947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:46:42.007990 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0518c8e-d64a-4390-9261-270ae31d6bde tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 204 len: 0 microversion: 2.1 time: 0.286814 Jul 25 20:46:42.010690 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2831/5710] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:46:41 2022] DELETE /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:46:42.023958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:42.024690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:42.034557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:42.039558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:42.039558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:42.039558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:42.283550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:42.302040 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94ba1366-2ada-4863-babe-3a1f0cefc036 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1467 microversion: 2.1 time: 0.283896 Jul 25 20:46:42.303089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2880/5711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:42 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1467 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:43.343099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:43.344497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:43.359979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:43.361086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:43.363235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:43.364380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:43.586618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:43.602417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0949f16-3ce4-4c38-bc5b-a97f9fb37b5e tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1467 microversion: 2.1 time: 0.266446 Jul 25 20:46:43.603949 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2832/5712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:43 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1467 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:44.629949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:44.631486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:44.641293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:44.642255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:44.643417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:44.644132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:44.767594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ade541d3404766900563e5eb231e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70415334c3d4fa7a8ae42613a24c806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:46:44.784322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4a60b16-2c1d-4415-87a2-a02143f61920 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 200 len: 1425 microversion: 2.1 time: 0.159952 Jul 25 20:46:44.785356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2881/5713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:44 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 1425 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:46:44.849764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4d9ec2ae-fa4a-460d-a138-059d0ce76e00 req-200323f1-431f-4aa7-86f6-4012deb95a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f9ce8e-97b0-4fdd-afbd-b47d0877c260", "name": "network-vif-deleted", "tag": "e5981bd5-7cf0-4bad-93b9-a22a6742c888"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:46:44.875115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4d9ec2ae-fa4a-460d-a138-059d0ce76e00 req-200323f1-431f-4aa7-86f6-4012deb95a15 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:44.875115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4d9ec2ae-fa4a-460d-a138-059d0ce76e00 req-200323f1-431f-4aa7-86f6-4012deb95a15 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:44.896109 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4d9ec2ae-fa4a-460d-a138-059d0ce76e00 req-200323f1-431f-4aa7-86f6-4012deb95a15 service nova] Creating event network-vif-deleted:e5981bd5-7cf0-4bad-93b9-a22a6742c888 for instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 on n-h2-845775-3 Jul 25 20:46:44.912521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4d9ec2ae-fa4a-460d-a138-059d0ce76e00 req-200323f1-431f-4aa7-86f6-4012deb95a15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066965 Jul 25 20:46:44.918988 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2833/5714] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:46:45.811526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:46:45.813695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] [instance: c6f9ce8e-97b0-4fdd-afbd-b47d0877c260] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:46:45.821235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:45.821729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:45.822526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:46:45.822979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:46:45.826152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:46:45.843718 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] HTTP exception thrown: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Request method failure captured: Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 HTTP/1.1 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wC2pE-lojGe5uqF5LBObkY6nzTCqfl4ihZDzwtZ0FzBLbYwHpmjQlj3Cm_PNSQCw0LxBBaBDqQVYylSzW12zzUJSXuT2KVpyuO-BVU7Mb6_op2MWaKrNRGkX9QyJBSO0u_37pPAfR4-ZGECzGn9sn5Qrk95eFApmS0zdOUIN86a4vY Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d70415334c3d4fa7a8ae42613a24c806 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesBackupsTest-1120346148 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d70415334c3d4fa7a8ae42613a24c806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d70415334c3d4fa7a8ae42613a24c806"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d70415334c3d4fa7a8ae42613a24c806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d70415334c3d4fa7a8ae42613a24c806"}]}] Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesBackupsTest-1120346148 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d70415334c3d4fa7a8ae42613a24c806 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesBackupsTest-1120346148 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesBackupsTest-1120346148-project Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 58ade541d3404766900563e5eb231e81 Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesBackupsTest-1120346148-project Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c6f9ce8e-97b0-4fdd-afbd-b47d0877c260'} Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:46:45.857904 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] Returning 404 to user: Instance c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-308bb5f4-5613-4aac-a570-b2e683ee9579 tempest-VolumesBackupsTest-1120346148 tempest-VolumesBackupsTest-1120346148-project] 10.222.0.48 "GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260" status: 404 len: 111 microversion: 2.1 time: 0.055184 Jul 25 20:46:45.862288 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2882/5715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:46:45 2022] GET /compute/v2.1/servers/c6f9ce8e-97b0-4fdd-afbd-b47d0877c260 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:47:08.022745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:08.025159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:08.041248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1872698489", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625105149", "security_groups": [{"name": "tempest-secgroup-smoke-1675704218"}], "block_device_mapping_v2": [{"uuid": "8cfa6d22-0c87-4f7f-94a7-3da38eee2ee8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:08.252463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:47:08.844891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:47:08.845205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:47:08.846068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:47:08.846642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:47:08.847262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:47:08.878125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:08.879034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:08.879380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:08.879826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:08.910928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:47:08.919960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:47:08.999355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:47:09.001806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cfa6d22-0c87-4f7f-94a7-3da38eee2ee8',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:47:09.186742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:09.187993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:09.189004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:09.214986 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63d86bfe-6228-4712-9a61-97d803d46d10 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.194665 Jul 25 20:47:09.216641 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2834/5716] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:47:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:47:09.234602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ebd89c7-5e4e-4bf2-a27e-3a9dc8c58b13 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:09.247883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ebd89c7-5e4e-4bf2-a27e-3a9dc8c58b13 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:09.323272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ebd89c7-5e4e-4bf2-a27e-3a9dc8c58b13 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:09.350687 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ebd89c7-5e4e-4bf2-a27e-3a9dc8c58b13 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1095 microversion: 2.1 time: 0.126735 Jul 25 20:47:09.365563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2835/5717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:09 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:09.381096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-874840359", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "a8700aaa-8624-4e45-8057-f03c3d3a5ebe"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:09.607641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] validate_networks() for [('a8700aaa-8624-4e45-8057-f03c3d3a5ebe', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:47:10.141924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:47:10.142370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:47:10.142868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:47:10.143298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:47:10.143738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:47:10.153277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:10.153745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:10.154579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:10.155036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:10.177637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Getting quotas for project 717afa30e46d4b13ad463997965fbb24. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:47:10.185270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Getting quotas for user c82a05e929c442c2a2128d79783dadaa and project 717afa30e46d4b13ad463997965fbb24. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:47:10.200674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:47:10.203023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:47:10.256580 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-211e75fe-5222-415f-a2a2-0f66af13a831 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074784 Jul 25 20:47:10.257260 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2883/5718] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:47:10.268279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-950b8dfe-a60c-4000-91b7-7524aeb3b9f0 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:10.269079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-950b8dfe-a60c-4000-91b7-7524aeb3b9f0 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:10.377161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:10.377759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:10.386504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:10.387041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:10.388149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:10.389324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:10.403121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-950b8dfe-a60c-4000-91b7-7524aeb3b9f0 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:10.430697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-950b8dfe-a60c-4000-91b7-7524aeb3b9f0 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1213 microversion: 2.1 time: 0.163438 Jul 25 20:47:10.432368 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2836/5719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:10 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:10.557173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:10.570091 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-062881d4-45f4-4c9c-a80b-e49392792382 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1201 microversion: 2.1 time: 0.199000 Jul 25 20:47:10.575646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2884/5720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:10 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1201 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:11.464483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:11.465128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:11.488651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:11.491650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:11.505842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:11.506415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:11.592950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:11.593587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:11.605350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:11.605971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:11.607347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:11.621214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:12.159314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:12.181243 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0d2d6bc7-9063-414a-ad60-b859ea892e05 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1265 microversion: 2.1 time: 0.720382 Jul 25 20:47:12.183656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2837/5721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:11 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1265 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:12.360982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:12.370365 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f8f4bc9-3968-4238-a39b-b85d887ea1c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1279 microversion: 2.1 time: 0.781263 Jul 25 20:47:12.371673 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2885/5722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:11 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1279 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:13.209185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:13.210020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:13.220164 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:13.221282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:13.222675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:13.223602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:13.385154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:13.393776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:13.395180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:13.402045 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2805fdb1-daca-43db-aea8-caf5d41a4385 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1271 microversion: 2.1 time: 0.198472 Jul 25 20:47:13.403022 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2838/5723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:13 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:13.432180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:13.432927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:13.433995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:13.434632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:13.763625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:13.775505 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bdfc7511-ecfd-48f7-acfd-0b3405cd39ca tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1279 microversion: 2.1 time: 0.386517 Jul 25 20:47:13.792224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2886/5724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:13 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1279 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:13.945470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6cfec781-feaf-416e-8429-dde4d7ca2cf1 req-efdfbca0-0148-4d10-92ea-40b2baf21f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3331881-ac90-46c8-a151-db43ad8130c0", "tag": "3ba85343-4571-4a5d-8131-5b5a046767c4"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:14.000408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6cfec781-feaf-416e-8429-dde4d7ca2cf1 req-efdfbca0-0148-4d10-92ea-40b2baf21f83 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:14.001391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6cfec781-feaf-416e-8429-dde4d7ca2cf1 req-efdfbca0-0148-4d10-92ea-40b2baf21f83 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:14.044474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6cfec781-feaf-416e-8429-dde4d7ca2cf1 req-efdfbca0-0148-4d10-92ea-40b2baf21f83 service nova] Creating event network-changed:3ba85343-4571-4a5d-8131-5b5a046767c4 for instance d3331881-ac90-46c8-a151-db43ad8130c0 on n-h1-845775-3 Jul 25 20:47:14.064624 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6cfec781-feaf-416e-8429-dde4d7ca2cf1 req-efdfbca0-0148-4d10-92ea-40b2baf21f83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126388 Jul 25 20:47:14.066535 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2839/5725] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:14.432870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:14.435122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:14.443059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:14.443954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:14.445141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:14.446781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:14.805701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:14.813309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:14.823115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:14.824119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:14.825687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:14.826678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:14.858035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:14.876431 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e08ee93-577f-48cc-8498-fb7574c2a618 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.450703 Jul 25 20:47:14.892661 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2887/5726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:14 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:15.312436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:15.324201 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b7a4966-5f91-464c-bf74-97d895309f44 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1279 microversion: 2.1 time: 0.527482 Jul 25 20:47:15.325838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2840/5727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:14 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1279 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:15.909550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:15.910830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:15.920288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:15.921269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:15.922559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:15.923180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:16.362581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:16.363613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:16.375517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:16.377333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:16.378659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:16.379475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:16.824021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:16.832451 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36d39963-1c92-4633-945c-1104e6b5a788 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.928507 Jul 25 20:47:16.844285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:16.848335 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2888/5728] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:15 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:16.850932 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c00b639b-d180-4734-b652-6de5daac58ec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1279 microversion: 2.1 time: 0.500704 Jul 25 20:47:16.852828 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2841/5729] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:16 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1279 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:16.854669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9b61c55c-a9cd-44c7-aff3-7a3050b7a760 req-bc89d226-9bf2-438a-ac92-0fea3add23c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed52b56d-0677-4117-b062-7010f1fd1c4b", "tag": "18873648-68b8-433d-a56e-7345edf3977e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:16.865020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9b61c55c-a9cd-44c7-aff3-7a3050b7a760 req-bc89d226-9bf2-438a-ac92-0fea3add23c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:16.865828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9b61c55c-a9cd-44c7-aff3-7a3050b7a760 req-bc89d226-9bf2-438a-ac92-0fea3add23c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:16.879258 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9b61c55c-a9cd-44c7-aff3-7a3050b7a760 req-bc89d226-9bf2-438a-ac92-0fea3add23c2 service nova] Creating event network-changed:18873648-68b8-433d-a56e-7345edf3977e for instance ed52b56d-0677-4117-b062-7010f1fd1c4b on n-h2-845775-3 Jul 25 20:47:16.886427 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9b61c55c-a9cd-44c7-aff3-7a3050b7a760 req-bc89d226-9bf2-438a-ac92-0fea3add23c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035853 Jul 25 20:47:16.888073 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2889/5730] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:17.856016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:17.856712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:17.864364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:17.864825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:17.865622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:17.866074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:17.878322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:17.879176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:17.889041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:17.890652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:17.890652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:17.891638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:18.126855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:18.136158 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18126370-c2c1-4d4e-9313-5facaaf24a4e tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.284603 Jul 25 20:47:18.137125 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2842/5731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:17 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:18.192934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:18.201507 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4b78581-6556-4638-9068-a539f0c998fa tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.330036 Jul 25 20:47:18.210730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2890/5732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:17 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:19.056321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:19.057067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.060835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:19.068111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.068572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.069354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.069801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.097331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26ff9781-6cd5-45c0-ab80-c108c68e0f59 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/ips" status: 200 len: 149 microversion: 2.1 time: 0.047230 Jul 25 20:47:19.097931 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2843/5733] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:47:19 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:19.109610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "176b57b2-652b-411b-b12f-f67602664671"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:19.112072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.119666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.120174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.120978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.121438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.158163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:19.158931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.165428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.166420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.167297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.167827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.242684 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/os-volume_attachments HTTP/1.1 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 74 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: {"volumeAttachment": {"volumeId": "176b57b2-652b-411b-b12f-f67602664671"}} Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: exception: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': 'e3ea8995-6c34-4cf0-843c-9f3bee5f5b35', 'body': {'volumeAttachment': {'volumeId': '176b57b2-652b-411b-b12f-f67602664671'}}} Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:47:19.244648 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd Jul 25 20:47:19.248991 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:19.251642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 400 to user: Invalid volume: volume 176b57b2-652b-411b-b12f-f67602664671 is already attached to instances: 01c21314-1e1c-4422-995d-74129498debd {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:19.252784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9ba01d6-65c1-42b4-a6fc-653ef963a697 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147485 Jul 25 20:47:19.253514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2891/5734] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:47:19 2022] POST /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 20:47:19.259090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:19.259921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.266600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.267377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.268415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.268991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.418835 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:19.427581 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19468228-8c0f-4f53-8b79-d9281793a1bb tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.273453 Jul 25 20:47:19.428484 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2844/5735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:19 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:19.435998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:19.437261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.446535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.447351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.448488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.449226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.459121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:19.467761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f279535-b3a5-4b77-9aab-0688e8423892 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.212887 Jul 25 20:47:19.468595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2892/5736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:19 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:19.477921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:47:19.573168 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00949a7a-f5ca-479c-9b43-dd10b9f9cf14 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 204 len: 0 microversion: 2.1 time: 0.143163 Jul 25 20:47:19.574085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2845/5737] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:47:19 2022] DELETE /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:47:19.583586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:19.584605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:19.593342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.593724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.594522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:19.594971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:19.764859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:19.773427 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec780145-3f68-497b-9572-092ea566f3a3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1681 microversion: 2.1 time: 0.194685 Jul 25 20:47:19.779502 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2893/5738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:19 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:20.451313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:20.452118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:20.456396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:20.462432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.462748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.463561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.464009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.492516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:20.494560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:20.504498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:20.505494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:20.510186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.511107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.512833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.513820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.748965 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:20.762763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-838ee83a-67d3-4271-8a67-31d7f0605920 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.315421 Jul 25 20:47:20.764951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2846/5739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:20 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:20.780902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:20.788536 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0331fbc1-7ac2-494e-a5a8-9e4acb19210d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.302132 Jul 25 20:47:20.790244 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2894/5740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:20 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:20.803278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:20.804346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:20.815020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.815981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.817550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:20.818472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:20.996467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:21.004460 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0af05d51-509d-4762-9a27-4a4b170621b6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1681 microversion: 2.1 time: 0.206791 Jul 25 20:47:21.020120 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2847/5741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:20 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:21.788413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:21.789234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:21.797538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:21.798093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:21.798880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:21.799371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:21.812418 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:21.813072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:21.819961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:21.820490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:21.821274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:21.821729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:22.106464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:22.114592 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b3f577ba-3875-4e28-9737-a8ad323f1e9a tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.331006 Jul 25 20:47:22.115188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2895/5742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:21 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:22.122251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:22.124186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:22.132533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:22.133528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:22.134362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:22.135478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:22.165950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:22.176939 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be2cb3e3-119d-4183-b85c-3be3cdfa866d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.368282 Jul 25 20:47:22.177666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2848/5743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:21 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:22.220915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:22.229678 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b90ddbb-529b-4e05-b9a9-467f94c8ea1f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1614 microversion: 2.1 time: 0.113405 Jul 25 20:47:22.230289 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2896/5744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:22 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1614 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:22.322330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1ecb5cfc-a40b-4e08-b400-89b1b7591e34 req-06dcf5e2-33da-422c-89e2-49c8e5c3020e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed52b56d-0677-4117-b062-7010f1fd1c4b", "name": "network-vif-plugged", "status": "completed", "tag": "18873648-68b8-433d-a56e-7345edf3977e"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:22.341863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1ecb5cfc-a40b-4e08-b400-89b1b7591e34 req-06dcf5e2-33da-422c-89e2-49c8e5c3020e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:22.342315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1ecb5cfc-a40b-4e08-b400-89b1b7591e34 req-06dcf5e2-33da-422c-89e2-49c8e5c3020e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:22.355898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1ecb5cfc-a40b-4e08-b400-89b1b7591e34 req-06dcf5e2-33da-422c-89e2-49c8e5c3020e service nova] Creating event network-vif-plugged:18873648-68b8-433d-a56e-7345edf3977e for instance ed52b56d-0677-4117-b062-7010f1fd1c4b on n-h2-845775-3 Jul 25 20:47:22.363841 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1ecb5cfc-a40b-4e08-b400-89b1b7591e34 req-06dcf5e2-33da-422c-89e2-49c8e5c3020e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045177 Jul 25 20:47:22.364825 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2849/5745] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:22.433020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d1e7e407-e332-4f2b-b3fd-d838931db719 req-0eb5c247-8748-4f7c-91ce-11164e39c791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ea8995-6c34-4cf0-843c-9f3bee5f5b35", "name": "network-vif-deleted", "tag": "a1e319cd-d581-45b4-979a-f9564427895f"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:22.443769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d1e7e407-e332-4f2b-b3fd-d838931db719 req-0eb5c247-8748-4f7c-91ce-11164e39c791 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:22.444675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d1e7e407-e332-4f2b-b3fd-d838931db719 req-0eb5c247-8748-4f7c-91ce-11164e39c791 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:22.462605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d1e7e407-e332-4f2b-b3fd-d838931db719 req-0eb5c247-8748-4f7c-91ce-11164e39c791 service nova] Creating event network-vif-deleted:a1e319cd-d581-45b4-979a-f9564427895f for instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 on n-h2-845775-3 Jul 25 20:47:22.469302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d1e7e407-e332-4f2b-b3fd-d838931db719 req-0eb5c247-8748-4f7c-91ce-11164e39c791 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039998 Jul 25 20:47:22.470717 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2897/5746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:23.141473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:23.142699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:23.156027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.156903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.158508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.159582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.200410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:23.201776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:23.211818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.212965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.214379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.215014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.471815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:23.494548 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7fb4bf15-f33c-43f9-83b9-132d2e0155bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1313 microversion: 2.1 time: 0.360379 Jul 25 20:47:23.508619 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2850/5747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:23 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:23.530950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:23.531546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:23.533086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:23.544192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.544774 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c07de1c8-7d9c-4c73-8567-336c85f02cfc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.349654 Jul 25 20:47:23.545038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.546605 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2898/5748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:23 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:23.546789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.547845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.604682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:23.605139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:23.605606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lazy-loading 'fault' on Instance uuid e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:47:23.670393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:23.690324 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f598adaf-b283-4a82-931a-104cec2af7e2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 200 len: 1332 microversion: 2.1 time: 0.177758 Jul 25 20:47:23.691346 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2851/5749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:23 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:24.516474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:24.517138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:24.525418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.525885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.526667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.527127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.576928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:24.577976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:24.587169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.587744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.588727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.589695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.765259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:24.777253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3710d146-b019-4378-9081-eeaeea5f1688 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1497 microversion: 2.1 time: 0.265538 Jul 25 20:47:24.778044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2899/5750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:24 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:24.784850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:24.785702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:24.794706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.795433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.796418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:24.796961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:24.818119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:24.822509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:24.827759 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:47:24.828211 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0249ac7d-25e0-43ac-b5ee-3f8ce75278ad tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.256797 Jul 25 20:47:24.829502 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2852/5751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:24 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 HTTP/1.1 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'e3ea8995-6c34-4cf0-843c-9f3bee5f5b35'} Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:24.830492 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:24.834279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3d9ce23-8bc0-4f2d-8b09-89cc2eb0aad9 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 404 len: 111 microversion: 2.1 time: 0.052350 Jul 25 20:47:24.835851 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2900/5752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:24 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:47:24.847371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-16655311-55de-426b-a157-09337eb6f0f4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '.version_select at 0x7f1969c82ca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:24.870540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-16655311-55de-426b-a157-09337eb6f0f4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599488955" status: 202 len: 0 microversion: 2.1 time: 0.032512 Jul 25 20:47:24.871263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2853/5753] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 20:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599488955 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:47:25.712983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:25.714093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:25.723151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.729603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:25.731816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.735292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:25.853334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:25.854820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:25.855270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lazy-loading 'services' on Instance uuid 01c21314-1e1c-4422-995d-74129498debd {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:47:25.859446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=100 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:25.871746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.872983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:25.875849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.877895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:25.948359 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6eb4d0ed-5d1a-49b1-883a-4b99c7514b5f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments/176b57b2-652b-411b-b12f-f67602664671" status: 202 len: 0 microversion: 2.1 time: 0.239466 Jul 25 20:47:25.954697 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2901/5754] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:47:25 2022] DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments/176b57b2-652b-411b-b12f-f67602664671 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:47:25.960594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:25.964210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:25.971223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.972103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:25.973129 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:25.973755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:26.025043 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4129996-4b05-4deb-9082-b0f08ce0bc5a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068634 Jul 25 20:47:26.026796 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2902/5755] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:25 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:26.175369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:26.184019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6767df7b-4f71-413e-9419-4fb2448fd02c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.335169 Jul 25 20:47:26.204847 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2854/5756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:25 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:27.042443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:27.047327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:27.060965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.061875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.062895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.063614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.117782 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bffaa8b3-7da7-42a5-98e7-7fb59f8359fa tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082577 Jul 25 20:47:27.124407 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2903/5757] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:27 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:27.220443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:27.222116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:27.233295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.234229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.236665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.237564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.430211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:27.441326 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e17228ea-0382-4f02-8685-807848aab8bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.227210 Jul 25 20:47:27.442986 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2855/5758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:27 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:27.794113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ed10cd57-f615-4c28-8489-4d549013fb99 req-02e0854b-f9c5-4082-a136-9a7fcb1edb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3331881-ac90-46c8-a151-db43ad8130c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ba85343-4571-4a5d-8131-5b5a046767c4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:27.808338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ed10cd57-f615-4c28-8489-4d549013fb99 req-02e0854b-f9c5-4082-a136-9a7fcb1edb86 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.808462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ed10cd57-f615-4c28-8489-4d549013fb99 req-02e0854b-f9c5-4082-a136-9a7fcb1edb86 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.819870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:27.820661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:27.827649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.828532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.829719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:27.830355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:27.831107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ed10cd57-f615-4c28-8489-4d549013fb99 req-02e0854b-f9c5-4082-a136-9a7fcb1edb86 service nova] Creating event network-vif-plugged:3ba85343-4571-4a5d-8131-5b5a046767c4 for instance d3331881-ac90-46c8-a151-db43ad8130c0 on n-h1-845775-3 Jul 25 20:47:27.841135 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ed10cd57-f615-4c28-8489-4d549013fb99 req-02e0854b-f9c5-4082-a136-9a7fcb1edb86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052455 Jul 25 20:47:27.842281 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2904/5759] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:27.872945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:47:28.020013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f39f0f2f-b111-46ff-9363-a0e57f0712e4 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 204 len: 0 microversion: 2.1 time: 0.204409 Jul 25 20:47:28.024144 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2856/5760] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:47:27 2022] DELETE /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:47:28.031112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:28.031864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:28.043798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.044971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.045952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.046541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.132917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:28.135379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:28.142891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.143429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.144318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.144831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.200827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d203525-5630-47fa-9395-fc63927d095d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072569 Jul 25 20:47:28.201594 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2857/5761] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:28 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:47:28.271982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:28.285878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e60f44c7-73db-4f55-b1d7-69bba844ab96 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1503 microversion: 2.1 time: 0.258591 Jul 25 20:47:28.287166 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2905/5762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:28 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:28.465077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:28.465877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:28.473262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.473716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.474523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:28.474971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:28.667197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:28.677362 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8cd609b4-6307-4f93-9a3b-44500c98331a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1267 microversion: 2.1 time: 0.217391 Jul 25 20:47:28.678334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2858/5763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:28 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:29.218643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:29.221385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:29.229943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.230415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:29.231222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.231678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:29.275162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7078cd8-e6b4-4823-b207-ec99caa7e301 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061358 Jul 25 20:47:29.276206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2906/5764] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:29 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:29.327044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:29.327954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:29.355811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.357134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:29.360188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.361323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:29.565452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:29.576709 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-55ef140e-dab2-4b38-98f8-5db7a6d10282 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1503 microversion: 2.1 time: 0.259239 Jul 25 20:47:29.577923 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2859/5765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:29 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:29.708637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:29.709900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:29.717789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.718386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:29.719832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:29.720158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.015837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:30.027304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-120c13c4-a153-490b-b08c-9325c9523ed1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1455 microversion: 2.1 time: 0.322435 Jul 25 20:47:30.028573 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2907/5766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:29 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1455 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:30.051413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:30.052379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:30.068435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.069219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.070326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.071104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.290801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:30.294147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:30.313254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.313739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.314556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.315014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.317880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:30.325691 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8a86a14c-77a3-4cee-b487-887b06bac83d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1455 microversion: 2.1 time: 0.278854 Jul 25 20:47:30.326313 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2860/5767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:30 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1455 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:30.392667 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-423fc4fe-a92f-473d-b28a-a75dc5083f9f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106877 Jul 25 20:47:30.393158 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2908/5768] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:30 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:47:30.611993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:30.612671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:30.627789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.628185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e43a1bf0-d9f3-4dd1-be86-2ff934bb96d0 req-cad9500c-a403-439c-9f31-0eeb44cb6108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed52b56d-0677-4117-b062-7010f1fd1c4b", "name": "network-vif-deleted", "tag": "18873648-68b8-433d-a56e-7345edf3977e"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:30.628349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.629578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.630062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.653015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e43a1bf0-d9f3-4dd1-be86-2ff934bb96d0 req-cad9500c-a403-439c-9f31-0eeb44cb6108 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:30.653591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e43a1bf0-d9f3-4dd1-be86-2ff934bb96d0 req-cad9500c-a403-439c-9f31-0eeb44cb6108 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:30.681207 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e43a1bf0-d9f3-4dd1-be86-2ff934bb96d0 req-cad9500c-a403-439c-9f31-0eeb44cb6108 service nova] Creating event network-vif-deleted:18873648-68b8-433d-a56e-7345edf3977e for instance ed52b56d-0677-4117-b062-7010f1fd1c4b on n-h2-845775-3 Jul 25 20:47:30.706812 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e43a1bf0-d9f3-4dd1-be86-2ff934bb96d0 req-cad9500c-a403-439c-9f31-0eeb44cb6108 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082513 Jul 25 20:47:30.707839 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2909/5769] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:47:30.732759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c82a05e929c442c2a2128d79783dadaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '717afa30e46d4b13ad463997965fbb24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:30.742990 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aadcff31-3370-460f-8c80-096885b69b76 tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 200 len: 1461 microversion: 2.1 time: 0.136009 Jul 25 20:47:30.745653 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2861/5770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:30 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 1461 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:31.413479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:31.419508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:31.435418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:31.436063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:31.437094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:31.437803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:31.502287 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-520769e8-81c1-4231-9db0-1f3f0440b865 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096513 Jul 25 20:47:31.503518 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2910/5771] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:31 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:31.765577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:31.766939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] [instance: ed52b56d-0677-4117-b062-7010f1fd1c4b] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:31.775724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:31.777018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:31.777998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:31.778728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:31.800758 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] HTTP exception thrown: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Request method failure captured: Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b HTTP/1.1 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wFLDH23K7Tu43J7i711Qpx59VeiRa3bShxqZp44Gz00IOUOx2Bpccq4RcvqicZ2O1Y-MdoAcgrJPLVMk2gCfg__eyxQd_RwKYA4Bqr12hXBaK_aJtIef16oPn7PqbyKE9U-iMwF9TmCu7yTZLkHrS9qE5HjLxVdS8I7Wv-SpZXrO4g Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 717afa30e46d4b13ad463997965fbb24 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesActionsTest-1790027782 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/717afa30e46d4b13ad463997965fbb24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_717afa30e46d4b13ad463997965fbb24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/717afa30e46d4b13ad463997965fbb24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/717afa30e46d4b13ad463997965fbb24"}]}] Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesActionsTest-1790027782 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 717afa30e46d4b13ad463997965fbb24 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesActionsTest-1790027782 Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesActionsTest-1790027782-project Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: c82a05e929c442c2a2128d79783dadaa Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesActionsTest-1790027782-project Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'ed52b56d-0677-4117-b062-7010f1fd1c4b'} Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:31.803797 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] Returning 404 to user: Instance ed52b56d-0677-4117-b062-7010f1fd1c4b could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0bc0181b-3ece-452c-b1d5-1fc7c09402bc tempest-VolumesActionsTest-1790027782 tempest-VolumesActionsTest-1790027782-project] 10.222.0.48 "GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b" status: 404 len: 111 microversion: 2.1 time: 0.046729 Jul 25 20:47:31.810809 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2862/5772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:31 2022] GET /compute/v2.1/servers/ed52b56d-0677-4117-b062-7010f1fd1c4b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:47:32.515028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:32.517740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:32.537160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.537631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.538630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.539953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.579604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:32.580254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:32.599354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.599836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.600749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.601216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.621290 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-22f339d8-0678-4207-a71b-b52cb110a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110140 Jul 25 20:47:32.627171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2863/5773] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:47:32 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 20:47:32.639148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:47:32.764354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:32.765557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:32.772673 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8004b8ce-a650-4671-8ef8-282a5d1dcf4d tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 204 len: 0 microversion: 2.1 time: 0.362424 Jul 25 20:47:32.775262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.776173 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2911/5774] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:47:32 2022] DELETE /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:47:32.777891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.779366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.780595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.807223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:32.808712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:32.823249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:47:32.830754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.831699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.833431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.834535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.930390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:32.953010 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d395988d-cfb7-46ed-9892-3277056fd5df tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 204 len: 0 microversion: 2.1 time: 0.193551 Jul 25 20:47:32.956132 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2864/5775] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:47:32 2022] DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:47:32.967303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:32.968399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:32.979119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.980486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:32.983251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:32.983580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:33.117793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:33.133604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb3f4c22-30a7-470c-866f-f65035689632 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1730 microversion: 2.1 time: 0.349701 Jul 25 20:47:33.135495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2912/5776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:32 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1730 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:33.237312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:33.250925 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b5ebca0b-b515-4797-ba97-37bfe132b953 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1681 microversion: 2.1 time: 0.289155 Jul 25 20:47:33.251652 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2865/5777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:32 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1681 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:33.676473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-98b41d6b-2a9d-4eb6-964c-d8bb35ca4647 req-6b020cc6-f907-4fe3-a2a1-b1f01d1a4ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3331881-ac90-46c8-a151-db43ad8130c0", "tag": "3ba85343-4571-4a5d-8131-5b5a046767c4"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:33.707579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98b41d6b-2a9d-4eb6-964c-d8bb35ca4647 req-6b020cc6-f907-4fe3-a2a1-b1f01d1a4ff6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:33.708600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-98b41d6b-2a9d-4eb6-964c-d8bb35ca4647 req-6b020cc6-f907-4fe3-a2a1-b1f01d1a4ff6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:33.723997 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-98b41d6b-2a9d-4eb6-964c-d8bb35ca4647 req-6b020cc6-f907-4fe3-a2a1-b1f01d1a4ff6 service nova] Creating event network-changed:3ba85343-4571-4a5d-8131-5b5a046767c4 for instance d3331881-ac90-46c8-a151-db43ad8130c0 on n-h1-845775-3 Jul 25 20:47:33.730107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-98b41d6b-2a9d-4eb6-964c-d8bb35ca4647 req-6b020cc6-f907-4fe3-a2a1-b1f01d1a4ff6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156802 Jul 25 20:47:33.735972 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2913/5778] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:47:34.161227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:34.161851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:34.170973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:34.171707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:34.172759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:34.173392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:34.277771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:34.278421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:34.295961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:34.296761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:34.297732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:34.298380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:34.569464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:34.577932 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a889bcd-7495-4966-a547-394a6c1a5e17 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1730 microversion: 2.1 time: 0.420623 Jul 25 20:47:34.579234 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2866/5779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:34 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1730 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:35.178114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:35.192540 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-78708b14-4db2-4be7-9980-aa252384ef1a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1681 microversion: 2.1 time: 0.919647 Jul 25 20:47:35.196135 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2914/5780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:34 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1681 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:35.601875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:35.602517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:35.626414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:35.626793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:35.627602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:35.628079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:35.762080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307ba31f42144fea97c9ffbb0850cc20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87fab28d7549579e93c64089ebd0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:35.772068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:35.777488 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cdd32680-1fbe-4e8b-a838-04536cb2da37 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 200 len: 1663 microversion: 2.1 time: 0.179494 Jul 25 20:47:35.796813 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2867/5781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:35 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 1663 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:36.168379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e69840f4-c27a-466a-9e7b-b96dbf177d8a req-51838c62-6ca9-4b6a-b925-7174d1a14921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb54585-9977-4322-8249-3d1bc5783a57", "name": "network-vif-deleted", "tag": "e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:36.191162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e69840f4-c27a-466a-9e7b-b96dbf177d8a req-51838c62-6ca9-4b6a-b925-7174d1a14921 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:36.193278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e69840f4-c27a-466a-9e7b-b96dbf177d8a req-51838c62-6ca9-4b6a-b925-7174d1a14921 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:36.219088 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e69840f4-c27a-466a-9e7b-b96dbf177d8a req-51838c62-6ca9-4b6a-b925-7174d1a14921 service nova] Creating event network-vif-deleted:e53e1ef1-ceeb-4cd3-8d88-e7c7fe6ce854 for instance 1fb54585-9977-4322-8249-3d1bc5783a57 on n-h2-845775-3 Jul 25 20:47:36.220184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:36.221369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:36.233583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:36.234350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:36.235335 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e69840f4-c27a-466a-9e7b-b96dbf177d8a req-51838c62-6ca9-4b6a-b925-7174d1a14921 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072087 Jul 25 20:47:36.235488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:36.236176 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2915/5782] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:36.236535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:36.809558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:36.810296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:36.833729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:36.834296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:36.835311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:36.853140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:36.868288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:36.886820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bb153fb-1140-4239-8297-f5108d9fc651 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1681 microversion: 2.1 time: 0.675853 Jul 25 20:47:36.887439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2868/5783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:36 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1681 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:47:36.888808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] HTTP exception thrown: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Request method failure captured: Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 HTTP/1.1 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wAO1HBYt1LA3511e_Q4kfq8XBy_qaIjw-ZVyxPjRMAF2rwC6KZlEbDPdS7ZeL3R8Tu7Rh8rjUr8v1FiE_gySnaXN3R7e3NvdpPK5ktFeF2WdrxZ5DVobqK87vm9WUnLzKBeMlfnrNIcnqyCSmnrpPPqsTnVXulPvYH5-Wqz8RD4rV0 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}] Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 307ba31f42144fea97c9ffbb0850cc20 Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1fb54585-9977-4322-8249-3d1bc5783a57'} Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:36.893333 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:36.896984 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:36.899031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Returning 404 to user: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:36.901715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-414fa2a4-10a9-4ae4-a6ed-b82155e9828e tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 404 len: 111 microversion: 2.1 time: 0.102188 Jul 25 20:47:36.906493 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2916/5784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:36 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:47:37.829722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:37.830268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:37.848414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.849082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:37.849941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.850554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:37.884059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] HTTP exception thrown: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Request method failure captured: Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 HTTP/1.1 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wAO1HBYt1LA3511e_Q4kfq8XBy_qaIjw-ZVyxPjRMAF2rwC6KZlEbDPdS7ZeL3R8Tu7Rh8rjUr8v1FiE_gySnaXN3R7e3NvdpPK5ktFeF2WdrxZ5DVobqK87vm9WUnLzKBeMlfnrNIcnqyCSmnrpPPqsTnVXulPvYH5-Wqz8RD4rV0 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}] Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 307ba31f42144fea97c9ffbb0850cc20 Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '1fb54585-9977-4322-8249-3d1bc5783a57'} Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:37.886431 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:37.890168 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:47:37.894692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Returning 404 to user: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:37.895869 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0c197c94-5ddd-452c-b075-b0cca989c845 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 404 len: 111 microversion: 2.1 time: 0.072348 Jul 25 20:47:37.900052 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2869/5785] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:47:37 2022] DELETE /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:47:37.906879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:37.907972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] [instance: 1fb54585-9977-4322-8249-3d1bc5783a57] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:37.933487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:37.934307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:37.937384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.939118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:37.950984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.951690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:37.968296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.969073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:37.971195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:37.975699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:38.003657 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] HTTP exception thrown: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Request method failure captured: Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 HTTP/1.1 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wAO1HBYt1LA3511e_Q4kfq8XBy_qaIjw-ZVyxPjRMAF2rwC6KZlEbDPdS7ZeL3R8Tu7Rh8rjUr8v1FiE_gySnaXN3R7e3NvdpPK5ktFeF2WdrxZ5DVobqK87vm9WUnLzKBeMlfnrNIcnqyCSmnrpPPqsTnVXulPvYH5-Wqz8RD4rV0 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca87fab28d7549579e93c64089ebd0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca87fab28d7549579e93c64089ebd0a2"}]}] Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: ca87fab28d7549579e93c64089ebd0a2 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestServerBasicOps-1278239173 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 307ba31f42144fea97c9ffbb0850cc20 Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestServerBasicOps-1278239173-project Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1fb54585-9977-4322-8249-3d1bc5783a57'} Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:38.005374 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Returning 404 to user: Instance 1fb54585-9977-4322-8249-3d1bc5783a57 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:38.010441 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2afaffd1-bf68-49b2-b2ab-a30200c16fad tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57" status: 404 len: 111 microversion: 2.1 time: 0.105972 Jul 25 20:47:38.014275 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2917/5786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:37 2022] GET /compute/v2.1/servers/1fb54585-9977-4322-8249-3d1bc5783a57 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:47:38.060450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:38.060904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:38.061379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lazy-loading 'fault' on Instance uuid 01c21314-1e1c-4422-995d-74129498debd {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:47:38.196456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:38.207752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4f935d1-841a-4157-a612-c1fcfe748d90 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 200 len: 1331 microversion: 2.1 time: 0.303679 Jul 25 20:47:38.212486 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2870/5787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:37 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 1331 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:38.275691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8b957107-0c43-4966-817a-e93ed6ab47f2 req-41977422-5a4d-413a-9004-323f562d56af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c21314-1e1c-4422-995d-74129498debd", "name": "network-vif-deleted", "tag": "4ce626ca-57ed-4685-92e2-078016778ff6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:38.299992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8b957107-0c43-4966-817a-e93ed6ab47f2 req-41977422-5a4d-413a-9004-323f562d56af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:38.301105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8b957107-0c43-4966-817a-e93ed6ab47f2 req-41977422-5a4d-413a-9004-323f562d56af service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:38.336884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8b957107-0c43-4966-817a-e93ed6ab47f2 req-41977422-5a4d-413a-9004-323f562d56af service nova] Creating event network-vif-deleted:4ce626ca-57ed-4685-92e2-078016778ff6 for instance 01c21314-1e1c-4422-995d-74129498debd on n-h1-845775-3 Jul 25 20:47:38.350067 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8b957107-0c43-4966-817a-e93ed6ab47f2 req-41977422-5a4d-413a-9004-323f562d56af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079482 Jul 25 20:47:38.352758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2918/5788] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:38.475292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-13ae1fe0-abe4-451f-aec3-53bdefbed4b0 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] Calling method '.version_select at 0x7f196e9afaf0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:38.521936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-13ae1fe0-abe4-451f-aec3-53bdefbed4b0 tempest-TestServerBasicOps-1278239173 tempest-TestServerBasicOps-1278239173-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-66873659" status: 202 len: 0 microversion: 2.1 time: 0.050890 Jul 25 20:47:38.526435 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2871/5789] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:47:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-66873659 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:47:39.238373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:39.240922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:39.247664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:39.251105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:39.251901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:39.252921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:39.254481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:39.278379 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd HTTP/1.1 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '01c21314-1e1c-4422-995d-74129498debd'} Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:47:39.280564 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:47:39.285085 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:47:39.286832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:47:39.295037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-589f6723-4ca3-4645-84de-9724c5c90189 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 404 len: 111 microversion: 2.1 time: 0.055279 Jul 25 20:47:39.304301 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2919/5790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:39 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:47:39.310306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1162295f-6340-4d0d-b44c-ae5e53ab95e4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '.version_select at 0x7f19698df700>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:39.392244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1162295f-6340-4d0d-b44c-ae5e53ab95e4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351808605" status: 202 len: 0 microversion: 2.1 time: 0.086576 Jul 25 20:47:39.393019 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2872/5791] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351808605 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:47:40.292818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c13206d8-56be-4a47-b3c6-c8cfd0babc2e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: .version_select at 0x7f196991f430>, body: {"keypair": {"name": "tempest-keypair-868407578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgy+yc1G46voGT4PLCWqrxiyZSjH5mveS50hejV9WM+w3i1huSnEO9BWF1N1EQTTbpfMJIk6VH04/9JpwcuwwgqSUTiSlYvc9AOgNu+hiEDA5Y4pF38iWYlscJUzj3jbw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:40.314374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c13206d8-56be-4a47-b3c6-c8cfd0babc2e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:47:40.321208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c13206d8-56be-4a47-b3c6-c8cfd0babc2e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:47:40.353253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c13206d8-56be-4a47-b3c6-c8cfd0babc2e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067050 Jul 25 20:47:40.354466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2920/5792] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:47:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:47:42.526207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111229573", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f71a1d-bbf9-4b41-88b5-61ab23da3479"}], "security_groups": [{"name": "tempest-securitygroup--1353099"}], "key_name": "tempest-keypair-868407578", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:42.776935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] validate_networks() for [('98f71a1d-bbf9-4b41-88b5-61ab23da3479', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:47:43.528383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:47:43.529553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:47:43.530243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:47:43.530845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:47:43.531432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:47:43.546266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:43.550154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:43.551306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:43.552137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:43.573081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:47:43.580628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:47:43.600405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:47:43.604294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:47:43.713313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0e7b5d7b-449a-49d0-917c-6738280462f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.198451 Jul 25 20:47:43.714055 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2873/5793] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:47:42 2022] POST /compute/v2.1/servers => generated 399 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:47:43.725513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-61611dd9-06e3-4ff9-a86b-5a37de43b797 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:43.726222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-61611dd9-06e3-4ff9-a86b-5a37de43b797 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:43.988767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-61611dd9-06e3-4ff9-a86b-5a37de43b797 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:43.998177 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-61611dd9-06e3-4ff9-a86b-5a37de43b797 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1241 microversion: 2.1 time: 0.276575 Jul 25 20:47:44.001264 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2921/5794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:43 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1241 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:45.029482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:45.030707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:45.037623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:45.038337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:45.040285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:45.041276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:45.598168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:45.629185 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7636f75a-8d16-4139-a611-7e085f95e42a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1293 microversion: 2.1 time: 0.604279 Jul 25 20:47:45.636086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2874/5795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:45 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1293 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:46.670183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:46.671871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:46.684769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:46.685684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:46.686856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:46.687531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:46.815193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:46.828905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fee1ee8d-23ea-4af6-847e-db435c84a4a0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1299 microversion: 2.1 time: 0.164589 Jul 25 20:47:46.831785 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2922/5796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:46 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:47.853874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:47.855089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:47.862703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:47.863402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:47.864383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:47.865015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:48.203066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:48.213939 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2de99482-8510-47ca-8281-a944f250b240 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 0.364684 Jul 25 20:47:48.224079 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2875/5797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:47 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:48.910252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7d93ca1e-a1ba-4705-b1fa-00460b940412 req-9a452b6e-dc3d-4c1c-bc38-5caed6aafb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85706e3e-340d-4d79-99fe-dea3882db1dd", "tag": "3ee83c16-9d30-44b3-b4bf-e479a51a687a"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:48.931350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7d93ca1e-a1ba-4705-b1fa-00460b940412 req-9a452b6e-dc3d-4c1c-bc38-5caed6aafb78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:48.931821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7d93ca1e-a1ba-4705-b1fa-00460b940412 req-9a452b6e-dc3d-4c1c-bc38-5caed6aafb78 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:48.984376 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7d93ca1e-a1ba-4705-b1fa-00460b940412 req-9a452b6e-dc3d-4c1c-bc38-5caed6aafb78 service nova] Creating event network-changed:3ee83c16-9d30-44b3-b4bf-e479a51a687a for instance 85706e3e-340d-4d79-99fe-dea3882db1dd on n-h2-845775-3 Jul 25 20:47:49.006309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7d93ca1e-a1ba-4705-b1fa-00460b940412 req-9a452b6e-dc3d-4c1c-bc38-5caed6aafb78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099880 Jul 25 20:47:49.012143 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2923/5798] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:49.242922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:49.243560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:49.256847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:49.261094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:49.262144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:49.262916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:49.655667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:49.681703 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aac5aabd-937b-4f50-83b8-ad9e58ad9a83 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 0.443339 Jul 25 20:47:49.685357 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2876/5799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:49 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:50.733829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:50.735616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:50.775319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:50.785595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:50.789484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:50.793285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:50.841641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:51.864127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:51.885781 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10b671eb-1e08-418f-8c5d-09463e0070f8 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 1.181660 Jul 25 20:47:51.905636 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2924/5800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:50 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:52.932857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:52.933630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:52.940989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:52.941532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:52.942836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:52.943301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:53.152654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:53.169019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9bb2a1a-fb63-4d57-be9c-e5ee55fcec72 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 0.245820 Jul 25 20:47:53.184859 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2877/5801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:52 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:54.202350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:54.203961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:54.215108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:54.218702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:54.220430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:54.223711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:54.224802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:54.512268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:54.525007 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6d7bac4-36be-4e23-a73b-143c10cfa756 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 0.328106 Jul 25 20:47:54.535937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2925/5802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:54 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:54.583940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f3ef94a1-dd00-481f-9c87-a57a39291f1f req-bee8c4ec-94e4-4a70-b6c8-1ff2ff7a4a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85706e3e-340d-4d79-99fe-dea3882db1dd", "name": "network-vif-plugged", "status": "completed", "tag": "3ee83c16-9d30-44b3-b4bf-e479a51a687a"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:54.597588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:54.600468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:47:54.606978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f3ef94a1-dd00-481f-9c87-a57a39291f1f req-bee8c4ec-94e4-4a70-b6c8-1ff2ff7a4a39 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:54.607907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f3ef94a1-dd00-481f-9c87-a57a39291f1f req-bee8c4ec-94e4-4a70-b6c8-1ff2ff7a4a39 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:54.627235 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f3ef94a1-dd00-481f-9c87-a57a39291f1f req-bee8c4ec-94e4-4a70-b6c8-1ff2ff7a4a39 service nova] Creating event network-vif-plugged:3ee83c16-9d30-44b3-b4bf-e479a51a687a for instance 85706e3e-340d-4d79-99fe-dea3882db1dd on n-h2-845775-3 Jul 25 20:47:54.634291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f3ef94a1-dd00-481f-9c87-a57a39291f1f req-bee8c4ec-94e4-4a70-b6c8-1ff2ff7a4a39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053640 Jul 25 20:47:54.635761 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2878/5803] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:55.549348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:55.550161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:55.557899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:55.558368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:55.559185 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:55.559643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:55.745368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:55.755246 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-464e493e-c584-4729-8ec2-69e236194e6b tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1364 microversion: 2.1 time: 0.210074 Jul 25 20:47:55.758226 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2926/5804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:55 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:56.782190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:56.783438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:56.793349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:56.794323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:56.796716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:56.797872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:56.959977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:47:56.968601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7633699b-f94b-46d0-9d81-04b943bc5874 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1553 microversion: 2.1 time: 0.192586 Jul 25 20:47:56.969654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2879/5805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:47:56 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:47:56.994857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:47:56.995417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:47:57.003624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:57.003922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:57.004762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:57.005218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:57.105283 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4c1a06f-01b0-4cc1-a82d-b7b088ef6a20 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115062 Jul 25 20:47:57.106460 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2927/5806] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:47:56 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:47:58.550935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-650df5da-2e6a-4b03-a004-4234bdaff155 req-2ccfe2cf-8fc5-43ce-b5fc-e68ca40b0d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85706e3e-340d-4d79-99fe-dea3882db1dd", "tag": "3ee83c16-9d30-44b3-b4bf-e479a51a687a"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:47:58.576959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-650df5da-2e6a-4b03-a004-4234bdaff155 req-2ccfe2cf-8fc5-43ce-b5fc-e68ca40b0d24 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:47:58.577628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-650df5da-2e6a-4b03-a004-4234bdaff155 req-2ccfe2cf-8fc5-43ce-b5fc-e68ca40b0d24 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:47:58.597938 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-650df5da-2e6a-4b03-a004-4234bdaff155 req-2ccfe2cf-8fc5-43ce-b5fc-e68ca40b0d24 service nova] Creating event network-changed:3ee83c16-9d30-44b3-b4bf-e479a51a687a for instance 85706e3e-340d-4d79-99fe-dea3882db1dd on n-h2-845775-3 Jul 25 20:47:58.611234 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-650df5da-2e6a-4b03-a004-4234bdaff155 req-2ccfe2cf-8fc5-43ce-b5fc-e68ca40b0d24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086279 Jul 25 20:47:58.615192 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2880/5807] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:17.996170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:17.999008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=18 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:18.005593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-64261596", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "9e115260-8bfa-42cb-9a5a-fa49f9f659b8"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:18.084135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] validate_networks() for [('9e115260-8bfa-42cb-9a5a-fa49f9f659b8', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:48:18.537149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:48:18.538332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:48:18.538990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:48:18.539575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:48:18.540244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:48:18.552411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:18.552873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:18.554301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:18.554755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:18.579246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Getting quotas for project 47e805616cc04263a6eeecbf856d75c0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:48:18.588535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Getting quotas for user 0706efde6cec4faaa119b8c3ccce1f00 and project 47e805616cc04263a6eeecbf856d75c0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:48:18.603692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:48:18.605992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:48:18.654044 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e738c5f8-6594-473e-a863-f0a1003b31d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660519 Jul 25 20:48:18.662361 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2928/5808] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:48:18.669449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:18.670888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=52 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:18.676456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-52661a7e-d34f-4321-96a6-61ad06619d70 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:18.678057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-52661a7e-d34f-4321-96a6-61ad06619d70 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:18.762262 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-52661a7e-d34f-4321-96a6-61ad06619d70 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:18.770463 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-52661a7e-d34f-4321-96a6-61ad06619d70 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1212 microversion: 2.1 time: 0.105587 Jul 25 20:48:18.771405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2881/5809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:18 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:48:19.794692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:19.796862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:19.806515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:19.807418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:19.808557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:19.809230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:20.276739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:20.287107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13afe36a-6892-417a-af97-9cf9c558ba28 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1272 microversion: 2.1 time: 0.497992 Jul 25 20:48:20.288243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2929/5810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:19 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1272 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:21.309555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:21.310776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:21.319096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:21.319800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:21.320802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:21.321413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:21.572148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:21.585181 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f72b2d20-51b5-460d-a7ee-665695f29149 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.278060 Jul 25 20:48:21.586043 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2882/5811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:21 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:21.607619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b8761932-2097-4eb1-9152-fa70a596e041 req-d454888a-807f-449b-a54d-7f0b787df3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b227168f-66de-49d1-85eb-bde98b42c249", "tag": "70e5cdd6-c480-4d92-a7f2-daaba3d782e6"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:21.638296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8761932-2097-4eb1-9152-fa70a596e041 req-d454888a-807f-449b-a54d-7f0b787df3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:21.638863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8761932-2097-4eb1-9152-fa70a596e041 req-d454888a-807f-449b-a54d-7f0b787df3ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:21.656067 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b8761932-2097-4eb1-9152-fa70a596e041 req-d454888a-807f-449b-a54d-7f0b787df3ba service nova] Creating event network-changed:70e5cdd6-c480-4d92-a7f2-daaba3d782e6 for instance b227168f-66de-49d1-85eb-bde98b42c249 on n-h2-845775-3 Jul 25 20:48:21.662501 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b8761932-2097-4eb1-9152-fa70a596e041 req-d454888a-807f-449b-a54d-7f0b787df3ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058550 Jul 25 20:48:21.664221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2930/5812] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:22.609515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:22.610284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:22.619632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:22.620416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:22.621778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:22.622479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:22.783738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:22.792436 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4a2905d-17ca-4539-8b64-03a73af42257 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.186882 Jul 25 20:48:22.793034 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2883/5813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:22 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:23.816520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:23.817257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:23.824496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:23.824968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:23.825765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:23.826219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:23.967680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:23.975651 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-533925bd-5da6-4f57-b8a9-403de7bb0e06 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.164463 Jul 25 20:48:23.976361 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2931/5814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:23 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:24.997960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:24.999594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:25.009623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:25.010447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:25.011584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:25.012373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:25.190603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:25.202315 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1edb395c-01c7-4bbc-b67c-c3424668f03a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.208367 Jul 25 20:48:25.203337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2884/5815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:24 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:26.227958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:26.228847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:26.236190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:26.236514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:26.237402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:26.237949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:26.391559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:26.400948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7da5cc90-cae8-43b5-914b-84ab55a1ab84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.177459 Jul 25 20:48:26.401565 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2932/5816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:26 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:26.657971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5889e3c4-a173-4a50-9197-11c375356a51 req-9d486b53-60b1-4d76-85a4-d489c0e74ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b227168f-66de-49d1-85eb-bde98b42c249", "name": "network-vif-plugged", "status": "completed", "tag": "70e5cdd6-c480-4d92-a7f2-daaba3d782e6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:26.682125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5889e3c4-a173-4a50-9197-11c375356a51 req-9d486b53-60b1-4d76-85a4-d489c0e74ca6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:26.682659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5889e3c4-a173-4a50-9197-11c375356a51 req-9d486b53-60b1-4d76-85a4-d489c0e74ca6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:26.696901 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5889e3c4-a173-4a50-9197-11c375356a51 req-9d486b53-60b1-4d76-85a4-d489c0e74ca6 service nova] Creating event network-vif-plugged:70e5cdd6-c480-4d92-a7f2-daaba3d782e6 for instance b227168f-66de-49d1-85eb-bde98b42c249 on n-h2-845775-3 Jul 25 20:48:26.702636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5889e3c4-a173-4a50-9197-11c375356a51 req-9d486b53-60b1-4d76-85a4-d489c0e74ca6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048439 Jul 25 20:48:26.703377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2885/5817] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:27.426707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:27.427331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:27.434600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:27.435067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:27.435851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:27.436333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:27.597278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:27.608094 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b1b002a2-a743-43f9-a927-77fc2632cf87 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1312 microversion: 2.1 time: 0.185201 Jul 25 20:48:27.608928 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2933/5818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:27 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:28.633623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:28.634685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:28.644740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:28.645434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:28.646602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:28.647846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:28.770032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:28.794049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:28.803874 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed83e51f-6d93-4c05-a376-253336396a1d tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1495 microversion: 2.1 time: 0.176293 Jul 25 20:48:28.804873 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2886/5819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:28 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1495 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:29.248823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:29.249520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:29.257613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:29.257613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:29.259944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:29.260518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:29.261321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:29.261778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:29.293217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:48:29.388028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b4af230-db88-4c4b-b8f8-626769afda08 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 204 len: 0 microversion: 2.1 time: 0.147826 Jul 25 20:48:29.388780 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2934/5820] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:48:29 2022] DELETE /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:48:29.397519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:29.398227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:29.404845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:29.405276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:29.406078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:29.406512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:29.603971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:29.612292 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0337bb51-9bfb-46f7-8a48-f5cef6bc5d23 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1501 microversion: 2.1 time: 0.218790 Jul 25 20:48:29.612885 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2887/5821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:29 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:30.639373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:30.640624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:30.652338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:30.653023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:30.654223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:30.654895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:30.856397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:30.865731 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-38f785bd-5ede-419b-9563-a2d807c4aa94 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1501 microversion: 2.1 time: 0.234905 Jul 25 20:48:30.866662 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2935/5822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:30 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1501 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:31.661402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f632f608-fe00-4fc2-8d0b-64e18052f85b req-cc3ed050-8b45-43d3-9e83-fa1e71dc4798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b227168f-66de-49d1-85eb-bde98b42c249", "name": "network-vif-deleted", "tag": "70e5cdd6-c480-4d92-a7f2-daaba3d782e6"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:31.675728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f632f608-fe00-4fc2-8d0b-64e18052f85b req-cc3ed050-8b45-43d3-9e83-fa1e71dc4798 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:31.679080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f632f608-fe00-4fc2-8d0b-64e18052f85b req-cc3ed050-8b45-43d3-9e83-fa1e71dc4798 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:31.698735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f632f608-fe00-4fc2-8d0b-64e18052f85b req-cc3ed050-8b45-43d3-9e83-fa1e71dc4798 service nova] Creating event network-vif-deleted:70e5cdd6-c480-4d92-a7f2-daaba3d782e6 for instance b227168f-66de-49d1-85eb-bde98b42c249 on n-h2-845775-3 Jul 25 20:48:31.710218 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f632f608-fe00-4fc2-8d0b-64e18052f85b req-cc3ed050-8b45-43d3-9e83-fa1e71dc4798 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050513 Jul 25 20:48:31.712416 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2888/5823] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:48:31.896739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:31.897773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:31.905997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:31.906469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:31.907281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:31.907740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:31.947585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:31.947585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:31.947585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lazy-loading 'fault' on Instance uuid b227168f-66de-49d1-85eb-bde98b42c249 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:48:31.997297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:32.005976 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20fd071c-78cf-41a1-8524-32ca8ac2ea84 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 200 len: 1302 microversion: 2.1 time: 0.113935 Jul 25 20:48:32.006919 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2936/5824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:31 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:48:33.037358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:33.038601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: b227168f-66de-49d1-85eb-bde98b42c249] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:33.045278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:33.045742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:33.046524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:33.046974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:33.064110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] HTTP exception thrown: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Request method failure captured: Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 HTTP/1.1 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wGQEVT4DrLi_BGuQXfCMzi-nXhp7Io-Hu14lPF6QS8IeYK9rU5yXScSjLSInZ8eIZFZSRScyuywWMdTBPQfZTYyF9Lqo63Wr4eDOqJbdD3uTag73EJsliwQmk8OkPxo-lIctHLx0PeJ9mc6gR05tA57FCcV_FgotQLs2XUvnrp5TzE Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 47e805616cc04263a6eeecbf856d75c0 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-VolumesActionsTest-686363654 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/47e805616cc04263a6eeecbf856d75c0"}]}] Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-VolumesActionsTest-686363654 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 47e805616cc04263a6eeecbf856d75c0 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-VolumesActionsTest-686363654 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-VolumesActionsTest-686363654-project Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 0706efde6cec4faaa119b8c3ccce1f00 Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-VolumesActionsTest-686363654-project Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'b227168f-66de-49d1-85eb-bde98b42c249'} Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:33.065860 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Returning 404 to user: Instance b227168f-66de-49d1-85eb-bde98b42c249 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b53102f5-12f1-4bde-ba8d-8172cbb3705a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249" status: 404 len: 111 microversion: 2.1 time: 0.035237 Jul 25 20:48:33.070811 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2889/5825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:33 2022] GET /compute/v2.1/servers/b227168f-66de-49d1-85eb-bde98b42c249 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:48:33.123570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-428395483", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "9e115260-8bfa-42cb-9a5a-fa49f9f659b8"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:33.182928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] validate_networks() for [('9e115260-8bfa-42cb-9a5a-fa49f9f659b8', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:48:33.569432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:48:33.569868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:48:33.570361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:48:33.571015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:48:33.571453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:48:33.580701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:33.581167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:33.581973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:33.582560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:33.601200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Getting quotas for project 47e805616cc04263a6eeecbf856d75c0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:48:33.606602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Getting quotas for user 0706efde6cec4faaa119b8c3ccce1f00 and project 47e805616cc04263a6eeecbf856d75c0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:48:33.619588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:48:33.621923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:48:33.669481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-727b92fc-0bd5-4248-8d96-d1a03c40e73f tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549693 Jul 25 20:48:33.670057 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2937/5826] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:48:33.681860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7e5559c-c822-40c7-876e-de488fc24e30 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:33.682439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7e5559c-c822-40c7-876e-de488fc24e30 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:33.743979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c7e5559c-c822-40c7-876e-de488fc24e30 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:33.752526 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7e5559c-c822-40c7-876e-de488fc24e30 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1213 microversion: 2.1 time: 0.075422 Jul 25 20:48:33.753417 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2890/5827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:33 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:34.776332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:34.777108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:34.785602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:34.786047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:34.786865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:34.788175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:34.902108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:34.913135 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee0a01e0-245f-4bf7-b4cc-738d697635fe tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1283 microversion: 2.1 time: 0.140171 Jul 25 20:48:34.914483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2938/5828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:34 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:35.116405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:35.117065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:35.126011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:35.127210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:35.128333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:35.128864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:35.167013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11b23f44-c343-42b9-bb07-2c1b3bc6bb27 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/ips" status: 200 len: 148 microversion: 2.1 time: 0.055254 Jul 25 20:48:35.168022 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2891/5829] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:48:35 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/ips => generated 148 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:35.935938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:35.938354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:35.954011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:35.955370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:35.956402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:35.957513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:36.218472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:36.227120 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-658e24cf-e01f-41ce-aa00-165d4d34318b tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.295763 Jul 25 20:48:36.241089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2939/5830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:35 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:36.507541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d6c2617f-2edf-47d7-b33a-3d48375bde58 req-ddb81a2e-0591-494d-8204-beaec4f47a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7b1861-d016-4fb9-97f6-7cee29fda8e2", "tag": "8989357f-d17a-426a-8836-77099ce43346"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:36.538154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d6c2617f-2edf-47d7-b33a-3d48375bde58 req-ddb81a2e-0591-494d-8204-beaec4f47a0e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:36.538803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d6c2617f-2edf-47d7-b33a-3d48375bde58 req-ddb81a2e-0591-494d-8204-beaec4f47a0e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:36.584028 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d6c2617f-2edf-47d7-b33a-3d48375bde58 req-ddb81a2e-0591-494d-8204-beaec4f47a0e service nova] Creating event network-changed:8989357f-d17a-426a-8836-77099ce43346 for instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 on n-h2-845775-3 Jul 25 20:48:36.591080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d6c2617f-2edf-47d7-b33a-3d48375bde58 req-ddb81a2e-0591-494d-8204-beaec4f47a0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108817 Jul 25 20:48:36.593110 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2892/5831] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:37.252213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:37.253040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:37.260834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:37.261408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:37.262297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:37.262969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:37.413977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:37.424742 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-74ff2af6-7d09-48d7-b7a0-7c3bfd0fc89a tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.178062 Jul 25 20:48:37.425742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2940/5832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:37 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:37.684365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d49f4d8-e8ee-415a-b2d8-e8701e65eea0"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:37.686875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:37.693473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:37.693961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:37.694961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:37.695233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:38.085415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-90016f11-253b-4b5a-b990-8a405d923282 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406085 Jul 25 20:48:38.086077 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2893/5833] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:48:37 2022] POST /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:38.452544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:38.453478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:38.462539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:38.463375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:38.464462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:38.465228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:38.625292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:38.636821 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fd8e36b5-18c2-4292-9337-c1e5055519d1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.188776 Jul 25 20:48:38.654048 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2941/5834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:38 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:39.671792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:39.673199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:39.684308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:39.685079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:39.686426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:39.687213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:39.866532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:39.877388 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-14a81b16-c973-4b12-9951-c618b9712c85 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.218187 Jul 25 20:48:39.878118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2894/5835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:39 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:40.832556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0e1eedc4-95dd-41ca-83d0-a80e5a0db236 req-4f5a5dfb-d3ee-41cf-b816-04086d9e4d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7b1861-d016-4fb9-97f6-7cee29fda8e2", "name": "network-vif-plugged", "status": "completed", "tag": "8989357f-d17a-426a-8836-77099ce43346"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:40.843056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0e1eedc4-95dd-41ca-83d0-a80e5a0db236 req-4f5a5dfb-d3ee-41cf-b816-04086d9e4d21 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:40.843785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0e1eedc4-95dd-41ca-83d0-a80e5a0db236 req-4f5a5dfb-d3ee-41cf-b816-04086d9e4d21 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:40.860683 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0e1eedc4-95dd-41ca-83d0-a80e5a0db236 req-4f5a5dfb-d3ee-41cf-b816-04086d9e4d21 service nova] Creating event network-vif-plugged:8989357f-d17a-426a-8836-77099ce43346 for instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 on n-h2-845775-3 Jul 25 20:48:40.866801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0e1eedc4-95dd-41ca-83d0-a80e5a0db236 req-4f5a5dfb-d3ee-41cf-b816-04086d9e4d21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186111 Jul 25 20:48:40.867622 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2942/5836] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:40.899406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:40.900173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:40.907520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:40.908294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:40.909163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:40.909616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:41.101718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:41.112222 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9443c4c-4825-42a7-b7ac-778b21fb7986 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.217235 Jul 25 20:48:41.113290 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2895/5837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:40 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:42.141777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:42.142600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:42.149874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:42.150413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:42.151146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:42.151606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:42.372028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:42.379805 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-be3d4785-028e-4d93-a228-72c5153ebb49 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1313 microversion: 2.1 time: 0.243597 Jul 25 20:48:42.380417 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2943/5838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:42 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:43.404996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:43.405657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:43.413316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:43.413776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:43.414563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:43.415007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:43.550827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:43.559159 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c08e469b-195e-470f-a815-cae3abab5090 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1496 microversion: 2.1 time: 0.158395 Jul 25 20:48:43.559745 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2896/5839] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:43 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1496 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:44.051585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:44.052206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:44.056864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:44.057630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:44.063508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:44.063975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:44.064793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:44.065241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:44.094124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:48:44.110464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:44.184245 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c088035-cc46-4419-8368-237147e063f6 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 204 len: 0 microversion: 2.1 time: 0.136220 Jul 25 20:48:44.185421 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2944/5840] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:48:44 2022] DELETE /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:48:44.195726 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:44.196841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:44.200871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:44.212855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:44.213565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:44.214447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:44.214885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:44.695120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:44.703627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a018197a-f458-4d20-8a1f-9d5e67ca31cb tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1502 microversion: 2.1 time: 0.511914 Jul 25 20:48:44.704261 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2897/5841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:44 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1502 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:45.726533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:45.727254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:45.749091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:45.749620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:45.750914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:45.751536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:46.013081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0706efde6cec4faaa119b8c3ccce1f00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47e805616cc04263a6eeecbf856d75c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:48:46.026426 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-749af61d-e799-487f-9e62-211454a4d0e1 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 200 len: 1502 microversion: 2.1 time: 0.304328 Jul 25 20:48:46.027944 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2945/5842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:45 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:48:46.278019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d76f4486-9f68-4b50-951d-7573eccabe85 req-1cc7ffeb-9c0c-4890-86cb-4933479fd975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7b1861-d016-4fb9-97f6-7cee29fda8e2", "name": "network-vif-deleted", "tag": "8989357f-d17a-426a-8836-77099ce43346"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:46.292343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d76f4486-9f68-4b50-951d-7573eccabe85 req-1cc7ffeb-9c0c-4890-86cb-4933479fd975 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:46.292790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d76f4486-9f68-4b50-951d-7573eccabe85 req-1cc7ffeb-9c0c-4890-86cb-4933479fd975 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:46.308279 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d76f4486-9f68-4b50-951d-7573eccabe85 req-1cc7ffeb-9c0c-4890-86cb-4933479fd975 service nova] Creating event network-vif-deleted:8989357f-d17a-426a-8836-77099ce43346 for instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 on n-h2-845775-3 Jul 25 20:48:46.314082 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d76f4486-9f68-4b50-951d-7573eccabe85 req-1cc7ffeb-9c0c-4890-86cb-4933479fd975 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039749 Jul 25 20:48:46.315538 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2898/5843] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:47.048258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:47.048958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] [instance: 7c7b1861-d016-4fb9-97f6-7cee29fda8e2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:47.057837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:47.058306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:47.059827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:47.060589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:47.080615 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] HTTP exception thrown: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Request method failure captured: Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 HTTP/1.1 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wGQEVT4DrLi_BGuQXfCMzi-nXhp7Io-Hu14lPF6QS8IeYK9rU5yXScSjLSInZ8eIZFZSRScyuywWMdTBPQfZTYyF9Lqo63Wr4eDOqJbdD3uTag73EJsliwQmk8OkPxo-lIctHLx0PeJ9mc6gR05tA57FCcV_FgotQLs2XUvnrp5TzE Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 47e805616cc04263a6eeecbf856d75c0 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-VolumesActionsTest-686363654 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/47e805616cc04263a6eeecbf856d75c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/47e805616cc04263a6eeecbf856d75c0"}]}] Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-VolumesActionsTest-686363654 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 47e805616cc04263a6eeecbf856d75c0 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-VolumesActionsTest-686363654 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-VolumesActionsTest-686363654-project Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 0706efde6cec4faaa119b8c3ccce1f00 Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-VolumesActionsTest-686363654-project Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '7c7b1861-d016-4fb9-97f6-7cee29fda8e2'} Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:47.082573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] Returning 404 to user: Instance 7c7b1861-d016-4fb9-97f6-7cee29fda8e2 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d61ea321-98e7-4330-867b-d841ec7ddfe4 tempest-VolumesActionsTest-686363654 tempest-VolumesActionsTest-686363654-project] 10.222.0.48 "GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2" status: 404 len: 111 microversion: 2.1 time: 0.040914 Jul 25 20:48:47.090858 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2946/5844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:47 2022] GET /compute/v2.1/servers/7c7b1861-d016-4fb9-97f6-7cee29fda8e2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:48:52.142199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d49f4d8-e8ee-415a-b2d8-e8701e65eea0"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:48:52.144654 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:52.147183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=41 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:52.172465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.172928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.173715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.174166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.176855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:52.332422 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments HTTP/1.1 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 74 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: {"volumeAttachment": {"volumeId": "5d49f4d8-e8ee-415a-b2d8-e8701e65eea0"}} Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '85706e3e-340d-4d79-99fe-dea3882db1dd', 'body': {'volumeAttachment': {'volumeId': '5d49f4d8-e8ee-415a-b2d8-e8701e65eea0'}}} Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:48:52.341861 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 400 to user: Invalid volume: volume 5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 is already attached to instances: 85706e3e-340d-4d79-99fe-dea3882db1dd {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-434d5d20-833d-44f4-8850-dc4a0c6715f3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.207073 Jul 25 20:48:52.346133 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2899/5845] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:48:52 2022] POST /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 174 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 20:48:52.426321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:52.426901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:52.430225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:48:52.436779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.437383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.438478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.439006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.569256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lazy-loading 'services' on Instance uuid 85706e3e-340d-4d79-99fe-dea3882db1dd {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:48:52.676502 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-77d7fecc-67e0-4f71-9fbf-b761360fa1bd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments/5d49f4d8-e8ee-415a-b2d8-e8701e65eea0" status: 202 len: 0 microversion: 2.1 time: 0.254507 Jul 25 20:48:52.680616 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2947/5846] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:48:52 2022] DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments/5d49f4d8-e8ee-415a-b2d8-e8701e65eea0 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:48:52.685924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:52.688478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:52.700155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.704620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.706068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:52.707079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:52.775044 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e26e1354-9be5-4dac-8b81-7b78868b9629 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093012 Jul 25 20:48:52.776383 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2900/5847] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:52 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:53.791652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:53.797796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:53.813839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:53.814312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:53.818873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:53.819613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:53.923477 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9a2166c-64cb-4060-8a83-0f233e3ab27a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138408 Jul 25 20:48:53.925376 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2948/5848] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:53 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:54.937227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:54.939839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:54.947826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:54.948504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:54.949553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:54.953976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:55.002336 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a5706b92-68fd-4eb2-ba9f-02dd29752ccc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069871 Jul 25 20:48:55.007965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2901/5849] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:54 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:56.020252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:56.023228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:56.043804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:56.044307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:56.048614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:56.049679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:56.139196 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d92a7141-3b0d-4d63-94b4-876f2945fa92 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127002 Jul 25 20:48:56.144904 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2949/5850] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:56 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:57.153446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:57.156567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:57.170590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:57.172683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:57.173600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:57.174621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:57.248849 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b5d43c7-66f9-47bd-90a7-7e0e6fc1a577 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101247 Jul 25 20:48:57.249921 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2902/5851] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:57 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:48:58.261393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:58.263969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:58.285519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:58.292230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:58.293463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:58.294151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:58.388485 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac655fdf-df79-4c2f-91f1-3bc511cf6fb3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130694 Jul 25 20:48:58.389427 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2950/5852] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:58 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:48:59.401833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:59.410518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:59.421159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.421869 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.423169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.423805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.464336 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7fd8878a-906d-4078-aceb-ef495081c76f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067174 Jul 25 20:48:59.470531 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2903/5853] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:48:59 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:48:59.561897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:59.561897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:59.565844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.566522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.567399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.568386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.602729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:48:59.715342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3efebf01-d5c0-476c-8d1a-ba97eb556569 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 204 len: 0 microversion: 2.1 time: 0.163750 Jul 25 20:48:59.720250 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2951/5854] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:48:59 2022] DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:48:59.725985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:48:59.726891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:48:59.759910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.760665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.761629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:48:59.762233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:48:59.992797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:00.002774 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb47ffbd-b302-45e7-8e56-48a5fbd11f25 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1677 microversion: 2.1 time: 0.281427 Jul 25 20:49:00.003601 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2904/5855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:48:59 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:01.029401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:01.030136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:01.039022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:01.039779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:01.041248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:01.041867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:01.304442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:01.327476 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4fb66c4-5d81-44ce-b4f4-0fb2a9e4190d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1677 microversion: 2.1 time: 0.302567 Jul 25 20:49:01.346665 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2952/5856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:01 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1677 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:02.355749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:02.357122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:02.365993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:02.366479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:02.367274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:02.368028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:02.584438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:02.606041 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2cba23fa-404e-4ede-8b9c-c77a61b22b8f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 200 len: 1612 microversion: 2.1 time: 0.254493 Jul 25 20:49:02.607561 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2905/5857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:02 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 1612 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:02.971257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e1e7ed82-4a97-4961-87b2-65475fc17401 req-23b9978f-43a6-463d-aa5d-afe337c2d62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85706e3e-340d-4d79-99fe-dea3882db1dd", "name": "network-vif-deleted", "tag": "3ee83c16-9d30-44b3-b4bf-e479a51a687a"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:02.993981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e1e7ed82-4a97-4961-87b2-65475fc17401 req-23b9978f-43a6-463d-aa5d-afe337c2d62a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:02.994455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e1e7ed82-4a97-4961-87b2-65475fc17401 req-23b9978f-43a6-463d-aa5d-afe337c2d62a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:03.054735 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e1e7ed82-4a97-4961-87b2-65475fc17401 req-23b9978f-43a6-463d-aa5d-afe337c2d62a service nova] Creating event network-vif-deleted:3ee83c16-9d30-44b3-b4bf-e479a51a687a for instance 85706e3e-340d-4d79-99fe-dea3882db1dd on n-h2-845775-3 Jul 25 20:49:03.065157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e1e7ed82-4a97-4961-87b2-65475fc17401 req-23b9978f-43a6-463d-aa5d-afe337c2d62a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275632 Jul 25 20:49:03.067487 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2953/5858] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:03.628560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:03.629185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:03.640574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:03.647638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:03.648738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:03.652616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:03.679959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd HTTP/1.1 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '85706e3e-340d-4d79-99fe-dea3882db1dd'} Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:49:03.697095 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:49:03.702196 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:49:03.703795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:49:03.704899 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c5ff257f-4819-4d60-9c71-5b60379b1d44 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 404 len: 111 microversion: 2.1 time: 0.080516 Jul 25 20:49:03.705826 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2906/5859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:03 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:49:03.727411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44225d0c-15f9-4845-97d4-38f3c5612332 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '.version_select at 0x7f1968cd9160>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:03.783151 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44225d0c-15f9-4845-97d4-38f3c5612332 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868407578" status: 202 len: 0 microversion: 2.1 time: 0.070771 Jul 25 20:49:03.785883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2954/5860] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868407578 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:49:05.079036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f05b7ab2-219b-4c82-955f-631201e963f7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: .version_select at 0x7f1969adf820>, body: {"keypair": {"name": "tempest-keypair-561709514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfvzyRotU7QqXiwca7F0TQkyQULrhUMBwOHrTdPbn4YyguvFFmxTFGgFLYjll+belg/N5aZZC2IdvLjvA8s4L9gJ/x/gk3cYA7pwW0Ngn6Q3W2iorbLmfb5MqaCUr8y0g=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:05.125768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f05b7ab2-219b-4c82-955f-631201e963f7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:49:05.134512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f05b7ab2-219b-4c82-955f-631201e963f7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:49:05.190876 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f05b7ab2-219b-4c82-955f-631201e963f7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116126 Jul 25 20:49:05.194181 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2907/5861] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:07.503104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1707137298", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98f71a1d-bbf9-4b41-88b5-61ab23da3479"}], "security_groups": [{"name": "tempest-securitygroup--836920437"}], "key_name": "tempest-keypair-561709514", "user_data": "}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:07.709709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] validate_networks() for [('98f71a1d-bbf9-4b41-88b5-61ab23da3479', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:49:08.320894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:49:08.322025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:49:08.322758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:49:08.323553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:49:08.324478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:49:08.338044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:08.338926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:08.340066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:08.340760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:08.375099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:49:08.381914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Getting quotas for user 8bd0ca815541436aa7a86f15b99b224f and project 6365bac28f7942ddbbef8167bcaddd9b. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:49:08.395107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:49:08.397739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:49:08.472472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0e6a03a-4e6f-4faf-bb04-b40087b8142a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.982671 Jul 25 20:49:08.474518 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2955/5862] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:49:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:49:08.487755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5656d449-335d-4685-b775-f913fd572dd1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:08.489090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5656d449-335d-4685-b775-f913fd572dd1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:08.588529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5656d449-335d-4685-b775-f913fd572dd1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:08.596547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5656d449-335d-4685-b775-f913fd572dd1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1241 microversion: 2.1 time: 0.114662 Jul 25 20:49:08.615500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2908/5863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:08 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:09.622243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:09.626073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:09.657618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:09.658559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:09.659621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:09.660329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:09.834509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:09.842604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-650e42d8-2744-4034-b929-f28b9c83493d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1301 microversion: 2.1 time: 0.225194 Jul 25 20:49:09.856445 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2956/5864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:09 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1301 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:10.872013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:10.875078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:10.888742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:10.890192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:10.891891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:10.893067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:11.250807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:11.263184 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05dbc0c0-f451-466a-aa44-16e5281e6485 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.397787 Jul 25 20:49:11.264478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2909/5865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:10 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:11.883151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-24741bc0-909e-4d82-8f79-22f89e7cb1f5 req-e7f71053-532e-4a7f-bfd2-a0c6931215ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05f25c-350e-4e1a-9b47-cd394e0c3968", "tag": "ea7a7888-e9b7-41b4-b01b-71fc59383509"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:11.896680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-24741bc0-909e-4d82-8f79-22f89e7cb1f5 req-e7f71053-532e-4a7f-bfd2-a0c6931215ef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:11.897337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-24741bc0-909e-4d82-8f79-22f89e7cb1f5 req-e7f71053-532e-4a7f-bfd2-a0c6931215ef service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:11.912856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-24741bc0-909e-4d82-8f79-22f89e7cb1f5 req-e7f71053-532e-4a7f-bfd2-a0c6931215ef service nova] Creating event network-changed:ea7a7888-e9b7-41b4-b01b-71fc59383509 for instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 on n-h2-845775-3 Jul 25 20:49:11.918621 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-24741bc0-909e-4d82-8f79-22f89e7cb1f5 req-e7f71053-532e-4a7f-bfd2-a0c6931215ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040866 Jul 25 20:49:11.919495 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2957/5866] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:12.286902 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:12.287773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:12.296589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:12.297401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:12.298569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:12.299232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:12.847343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:12.866627 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bc0b44b-2c47-4695-a276-a964ac61ac3e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.584527 Jul 25 20:49:12.869170 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2910/5867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:12 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:13.894644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:13.895378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:13.903487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:13.904093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:13.904880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:13.905816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:14.147600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:14.152016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:14.169267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-72b7cb88-028c-4afa-b3d9-c30b7ef78a94 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.280119 Jul 25 20:49:14.170077 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2958/5868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:13 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:15.191141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:15.191767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:15.207419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:15.209042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:15.210073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:15.210901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:15.489120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:15.496826 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-317ae170-5b33-41f8-bfb0-b6cb189dbb41 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.309755 Jul 25 20:49:15.497512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2911/5869] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:15 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:16.518499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:16.519163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:16.527333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:16.527812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:16.528668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:16.529130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:16.681747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:16.690126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b196f75f-4333-4dda-9666-f5c2ba240604 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.175779 Jul 25 20:49:16.691031 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2959/5870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:16 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:16.905325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1b8f654b-6956-4a7f-b941-7456349e6c28 req-9bf7bdaf-8e02-4dab-a094-a2990a95b304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f05f25c-350e-4e1a-9b47-cd394e0c3968", "name": "network-vif-plugged", "status": "completed", "tag": "ea7a7888-e9b7-41b4-b01b-71fc59383509"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:16.921528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b8f654b-6956-4a7f-b941-7456349e6c28 req-9bf7bdaf-8e02-4dab-a094-a2990a95b304 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:16.921781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1b8f654b-6956-4a7f-b941-7456349e6c28 req-9bf7bdaf-8e02-4dab-a094-a2990a95b304 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:16.938630 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1b8f654b-6956-4a7f-b941-7456349e6c28 req-9bf7bdaf-8e02-4dab-a094-a2990a95b304 service nova] Creating event network-vif-plugged:ea7a7888-e9b7-41b4-b01b-71fc59383509 for instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 on n-h2-845775-3 Jul 25 20:49:16.944616 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1b8f654b-6956-4a7f-b941-7456349e6c28 req-9bf7bdaf-8e02-4dab-a094-a2990a95b304 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043017 Jul 25 20:49:16.945627 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2912/5871] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:17.666892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f0505760-cde6-45e1-acaa-f34b9b325011 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: .version_select at 0x7f1968cd9ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-124851542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsJ6MrrYG1gQWxn7nFVb7ku4AuUWsPqjc7ZReAKM6lGqXyAo1cg5F9oAdPTOe1zSwXstKk+ZxaiD8zhTiOsLfwwhlCCG/XlDlLQK8D2h3y4iaxqITVpJrTLTBbUYgyzfQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:17.685100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f0505760-cde6-45e1-acaa-f34b9b325011 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:49:17.691157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-f0505760-cde6-45e1-acaa-f34b9b325011 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:49:17.713721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:17.714555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:17.722128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:17.722974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:17.724069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:17.724568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:17.732869 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f0505760-cde6-45e1-acaa-f34b9b325011 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.283281 Jul 25 20:49:17.733701 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2960/5872] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:49:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:17.920669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:17.931694 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e5c470e-a299-488e-9cca-4969cc758bfe tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1366 microversion: 2.1 time: 0.223042 Jul 25 20:49:17.935389 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2913/5873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:17 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:18.954951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:18.955584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:18.957627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:18.965664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:18.966171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:18.967097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:18.967575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:19.120973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:19.130373 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-182a1bc2-d906-4d1f-91e7-9c03b04bf185 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1555 microversion: 2.1 time: 0.179742 Jul 25 20:49:19.144497 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2961/5874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:18 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:19.153151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:19.153694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:19.157240 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:19.162419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:19.163068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:19.164402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:19.164925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:19.258374 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79daaa7a-f056-4c6a-9b8a-9599d4147031 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109159 Jul 25 20:49:19.259013 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2914/5875] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 20:49:19 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:49:20.598011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-2819b71a-6e97-4e37-887f-2a25fa96bca1 req-6c7f5048-4b73-49ab-b576-92dc67422b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05f25c-350e-4e1a-9b47-cd394e0c3968", "tag": "ea7a7888-e9b7-41b4-b01b-71fc59383509"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:20.611182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2819b71a-6e97-4e37-887f-2a25fa96bca1 req-6c7f5048-4b73-49ab-b576-92dc67422b18 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:20.611649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-2819b71a-6e97-4e37-887f-2a25fa96bca1 req-6c7f5048-4b73-49ab-b576-92dc67422b18 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:20.625081 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-2819b71a-6e97-4e37-887f-2a25fa96bca1 req-6c7f5048-4b73-49ab-b576-92dc67422b18 service nova] Creating event network-changed:ea7a7888-e9b7-41b4-b01b-71fc59383509 for instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 on n-h2-845775-3 Jul 25 20:49:20.636181 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-2819b71a-6e97-4e37-887f-2a25fa96bca1 req-6c7f5048-4b73-49ab-b576-92dc67422b18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040697 Jul 25 20:49:20.636757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2962/5876] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:49:25.487812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1043564956", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "31ede362-2fb9-44a5-b4b9-8c533d22f7c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-124851542", "security_groups": [{"name": "tempest-secgroup-smoke-1244359101"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:25.499166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:25.629388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] validate_networks() for [('31ede362-2fb9-44a5-b4b9-8c533d22f7c4', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:49:26.071300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:49:26.072085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:49:26.072650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:49:26.073153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:49:26.073587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:49:26.083330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:26.084134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:26.084959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:26.086029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:26.094526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=74 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:26.110047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:49:26.116815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:49:26.132911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:49:26.135591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:49:26.212941 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dfccfa93-c936-467d-b2e9-4edd04b326e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730362 Jul 25 20:49:26.232664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-51d38625-f033-419a-9207-b88d7f23a03a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:26.232664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-51d38625-f033-419a-9207-b88d7f23a03a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:26.232664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:26.233896 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2915/5877] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:49:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:49:26.337660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-51d38625-f033-419a-9207-b88d7f23a03a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:26.350819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-51d38625-f033-419a-9207-b88d7f23a03a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1266 microversion: 2.1 time: 0.127398 Jul 25 20:49:26.354460 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2963/5878] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:26 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:49:27.393928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:27.394575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:27.403784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:27.404555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:27.406143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:27.406770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:27.515593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:27.526136 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3daf9ca4-8653-48ec-89c5-55232fdece4e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1318 microversion: 2.1 time: 0.152378 Jul 25 20:49:27.526769 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2916/5879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:27 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:28.548709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:28.549400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:28.559074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:28.559872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:28.561031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:28.561653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:28.650679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:28.663472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22678170-624a-41fc-a405-52777368c309 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1324 microversion: 2.1 time: 0.118666 Jul 25 20:49:28.664873 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2964/5880] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:28 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1324 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:29.686862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:29.687699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:29.695092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:29.695552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:29.696995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:29.697440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:29.955346 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:29.964968 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5e2f9b81-9f0f-4e2b-aa8f-51a85cebe6ac tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.282225 Jul 25 20:49:29.965572 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2917/5881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:29 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:30.109294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-81081085-17d5-4fbb-a389-c119ca860ccc req-df29d3e3-75f5-4909-a4c2-5d546c5400f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:30.136376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81081085-17d5-4fbb-a389-c119ca860ccc req-df29d3e3-75f5-4909-a4c2-5d546c5400f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:30.136854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-81081085-17d5-4fbb-a389-c119ca860ccc req-df29d3e3-75f5-4909-a4c2-5d546c5400f2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:30.150396 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-81081085-17d5-4fbb-a389-c119ca860ccc req-df29d3e3-75f5-4909-a4c2-5d546c5400f2 service nova] Creating event network-changed:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h1-845775-3 Jul 25 20:49:30.156300 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-81081085-17d5-4fbb-a389-c119ca860ccc req-df29d3e3-75f5-4909-a4c2-5d546c5400f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051733 Jul 25 20:49:30.157368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2965/5882] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:49:30.988401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:30.990031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:30.998597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:30.999174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.000189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:31.000727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.148258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:31.159070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4d8019e4-0a74-420e-a1fc-3e75bbd23116 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.173980 Jul 25 20:49:31.159689 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2918/5883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:30 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:31.556902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:31.557658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:31.572905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:31.573757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.577589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:31.578217 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.614948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:49:31.717582 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73ed47bb-4c06-45cf-b71a-9c0c8431599f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 204 len: 0 microversion: 2.1 time: 0.163220 Jul 25 20:49:31.721636 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2966/5884] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:49:31 2022] DELETE /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:49:31.730888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:31.732194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:31.742779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:31.743668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.745007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:31.745807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:31.931803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:31.939861 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f71bd2b-fc42-4b2a-b1a1-070ed307fe61 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1580 microversion: 2.1 time: 0.216692 Jul 25 20:49:31.940484 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2919/5885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:31 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1580 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:32.181918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:32.182557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:32.189118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:32.189587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:32.190383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:32.190859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:32.364852 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:32.385380 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed60c691-63e9-4972-b22e-ad75f1f57630 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.207260 Jul 25 20:49:32.386512 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2967/5886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:32 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:32.961489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:32.962220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:32.970539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:32.970951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:32.971743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:32.972228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:33.221303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:33.229735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4fe62a6-aa0f-4dc0-b1e9-56421dcb84bc tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1580 microversion: 2.1 time: 0.272246 Jul 25 20:49:33.230335 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2920/5887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:32 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1580 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:33.415483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:33.416441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:33.423789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:33.424314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:33.425149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:33.425611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:33.726865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:33.735716 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94dfa2c4-14fa-45ff-b20b-627160dca8d3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.325088 Jul 25 20:49:33.741777 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2968/5888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:33 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:34.259275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:34.260362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:34.273846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:34.275080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:34.278464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:34.279550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:34.602421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:34.610810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b617ec5-17d4-410b-b57f-3e0572f81c7d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1580 microversion: 2.1 time: 0.358229 Jul 25 20:49:34.611419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2921/5889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:34 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1580 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:34.770161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:34.772419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:34.784841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:34.785582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:34.788906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:34.789941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:35.043005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:35.063490 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c9a1d81-6070-456f-9c27-079ba14a92de tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.299125 Jul 25 20:49:35.078046 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2969/5890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:34 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:35.123246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bf56e576-2e03-474f-ba1e-fd18e066b68d req-09787e0d-0008-417f-8806-7ef0f3f4ff09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3331881-ac90-46c8-a151-db43ad8130c0", "name": "network-vif-deleted", "tag": "3ba85343-4571-4a5d-8131-5b5a046767c4"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:35.154486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bf56e576-2e03-474f-ba1e-fd18e066b68d req-09787e0d-0008-417f-8806-7ef0f3f4ff09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:35.155455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bf56e576-2e03-474f-ba1e-fd18e066b68d req-09787e0d-0008-417f-8806-7ef0f3f4ff09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:35.175849 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bf56e576-2e03-474f-ba1e-fd18e066b68d req-09787e0d-0008-417f-8806-7ef0f3f4ff09 service nova] Creating event network-vif-deleted:3ba85343-4571-4a5d-8131-5b5a046767c4 for instance d3331881-ac90-46c8-a151-db43ad8130c0 on n-h1-845775-3 Jul 25 20:49:35.182496 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bf56e576-2e03-474f-ba1e-fd18e066b68d req-09787e0d-0008-417f-8806-7ef0f3f4ff09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062724 Jul 25 20:49:35.183131 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2922/5891] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:35.633411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:35.634304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:35.641071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:35.641777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:35.642749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:35.643363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:35.717361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:35.730197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff9485f7-b0ed-4891-be79-50536baeaf11 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1226 microversion: 2.1 time: 0.100766 Jul 25 20:49:35.747672 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2970/5892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:35 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:36.101306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:36.102283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:36.105623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:36.113381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:36.114333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:36.115366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:36.116000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:36.134628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:36.331069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:36.344609 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-819731d6-ddb3-4c23-9246-0bf5a711a259 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.247852 Jul 25 20:49:36.361269 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2923/5893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:36 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:36.366655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5c8731ff-e057-432f-ac19-ecc7617783e6 req-963a9c41-ac34-4c41-bf23-3e2d5edd8479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "name": "network-vif-plugged", "status": "completed", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:36.385022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:36.388302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5c8731ff-e057-432f-ac19-ecc7617783e6 req-963a9c41-ac34-4c41-bf23-3e2d5edd8479 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:36.390589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5c8731ff-e057-432f-ac19-ecc7617783e6 req-963a9c41-ac34-4c41-bf23-3e2d5edd8479 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:36.403965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5c8731ff-e057-432f-ac19-ecc7617783e6 req-963a9c41-ac34-4c41-bf23-3e2d5edd8479 service nova] Creating event network-vif-plugged:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h1-845775-3 Jul 25 20:49:36.410304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5c8731ff-e057-432f-ac19-ecc7617783e6 req-963a9c41-ac34-4c41-bf23-3e2d5edd8479 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047778 Jul 25 20:49:36.411514 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2971/5894] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:36.753833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:36.755014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:36.763964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:36.764461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:36.765272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:36.765713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:36.838422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:36.846888 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fdaf214-3539-4444-86ce-985dcfea93c2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1226 microversion: 2.1 time: 0.097037 Jul 25 20:49:36.847578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2924/5895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:36 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:37.378489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:37.379156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:37.387507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:37.387976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:37.388824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:37.389274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:37.535517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:37.545568 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c645a20-5020-4d6b-bc28-408ff65fd308 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1392 microversion: 2.1 time: 0.171746 Jul 25 20:49:37.546634 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2972/5896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:37 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:37.873386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:37.874437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:37.885557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:37.886428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:37.887570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:37.888319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:37.980717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:37.990474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-131ab73d-7ae3-42e5-ada5-06830187e4ab tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1226 microversion: 2.1 time: 0.125961 Jul 25 20:49:37.991614 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2925/5897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:37 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:38.567828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:38.568859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:38.576175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:38.576643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:38.577442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:38.577893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:38.731881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:38.740757 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-972b580b-e1c1-48f6-a13f-51d7c2e5f7cf tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1564 microversion: 2.1 time: 0.177433 Jul 25 20:49:38.741341 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2973/5898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:38 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:38.762606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:38.763318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:38.770020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:38.770577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:38.771472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:38.771928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:38.923027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:38.931732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d6f575a1-235d-41eb-bc51-edc6cfe28108 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1564 microversion: 2.1 time: 0.173137 Jul 25 20:49:38.932512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2926/5899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:38 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:49:39.014315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:39.015529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:39.022814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:39.023485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:39.024652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:39.025558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:39.191119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:39.199925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdcb8f67-731e-4a44-ae3c-ef7cbb0077bd tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1226 microversion: 2.1 time: 0.189379 Jul 25 20:49:39.214821 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2974/5900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:39 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:40.223457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:40.224962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:40.231790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:40.232366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:40.233222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:40.233733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:40.270332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:40.272150 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:40.272370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lazy-loading 'fault' on Instance uuid d3331881-ac90-46c8-a151-db43ad8130c0 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:49:40.329085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:40.339087 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93ccb732-9b2a-463c-bb94-ac3fbefbe47d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 200 len: 1231 microversion: 2.1 time: 0.120860 Jul 25 20:49:40.341371 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2927/5901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:40 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 1231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:41.362264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:41.363605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:41.372777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:41.373612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:41.374653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:41.375314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:41.387130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:41.387734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:41.400831 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:49:41.403728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:41.404202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 HTTP/1.1 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd3331881-ac90-46c8-a151-db43ad8130c0'} Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:49:41.404323 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:49:41.409573 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:49:41.410063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:41.410150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:49:41.410242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:41.410329 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-804c29df-d19d-4142-b97e-911b7e9166cb tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 404 len: 111 microversion: 2.1 time: 0.048399 Jul 25 20:49:41.420216 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2975/5902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:41 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:49:41.427861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a4824af0-455b-47dd-9efc-ff0f8ed3f34a req-86938add-b8b4-4370-b7c8-8edc69ec2e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:41.443371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a4824af0-455b-47dd-9efc-ff0f8ed3f34a req-86938add-b8b4-4370-b7c8-8edc69ec2e99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:41.444183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a4824af0-455b-47dd-9efc-ff0f8ed3f34a req-86938add-b8b4-4370-b7c8-8edc69ec2e99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:41.464570 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a4824af0-455b-47dd-9efc-ff0f8ed3f34a req-86938add-b8b4-4370-b7c8-8edc69ec2e99 service nova] Creating event network-changed:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h1-845775-3 Jul 25 20:49:41.479795 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a4824af0-455b-47dd-9efc-ff0f8ed3f34a req-86938add-b8b4-4370-b7c8-8edc69ec2e99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057427 Jul 25 20:49:41.488395 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2976/5903] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:41.639317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1862653456", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625105149", "security_groups": [{"name": "tempest-secgroup-smoke-1675704218"}], "block_device_mapping_v2": [{"uuid": "8cfa6d22-0c87-4f7f-94a7-3da38eee2ee8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:41.773777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:41.783317 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf233724-39c2-40b6-a4be-8557be1b0da7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1564 microversion: 2.1 time: 0.402020 Jul 25 20:49:41.784707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2928/5904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:41 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1564 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:41.895896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:49:42.589173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:49:42.589792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:49:42.590145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:49:42.590908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:49:42.591051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:49:42.608894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:42.609618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:42.610782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:42.611412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:42.635286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:49:42.641849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:49:42.709527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:49:42.712005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cfa6d22-0c87-4f7f-94a7-3da38eee2ee8',volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:49:42.859962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ec02e22-4e8a-44be-a6cc-f084ebf1b859 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.226237 Jul 25 20:49:42.866663 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2977/5905] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:49:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:49:42.872333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-683119eb-ac53-4d0c-8c25-cbf52e87f337 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:42.873824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-683119eb-ac53-4d0c-8c25-cbf52e87f337 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:42.976135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-683119eb-ac53-4d0c-8c25-cbf52e87f337 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:42.983959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-683119eb-ac53-4d0c-8c25-cbf52e87f337 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1095 microversion: 2.1 time: 0.115802 Jul 25 20:49:42.984773 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2929/5906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:42 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:44.007832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:44.008778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:44.019184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:44.019514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:44.020915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:44.021366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:44.131014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:44.139808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34acc86f-a921-4679-8e1c-c3e14c63f50d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1193 microversion: 2.1 time: 0.137429 Jul 25 20:49:44.149409 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2978/5907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:44 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:45.165074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:45.166577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:45.188588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:45.189352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:45.190155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:45.190774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:45.434042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:45.442764 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-047db68c-d94a-4fd8-9228-4d142db1e582 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1279 microversion: 2.1 time: 0.283715 Jul 25 20:49:45.447122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2930/5908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:45 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:46.218322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-53eca69d-d903-4875-a97d-d83f379fff4d req-b4b65090-6bb3-43c0-9708-72ddace24111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89564c53-7b72-423f-843e-1dc74bb856a2", "tag": "702ca7ae-66ce-4933-a1ba-d080f69bd2e1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:46.265533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-53eca69d-d903-4875-a97d-d83f379fff4d req-b4b65090-6bb3-43c0-9708-72ddace24111 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:46.276261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-53eca69d-d903-4875-a97d-d83f379fff4d req-b4b65090-6bb3-43c0-9708-72ddace24111 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:46.331228 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-53eca69d-d903-4875-a97d-d83f379fff4d req-b4b65090-6bb3-43c0-9708-72ddace24111 service nova] Creating event network-changed:702ca7ae-66ce-4933-a1ba-d080f69bd2e1 for instance 89564c53-7b72-423f-843e-1dc74bb856a2 on n-h2-845775-3 Jul 25 20:49:46.342864 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-53eca69d-d903-4875-a97d-d83f379fff4d req-b4b65090-6bb3-43c0-9708-72ddace24111 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129915 Jul 25 20:49:46.344374 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2979/5909] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:46.473993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:46.474952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:46.493499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:46.493958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:46.494754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:46.495200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:46.809416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:46.847759 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb395fd6-cd06-4d32-8391-0294e62717e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1279 microversion: 2.1 time: 0.378532 Jul 25 20:49:46.848443 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2931/5910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:46 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1279 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:47.877017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:47.877833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:47.887145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:47.891403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:47.891403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:47.891403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:47.892231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:48.075873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:48.086240 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c2359067-5b47-489c-9faf-6c623e2e942f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1279 microversion: 2.1 time: 0.214809 Jul 25 20:49:48.087908 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2980/5911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:47 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:49.111440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:49.112897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:49.121311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:49.121996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:49.123159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:49.123630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:49.288650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:49.299356 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-857aa305-70eb-4df9-9d9d-31ca143cd07d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1279 microversion: 2.1 time: 0.193089 Jul 25 20:49:49.300549 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2932/5912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:49 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:50.323611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:50.324731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:50.337400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:50.338831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:50.339918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:50.340780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:50.501172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:50.509617 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cfe567ee-35f8-4d2f-8d7b-a9013bead1c9 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1279 microversion: 2.1 time: 0.190950 Jul 25 20:49:50.510200 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2981/5913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:50 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:51.531481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:51.532210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:51.540292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:51.540757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:51.541808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:51.542256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:51.713548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:51.716490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:51.724868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b464ea19-4e71-44e5-b1c8-d0889e0c333d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.197189 Jul 25 20:49:51.725709 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2933/5914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:51 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:49:52.748231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:52.749069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:52.751977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:52.752891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:52.759991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:52.760478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:52.761272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:52.761721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:52.918836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:52.928206 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-356ec1e5-3183-4275-ac6c-005370b82fb1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.184339 Jul 25 20:49:52.929154 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2982/5915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:52 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:53.962549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:53.962549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:53.962549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:53.964663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:53.965153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:53.965931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:53.966372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:54.127834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:54.138364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7585cf21-3509-4dad-887a-cbd272f5425f tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.187435 Jul 25 20:49:54.148103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2934/5916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:53 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:55.162055 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:55.163078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:55.170124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:55.170837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:55.171639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:55.172163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:55.317558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:55.331134 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a20ad713-51e4-4508-a978-b59749149998 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.174985 Jul 25 20:49:55.332646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2983/5917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:55 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:56.361583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:56.362574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:56.367756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:56.377483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:56.377970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:56.379052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:56.379707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:56.571912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:56.581530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f7c5b44-128a-49e1-85ea-005a279eeaec tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.224176 Jul 25 20:49:56.583320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2935/5918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:56 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:57.561504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:57.563004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:57.568925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:49:57.571061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:57.571580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:57.572598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:57.573240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:57.604713 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9475743b-f2fb-4526-b140-68151eb28d4a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/ips" status: 200 len: 148 microversion: 2.1 time: 0.048639 Jul 25 20:49:57.605319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2984/5919] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Jul 25 20:49:57 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:49:57.618270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:57.619681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:57.631537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:57.633664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:57.635088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:57.636371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:57.822230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:57.833340 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e697504-6512-4c2c-a197-b9ae4df5a314 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.220359 Jul 25 20:49:57.834545 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2936/5920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:57 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:49:58.863751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:49:58.865369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:58.882696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:58.883529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:58.884966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:58.886023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:59.095695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84d3b48f-029d-481e-b541-86a854d8f6ff"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:59.099876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:49:59.107430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:59.108186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:59.109365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:59.110058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:59.164515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:49:59.175421 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa282581-e47f-4d60-980e-f1e0a8636ff2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.318706 Jul 25 20:49:59.178856 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2985/5921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:49:58 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:49:59.375168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4ba2b781-709e-4fec-9397-478ba5338a34 req-7483cd28-9387-4f6c-b786-8f13c719fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89564c53-7b72-423f-843e-1dc74bb856a2", "name": "network-vif-plugged", "status": "completed", "tag": "702ca7ae-66ce-4933-a1ba-d080f69bd2e1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:49:59.395048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ba2b781-709e-4fec-9397-478ba5338a34 req-7483cd28-9387-4f6c-b786-8f13c719fe86 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:49:59.395717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ba2b781-709e-4fec-9397-478ba5338a34 req-7483cd28-9387-4f6c-b786-8f13c719fe86 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:49:59.414385 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4ba2b781-709e-4fec-9397-478ba5338a34 req-7483cd28-9387-4f6c-b786-8f13c719fe86 service nova] Creating event network-vif-plugged:702ca7ae-66ce-4933-a1ba-d080f69bd2e1 for instance 89564c53-7b72-423f-843e-1dc74bb856a2 on n-h2-845775-3 Jul 25 20:49:59.421188 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4ba2b781-709e-4fec-9397-478ba5338a34 req-7483cd28-9387-4f6c-b786-8f13c719fe86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052471 Jul 25 20:49:59.423119 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2986/5922] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:49:59.467271 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2b086613-60fb-4552-ae15-20c3c90bb82c tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "POST /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375235 Jul 25 20:49:59.468764 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2937/5923] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 20:49:59 2022] POST /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:50:00.211638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:00.211638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:00.220932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:00.221634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:00.223981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:00.224520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:00.432077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:00.442965 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7a911ac8-1d34-46d5-92c6-799c8e007115 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1267 microversion: 2.1 time: 0.246962 Jul 25 20:50:00.443867 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2987/5924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:00 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:01.484748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:01.486188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:01.493560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:01.493930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:01.494731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:01.495149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:01.740599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:01.750675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b2705e43-6eb5-401c-bd52-965ed704264d tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1454 microversion: 2.1 time: 0.284885 Jul 25 20:50:01.751281 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2938/5925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:01 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:01.778917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:01.781608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:01.790989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:01.791960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:01.793358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:01.794067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:02.003729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:02.020469 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2922175-2546-4dd6-8f2d-ec809b2d6fcf tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1454 microversion: 2.1 time: 0.248175 Jul 25 20:50:02.023021 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2988/5926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:01 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1454 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:50:04.185284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6df7a054-7ad1-46ac-a83a-00a32ed01eb3 req-66d09b07-78aa-4d47-93c4-a1fc3d3f81dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89564c53-7b72-423f-843e-1dc74bb856a2", "tag": "702ca7ae-66ce-4933-a1ba-d080f69bd2e1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:04.212546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6df7a054-7ad1-46ac-a83a-00a32ed01eb3 req-66d09b07-78aa-4d47-93c4-a1fc3d3f81dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:04.214337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6df7a054-7ad1-46ac-a83a-00a32ed01eb3 req-66d09b07-78aa-4d47-93c4-a1fc3d3f81dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:04.240744 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6df7a054-7ad1-46ac-a83a-00a32ed01eb3 req-66d09b07-78aa-4d47-93c4-a1fc3d3f81dd service nova] Creating event network-changed:702ca7ae-66ce-4933-a1ba-d080f69bd2e1 for instance 89564c53-7b72-423f-843e-1dc74bb856a2 on n-h2-845775-3 Jul 25 20:50:04.248582 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6df7a054-7ad1-46ac-a83a-00a32ed01eb3 req-66d09b07-78aa-4d47-93c4-a1fc3d3f81dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067427 Jul 25 20:50:04.250475 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2939/5927] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:05.156867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:05.159868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:05.171553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:05.172690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:05.175197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:05.178545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:05.274268 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4be54b4-f99f-4038-a83b-a009f681c828 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action" status: 200 len: 24573 microversion: 2.1 time: 0.121837 Jul 25 20:50:05.274999 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2989/5928] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:50:05 2022] POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action => generated 24573 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:50:11.701773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:11.702358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:11.708773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:11.709232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:11.710006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:11.710446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:11.801929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lazy-loading 'services' on Instance uuid 7f05f25c-350e-4e1a-9b47-cd394e0c3968 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:50:11.876458 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11997a7d-2e17-4789-a5fe-f407c4b2fae7 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments/84d3b48f-029d-481e-b541-86a854d8f6ff" status: 202 len: 0 microversion: 2.1 time: 0.180383 Jul 25 20:50:11.877235 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2940/5929] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 20:50:11 2022] DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments/84d3b48f-029d-481e-b541-86a854d8f6ff => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:50:11.887709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:11.890102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:11.899609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:11.900114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:11.901353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:11.902116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:11.939366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-918adb3a-bf5a-479e-bf78-ed0003626ab2 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055993 Jul 25 20:50:11.940101 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2990/5930] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:11 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:12.957523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:12.961301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:12.971333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:12.972085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:12.973139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:12.973825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:13.017436 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09809694-7614-4b53-9b88-87217ebca1f0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067388 Jul 25 20:50:13.018042 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2941/5931] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:12 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:14.032641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:14.035030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:14.044908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:14.046028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:14.046422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:14.046887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:14.084847 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d14264a8-ef70-49b6-8543-193b8ce87cd3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056528 Jul 25 20:50:14.088988 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2991/5932] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:14 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:15.100058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:15.102205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:15.111450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:15.111908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:15.112740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:15.113786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:15.146958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26a9461d-d8a7-43ae-8421-f598810ebb0a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051722 Jul 25 20:50:15.147562 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2942/5933] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:15 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:16.161833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:16.164078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:16.171399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.171860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.172825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.173282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.210215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f6cdd7c-8dc4-49e3-93c8-295d092d4787 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048802 Jul 25 20:50:16.210215 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2992/5934] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:16 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:16.415685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:16.417152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:16.424097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.424554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.425381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.425823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.703908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e92b85e2-ba73-4365-a604-a63581f32a32 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1834 microversion: 2.1 time: 0.292263 Jul 25 20:50:16.707713 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2943/5935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:16 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1834 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:16.732065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:16.733075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:16.740345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.741122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.741625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:16.742433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:16.891087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:16.899685 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-caffce0d-beb8-4fec-9b7d-99263c256d92 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1683 microversion: 2.1 time: 0.172951 Jul 25 20:50:16.900315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2993/5936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:16 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:17.002515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:17.005223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.011553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.011993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.013267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.013718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.065635 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0511009-93bd-45eb-97f7-a800c6f4e4a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action" status: 200 len: 32644 microversion: 2.1 time: 0.066880 Jul 25 20:50:17.066607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2944/5937] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:50:16 2022] POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:50:17.218966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:17.221445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.229157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.229391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:17.229624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.230472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.230609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.231061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.238996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.239650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.240866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.241474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.264783 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d6df974-ed97-43be-a52d-6e60c86cd26f tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049997 Jul 25 20:50:17.265622 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2994/5938] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 20:50:17 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 20:50:17.294381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bf7cea98c369474d8d511bcb582cb1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dbe5ffd7214dd086fc67c24db3385a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:17.295268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] flavor_id is None. Assuming migration. {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 20:50:17.295722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:50:17.335242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:17.335963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.343700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.344830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.345049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.345519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.375293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:50:17.465475 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f08b28a-869a-4fd7-b857-9ab83eae0d5e tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 204 len: 0 microversion: 2.1 time: 0.134209 Jul 25 20:50:17.466903 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2995/5939] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:50:17 2022] DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:50:17.476096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:17.476936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.483452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.485319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-20a621a3-8fc0-4e9d-ba6c-333eb90fa6dc tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action" status: 202 len: 0 microversion: 2.1 time: 0.262045 Jul 25 20:50:17.486506 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2945/5940] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:50:17 2022] POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:50:17.492398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.493646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.495399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.496708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:17.499366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:17.507517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.508317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.509531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:17.510309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:17.538638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:50:17.760533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:17.763891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:17.772532 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0349cc84-05d6-432c-bfca-1df430ed1ed6 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1679 microversion: 2.1 time: 0.300169 Jul 25 20:50:17.774269 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2996/5941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:17 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:50:17.781142 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a2ba6370-5083-416e-8753-6e04d83d2175 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1692 microversion: 2.1 time: 0.289486 Jul 25 20:50:17.783800 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2946/5942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:17 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:50:18.796374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:18.796945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:18.804476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:18.805201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:18.806922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:18.807390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:18.808618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:18.808911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:18.816345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:18.816813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:18.817613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:18.818064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:19.064814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:19.076587 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e7f6d9ad-d384-46cc-b820-7ad3e0a6cbbd tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1679 microversion: 2.1 time: 0.284337 Jul 25 20:50:19.077527 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2997/5943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:18 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:19.094700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:19.098406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:50:19.114060 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4927ac92-12bb-4f90-8d1b-5b47637d7bab tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1692 microversion: 2.1 time: 0.313640 Jul 25 20:50:19.115025 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2947/5944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:18 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1692 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:20.114083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:20.115591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:20.134612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:20.136339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:20.138159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:20.144923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:20.154388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:20.156376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:20.174878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:20.176678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:20.177920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:20.178714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:20.623745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bd0ca815541436aa7a86f15b99b224f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6365bac28f7942ddbbef8167bcaddd9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:20.636453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c29f4d61-bf74-4e31-805a-55d6817cc48a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 200 len: 1679 microversion: 2.1 time: 0.532829 Jul 25 20:50:20.637914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2998/5945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:20 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 1679 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:20.677652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:20.691969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-065347d7-230d-4aa7-8e4d-dee5247ac406 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1692 microversion: 2.1 time: 0.545446 Jul 25 20:50:20.693578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2948/5946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:20 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1692 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:21.024813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1b068721-e958-43c3-b473-40a14c5b2c90 req-d39e405d-2b78-4280-a7f0-5489ba5a23b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f05f25c-350e-4e1a-9b47-cd394e0c3968", "name": "network-vif-deleted", "tag": "ea7a7888-e9b7-41b4-b01b-71fc59383509"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:21.051431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1b068721-e958-43c3-b473-40a14c5b2c90 req-d39e405d-2b78-4280-a7f0-5489ba5a23b6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:21.053357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1b068721-e958-43c3-b473-40a14c5b2c90 req-d39e405d-2b78-4280-a7f0-5489ba5a23b6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:21.072198 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1b068721-e958-43c3-b473-40a14c5b2c90 req-d39e405d-2b78-4280-a7f0-5489ba5a23b6 service nova] Creating event network-vif-deleted:ea7a7888-e9b7-41b4-b01b-71fc59383509 for instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 on n-h2-845775-3 Jul 25 20:50:21.078356 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1b068721-e958-43c3-b473-40a14c5b2c90 req-d39e405d-2b78-4280-a7f0-5489ba5a23b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060311 Jul 25 20:50:21.079748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 2999/5947] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:21.664763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:21.666097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:21.676123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:21.676807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:21.677936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:21.678522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:21.710772 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 HTTP/1.1 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7f05f25c-350e-4e1a-9b47-cd394e0c3968'} Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:21.712928 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:21.718097 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:21.718652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:21.720395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:21.734632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:21.734632 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-badedd8d-95bf-4a4c-a140-8f5c10042f33 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 404 len: 111 microversion: 2.1 time: 0.073060 Jul 25 20:50:21.734632 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2949/5948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:21 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:21.740968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76b2f2bd-f48c-4810-8986-7a38a714863a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '.version_select at 0x7f1969b7e5e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:21.745160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:21.745780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:21.746776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:21.747361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:21.767446 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76b2f2bd-f48c-4810-8986-7a38a714863a tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561709514" status: 202 len: 0 microversion: 2.1 time: 0.031234 Jul 25 20:50:21.771545 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2950/5949] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 20:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561709514 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:50:21.900482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:21.912309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20f5e8d8-daca-4025-b846-2bafd6fc657c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.200482 Jul 25 20:50:21.913093 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3000/5950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:21 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:50:22.936336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:22.937215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:22.945599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:22.946222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:22.947127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:22.947725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:23.522107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:23.532111 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6183a41-5028-41c4-af92-7e68a643e98c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.601046 Jul 25 20:50:23.533188 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2951/5951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:22 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:24.556714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:24.557560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:24.565280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:24.566597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:24.567849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:24.568591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:24.763967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:24.776884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-017ea67b-d915-4ec0-861a-b63669eff220 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.224478 Jul 25 20:50:24.777492 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3001/5952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:24 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:25.782488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:25.783158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:25.793800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.794821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.801518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.802136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.804751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:25.806531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:25.818156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.819225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.820787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.821332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.821941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 HTTP/1.1 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7f05f25c-350e-4e1a-9b47-cd394e0c3968'} Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:25.823366 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.829784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:25.832576 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25b7f291-e2fe-43a6-aa4c-8cda6fe90ee0 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 404 len: 111 microversion: 2.1 time: 0.047486 Jul 25 20:50:25.833768 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2952/5953] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:50:25 2022] DELETE /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:50:25.841989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:25.843120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 7f05f25c-350e-4e1a-9b47-cd394e0c3968] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:25.851324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.852506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.853558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:25.854259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:25.876170 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 HTTP/1.1 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '7f05f25c-350e-4e1a-9b47-cd394e0c3968'} Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:25.878344 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. Jul 25 20:50:25.883285 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:25.886186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 7f05f25c-350e-4e1a-9b47-cd394e0c3968 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:25.888178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-646b2302-3d0e-4e7d-97ef-d2e3c7570fcc tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968" status: 404 len: 111 microversion: 2.1 time: 0.049965 Jul 25 20:50:25.889292 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2953/5954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:25 2022] GET /compute/v2.1/servers/7f05f25c-350e-4e1a-9b47-cd394e0c3968 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:50:26.027210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:26.037462 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3e01a93-f8cf-4f52-8523-fc754bc38ca2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.239422 Jul 25 20:50:26.038455 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3002/5955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:25 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:27.062779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:27.064524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:27.074501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:50:27.076863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:27.077677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:27.078579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:27.079026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:27.260101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:27.271434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cabeedbb-b868-4f2c-bc68-768bdf15cd41 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.214610 Jul 25 20:50:27.272288 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2954/5956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:27 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:28.295305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:28.296077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:28.299359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:50:28.306131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:28.306605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:28.307423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:28.307967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:28.506332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:28.514988 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57a2a8a8-9c8c-4265-b782-de5698a4e303 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.224068 Jul 25 20:50:28.515684 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3003/5957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:28 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:29.264629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:29.265261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:29.277430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.277892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.278702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.279249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.300780 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd HTTP/1.1 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '85706e3e-340d-4d79-99fe-dea3882db1dd'} Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:29.302775 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c35e1e21-ce37-47be-999b-84cf46b7678d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 404 len: 111 microversion: 2.1 time: 0.045227 Jul 25 20:50:29.311756 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2955/5958] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:50:29 2022] DELETE /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:29.315385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:29.316636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 85706e3e-340d-4d79-99fe-dea3882db1dd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:29.324974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.325454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.326263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.326724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.354498 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd HTTP/1.1 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '85706e3e-340d-4d79-99fe-dea3882db1dd'} Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.356638 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 85706e3e-340d-4d79-99fe-dea3882db1dd could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:29.361444 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57f7e0b7-4d27-4ee5-a8ac-fbc1258f795d tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd" status: 404 len: 111 microversion: 2.1 time: 0.046711 Jul 25 20:50:29.362119 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3004/5959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:29 2022] GET /compute/v2.1/servers/85706e3e-340d-4d79-99fe-dea3882db1dd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:29.367438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:29.369017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:29.376886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.377764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.379133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.379747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.397616 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 HTTP/1.1 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'e3ea8995-6c34-4cf0-843c-9f3bee5f5b35'} Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:29.399412 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d9c4af8-1c67-4911-8bcd-cc33e4d15cf4 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 404 len: 111 microversion: 2.1 time: 0.037504 Jul 25 20:50:29.407569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2956/5960] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:50:29 2022] DELETE /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:29.413515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:29.414294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: e3ea8995-6c34-4cf0-843c-9f3bee5f5b35] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:29.422936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.423704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.424641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.425184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.444205 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 HTTP/1.1 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'e3ea8995-6c34-4cf0-843c-9f3bee5f5b35'} Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:29.446144 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:29.450197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f878e6a-4911-40f5-8099-a040cfe633ba tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35" status: 404 len: 111 microversion: 2.1 time: 0.040715 Jul 25 20:50:29.451937 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3005/5961] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:29 2022] GET /compute/v2.1/servers/e3ea8995-6c34-4cf0-843c-9f3bee5f5b35 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:29.545963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:29.547989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:29.564394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.566236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.569856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:29.570952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:29.775280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:29.785074 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81ea5fdd-6de9-4035-9ead-ef746670814f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.250358 Jul 25 20:50:29.785882 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2957/5962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:29 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:50:30.807734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:30.808326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:30.816207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:30.817157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:30.817993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:30.818473 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:30.981238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:30.989402 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4efe5bc-8103-4f79-a089-4ff5d9d133c6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.186167 Jul 25 20:50:30.990356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3006/5963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:30 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:32.010921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:32.012614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:32.020892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.021349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.022451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.022694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.189191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:32.197614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-30bc55e5-5311-4c35-b240-2b1cf27ec62e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.190749 Jul 25 20:50:32.198215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2958/5964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:32 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:32.749144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:32.750243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:32.758559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.759359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.763184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.764011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.779848 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd HTTP/1.1 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '01c21314-1e1c-4422-995d-74129498debd'} Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:32.781501 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:32.787045 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7f1211d6-a9b0-4795-8e8a-083f30af4af3 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 404 len: 111 microversion: 2.1 time: 0.038120 Jul 25 20:50:32.787895 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3007/5965] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:50:32 2022] DELETE /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:50:32.792943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:32.793574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] [instance: 01c21314-1e1c-4422-995d-74129498debd] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:32.802208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.803285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.805223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:32.805223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:32.820676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] HTTP exception thrown: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Request method failure captured: Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd HTTP/1.1 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wDO6_rtQlkQmo-bjaMZU4fWsq0-YRkAR0WXT289ZunydrFhozWQPBV2uo3_EmcW2vlP_zEajMytw1kTmI5t8i-VPF1q0DKxjCx38LxHgNRZ8Rfgw_eY-xhxG5wsLtvaBIeESM-OqXb_dfYfbcyxbO6feUr_DFDJEwPr2OkVOpoxexs Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6365bac28f7942ddbbef8167bcaddd9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6365bac28f7942ddbbef8167bcaddd9b"}]}] Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 6365bac28f7942ddbbef8167bcaddd9b Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1284657728 Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 8bd0ca815541436aa7a86f15b99b224f Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-AttachVolumeNegativeTest-1284657728-project Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '01c21314-1e1c-4422-995d-74129498debd'} Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:50:32.822774 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] Returning 404 to user: Instance 01c21314-1e1c-4422-995d-74129498debd could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:50:32.829059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2d388df0-8aa7-4134-bf52-a31ce003eeb1 tempest-AttachVolumeNegativeTest-1284657728 tempest-AttachVolumeNegativeTest-1284657728-project] 10.222.0.48 "GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd" status: 404 len: 111 microversion: 2.1 time: 0.036220 Jul 25 20:50:32.831658 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2959/5966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:32 2022] GET /compute/v2.1/servers/01c21314-1e1c-4422-995d-74129498debd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:50:33.221553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:33.222954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:33.230085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:33.230771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:33.231739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:33.232249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:33.429954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:33.440614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1f429810-b301-45f1-896c-249acbcdb05a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.224828 Jul 25 20:50:33.441212 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3008/5967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:33 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:34.462271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:34.462866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:34.469988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:34.470463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:34.471285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:34.471805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:34.799800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:34.808161 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-37a22dca-df1e-4ab8-8c86-6fefb254b440 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.349426 Jul 25 20:50:34.812502 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2960/5968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:34 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:35.833393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:35.834831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:35.844139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:35.844915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:35.845757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:35.846219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:35.997743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:36.006584 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4664405d-1626-4eaa-86d0-c0798c7a2282 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.178015 Jul 25 20:50:36.011968 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3009/5969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:35 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:37.027862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:37.028468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:37.036994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:37.037456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:37.038251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:37.038698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:37.190281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:37.199912 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d7bfaed2-67df-48f5-a4d2-c4dc71f6d32e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.176032 Jul 25 20:50:37.200618 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2961/5970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:37 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:38.222739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:38.223374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:38.230885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:38.231376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:38.232216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:38.232675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:38.397580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:38.405792 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-98e64674-dc53-4f56-b1b3-bac9038d63c4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1697 microversion: 2.1 time: 0.187156 Jul 25 20:50:38.406384 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3010/5971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:38 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:39.245497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "name": "network-vif-unplugged", "status": "completed", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:39.259256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:39.260117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:39.277831 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] Creating event network-vif-unplugged:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h2-845775-3 Jul 25 20:50:39.285306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] Instance c38e4dab-f7a6-4c52-a818-0feba337b166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:50:39.308584 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ed6c182b-0785-471d-91be-a0de3235882b req-5dd9ce2d-3014-4416-9f9c-baf4959b840d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069305 Jul 25 20:50:39.309625 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2962/5972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:50:39.430089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:39.430896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:39.439110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:39.440249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:39.441354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:39.442034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:39.798381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:39.811673 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d08d104e-897e-4321-8443-4634f4a4f914 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1696 microversion: 2.1 time: 0.383745 Jul 25 20:50:39.812310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3011/5973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:39 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1696 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:40.838811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:40.839532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:40.849264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:40.849724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:40.850522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:40.851049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:41.005632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:41.014754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-835805a4-02c5-49c9-a3dc-2ca459d47857 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1694 microversion: 2.1 time: 0.181669 Jul 25 20:50:41.015352 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2963/5974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:40 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:41.347504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:41.364330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:41.364330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:41.380712 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] Creating event network-changed:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h2-845775-3 Jul 25 20:50:41.387326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] Instance c38e4dab-f7a6-4c52-a818-0feba337b166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:50:41.399385 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0965ad73-efef-49d4-8587-e8f46008b3dc req-f4f63f91-dfb6-497c-be19-e0c0b9153cc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057427 Jul 25 20:50:41.400680 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3012/5975] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:42.037789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:42.038691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:42.046289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:42.046959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:42.047955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:42.048781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:42.386281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:42.421501 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e2653c3-159d-430d-9655-650ccf2d452a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1694 microversion: 2.1 time: 0.388073 Jul 25 20:50:42.423699 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2964/5976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:42 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1694 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:43.448888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:43.450554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:43.459019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.459491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:43.460325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.460789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:43.693175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:43.709987 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b69d9dc-d631-46e0-aec7-a5236db5c249 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1691 microversion: 2.1 time: 0.267010 Jul 25 20:50:43.711213 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3013/5977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:43 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:43.733266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:43.733815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:43.741765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.742252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:43.743719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.744384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:43.824077 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54243731-95e9-4051-a90b-0f518611a729 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action" status: 204 len: 0 microversion: 2.1 time: 0.094585 Jul 25 20:50:43.829123 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2965/5978] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:50:43 2022] POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:50:43.834211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:43.835156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:43.844367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.845226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:43.846716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:43.848294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:44.536242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:44.555595 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1997a54a-7b1c-421b-bec6-d77cde2e0b04 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1691 microversion: 2.1 time: 0.725335 Jul 25 20:50:44.574298 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3014/5979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:43 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1691 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:45.445697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "name": "network-vif-plugged", "status": "completed", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:50:45.466382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:45.466868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:45.499299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] Creating event network-vif-plugged:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h2-845775-3 Jul 25 20:50:45.509817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] Instance c38e4dab-f7a6-4c52-a818-0feba337b166 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:50:45.548543 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-68917875-1583-4a2c-89ef-4eedd2c06255 req-669e1874-bf35-4016-b1fc-e1d86b3aa04a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107986 Jul 25 20:50:45.550103 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2966/5980] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:50:45.589098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:45.590458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:45.607919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:45.608598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:45.609732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:45.612664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:45.901153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:45.914276 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6f07e88-0c82-442f-bc7f-aa3458e4af86 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1691 microversion: 2.1 time: 0.330803 Jul 25 20:50:45.930128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3015/5981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:45 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1691 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:50:46.939843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:50:46.941124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:50:46.947955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:46.948428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:46.949283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:50:46.949666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:50:47.121224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:50:47.130474 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05e2d4a1-9d4c-4d1d-95c2-2a2f8cf5326e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1683 microversion: 2.1 time: 0.195609 Jul 25 20:50:47.131436 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2967/5982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:50:46 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:11.405085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:11.407997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:11.410465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=25 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:11.411314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:11.418021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:11.418888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:11.420117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:11.420745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:11.484334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3743e6b5-69fe-4e5c-93a5-60fdf7f1ce36 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action" status: 200 len: 24576 microversion: 2.1 time: 0.084468 Jul 25 20:51:11.485867 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3016/5983] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:51:11 2022] POST /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166/action => generated 24576 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:51:17.943111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:17.944383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:17.950926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:17.951681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:17.953649 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:17.954351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:17.955475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:17.956251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:18.155759 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bb060c54-b99d-431c-8f14-fdaecad074da tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1834 microversion: 2.1 time: 0.216846 Jul 25 20:51:18.157188 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2968/5984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:17 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1834 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:19.394739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:19.395355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:19.412802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:19.413197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:19.414002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:19.414456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:19.417633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-30a58188-41ca-40d9-880a-45c4a4a8c856 req-604568bc-f18b-4f61-9501-5790570d0c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:19.434568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-30a58188-41ca-40d9-880a-45c4a4a8c856 req-604568bc-f18b-4f61-9501-5790570d0c5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:19.435026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-30a58188-41ca-40d9-880a-45c4a4a8c856 req-604568bc-f18b-4f61-9501-5790570d0c5e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:19.464729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-30a58188-41ca-40d9-880a-45c4a4a8c856 req-604568bc-f18b-4f61-9501-5790570d0c5e service nova] Creating event network-changed:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h2-845775-3 Jul 25 20:51:19.474084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:51:19.486039 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-30a58188-41ca-40d9-880a-45c4a4a8c856 req-604568bc-f18b-4f61-9501-5790570d0c5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073404 Jul 25 20:51:19.487164 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2969/5985] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:51:19.608966 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-883b7071-8e55-4d4f-bb08-754476098ba6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 204 len: 0 microversion: 2.1 time: 0.218330 Jul 25 20:51:19.609838 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3017/5986] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:51:19 2022] DELETE /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:51:19.619078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:19.619802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:19.640158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:19.640951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:19.641945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:19.643166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:19.941190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:19.952257 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51bb8a80-b291-4cab-862a-967d86db7f0d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1689 microversion: 2.1 time: 0.337432 Jul 25 20:51:19.953147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2970/5987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:19 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1689 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:20.975990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:20.976639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:20.984858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:20.985331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:20.986728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:20.987196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:21.332867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:21.344862 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc4cfa33-3001-4a0e-8362-61d98c4f553f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1689 microversion: 2.1 time: 0.373341 Jul 25 20:51:21.348921 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3018/5988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:20 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1689 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:21.872188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2d2ed460-839a-46d6-a18e-abce23784165 req-ba0134c2-d732-423f-855c-1f292245bea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c38e4dab-f7a6-4c52-a818-0feba337b166", "name": "network-vif-deleted", "tag": "f58b8c63-c142-4af9-8a11-765f671cc834"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:21.886383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2d2ed460-839a-46d6-a18e-abce23784165 req-ba0134c2-d732-423f-855c-1f292245bea6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:21.887275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2d2ed460-839a-46d6-a18e-abce23784165 req-ba0134c2-d732-423f-855c-1f292245bea6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:21.907074 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2d2ed460-839a-46d6-a18e-abce23784165 req-ba0134c2-d732-423f-855c-1f292245bea6 service nova] Creating event network-vif-deleted:f58b8c63-c142-4af9-8a11-765f671cc834 for instance c38e4dab-f7a6-4c52-a818-0feba337b166 on n-h2-845775-3 Jul 25 20:51:21.913300 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2d2ed460-839a-46d6-a18e-abce23784165 req-ba0134c2-d732-423f-855c-1f292245bea6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045878 Jul 25 20:51:21.914223 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2971/5989] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:51:22.374547 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:22.376240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:22.385671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:22.386383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:22.387365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:22.387975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:22.435950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:22.436703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:22.437377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lazy-loading 'fault' on Instance uuid c38e4dab-f7a6-4c52-a818-0feba337b166 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:51:22.488851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:22.500123 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4a20358-38ae-4ffe-97d9-639d985c9e63 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 200 len: 1507 microversion: 2.1 time: 0.132767 Jul 25 20:51:22.500929 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3019/5990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:22 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 1507 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:23.523683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:23.525041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c38e4dab-f7a6-4c52-a818-0feba337b166] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:23.531690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:23.532407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:23.533739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:23.534185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:23.549999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] HTTP exception thrown: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Request method failure captured: Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 HTTP/1.1 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wHMnTeCtAorbDdpthDlJLe79CcDnbALEtNw5HYwAY-U1Mh6Qtkv7x5MfJQ3MNwbBU3TKW92L_pUTYgOdjELGNvnJvjFCjEbcYjHiS8Li2EhE4qplY_A4trHCTAPsJNWRtA5fJNaUzZMGKZEkGQWTgSCJGNu-YcAjSnBWJbFlPRlgzk Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}] Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a299cd4f7ca94602bbff10845fd5ec11 Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c38e4dab-f7a6-4c52-a818-0feba337b166'} Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:51:23.551355 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. Jul 25 20:51:23.556402 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:51:23.557715 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Returning 404 to user: Instance c38e4dab-f7a6-4c52-a818-0feba337b166 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:51:23.558583 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a709bab9-efe1-4510-8719-1b39196d0ad4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166" status: 404 len: 111 microversion: 2.1 time: 0.039968 Jul 25 20:51:23.559156 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2972/5991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:23 2022] GET /compute/v2.1/servers/c38e4dab-f7a6-4c52-a818-0feba337b166 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:51:28.126338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4dda9240-1d0b-4f82-b2b3-0e7bf5397795 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '.version_select at 0x7f1968cc7d30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:28.158485 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4dda9240-1d0b-4f82-b2b3-0e7bf5397795 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-124851542" status: 202 len: 0 microversion: 2.1 time: 0.035988 Jul 25 20:51:28.159198 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3020/5992] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Jul 25 20:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-124851542 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:51:28.197534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc1cbbf1-c15c-4d5c-adbc-7eb3e77a14e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: .version_select at 0x7f19694ea9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-343527439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm/qe3AF03y2uO26AQLghwSMD5gZ2bQT4Ib4+t278pV7Yl/8KLH+aiAK5/XyTdngeisZUi7r8xipRfwPHraPZs51sKvBBjGzPki+BNE4C2tWtry7w2CSlYuCjxq75opSA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:28.220675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-cc1cbbf1-c15c-4d5c-adbc-7eb3e77a14e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:51:28.229323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-cc1cbbf1-c15c-4d5c-adbc-7eb3e77a14e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:51:28.274927 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc1cbbf1-c15c-4d5c-adbc-7eb3e77a14e2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.085015 Jul 25 20:51:28.280438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2973/5993] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:51:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:51:36.740303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-444450466", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f31cef65-9700-468c-8717-9d122034a6e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-343527439", "security_groups": [{"name": "tempest-secgroup-smoke-1927090740"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:36.753143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:36.878140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] validate_networks() for [('f31cef65-9700-468c-8717-9d122034a6e5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:51:37.402302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:51:37.402953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:51:37.404005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:51:37.404469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:51:37.404908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:51:37.420632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:37.421563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:37.423060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:37.424581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:37.450107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:51:37.459243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:51:37.477998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:51:37.481280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:51:37.547893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bfe56458-8157-4347-830a-52e78581a021 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810796 Jul 25 20:51:37.549743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3021/5994] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:51:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:51:37.558407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=18 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:37.563333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4aef9399-7b11-44f2-91d3-ab5bf753aa08 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:37.564230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4aef9399-7b11-44f2-91d3-ab5bf753aa08 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:37.660600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4aef9399-7b11-44f2-91d3-ab5bf753aa08 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:37.676958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4aef9399-7b11-44f2-91d3-ab5bf753aa08 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1265 microversion: 2.1 time: 0.120234 Jul 25 20:51:37.678132 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2974/5995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:37 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:38.701224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:38.702704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:38.725111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:38.725997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:38.727759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:38.729498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:38.815439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:38.831370 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6937024c-d15c-4154-b5e2-075ad4716d56 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1261 microversion: 2.1 time: 0.134985 Jul 25 20:51:38.831978 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3022/5996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:38 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:39.857615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:39.858762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:39.871175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:39.874199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:39.875041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:39.875482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:40.016409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:40.029555 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08a717d2-044d-40fa-82db-7f7141aff394 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1323 microversion: 2.1 time: 0.177157 Jul 25 20:51:40.045597 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2975/5997] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:39 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:41.056822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:41.059235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:41.077886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:41.078497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:41.083109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:41.085389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:41.357684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:41.368102 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2334e022-d871-4932-823b-b8951c338bdc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.317043 Jul 25 20:51:41.369206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3023/5998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:41 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:41.895584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1839f6c6-bfa6-4121-8453-fc38ae0b703c req-2b801db4-2607-4f30-a67c-9c9abeedea2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:41.933433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1839f6c6-bfa6-4121-8453-fc38ae0b703c req-2b801db4-2607-4f30-a67c-9c9abeedea2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:41.936399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1839f6c6-bfa6-4121-8453-fc38ae0b703c req-2b801db4-2607-4f30-a67c-9c9abeedea2e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:41.953830 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1839f6c6-bfa6-4121-8453-fc38ae0b703c req-2b801db4-2607-4f30-a67c-9c9abeedea2e service nova] Creating event network-changed:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:51:41.974359 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1839f6c6-bfa6-4121-8453-fc38ae0b703c req-2b801db4-2607-4f30-a67c-9c9abeedea2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087028 Jul 25 20:51:41.984265 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2976/5999] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:51:42.390717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:42.391680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:42.394909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:42.402451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:42.403381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:42.404709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:42.405731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:42.800544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:42.808884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d22606b0-2a47-4080-9199-38a46693eefb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.422830 Jul 25 20:51:42.823531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3024/6000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:42 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:43.831616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:43.833169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:43.856188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:43.856754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:43.863894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:43.877023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:44.165625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:44.194132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ea1df1dc-d187-4896-af47-e9e98bbc934a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.367574 Jul 25 20:51:44.211402 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2977/6001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:43 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:45.221569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:45.222825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:45.233114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:45.233866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:45.234911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:45.235559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:45.489634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:45.499923 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16272fb4-c14f-42a9-882a-41177ba71d5d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.284164 Jul 25 20:51:45.501402 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3025/6002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:45 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:46.523735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:46.524470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:46.534925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:46.535396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:46.538958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:46.539428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:46.891049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:46.901408 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-caa89290-efef-49b1-a714-263b302882b8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.381238 Jul 25 20:51:46.907182 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2978/6003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:46 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:47.931422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:47.933789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:47.945273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:47.948172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:47.950432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:47.951424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:47.952854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:47.953595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:48.278320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:48.292729 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-907ac5f3-e7fe-427a-8967-3b3f9075065a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.365400 Jul 25 20:51:48.296053 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3026/6004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:47 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:49.319955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:49.320783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:49.324768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:49.324768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:51:49.354426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:49.357602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:49.358686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:49.360168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:49.498562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f95726b2-8393-4456-b163-c70780d6371f req-63f45ec0-70c6-4d88-8ae0-7e2ef24dd5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:49.516431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f95726b2-8393-4456-b163-c70780d6371f req-63f45ec0-70c6-4d88-8ae0-7e2ef24dd5c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:49.516951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f95726b2-8393-4456-b163-c70780d6371f req-63f45ec0-70c6-4d88-8ae0-7e2ef24dd5c8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:49.559848 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f95726b2-8393-4456-b163-c70780d6371f req-63f45ec0-70c6-4d88-8ae0-7e2ef24dd5c8 service nova] Creating event network-vif-plugged:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:51:49.565589 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f95726b2-8393-4456-b163-c70780d6371f req-63f45ec0-70c6-4d88-8ae0-7e2ef24dd5c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072843 Jul 25 20:51:49.566368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3027/6005] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:51:49.614799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:49.628593 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98ea0191-6c5e-4fd3-94ee-1c03f65b223d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.312693 Jul 25 20:51:49.633824 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2979/6006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:49 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:50.657145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:50.658672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:50.673918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:50.674392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:50.675361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:50.679753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:50.903919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:50.913955 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c63c9bde-ea5d-4e91-a6df-c508b645a273 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1391 microversion: 2.1 time: 0.262859 Jul 25 20:51:50.915227 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3028/6007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:50 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1391 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:51:51.939847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:51.940537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:51.970805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:51.971265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:51.972129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:51.972571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:52.344663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:52.366872 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a6c4d02f-2164-4b07-9821-e77537b70d70 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1562 microversion: 2.1 time: 0.431782 Jul 25 20:51:52.380127 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2980/6008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:51 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1562 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:51:52.398246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:52.399020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:52.424325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:52.424900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:52.426001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:52.426710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:52.746945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:52.762264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6e5c9bd6-952a-462e-82c4-5817de69046b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1562 microversion: 2.1 time: 0.370198 Jul 25 20:51:52.819267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3029/6009] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:52 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1562 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:51:56.850299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:51:56.851754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:51:56.852305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-64cc309a-286d-4477-8587-26d5e7036565 req-58ba16a7-4027-44c4-8797-cbb2ca476b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:51:56.866379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:56.867130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:56.868814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:56.870391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:56.870913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64cc309a-286d-4477-8587-26d5e7036565 req-58ba16a7-4027-44c4-8797-cbb2ca476b45 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:51:56.871403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64cc309a-286d-4477-8587-26d5e7036565 req-58ba16a7-4027-44c4-8797-cbb2ca476b45 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:51:56.901435 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-64cc309a-286d-4477-8587-26d5e7036565 req-58ba16a7-4027-44c4-8797-cbb2ca476b45 service nova] Creating event network-changed:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:51:56.908478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-64cc309a-286d-4477-8587-26d5e7036565 req-58ba16a7-4027-44c4-8797-cbb2ca476b45 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059406 Jul 25 20:51:56.910041 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3030/6010] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:51:57.368684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:51:57.377453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7dbbc1bf-d831-4c5e-a43c-048064bdcc78 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1562 microversion: 2.1 time: 0.532645 Jul 25 20:51:57.378055 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2981/6011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:51:56 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1562 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:00.169328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-173001064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625105149", "security_groups": [{"name": "tempest-secgroup-smoke-1675704218"}], "block_device_mapping_v2": [{"uuid": "9a198ed2-d1a0-4e68-8499-963634f6e890", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d4d71ed-179f-4101-b1aa-d39926bb99a5"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:00.390389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] validate_networks() for [('8d4d71ed-179f-4101-b1aa-d39926bb99a5', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:52:01.055527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:52:01.056498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:52:01.056968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:52:01.057644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:52:01.058446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:52:01.077892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:01.078581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:01.080853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:01.081518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:01.105532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:52:01.113663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Getting quotas for user f417948e34704458b1566cb24238b722 and project d342c91d4ee7490f8d4e3dd3792363ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:52:01.206577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:52:01.209042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a198ed2-d1a0-4e68-8499-963634f6e890',volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:52:01.431628 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2220d936-894f-4989-bb5f-738121735109 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.270046 Jul 25 20:52:01.432571 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3031/6012] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:52:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 20:52:01.444562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cd447ea3-ccd1-4376-9d03-01c7285d1673 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:01.445816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cd447ea3-ccd1-4376-9d03-01c7285d1673 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:01.520096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cd447ea3-ccd1-4376-9d03-01c7285d1673 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:01.528829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cd447ea3-ccd1-4376-9d03-01c7285d1673 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1094 microversion: 2.1 time: 0.088057 Jul 25 20:52:01.529837 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2982/6013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:01 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:02.576152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:02.578222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:02.599386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:02.599976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:02.601407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:02.602136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:02.718289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:02.730808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca9ad669-0383-45cd-867d-1d15ace6797c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1192 microversion: 2.1 time: 0.180647 Jul 25 20:52:02.732278 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3032/6014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:02 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1192 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:03.756024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:03.757448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:03.779358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:03.779829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:03.780688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:03.781135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:04.170583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:04.181560 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3840e854-e624-4ddb-a9e7-60c958591c1b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1278 microversion: 2.1 time: 0.431620 Jul 25 20:52:04.195083 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2983/6015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:03 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1278 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:05.212404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:05.213246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:05.245447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:05.246264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:05.247679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:05.248538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:05.259798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cdffa368-5890-4fce-a5cb-b07e8021d053 req-7393cbfc-dde9-4705-bac6-299f63b06198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caf69c4-88a3-4122-a562-467e487ab99c", "tag": "2636175d-7484-4298-94a8-6e6992036e74"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:05.285611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cdffa368-5890-4fce-a5cb-b07e8021d053 req-7393cbfc-dde9-4705-bac6-299f63b06198 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:05.286069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cdffa368-5890-4fce-a5cb-b07e8021d053 req-7393cbfc-dde9-4705-bac6-299f63b06198 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:05.327712 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cdffa368-5890-4fce-a5cb-b07e8021d053 req-7393cbfc-dde9-4705-bac6-299f63b06198 service nova] Creating event network-changed:2636175d-7484-4298-94a8-6e6992036e74 for instance 4caf69c4-88a3-4122-a562-467e487ab99c on n-h2-845775-3 Jul 25 20:52:05.340753 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cdffa368-5890-4fce-a5cb-b07e8021d053 req-7393cbfc-dde9-4705-bac6-299f63b06198 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080995 Jul 25 20:52:05.345012 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2984/6016] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:05.628565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:05.663218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f2fb19f-508a-46d1-b665-bccc647a5f06 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1278 microversion: 2.1 time: 0.463238 Jul 25 20:52:05.665165 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3033/6017] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:05 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1278 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:06.686489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:06.687785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:06.701557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:06.704961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:06.706007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:06.706602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:07.348598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:07.357233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b31a6f13-0533-4e43-a146-357b3d70f7e2 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1278 microversion: 2.1 time: 0.675312 Jul 25 20:52:07.377659 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2985/6018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:06 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1278 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:08.379159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:08.381363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:08.391727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:08.392555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:08.393584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:08.394223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:08.399638 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=63 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:08.623719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:08.633830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35cb7a23-80e0-4db4-bc0c-cb649895cbe5 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1278 microversion: 2.1 time: 0.258823 Jul 25 20:52:08.635032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3034/6019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:08 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:09.655341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:09.656139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:09.664991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:09.665467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:09.666263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:09.666973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:09.687841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=53 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:09.862472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:09.874206 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-44d44e71-137b-4a69-bac8-3798d847b668 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1278 microversion: 2.1 time: 0.222839 Jul 25 20:52:09.875511 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2986/6020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:09 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:10.896206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:10.897430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:10.904798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:10.905571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:10.907419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:10.908402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:11.093272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:11.125040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:11.283201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:11.292164 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-883bdd35-db90-45a4-98aa-029b7102447e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.399451 Jul 25 20:52:11.305790 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3035/6021] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:10 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:12.314774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:12.316469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:12.326642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:12.329929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:12.330953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:12.332188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:12.334055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:13.062034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:13.071059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9a3d6af-25d9-4387-8aaa-1fb1947d46c8 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.761366 Jul 25 20:52:13.085386 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2987/6022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:12 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:14.096702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:14.097340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:14.100352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:14.124027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:14.124660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:14.126103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:14.126561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:14.438453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:14.458470 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f21314a2-7527-4c88-98a9-e86767cbee5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.366802 Jul 25 20:52:14.459843 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3036/6023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:14 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:15.490434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:15.492451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:15.504383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:15.505143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:15.513210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:15.513929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:15.783026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:15.792166 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cd026353-d721-433c-bebd-03bbae33a65e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.305408 Jul 25 20:52:15.800098 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2988/6024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:15 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:16.821416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:16.822725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:16.840532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:16.842179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:16.843143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:16.843800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:16.996476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:17.004852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f6fd16b-a585-4147-8216-a72a9d536744 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.187507 Jul 25 20:52:17.005437 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3037/6025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:16 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:17.877415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:17.880215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:17.892011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:17.893302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:17.894128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:17.894570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:17.953281 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-302a207c-e47d-4f83-a82e-34e4835c7be4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action" status: 200 len: 24573 microversion: 2.1 time: 0.081428 Jul 25 20:52:17.954957 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2989/6026] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:52:17 2022] POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action => generated 24573 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:52:18.032835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:18.034241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:18.042603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:18.043114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:18.044300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:18.045081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:18.285103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:18.306531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed24fc13-fcbb-4391-aff2-5046824fd0e1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.284083 Jul 25 20:52:18.315735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3038/6027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:18 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:52:19.345617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:19.346421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:19.356204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:19.356674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:19.357464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:19.357915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:19.627876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:19.642160 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a40a52b7-23a2-4fb0-8889-add25bd42789 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.315269 Jul 25 20:52:19.646155 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2990/6028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:19 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:20.666093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:20.666728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:20.674605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:20.675464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:20.676326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:20.676785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:20.824587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:20.833404 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-707150fa-75f6-4d1e-a211-a060e942d6b7 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.171009 Jul 25 20:52:20.834995 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3039/6029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:20 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:21.801551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-83ccd586-b767-4817-9325-5587dd0fcc6d req-8f3965c8-87ba-403f-b586-7cfb51974344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caf69c4-88a3-4122-a562-467e487ab99c", "name": "network-vif-plugged", "status": "completed", "tag": "2636175d-7484-4298-94a8-6e6992036e74"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:21.806578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=26 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:21.825383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-83ccd586-b767-4817-9325-5587dd0fcc6d req-8f3965c8-87ba-403f-b586-7cfb51974344 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:21.826141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-83ccd586-b767-4817-9325-5587dd0fcc6d req-8f3965c8-87ba-403f-b586-7cfb51974344 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:21.841813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-83ccd586-b767-4817-9325-5587dd0fcc6d req-8f3965c8-87ba-403f-b586-7cfb51974344 service nova] Creating event network-vif-plugged:2636175d-7484-4298-94a8-6e6992036e74 for instance 4caf69c4-88a3-4122-a562-467e487ab99c on n-h2-845775-3 Jul 25 20:52:21.848433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-83ccd586-b767-4817-9325-5587dd0fcc6d req-8f3965c8-87ba-403f-b586-7cfb51974344 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058768 Jul 25 20:52:21.849378 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2991/6030] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:21.867112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:21.869304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:21.880368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:21.881176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:21.882428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:21.883087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:22.137955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:22.158149 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55d23972-4144-4cfd-ad5f-aab7e5f01000 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.302404 Jul 25 20:52:22.158756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3040/6031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:21 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:23.184463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:23.188182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:23.219556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:23.220392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:23.221486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:23.222730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:23.550332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:23.558943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83b1e37d-7daa-4370-b5ce-f124074c7c16 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1266 microversion: 2.1 time: 0.380430 Jul 25 20:52:23.572913 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2992/6032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:23 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:24.583992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:24.585546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:24.593393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:24.594919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:24.596303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:24.596961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:24.772630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:24.782504 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b7032cb9-fa27-4ff8-be2a-dea8a8d9d61c tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1454 microversion: 2.1 time: 0.204876 Jul 25 20:52:24.783664 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3041/6033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:24 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:24.803546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:24.804188 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:24.813516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:24.814206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:24.815151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:24.815749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:24.973867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:24.982646 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f7032ad-0b34-4863-99f1-d826e4f1dd5e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1454 microversion: 2.1 time: 0.182761 Jul 25 20:52:24.983266 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2993/6034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:24 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:27.777134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4fc7b13a-2f98-4000-bbeb-3b28169e36a4 req-61fc9e57-9724-4360-9a3f-218001719859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caf69c4-88a3-4122-a562-467e487ab99c", "tag": "2636175d-7484-4298-94a8-6e6992036e74"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:27.807813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4fc7b13a-2f98-4000-bbeb-3b28169e36a4 req-61fc9e57-9724-4360-9a3f-218001719859 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:27.808506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4fc7b13a-2f98-4000-bbeb-3b28169e36a4 req-61fc9e57-9724-4360-9a3f-218001719859 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:27.846057 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4fc7b13a-2f98-4000-bbeb-3b28169e36a4 req-61fc9e57-9724-4360-9a3f-218001719859 service nova] Creating event network-changed:2636175d-7484-4298-94a8-6e6992036e74 for instance 4caf69c4-88a3-4122-a562-467e487ab99c on n-h2-845775-3 Jul 25 20:52:27.860447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4fc7b13a-2f98-4000-bbeb-3b28169e36a4 req-61fc9e57-9724-4360-9a3f-218001719859 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090133 Jul 25 20:52:27.868655 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3042/6035] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:28.858771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:28.863301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:28.900123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:28.903879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:28.907216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:28.917516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.182631 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-95555162-c0c3-4e03-b49e-fed10530b335 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1832 microversion: 2.1 time: 0.326852 Jul 25 20:52:29.185010 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2994/6036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:28 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1832 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:29.209529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:29.210983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:29.219124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.220003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.221176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.221884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.427348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:29.435982 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3dc774da-be00-47d3-bca1-ff1ab57aaf7f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1681 microversion: 2.1 time: 0.230742 Jul 25 20:52:29.439044 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3043/6037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:29 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:29.547442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:29.550239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:29.558057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.558760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.559905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.560573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.624783 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ecc19fc6-bb4a-4056-b78f-ab891bd2738f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action" status: 200 len: 32646 microversion: 2.1 time: 0.083969 Jul 25 20:52:29.626046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2995/6038] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:52:29 2022] POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action => generated 32646 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:52:29.829274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:29.830378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:29.853669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.854553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:29.855608 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:29.857764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:30.244163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bf7cea98c369474d8d511bcb582cb1c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dbe5ffd7214dd086fc67c24db3385a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:30.245529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c2407945-360f-4434-87ab-c241fe8d216f] flavor_id is None. Assuming migration. {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 25 20:52:30.246179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:52:30.756934 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-538035bf-5727-4450-95dd-30e8a619e9f4 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action" status: 202 len: 0 microversion: 2.1 time: 0.933402 Jul 25 20:52:30.758773 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3044/6039] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:52:29 2022] POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action => generated 0 bytes in 937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 20:52:30.772992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:30.773704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:30.833503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:30.837495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:30.839300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:30.843111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:31.244628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:31.255722 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aed39c5b-0b83-4c8e-9547-7711946462e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1690 microversion: 2.1 time: 0.491536 Jul 25 20:52:31.272666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2996/6040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:30 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1690 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:32.314298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:32.330423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:32.366168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:32.367367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:32.369059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:32.369842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:32.716795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:32.735272 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-607801b3-066b-48fe-917e-5e19f1cfda2d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1690 microversion: 2.1 time: 0.455369 Jul 25 20:52:32.737151 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3045/6041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:32 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1690 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:33.760381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:33.761235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:33.783185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:33.783829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:33.784867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:33.785329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:34.110190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:34.126484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cde75c8-aa30-4b0a-9521-d85c646b355c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1690 microversion: 2.1 time: 0.367849 Jul 25 20:52:34.128095 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2997/6042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:33 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1690 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:35.155557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:35.157692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:35.170530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:35.172264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:35.173501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:35.184479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:35.460859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:35.471173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f014a845-e8be-428e-a3b5-f9ff55a12b42 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.324162 Jul 25 20:52:35.471781 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3046/6043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:35 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:52:36.497814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:36.498734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:36.519540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:36.520008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:36.524782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:36.527367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:36.821293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:36.840296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85e2c0ef-977e-40be-9a2f-71095d78f08a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.346190 Jul 25 20:52:36.841968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2998/6044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:36 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:52:37.877759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:37.881689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:37.905183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:37.907537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:37.910844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:37.918617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:38.350514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:38.362388 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f9216f31-f6e0-4dd5-99c7-63da83b29bcb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.491944 Jul 25 20:52:38.364403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3047/6045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:37 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:39.388001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:39.389111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:39.401739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:39.403439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:39.405131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:39.406817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:39.872507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:39.877211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=74 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:39.897006 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69c85205-b247-4d9b-b290-2217afb89ac2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.514990 Jul 25 20:52:39.913530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 2999/6046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:39 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:40.929161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:40.930973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:40.965125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:40.966119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:40.969492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:40.977606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:41.015789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:41.261282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:41.294232 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0000bf84-e1af-4995-ae44-48307dc2cb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.372552 Jul 25 20:52:41.298601 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3048/6047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:40 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:42.323195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:42.323989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:42.337890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:42.338644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:42.339707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:42.340437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:42.600808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:42.609229 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bdf67485-7712-4f55-a787-c6d86f08ae67 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.290066 Jul 25 20:52:42.610174 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3000/6048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:42 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:43.641114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:43.643083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:43.659994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:43.661513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:43.662396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:43.663079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:43.984263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:43.998961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1153bae2-8436-4331-9e88-c5fe5cfcc913 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.368944 Jul 25 20:52:43.999448 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3049/6049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:43 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:45.024444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:45.025448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:45.033496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:45.034296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:45.035087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:45.035532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:45.806338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:45.830335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dd7c3bf-1a12-4601-ae87-3d65cbc2a27d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.809032 Jul 25 20:52:45.832413 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3001/6050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:45 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:46.867224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:46.867804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:46.879874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=30 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:46.881592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:46.882070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:46.884728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:46.886498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:47.236841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:47.259511 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a204c2a-04e0-40e3-bcce-53533a96ff69 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.404791 Jul 25 20:52:47.263282 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3050/6051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:46 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:48.287942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:48.288753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:48.302604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:48.303072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:48.303879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:48.304367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:48.889991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:48.900796 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f6dd6d0d-8d6f-4b65-85d9-f2cde96926d6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.616983 Jul 25 20:52:48.917767 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3002/6052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:48 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:49.931110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:49.931874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:49.952205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:49.955478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:49.957234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:49.958027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:50.432597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:50.442345 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c532b551-a531-4878-9f02-477084b41978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.516577 Jul 25 20:52:50.443371 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3051/6053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:49 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:51.471001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:51.483306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:51.536702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:51.537799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:51.546247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:51.561121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:51.700206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aeddc6d7-9d01-45cc-89d7-6e54b58e6b6e tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-935575993", "availability_zone": "foo_zone"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:51.722579 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:51.722579 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:51.723915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.aggregate [None req-aeddc6d7-9d01-45cc-89d7-6e54b58e6b6e tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Generated uuid bdfaa257-1f73-4f87-afd1-80f214a61e4e for aggregate {{(pid=119723) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 25 20:52:51.788702 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aeddc6d7-9d01-45cc-89d7-6e54b58e6b6e tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.520929 Jul 25 20:52:51.801187 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3003/6054] 10.222.0.48 () {60 vars in 1164 bytes} [Mon Jul 25 20:52:51 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:51.815448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:51.815772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f8f0bbd-7c31-48fb-856d-9aa9a8040ef0 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:51.818372 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:51.818372 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:51.824815 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b9bcba48-ba5b-44bc-a074-f81443c0560b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1695 microversion: 2.1 time: 0.362635 Jul 25 20:52:51.833133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:52:51.837345 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3052/6055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:51 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1695 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:51.907875 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f8f0bbd-7c31-48fb-856d-9aa9a8040ef0 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.105011 Jul 25 20:52:51.919070 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3004/6056] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:52:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:51.930487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:51.933800 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:51.933800 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:52:51.935716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:51.936465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:51.937632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:51.938227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:51.980961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3487b7cb-bd40-460a-8f92-cbaf06e1f24d tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056697 Jul 25 20:52:51.981595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3053/6057] 10.222.0.48 () {58 vars in 1176 bytes} [Mon Jul 25 20:52:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:51.997393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4b5257ae-1820-4990-929e-93cde5cef6df tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:51.998172 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:51.998172 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:52.007524 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4b5257ae-1820-4990-929e-93cde5cef6df tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013696 Jul 25 20:52:52.008383 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3005/6058] 10.222.0.48 () {58 vars in 1143 bytes} [Mon Jul 25 20:52:51 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:52.024747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df24d6f6-868f-4dd7-9b54-d9097142c115 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:52.028962 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:52.028962 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:52:52.045804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df24d6f6-868f-4dd7-9b54-d9097142c115 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:52.047029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df24d6f6-868f-4dd7-9b54-d9097142c115 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:52.847068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-unplugged", "status": "completed", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:52.848567 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df24d6f6-868f-4dd7-9b54-d9097142c115 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.830728 Jul 25 20:52:52.851568 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3054/6059] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:52:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:52.863342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:52.864297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:52.882187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:52.887086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:52.888573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:52.890650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:52.890926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:52.896193 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:52.926440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] Creating event network-vif-unplugged:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h2-845775-3 Jul 25 20:52:52.948807 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] Instance c2407945-360f-4434-87ab-c241fe8d216f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:52:52.993661 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-7ae041a4-1a29-4bf0-b7f4-e77de81b8be9 req-db3f641c-d11d-4653-a089-75ac5379a8fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151842 Jul 25 20:52:52.995130 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3006/6060] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:53.006900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ae0d98f-21cb-4b26-be8e-a1dab3eaeb1c tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:53.019530 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.019530 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:53.039799 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ae0d98f-21cb-4b26-be8e-a1dab3eaeb1c tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.042857 Jul 25 20:52:53.040503 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3007/6061] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:52:52 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:53.061396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4eee2986-7775-4fd0-a693-f844568077bf tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1352709543", "availability_zone": "foo_zone"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:53.285131 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.285131 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:53.405035 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4eee2986-7775-4fd0-a693-f844568077bf tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.354860 Jul 25 20:52:53.406146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3008/6062] 10.222.0.48 () {60 vars in 1173 bytes} [Mon Jul 25 20:52:53 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:53.418602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c9adfa19-64bb-4818-aa34-4a64daddf9b9 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:53.423052 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.423052 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:53.452978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:53.456784 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c9adfa19-64bb-4818-aa34-4a64daddf9b9 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.042333 Jul 25 20:52:53.458491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3009/6063] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:52:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:53.466702 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05b9fd5b-f106-4108-a817-132e96240deb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1694 microversion: 2.1 time: 0.610117 Jul 25 20:52:53.471706 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3055/6064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:52 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1694 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:53.475969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3316630d-08d3-4c19-ae4f-77b21931eaea tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:53.479373 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.479373 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:53.507755 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3316630d-08d3-4c19-ae4f-77b21931eaea tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.041328 Jul 25 20:52:53.511299 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3010/6065] 10.222.0.48 () {58 vars in 1152 bytes} [Mon Jul 25 20:52:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:53.524246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c1d59ea4-f5c1-471f-a7aa-63b306a1b8ff tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-845775-3"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:53.527900 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.527900 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:52:53.558720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d59ea4-f5c1-471f-a7aa-63b306a1b8ff tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:53.563777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c1d59ea4-f5c1-471f-a7aa-63b306a1b8ff tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:53.855135 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c1d59ea4-f5c1-471f-a7aa-63b306a1b8ff tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.331364 Jul 25 20:52:53.864142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3056/6066] 10.222.0.48 () {60 vars in 1194 bytes} [Mon Jul 25 20:52:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:52:53.871684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26f069fa-4b0e-47e0-b0e4-2f705a573c99 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:53.872562 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:52:53.872562 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:52:53.945299 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26f069fa-4b0e-47e0-b0e4-2f705a573c99 tempest-TestAggregatesBasicOps-457343683 tempest-TestAggregatesBasicOps-457343683-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.079163 Jul 25 20:52:53.946231 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3011/6067] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Jul 25 20:52:53 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 25 20:52:54.500393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:54.501333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:54.514567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:54.516630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:54.519427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:54.523986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:55.101010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:52:55.125600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:55.126437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:55.147209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] Creating event network-changed:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h2-845775-3 Jul 25 20:52:55.176551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] Instance c2407945-360f-4434-87ab-c241fe8d216f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:52:55.208749 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-34892d83-52c8-4cf0-b8c8-69232e0cade1 req-dc6dd6a2-a026-4994-b529-174a3cfefcad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111351 Jul 25 20:52:55.211507 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3012/6068] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:52:55.575434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:55.592924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3f1fa3a-1df1-40b7-a557-0b0948c20a3a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1694 microversion: 2.1 time: 1.092513 Jul 25 20:52:55.594483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3057/6069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:54 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1694 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:52:56.621841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:56.623347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:56.632549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:56.637629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:56.638515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:56.639171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:57.091766 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:57.103033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3cdee107-6930-4440-ad08-f2b5e63d2214 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1694 microversion: 2.1 time: 0.486257 Jul 25 20:52:57.103808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3013/6070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:56 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1694 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:52:58.132720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:52:58.134165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:52:58.149688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:58.150158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:58.151139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:52:58.151770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:52:58.972905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:52:58.986322 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7849b25a-ceef-48dc-84f3-cf0d67916a88 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1692 microversion: 2.1 time: 0.859863 Jul 25 20:52:58.988079 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3058/6071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:52:58 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1692 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:00.025980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:00.027424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:00.039483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.039940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.040768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.041213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.354276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:00.362908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2079cce2-f0f9-42f4-8e30-c564dcf75aa3 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1689 microversion: 2.1 time: 0.341054 Jul 25 20:53:00.364147 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3014/6072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:00 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1689 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:53:00.400789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:00.404263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:00.426206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.426687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.427512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.428544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.584249 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed2da057-d391-4101-8c95-d66df0697071 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action" status: 202 len: 0 microversion: 2.1 time: 0.196541 Jul 25 20:53:00.594120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:00.594789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:00.597399 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3059/6073] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:53:00 2022] POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:53:00.610956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.613554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.615007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:00.623605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:00.967764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:00.989733 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2831d359-a3da-4ef5-ae21-0d010cea27e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.399597 Jul 25 20:53:01.000868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3015/6074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:00 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:02.021114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:02.026341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:02.027098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:02.043959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:02.045010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:02.046303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:02.048589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:02.436666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:02.458161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:02.459687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:02.488867 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] Creating event network-vif-plugged:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h2-845775-3 Jul 25 20:53:02.499599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] Instance c2407945-360f-4434-87ab-c241fe8d216f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:53:02.516404 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f31b965a-8125-4bec-8dae-99e9d17073ef req-10c2f7af-99dc-4529-849b-6cfcfd5aab10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085827 Jul 25 20:53:02.517449 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3016/6075] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:53:02.588113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:02.610935 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ec7cbc5-6a3c-4cf7-994c-2789603df58a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.591210 Jul 25 20:53:02.611748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3060/6076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:02 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:03.645570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:03.646295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:03.657675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:03.658142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:03.658974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:03.659579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:04.113922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:04.154031 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35988f4b-98eb-4562-a095-42522bda1e91 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.513856 Jul 25 20:53:04.154851 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3017/6077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:03 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:05.181019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:05.181643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:05.192747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:05.196628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:05.198485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:05.201010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:05.551758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:05.560864 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94037fa0-1d16-4739-a037-45f38ec3235b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.383778 Jul 25 20:53:05.565189 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3061/6078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:05 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:06.586737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:06.587357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:06.598207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:06.598846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:06.600481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:06.601633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:06.781762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-unplugged", "status": "completed", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:06.834139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:06.836359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:06.869326 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] Creating event network-vif-unplugged:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:53:06.905648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] Instance c2407945-360f-4434-87ab-c241fe8d216f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:53:06.926140 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d7667b4e-e39e-4a48-884c-c585157a077d req-beab5cca-f463-4305-8097-5ccf10047168 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152905 Jul 25 20:53:06.927094 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3062/6079] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:53:07.241675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:07.266551 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ab2229b6-4515-4b67-a014-350ff29f7a33 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.685208 Jul 25 20:53:07.281213 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3018/6080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:06 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:08.304090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:08.304731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:08.343240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:08.343726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:08.347269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:08.347749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:08.935487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:08.966991 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fe9626ee-0f9a-4ba1-b883-549cd80d0419 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.678024 Jul 25 20:53:08.967501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:08.977490 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3063/6081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:08 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:09.020597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:09.021093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:09.047373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] Creating event network-changed:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:53:09.061491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] Instance c2407945-360f-4434-87ab-c241fe8d216f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:53:09.080075 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-299c4e0e-8b0f-45e7-896d-b53ec1f4ef92 req-b03df0e6-2c2c-4aae-867e-0520fc2f5280 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117413 Jul 25 20:53:09.082210 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3019/6082] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:53:09.998160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:09.998811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:10.016316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:10.017131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:10.018418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:10.019333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:10.070365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:10.525632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:10.545199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8401baf9-b300-4713-8350-e4ec6e4b33a7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1688 microversion: 2.1 time: 0.546989 Jul 25 20:53:10.554397 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3064/6083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:09 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1688 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:11.574135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:11.574972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:11.585325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:11.585810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:11.586612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:11.588336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:11.594388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=66 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:11.910655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:11.926781 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5556c33-71fb-4fce-b4bc-0f15e8fbd532 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1681 microversion: 2.1 time: 0.360835 Jul 25 20:53:11.928018 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3020/6084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:11 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1681 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:18.097737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-676ba46e-8bf8-4e6c-bb17-8a998b6ea906 req-c298d37a-34d5-4dda-8e2d-68427a2ede90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-plugged", "status": "completed", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:18.140256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:18.146653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-676ba46e-8bf8-4e6c-bb17-8a998b6ea906 req-c298d37a-34d5-4dda-8e2d-68427a2ede90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:18.147885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-676ba46e-8bf8-4e6c-bb17-8a998b6ea906 req-c298d37a-34d5-4dda-8e2d-68427a2ede90 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:18.195354 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-676ba46e-8bf8-4e6c-bb17-8a998b6ea906 req-c298d37a-34d5-4dda-8e2d-68427a2ede90 service nova] Creating event network-vif-plugged:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:53:18.210689 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-676ba46e-8bf8-4e6c-bb17-8a998b6ea906 req-c298d37a-34d5-4dda-8e2d-68427a2ede90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120178 Jul 25 20:53:18.216252 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3065/6085] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:53:38.361287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:38.363554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:38.365905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:38.366597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=5 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:38.372216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:38.372500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:38.373291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:38.373769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:38.440722 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7df151dd-1ac2-40db-81d3-1195706f8d72 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action" status: 200 len: 63185 microversion: 2.1 time: 0.083461 Jul 25 20:53:38.444693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3021/6086] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:53:38 2022] POST /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f/action => generated 63185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:53:44.792772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:53:44.797636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:44.798443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:44.806206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:44.806676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:44.807476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:44.807932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:44.949810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bf1273f-8001-4121-bca2-b9be2d9fc967 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1832 microversion: 2.1 time: 0.159898 Jul 25 20:53:44.950391 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3066/6087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:44 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1832 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:46.249435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:46.250569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:46.273607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:46.285704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:46.288107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:46.291328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:46.347776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:53:46.472388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4ccfb1bf-6a2e-4247-92c4-865c09c509ce req-d6524398-f4cd-4fcd-916e-a1d1baf45d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:46.488507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ccfb1bf-6a2e-4247-92c4-865c09c509ce req-d6524398-f4cd-4fcd-916e-a1d1baf45d31 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:46.489174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ccfb1bf-6a2e-4247-92c4-865c09c509ce req-d6524398-f4cd-4fcd-916e-a1d1baf45d31 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:46.500341 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c7d2f5e0-cb81-44d6-85d7-97a94249eaec tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 204 len: 0 microversion: 2.1 time: 0.253927 Jul 25 20:53:46.502882 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3022/6088] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:53:46 2022] DELETE /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:53:46.517788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:46.518535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4ccfb1bf-6a2e-4247-92c4-865c09c509ce req-d6524398-f4cd-4fcd-916e-a1d1baf45d31 service nova] Creating event network-changed:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:53:46.519143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:46.524323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4ccfb1bf-6a2e-4247-92c4-865c09c509ce req-d6524398-f4cd-4fcd-916e-a1d1baf45d31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270252 Jul 25 20:53:46.530551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:46.530922 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3067/6089] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:53:46.531570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:46.532533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:46.533267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:46.707087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:46.715831 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8b34e136-801c-49da-a501-c8bbfab00ac7 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1687 microversion: 2.1 time: 0.202779 Jul 25 20:53:46.716691 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3023/6090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:46 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:47.739315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:47.740433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:47.747764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:47.748365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:47.749249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:47.749845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:47.970787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:47.978840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-930481aa-8bdb-4c2a-b185-732e5be77946 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1687 microversion: 2.1 time: 0.244490 Jul 25 20:53:47.979522 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3068/6091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:47 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:48.753793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1bb76a8b-6f08-431c-93fa-bd9c01a2194c req-9e383587-ecb3-41e6-9278-0d8a77ce37ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2407945-360f-4434-87ab-c241fe8d216f", "name": "network-vif-deleted", "tag": "f0fa220c-27f1-4bd6-815c-235ee32c7304"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:48.765584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1bb76a8b-6f08-431c-93fa-bd9c01a2194c req-9e383587-ecb3-41e6-9278-0d8a77ce37ac service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:48.766387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1bb76a8b-6f08-431c-93fa-bd9c01a2194c req-9e383587-ecb3-41e6-9278-0d8a77ce37ac service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:48.778829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1bb76a8b-6f08-431c-93fa-bd9c01a2194c req-9e383587-ecb3-41e6-9278-0d8a77ce37ac service nova] Creating event network-vif-deleted:f0fa220c-27f1-4bd6-815c-235ee32c7304 for instance c2407945-360f-4434-87ab-c241fe8d216f on n-h1-845775-3 Jul 25 20:53:48.784749 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1bb76a8b-6f08-431c-93fa-bd9c01a2194c req-9e383587-ecb3-41e6-9278-0d8a77ce37ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038781 Jul 25 20:53:48.785778 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3024/6092] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:53:49.002830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:49.004004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:49.017041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:49.017511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:49.018303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:49.018748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:49.059405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:49.060187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:49.060832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lazy-loading 'fault' on Instance uuid c2407945-360f-4434-87ab-c241fe8d216f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:53:49.106437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:53:49.118186 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c01b287-9c92-4e05-84d4-9f316525d183 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 200 len: 1355 microversion: 2.1 time: 0.120676 Jul 25 20:53:49.120515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3069/6093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:48 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 1355 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:53:50.144616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:50.145517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: c2407945-360f-4434-87ab-c241fe8d216f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:53:50.152084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:50.152793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:50.153575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:53:50.154022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:53:50.170917 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] HTTP exception thrown: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Request method failure captured: Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f HTTP/1.1 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wHMnTeCtAorbDdpthDlJLe79CcDnbALEtNw5HYwAY-U1Mh6Qtkv7x5MfJQ3MNwbBU3TKW92L_pUTYgOdjELGNvnJvjFCjEbcYjHiS8Li2EhE4qplY_A4trHCTAPsJNWRtA5fJNaUzZMGKZEkGQWTgSCJGNu-YcAjSnBWJbFlPRlgzk Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}] Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a299cd4f7ca94602bbff10845fd5ec11 Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c2407945-360f-4434-87ab-c241fe8d216f'} Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:53:50.173266 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Returning 404 to user: Instance c2407945-360f-4434-87ab-c241fe8d216f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fe8952f8-211c-4aaf-9c91-a43839a3821c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f" status: 404 len: 111 microversion: 2.1 time: 0.035847 Jul 25 20:53:50.182496 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3025/6094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:53:50 2022] GET /compute/v2.1/servers/c2407945-360f-4434-87ab-c241fe8d216f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:53:54.022277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-24b70fa9-76fc-4c91-a782-bcb6ab303863 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '.version_select at 0x7f19681efee0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:53:54.050234 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-24b70fa9-76fc-4c91-a782-bcb6ab303863 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343527439" status: 202 len: 0 microversion: 2.1 time: 0.032012 Jul 25 20:53:54.051100 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3070/6095] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Jul 25 20:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343527439 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:53:54.085357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f985ec2c-3d56-4ed5-bc8e-8a869c9c9e19 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: .version_select at 0x7f196e9b5700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1458377919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ3dOdl4oanebjhaGlTyPNuNzW8cY9lWN8knt5kZpY92zCdUKJhTmRwK3o8nG2DeORDz5mkvUR0pXbABHVxj3sSK7jHDkLcKdUeCRmJNA3H+JjahkS8n5spCYkgCLz3jQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:53:54.103098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f985ec2c-3d56-4ed5-bc8e-8a869c9c9e19 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:53:54.109281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-f985ec2c-3d56-4ed5-bc8e-8a869c9c9e19 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:53:54.135046 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f985ec2c-3d56-4ed5-bc8e-8a869c9c9e19 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053553 Jul 25 20:53:54.135848 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3026/6096] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:53:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:00.671087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=22 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:00.679479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-696531669", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "69b73eb5-f364-4a0f-b4bc-55dc5cd874cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1458377919", "security_groups": [{"name": "tempest-secgroup-smoke-671525631"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:00.821556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] validate_networks() for [('69b73eb5-f364-4a0f-b4bc-55dc5cd874cb', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:54:01.295820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:54:01.296539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:54:01.297139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:54:01.297673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:54:01.298224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:54:01.310970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:01.312456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:01.313243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:01.313807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:01.336331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:54:01.344959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:54:01.359124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:54:01.361040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:54:01.418858 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1254d663-2542-4d8c-a9af-2808a91d509d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749769 Jul 25 20:54:01.419635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3071/6097] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:54:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:54:01.429727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:01.434782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b580541-6c92-4d13-9a2f-54513f393969 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:01.435413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b580541-6c92-4d13-9a2f-54513f393969 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:01.519154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6b580541-6c92-4d13-9a2f-54513f393969 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:01.529468 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b580541-6c92-4d13-9a2f-54513f393969 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1266 microversion: 2.1 time: 0.100544 Jul 25 20:54:01.530415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3027/6098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:01 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:02.551092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:02.551673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:02.559856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:02.560651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:02.561469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:02.562519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:02.641428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:02.651023 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2908bddb-7a2a-4f25-bee0-11e3b2bf80ce tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1318 microversion: 2.1 time: 0.103784 Jul 25 20:54:02.651940 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3072/6099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:02 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:03.675641 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:03.676473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:03.690045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:03.690587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:03.691457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:03.692198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:03.963604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:03.976939 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e996d56c-5e38-4c59-8136-a3b3893eb783 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.307294 Jul 25 20:54:03.977861 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3028/6100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:03 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:04.768332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-811b9df4-105a-4ced-ac9b-76893dac99f8 req-923e5780-3b9b-4a1b-b7b9-7c129aff7863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:04.784209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-811b9df4-105a-4ced-ac9b-76893dac99f8 req-923e5780-3b9b-4a1b-b7b9-7c129aff7863 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:04.784668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-811b9df4-105a-4ced-ac9b-76893dac99f8 req-923e5780-3b9b-4a1b-b7b9-7c129aff7863 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:04.799533 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-811b9df4-105a-4ced-ac9b-76893dac99f8 req-923e5780-3b9b-4a1b-b7b9-7c129aff7863 service nova] Creating event network-changed:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:54:04.817467 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-811b9df4-105a-4ced-ac9b-76893dac99f8 req-923e5780-3b9b-4a1b-b7b9-7c129aff7863 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163928 Jul 25 20:54:04.818318 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3073/6101] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:54:04.999575 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:05.000737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:05.010780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:05.011497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:05.012570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:05.012993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:05.233431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:05.241910 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f1c3a33-3e6b-49ed-9d8e-373350c6398d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.246413 Jul 25 20:54:05.242509 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3029/6102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:04 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:06.267015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:06.268051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:06.276768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:06.278516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:06.279452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:06.280130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:06.498745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:06.506510 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4bde4b87-4fe7-4b14-8d31-65990485724e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.246299 Jul 25 20:54:06.507098 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3074/6103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:06 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:07.527246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:07.527875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:07.535610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:07.536110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:07.536899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:07.537345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:07.683561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:07.691732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e22d1c8d-786b-49e3-a71a-2b91bb2d77a9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.168370 Jul 25 20:54:07.692478 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3030/6104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:07 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:54:08.714318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:08.714997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:08.721865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:08.722324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:08.723099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:08.723551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:08.867530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:08.875749 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa8e451d-60fe-421f-bd82-4c5ae2fd2a9d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.165669 Jul 25 20:54:08.876412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3075/6105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:08 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:09.900699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:09.902138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:09.913245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:09.914894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:09.920124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-29895cfb-f74d-44e2-a0b6-27f9ba99e57d req-37a9f166-9f4d-4aa4-942a-27de08740a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "name": "network-vif-plugged", "status": "completed", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:09.924602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:09.925352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:09.925808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:09.933081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-29895cfb-f74d-44e2-a0b6-27f9ba99e57d req-37a9f166-9f4d-4aa4-942a-27de08740a07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:09.933638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-29895cfb-f74d-44e2-a0b6-27f9ba99e57d req-37a9f166-9f4d-4aa4-942a-27de08740a07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:09.948407 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-29895cfb-f74d-44e2-a0b6-27f9ba99e57d req-37a9f166-9f4d-4aa4-942a-27de08740a07 service nova] Creating event network-vif-plugged:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:54:09.954227 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-29895cfb-f74d-44e2-a0b6-27f9ba99e57d req-37a9f166-9f4d-4aa4-942a-27de08740a07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118158 Jul 25 20:54:09.954859 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3031/6106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:10.301746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:10.309551 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac917ddc-cfc4-40a5-b641-fbc1804a677d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.416204 Jul 25 20:54:10.310156 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3076/6107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:09 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:10.557126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:10.557719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:10.564325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:10.564947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:10.565285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3ae1e938-bc35-4c8e-a377-e4e4ed596a07 req-10ecd1d1-cac7-48dd-82c7-9caebbf05916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caf69c4-88a3-4122-a562-467e487ab99c", "tag": "2636175d-7484-4298-94a8-6e6992036e74"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:10.565972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:10.566565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:10.574826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3ae1e938-bc35-4c8e-a377-e4e4ed596a07 req-10ecd1d1-cac7-48dd-82c7-9caebbf05916 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:10.575291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3ae1e938-bc35-4c8e-a377-e4e4ed596a07 req-10ecd1d1-cac7-48dd-82c7-9caebbf05916 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:10.589100 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3ae1e938-bc35-4c8e-a377-e4e4ed596a07 req-10ecd1d1-cac7-48dd-82c7-9caebbf05916 service nova] Creating event network-changed:2636175d-7484-4298-94a8-6e6992036e74 for instance 4caf69c4-88a3-4122-a562-467e487ab99c on n-h2-845775-3 Jul 25 20:54:10.596203 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3ae1e938-bc35-4c8e-a377-e4e4ed596a07 req-10ecd1d1-cac7-48dd-82c7-9caebbf05916 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034375 Jul 25 20:54:10.597075 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3077/6108] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:10.600339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:54:10.701253 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ead5750b-69b1-4cb0-b58c-52b1b5f78469 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 204 len: 0 microversion: 2.1 time: 0.147942 Jul 25 20:54:10.703052 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3032/6109] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:54:10 2022] DELETE /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:54:10.714583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:10.715753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:10.724939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:10.725612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:10.726624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:10.729040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:10.925147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:10.934662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05e8996b-acd8-4704-8d58-1ffe1c710381 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1578 microversion: 2.1 time: 0.226625 Jul 25 20:54:10.935457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3078/6110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:10 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:11.347805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:11.349727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:11.365109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:11.365702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:11.367045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:11.367764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:11.524706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:11.580816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:11.599679 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6c7850f-ccd7-44a9-bdaf-9f872e33b640 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1391 microversion: 2.1 time: 0.272339 Jul 25 20:54:11.601503 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3033/6111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:11 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:11.957044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:11.958953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:11.965188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:11.966792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:11.970475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:11.971166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:11.972560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:11.973542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:12.212078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:12.220476 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ec0defe-3abd-4044-bad7-b658ba585126 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1578 microversion: 2.1 time: 0.267315 Jul 25 20:54:12.221065 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3079/6112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:11 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:12.625871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:12.626661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:12.635135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:12.635589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:12.636495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:12.636937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:12.839868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:12.848537 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a28475e6-011d-4f1a-b034-9d29fc482280 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1564 microversion: 2.1 time: 0.228811 Jul 25 20:54:12.849706 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3034/6113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:12 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:12.872403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:12.873390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:12.879844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:12.880345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:12.881877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:12.882512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:13.051607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d1d20f60-f53b-4f76-8b91-58361fbc5f2c req-4112ced0-7b3a-4e3b-8000-0546ac815b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caf69c4-88a3-4122-a562-467e487ab99c", "name": "network-vif-deleted", "tag": "2636175d-7484-4298-94a8-6e6992036e74"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:13.051812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:13.063235 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fba24c74-e515-402b-b42f-004732ca5032 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1564 microversion: 2.1 time: 0.196750 Jul 25 20:54:13.064430 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3080/6114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:12 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:13.074927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d1d20f60-f53b-4f76-8b91-58361fbc5f2c req-4112ced0-7b3a-4e3b-8000-0546ac815b6a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:13.075471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d1d20f60-f53b-4f76-8b91-58361fbc5f2c req-4112ced0-7b3a-4e3b-8000-0546ac815b6a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:13.088832 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d1d20f60-f53b-4f76-8b91-58361fbc5f2c req-4112ced0-7b3a-4e3b-8000-0546ac815b6a service nova] Creating event network-vif-deleted:2636175d-7484-4298-94a8-6e6992036e74 for instance 4caf69c4-88a3-4122-a562-467e487ab99c on n-h2-845775-3 Jul 25 20:54:13.096351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d1d20f60-f53b-4f76-8b91-58361fbc5f2c req-4112ced0-7b3a-4e3b-8000-0546ac815b6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053862 Jul 25 20:54:13.097252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3035/6115] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:13.247647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:13.248409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:13.257930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:13.258442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:13.259301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:13.259752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:13.354875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:13.366128 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d805e8fb-29d4-4a98-bc52-7d7885fd6519 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1225 microversion: 2.1 time: 0.123454 Jul 25 20:54:13.370738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3081/6116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:13 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:14.400533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:14.402289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:14.411662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:14.412485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:14.413432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:14.414237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:14.522253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:14.535261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aded19ba-3c3a-47cd-b94b-fce201fbc72a tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1225 microversion: 2.1 time: 0.141568 Jul 25 20:54:14.536068 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3036/6117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:14 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:14.996100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:14.996712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:15.000083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:15.006884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:15.007357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:15.008308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:15.008844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:15.132434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6475e404-ae77-4ebd-9040-fee04b49f0e7 req-f6d9d38b-08f3-4054-9b3b-6a598e672bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:15.144613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6475e404-ae77-4ebd-9040-fee04b49f0e7 req-f6d9d38b-08f3-4054-9b3b-6a598e672bba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:15.145297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6475e404-ae77-4ebd-9040-fee04b49f0e7 req-f6d9d38b-08f3-4054-9b3b-6a598e672bba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:15.158927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:15.164434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6475e404-ae77-4ebd-9040-fee04b49f0e7 req-f6d9d38b-08f3-4054-9b3b-6a598e672bba service nova] Creating event network-changed:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:54:15.169171 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b424257a-504c-4356-a5e7-033edf6def60 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1564 microversion: 2.1 time: 0.177440 Jul 25 20:54:15.170543 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3082/6118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:14 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:15.171501 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6475e404-ae77-4ebd-9040-fee04b49f0e7 req-f6d9d38b-08f3-4054-9b3b-6a598e672bba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042954 Jul 25 20:54:15.172152 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3037/6119] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:54:15.557060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:15.557598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:15.571828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:15.572323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:15.573118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:15.573566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:15.706043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:15.714049 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df16d189-1466-4ef6-a07c-df8e6fdc71b6 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1225 microversion: 2.1 time: 0.161040 Jul 25 20:54:15.720354 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3083/6120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:15 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:16.736956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:16.737811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:16.744471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:16.744935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:16.745718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:16.746165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:16.814403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:16.834866 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-418c3dd8-6ca8-4c26-b416-0f91e4e58e76 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1225 microversion: 2.1 time: 0.103269 Jul 25 20:54:16.835581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3038/6121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:16 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:17.857549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:17.859985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:17.869573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:17.870057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:17.871752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:17.872618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:17.912903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:17.913528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:17.914010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lazy-loading 'fault' on Instance uuid 4caf69c4-88a3-4122-a562-467e487ab99c {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:54:17.962261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:17.970309 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10a854b8-5a44-47ba-b46d-fe2eea7d9587 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 200 len: 1230 microversion: 2.1 time: 0.117893 Jul 25 20:54:17.971638 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3084/6122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:17 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:18.991896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:18.992620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 4caf69c4-88a3-4122-a562-467e487ab99c] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:19.000712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:19.001550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:19.002466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:19.002991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:19.017977 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c HTTP/1.1 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '4caf69c4-88a3-4122-a562-467e487ab99c'} Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:19.019627 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 4caf69c4-88a3-4122-a562-467e487ab99c could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e9b81e03-ccbd-4321-8f44-2cc8d359bb4e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c" status: 404 len: 111 microversion: 2.1 time: 0.033799 Jul 25 20:54:19.025277 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3039/6123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:18 2022] GET /compute/v2.1/servers/4caf69c4-88a3-4122-a562-467e487ab99c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:54:25.352058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:25.352832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:25.354200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c0e8145b-e1be-4949-9fcb-21e47dea9feb req-9f2e28f6-962c-481a-b90a-bbf9eb431f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89564c53-7b72-423f-843e-1dc74bb856a2", "tag": "702ca7ae-66ce-4933-a1ba-d080f69bd2e1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:25.361116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:25.361740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:25.362782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:25.363346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:25.367463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0e8145b-e1be-4949-9fcb-21e47dea9feb req-9f2e28f6-962c-481a-b90a-bbf9eb431f72 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:25.367854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c0e8145b-e1be-4949-9fcb-21e47dea9feb req-9f2e28f6-962c-481a-b90a-bbf9eb431f72 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:25.379984 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c0e8145b-e1be-4949-9fcb-21e47dea9feb req-9f2e28f6-962c-481a-b90a-bbf9eb431f72 service nova] Creating event network-changed:702ca7ae-66ce-4933-a1ba-d080f69bd2e1 for instance 89564c53-7b72-423f-843e-1dc74bb856a2 on n-h2-845775-3 Jul 25 20:54:25.386401 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c0e8145b-e1be-4949-9fcb-21e47dea9feb req-9f2e28f6-962c-481a-b90a-bbf9eb431f72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035587 Jul 25 20:54:25.387180 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3040/6124] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:54:25.395060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:54:25.538478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-37e3980a-30b1-4bd7-8c39-9567790fbb87 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 204 len: 0 microversion: 2.1 time: 0.188412 Jul 25 20:54:25.543350 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3085/6125] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:54:25 2022] DELETE /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:54:25.549279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:25.550117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:25.565683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:25.567212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:25.569106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:25.569785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:25.747392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:25.755528 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15206375-3033-4ae4-9331-6cf3e0f4c9b1 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1578 microversion: 2.1 time: 0.210533 Jul 25 20:54:25.760081 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3041/6126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:25 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:26.778149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:26.778874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:26.788183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:26.788649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:26.789445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:26.789891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:26.950965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:26.960069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9845bbe4-f7b0-494a-a512-3774c7a66523 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1578 microversion: 2.1 time: 0.186128 Jul 25 20:54:26.960645 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3086/6127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:26 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:27.685133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-81cc7906-0e9a-432d-b873-32a7bb73dc9e req-0356ebf5-56e0-4df9-b8ac-5eecde34cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89564c53-7b72-423f-843e-1dc74bb856a2", "name": "network-vif-deleted", "tag": "702ca7ae-66ce-4933-a1ba-d080f69bd2e1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:27.696203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-81cc7906-0e9a-432d-b873-32a7bb73dc9e req-0356ebf5-56e0-4df9-b8ac-5eecde34cf5a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:27.696941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-81cc7906-0e9a-432d-b873-32a7bb73dc9e req-0356ebf5-56e0-4df9-b8ac-5eecde34cf5a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:27.711053 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-81cc7906-0e9a-432d-b873-32a7bb73dc9e req-0356ebf5-56e0-4df9-b8ac-5eecde34cf5a service nova] Creating event network-vif-deleted:702ca7ae-66ce-4933-a1ba-d080f69bd2e1 for instance 89564c53-7b72-423f-843e-1dc74bb856a2 on n-h2-845775-3 Jul 25 20:54:27.716016 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-81cc7906-0e9a-432d-b873-32a7bb73dc9e req-0356ebf5-56e0-4df9-b8ac-5eecde34cf5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 Jul 25 20:54:27.716668 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3042/6128] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:27.984149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:27.984791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:28.011943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:28.012534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:28.013400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:28.013859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:28.049280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:28.107250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:28.117736 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4af3bfc-a802-401d-a2c0-6046e4c59107 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1226 microversion: 2.1 time: 0.137493 Jul 25 20:54:28.118646 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3087/6129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:27 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:29.142561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:29.143307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:29.150113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:29.151147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:29.151949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:29.152444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:29.223321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:29.231659 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9470c665-f9c0-4ca9-9faf-77055f8fdd8b tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1226 microversion: 2.1 time: 0.094651 Jul 25 20:54:29.232367 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3043/6130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:29 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:30.255776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:30.259779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:30.271673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:30.272490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:30.273548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:30.274168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:30.356251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:30.365893 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d3535f6-b3bc-4e48-bb86-e92bd80ae183 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1226 microversion: 2.1 time: 0.115477 Jul 25 20:54:30.366671 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3088/6131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:30 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:31.387335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:31.387959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:31.395780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:31.396492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:31.397483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:31.397927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:31.472349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417948e34704458b1566cb24238b722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd342c91d4ee7490f8d4e3dd3792363ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:31.480885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:31.484813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-954b02bb-dc1f-4365-a928-61789cb22a97 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 200 len: 1226 microversion: 2.1 time: 0.101160 Jul 25 20:54:31.485522 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3044/6132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:31 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:32.505707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:32.506331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: 89564c53-7b72-423f-843e-1dc74bb856a2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:32.519139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:32.519795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:32.521111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:32.521727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:32.540581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 HTTP/1.1 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '89564c53-7b72-423f-843e-1dc74bb856a2'} Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:32.542340 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance 89564c53-7b72-423f-843e-1dc74bb856a2 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6c3643f-8ffb-4044-8345-13729681e8f0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2" status: 404 len: 111 microversion: 2.1 time: 0.043561 Jul 25 20:54:32.547825 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3089/6133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:32 2022] GET /compute/v2.1/servers/89564c53-7b72-423f-843e-1dc74bb856a2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:54:33.024336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:33.025211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:33.033632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:33.034224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:33.035176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:33.035696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:33.051364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 HTTP/1.1 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd3331881-ac90-46c8-a151-db43ad8130c0'} Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:54:33.053190 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8919f20b-3cb5-4ac9-97da-a28775ed0a1e tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 404 len: 111 microversion: 2.1 time: 0.034374 Jul 25 20:54:33.058440 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3045/6134] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:54:33 2022] DELETE /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:54:33.064445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:33.065266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] [instance: d3331881-ac90-46c8-a151-db43ad8130c0] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:33.071529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:33.072006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:33.072883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:33.073341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:33.087764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] HTTP exception thrown: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Request method failure captured: Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 HTTP/1.1 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3v_BziebK6or1W8y8kZHCtdQ-AeosUWDzBVLDCAppr3WBBW4UoDFqo19l0G-LPJOfb9TgkZwnp4W9GKTf2r6SvKO_nlr9-I8RhsLObjpsyPH8LyOmrxBHOUBGDDYRL2OcHrKXD6Ee-9I6MqYMmTn02rFHcjEZxbAgDyoIYt6n5szdyE Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d342c91d4ee7490f8d4e3dd3792363ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d342c91d4ee7490f8d4e3dd3792363ed"}]}] Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: d342c91d4ee7490f8d4e3dd3792363ed Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestVolumeBootPattern-66986680 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f417948e34704458b1566cb24238b722 Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestVolumeBootPattern-66986680-project Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd3331881-ac90-46c8-a151-db43ad8130c0'} Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:54:33.089375 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Returning 404 to user: Instance d3331881-ac90-46c8-a151-db43ad8130c0 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea00ae29-5d6d-49a4-8702-80d0bf7571a0 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0" status: 404 len: 111 microversion: 2.1 time: 0.031158 Jul 25 20:54:33.095372 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3090/6135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:33 2022] GET /compute/v2.1/servers/d3331881-ac90-46c8-a151-db43ad8130c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:54:36.591063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a25fbb83-49ad-4c35-8efb-42191622b876 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] Calling method '.version_select at 0x7f196a686280>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:36.624790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a25fbb83-49ad-4c35-8efb-42191622b876 tempest-TestVolumeBootPattern-66986680 tempest-TestVolumeBootPattern-66986680-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1625105149" status: 202 len: 0 microversion: 2.1 time: 0.037686 Jul 25 20:54:36.626060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3046/6136] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Jul 25 20:54:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1625105149 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:54:39.993415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:39.996662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:40.005613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:40.006082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:40.007111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:40.008292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:40.080614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-29fc3c49-d37d-40b7-90b8-a3996f704759 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action" status: 200 len: 24564 microversion: 2.1 time: 0.437031 Jul 25 20:54:40.082098 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3091/6137] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:54:39 2022] POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action => generated 24564 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 20:54:51.193382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:51.194272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:51.199292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:51.199919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:51.207027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.207485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:51.208368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.208819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:51.353042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:51.362083 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-faacf65c-7358-427b-974f-d9df54e64694 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1683 microversion: 2.1 time: 0.171198 Jul 25 20:54:51.363137 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3047/6138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:51 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:51.462361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:51.465566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:51.469526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:51.470437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=16 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:54:51.477717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.478227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:51.479080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.479516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:51.533066 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc64e5c6-54f2-4a22-a563-9b12d5f4c978 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action" status: 200 len: 32634 microversion: 2.1 time: 0.074767 Jul 25 20:54:51.533801 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3092/6139] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:54:51 2022] POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action => generated 32634 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:54:51.883811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:51.884495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:51.891719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.892216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:51.893081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:51.893552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:52.029287 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11c36d4e-88b2-498e-b45e-3806109ef9a5 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1834 microversion: 2.1 time: 0.337229 Jul 25 20:54:52.030835 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3048/6140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:51 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1834 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:52.066936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:52.069424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:52.077552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:52.078020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:52.078827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:52.079285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:52.106220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lazy-loading 'flavor' on Instance uuid db60e10f-8613-40f0-888f-4e8d5940cdfc {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 20:54:52.118664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Going to try to live migrate instance to another host {{(pid=119724) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 25 20:54:55.586961 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-558ea385-04ed-4831-8051-d341a19257b8 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action" status: 202 len: 0 microversion: 2.1 time: 3.524006 Jul 25 20:54:55.587824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3093/6141] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:54:52 2022] POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action => generated 0 bytes in 3526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:54:55.599138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:55.600292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:55.609801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:55.611446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:55.613539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:55.614282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:55.809817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:55.818601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e0b48187-2a19-4778-8a6d-7f9f439afb9a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.224691 Jul 25 20:54:55.819555 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3049/6142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:55 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:56.819397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a1cd6225-1ab6-4d5b-bac2-f9691888e5b1 req-ea827fa5-83c9-426e-b6c3-d89f26504c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "name": "network-vif-unplugged", "status": "completed", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:56.832560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a1cd6225-1ab6-4d5b-bac2-f9691888e5b1 req-ea827fa5-83c9-426e-b6c3-d89f26504c6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:56.833033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a1cd6225-1ab6-4d5b-bac2-f9691888e5b1 req-ea827fa5-83c9-426e-b6c3-d89f26504c6b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:56.845333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:56.846503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:56.849593 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a1cd6225-1ab6-4d5b-bac2-f9691888e5b1 req-ea827fa5-83c9-426e-b6c3-d89f26504c6b service nova] Creating event network-vif-unplugged:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:54:56.855264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:56.856189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:56.858717 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a1cd6225-1ab6-4d5b-bac2-f9691888e5b1 req-ea827fa5-83c9-426e-b6c3-d89f26504c6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043543 Jul 25 20:54:56.860476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3094/6143] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:56.868565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:56.869153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:57.106543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:57.115519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-862186f4-a2c7-4c70-a663-cb52a3363ad5 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.277193 Jul 25 20:54:57.125673 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3050/6144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:56 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:54:58.140354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:58.141450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:58.147933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:58.148487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:58.149332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:58.149784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:58.328594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:54:58.342892 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25b5d768-dacb-4003-97d4-3f9e1d47b172 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.205570 Jul 25 20:54:58.342892 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3095/6145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:58 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:54:58.876637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b49c4dfe-a880-4c6e-8eca-b5eae1b3b657 req-35c01d7a-b5a9-4ca1-8bbc-385a0774eba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:54:58.887356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b49c4dfe-a880-4c6e-8eca-b5eae1b3b657 req-35c01d7a-b5a9-4ca1-8bbc-385a0774eba9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:58.887805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b49c4dfe-a880-4c6e-8eca-b5eae1b3b657 req-35c01d7a-b5a9-4ca1-8bbc-385a0774eba9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:58.901694 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b49c4dfe-a880-4c6e-8eca-b5eae1b3b657 req-35c01d7a-b5a9-4ca1-8bbc-385a0774eba9 service nova] Creating event network-changed:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:54:58.913959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b49c4dfe-a880-4c6e-8eca-b5eae1b3b657 req-35c01d7a-b5a9-4ca1-8bbc-385a0774eba9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041572 Jul 25 20:54:58.914725 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3051/6146] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:54:59.369948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:54:59.371232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:54:59.380427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:59.381170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:54:59.382128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:54:59.382778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:00.008587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:00.027478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8c125233-6754-47c5-a8d1-26287ef9e6e0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.662111 Jul 25 20:55:00.028112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3096/6147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:54:59 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:01.069957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:01.071212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:01.083060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:01.083963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:01.085515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:01.086284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:01.339239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:01.354178 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-125eae94-c821-4035-8afa-71e46225e43c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.294572 Jul 25 20:55:01.354793 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3052/6148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:01 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:01.974635 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:55:01.974635 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 20:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:55:02.378551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:02.379240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:02.387880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:02.388434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:02.390287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:02.390788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:02.599897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:02.609327 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2e23991-888c-416f-b4d4-aca79414064e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.236391 Jul 25 20:55:02.610311 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3097/6149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:02 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:03.093519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3b9b6c0a-3bd6-4763-aca0-915e8224f627 req-f95ca173-9ec9-4a4e-bf66-e6ae7eb87132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "name": "network-vif-unplugged", "status": "completed", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:03.106751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3b9b6c0a-3bd6-4763-aca0-915e8224f627 req-f95ca173-9ec9-4a4e-bf66-e6ae7eb87132 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:03.106751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3b9b6c0a-3bd6-4763-aca0-915e8224f627 req-f95ca173-9ec9-4a4e-bf66-e6ae7eb87132 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:03.119423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3b9b6c0a-3bd6-4763-aca0-915e8224f627 req-f95ca173-9ec9-4a4e-bf66-e6ae7eb87132 service nova] Creating event network-vif-unplugged:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h1-845775-3 Jul 25 20:55:03.126701 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3b9b6c0a-3bd6-4763-aca0-915e8224f627 req-f95ca173-9ec9-4a4e-bf66-e6ae7eb87132 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037289 Jul 25 20:55:03.127405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3053/6150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:55:03.630928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:03.632261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:03.639005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:03.639480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:03.640308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:03.640981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:03.878878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:03.887652 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0086404-03f4-47e4-abff-38647c23b7d0 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1693 microversion: 2.1 time: 0.260461 Jul 25 20:55:03.898915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3098/6151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:03 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1693 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:04.912391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:04.913320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:04.921720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:04.922181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:04.922961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:04.923443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.071117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:05.080097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6e7dadc1-c385-4917-93ca-96f3706bd27a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1683 microversion: 2.1 time: 0.173164 Jul 25 20:55:05.080696 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3054/6152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:04 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:05.101474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:05.102104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:05.110493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.111024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.112102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.112576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.252642 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-937d801a-fd0d-49e0-a8d5-2b22ca82c518 tempest-TestNetworkAdvancedServerOps-1043116598 tempest-TestNetworkAdvancedServerOps-1043116598-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1834 microversion: 2.1 time: 0.154819 Jul 25 20:55:05.253229 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3099/6153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:05 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1834 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:05.274293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:05.274939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:05.282221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.282831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.283614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.284078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.422079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:05.430987 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cc872783-0fe8-463a-bcf5-29a1b504c989 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1683 microversion: 2.1 time: 0.160511 Jul 25 20:55:05.431838 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3055/6154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:05 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:55:05.539003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:05.541169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:05.549933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.550230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.553043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:05.553516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:05.611016 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6778af04-10c6-46ee-b7ad-ef2fa0fd5bfb tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action" status: 200 len: 38621 microversion: 2.1 time: 0.075676 Jul 25 20:55:05.611609 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3100/6155] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:55:05 2022] POST /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc/action => generated 38621 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:55:06.648989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:06.652984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-00996de9-6e22-467d-89a0-5c351ef7dd53 req-275f0883-1b58-46f5-99e0-68d6b5d5e956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:06.653483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:06.661663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:06.662129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:06.662984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:06.663617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:06.666087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00996de9-6e22-467d-89a0-5c351ef7dd53 req-275f0883-1b58-46f5-99e0-68d6b5d5e956 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:06.666907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00996de9-6e22-467d-89a0-5c351ef7dd53 req-275f0883-1b58-46f5-99e0-68d6b5d5e956 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:06.681353 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-00996de9-6e22-467d-89a0-5c351ef7dd53 req-275f0883-1b58-46f5-99e0-68d6b5d5e956 service nova] Creating event network-changed:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h2-845775-3 Jul 25 20:55:06.687336 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-00996de9-6e22-467d-89a0-5c351ef7dd53 req-275f0883-1b58-46f5-99e0-68d6b5d5e956 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044048 Jul 25 20:55:06.688659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3101/6156] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:55:06.717084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:55:06.823846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-81c8aeb6-0393-4484-9163-7d1551fed965 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 204 len: 0 microversion: 2.1 time: 0.181211 Jul 25 20:55:06.830183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3056/6157] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:55:06 2022] DELETE /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:55:06.841109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:06.843252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:06.853274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:06.854565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:06.855623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:06.856106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:07.129147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:07.141025 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23038927-6f0b-4a79-820c-09efdb8808b2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1689 microversion: 2.1 time: 0.310097 Jul 25 20:55:07.141630 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3102/6158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:06 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1689 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:08.184117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ea0d98ad-c304-4f18-a2ef-ac4a4205da78 req-440408c8-7680-469d-a753-9d15d919373a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db60e10f-8613-40f0-888f-4e8d5940cdfc", "name": "network-vif-deleted", "tag": "48378e0a-a10e-44a6-a3a8-747d3d5c4763"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:08.185890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:08.186718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:08.198491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:08.199146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:08.216341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ea0d98ad-c304-4f18-a2ef-ac4a4205da78 req-440408c8-7680-469d-a753-9d15d919373a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:08.217147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ea0d98ad-c304-4f18-a2ef-ac4a4205da78 req-440408c8-7680-469d-a753-9d15d919373a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:08.226622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:08.227708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:08.261014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ea0d98ad-c304-4f18-a2ef-ac4a4205da78 req-440408c8-7680-469d-a753-9d15d919373a service nova] Creating event network-vif-deleted:48378e0a-a10e-44a6-a3a8-747d3d5c4763 for instance db60e10f-8613-40f0-888f-4e8d5940cdfc on n-h2-845775-3 Jul 25 20:55:08.269671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ea0d98ad-c304-4f18-a2ef-ac4a4205da78 req-440408c8-7680-469d-a753-9d15d919373a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092025 Jul 25 20:55:08.274784 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3103/6159] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:55:08.376437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:08.391118 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0241a552-f2c5-4d9c-bb99-0621b58564ef tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 200 len: 1351 microversion: 2.1 time: 0.213633 Jul 25 20:55:08.405521 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3057/6160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:08 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 1351 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:09.415167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:09.415920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: db60e10f-8613-40f0-888f-4e8d5940cdfc] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:09.423315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:09.423766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:09.424635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:09.425088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:09.447415 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] HTTP exception thrown: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Request method failure captured: Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc HTTP/1.1 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wHMnTeCtAorbDdpthDlJLe79CcDnbALEtNw5HYwAY-U1Mh6Qtkv7x5MfJQ3MNwbBU3TKW92L_pUTYgOdjELGNvnJvjFCjEbcYjHiS8Li2EhE4qplY_A4trHCTAPsJNWRtA5fJNaUzZMGKZEkGQWTgSCJGNu-YcAjSnBWJbFlPRlgzk Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}] Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: a299cd4f7ca94602bbff10845fd5ec11 Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'db60e10f-8613-40f0-888f-4e8d5940cdfc'} Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:55:09.449151 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Returning 404 to user: Instance db60e10f-8613-40f0-888f-4e8d5940cdfc could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f21ad2f6-2dd6-4850-bff7-10099a5a224f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc" status: 404 len: 111 microversion: 2.1 time: 0.041051 Jul 25 20:55:09.455743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3104/6161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:09 2022] GET /compute/v2.1/servers/db60e10f-8613-40f0-888f-4e8d5940cdfc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:55:13.393783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9b98cd22-d6b7-4855-b3fe-ca2f920baba9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '.version_select at 0x7f1968cf90d0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:13.429921 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9b98cd22-d6b7-4855-b3fe-ca2f920baba9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1458377919" status: 202 len: 0 microversion: 2.1 time: 0.043413 Jul 25 20:55:13.430788 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3058/6162] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 20:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1458377919 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:55:13.461501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a0770763-b80c-43ba-a8e7-22232f594367 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: .version_select at 0x7f1968102820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1438972503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtjbutZwGpwVgOZKmhhpEoZxIenpN8uKQxNz3OAj+8lg2n2c2rQI6kSaq+6DJGA1BwAFUeWS/iLw83K0YofwSCnoP+h4o/HrQ35hNNwaKGnZcysTtuTT4rEKnLTpLRsdA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:13.478930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a0770763-b80c-43ba-a8e7-22232f594367 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:55:13.486757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-a0770763-b80c-43ba-a8e7-22232f594367 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:55:13.514963 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a0770763-b80c-43ba-a8e7-22232f594367 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057454 Jul 25 20:55:13.516222 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3105/6163] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:55:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:55:20.017342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:20.021711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-466751032", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "bd9a9af2-98b7-40ae-aaab-5b22ab0b1725"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1438972503", "security_groups": [{"name": "tempest-secgroup-smoke-844152040"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:20.189137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] validate_networks() for [('bd9a9af2-98b7-40ae-aaab-5b22ab0b1725', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:55:20.925875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:55:20.926300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:55:20.926786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:55:20.927207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:55:20.927633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:55:20.946326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:20.946796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:20.948127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:20.948127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:20.998587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:55:21.006334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Getting quotas for user a299cd4f7ca94602bbff10845fd5ec11 and project a32caaa0172c4538a1ecf083b5d2df21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:55:21.035429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:55:21.039291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:55:21.114406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aece8b21-2526-4216-9c60-8254594ef082 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.098793 Jul 25 20:55:21.115690 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3059/6164] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:55:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:55:21.125520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:21.133006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1348575-5811-49b6-8abf-050b886244db tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:21.133975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d1348575-5811-49b6-8abf-050b886244db tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:21.295821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1348575-5811-49b6-8abf-050b886244db tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:21.312560 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1348575-5811-49b6-8abf-050b886244db tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1266 microversion: 2.1 time: 0.181250 Jul 25 20:55:21.316976 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3106/6165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:21 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:22.333368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:22.334000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:22.337397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:22.344823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:22.345651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:22.346707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:22.347407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:22.489027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:22.506611 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0460b138-215c-4eab-a6e2-2cb03909825c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1318 microversion: 2.1 time: 0.178677 Jul 25 20:55:22.507912 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3060/6166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:22 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:23.531637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:23.532506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:23.536651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:23.541549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:23.542713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:23.544418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:23.544856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:23.733706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:23.742207 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44b7a37e-9259-4e80-a167-5347c5bf9e0e tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.215167 Jul 25 20:55:23.744862 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3107/6167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:23 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:24.772214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:24.774168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:24.789861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:24.790592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:24.792169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:24.793550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:24.914941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f6e62815-a648-4d49-a622-5e0a7c684bb3 req-6404d184-b31a-4f68-89b9-64772b97596a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:24.940372 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6e62815-a648-4d49-a622-5e0a7c684bb3 req-6404d184-b31a-4f68-89b9-64772b97596a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:24.941003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f6e62815-a648-4d49-a622-5e0a7c684bb3 req-6404d184-b31a-4f68-89b9-64772b97596a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:24.958445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f6e62815-a648-4d49-a622-5e0a7c684bb3 req-6404d184-b31a-4f68-89b9-64772b97596a service nova] Creating event network-changed:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:55:24.964745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f6e62815-a648-4d49-a622-5e0a7c684bb3 req-6404d184-b31a-4f68-89b9-64772b97596a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062802 Jul 25 20:55:24.969054 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3108/6168] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:55:25.023837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:25.032234 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4488675-1a3c-4a89-8a41-ac2da9019afa tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.269584 Jul 25 20:55:25.056378 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3061/6169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:24 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:26.055848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:26.056509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:26.062870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:26.063331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:26.064230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:26.064681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:26.221885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:26.238037 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b2c0630-d9e4-4171-8dcc-cf6ea7a4a76b tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.187366 Jul 25 20:55:26.238607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3109/6170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:26 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:27.261680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:27.263232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:27.271226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:27.271683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:27.272612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:27.273272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:27.449604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:27.459506 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4888c9a4-933f-499d-8dd4-ae70f86d40d1 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.203187 Jul 25 20:55:27.464122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3062/6171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:27 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:28.482284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:28.483053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:28.489980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:28.490577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:28.491413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:28.491864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:28.675385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:28.684633 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28b9dc7c-6a09-4ee8-88a7-4fe7d8d6ef81 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.206034 Jul 25 20:55:28.700381 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3110/6172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:28 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:29.705980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:29.707762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:29.714032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:29.714479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:29.715260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:29.715690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:29.876488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:29.892364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7860fdca-4527-45c4-9041-ab3da0831878 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.189095 Jul 25 20:55:29.893174 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3063/6173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:29 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:30.871607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-aac98c1d-c878-44a4-870c-3ff5c1558e94 req-437aa6e3-08e2-45ff-ad27-db395ad03546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "name": "network-vif-plugged", "status": "completed", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:30.885644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aac98c1d-c878-44a4-870c-3ff5c1558e94 req-437aa6e3-08e2-45ff-ad27-db395ad03546 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:30.886199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-aac98c1d-c878-44a4-870c-3ff5c1558e94 req-437aa6e3-08e2-45ff-ad27-db395ad03546 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:30.899484 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-aac98c1d-c878-44a4-870c-3ff5c1558e94 req-437aa6e3-08e2-45ff-ad27-db395ad03546 service nova] Creating event network-vif-plugged:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:55:30.906061 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-aac98c1d-c878-44a4-870c-3ff5c1558e94 req-437aa6e3-08e2-45ff-ad27-db395ad03546 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038062 Jul 25 20:55:30.907024 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3111/6174] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:55:30.921201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:30.923362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:30.938974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:30.940996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:30.942817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:30.943584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:30.977631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:31.028224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:31.142177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:31.150586 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-87b088e7-e7c0-4e3e-8832-d64a40870eb8 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.236131 Jul 25 20:55:31.151200 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3064/6175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:30 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:55:32.170731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:32.176544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:32.177268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:32.185183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:32.185690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:32.186499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:32.186950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:32.419612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:32.427494 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ebec0962-8d72-4ea4-b436-90a82300d2d4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1391 microversion: 2.1 time: 0.258209 Jul 25 20:55:32.428252 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3112/6176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:32 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:55:33.448420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:33.449389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:33.456589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:33.457197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:33.458179 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:33.458754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:33.611774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:33.620146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7c4b3837-00fe-4653-9965-c0cefc1b852a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1564 microversion: 2.1 time: 0.175723 Jul 25 20:55:33.620739 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3065/6177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:33 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:33.641953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:33.642582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:33.651213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:33.651841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:33.653005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:33.654166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:33.818826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:33.827519 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-350d27fe-7264-40c4-8517-fde6a9f93650 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1564 microversion: 2.1 time: 0.189948 Jul 25 20:55:33.828155 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3113/6178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:33 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:35.950001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-de70d689-ad62-4c01-b799-7901483d0287 req-5d8ae28c-467d-4464-b0cd-1a8c0bb4b899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:35.953151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:55:35.960824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:35.968441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:35.972622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-de70d689-ad62-4c01-b799-7901483d0287 req-5d8ae28c-467d-4464-b0cd-1a8c0bb4b899 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:35.973088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-de70d689-ad62-4c01-b799-7901483d0287 req-5d8ae28c-467d-4464-b0cd-1a8c0bb4b899 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:35.974176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:35.974996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:35.975451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:36.001287 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-de70d689-ad62-4c01-b799-7901483d0287 req-5d8ae28c-467d-4464-b0cd-1a8c0bb4b899 service nova] Creating event network-changed:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:55:36.012857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-de70d689-ad62-4c01-b799-7901483d0287 req-5d8ae28c-467d-4464-b0cd-1a8c0bb4b899 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066283 Jul 25 20:55:36.020394 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3114/6179] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:55:36.188222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:55:36.198360 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb2add71-3373-4e8e-aec8-d5700b7f89bc tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1564 microversion: 2.1 time: 0.255648 Jul 25 20:55:36.213305 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3066/6180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:55:35 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:55:57.482935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=15 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:57.483937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=36 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:55:57.489249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:55:57.491555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:55:57.499326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:57.499826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:57.500651 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:55:57.501113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:55:57.560992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b85f84e0-c3f6-46c0-a47c-8f2008b03c59 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action" status: 200 len: 24571 microversion: 2.1 time: 0.080223 Jul 25 20:55:57.562592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3115/6181] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:55:57 2022] POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:56:08.430228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:56:08.433209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:08.435545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=13 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:08.436349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=44 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:08.448195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.448195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.448195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.448195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.524261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:56:08.524700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:56:08.525625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:56:08.526041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:56:08.526459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:56:08.595486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:08.602046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.602505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.603322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.603731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.633182 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b364604b-bae4-4d7d-abaa-46fb8e6c0e0f tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action" status: 202 len: 1136 microversion: 2.1 time: 0.207218 Jul 25 20:56:08.634028 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3067/6182] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:56:08 2022] POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action => generated 1136 bytes in 209 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 25 20:56:08.652284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:08.653039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:08.660374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:08.661379 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:08.663533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.664364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.665527 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:08.666161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:08.826510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:08.835278 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-87ceb793-4116-44c4-836c-17b1197ac2a4 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.187077 Jul 25 20:56:08.849104 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3116/6183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:08 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:56:09.873331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:09.873956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:09.882057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:09.882522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:09.883318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:09.883765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:10.020247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:10.027855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad3f2fe2-d8dc-4efe-a46d-42961b0e69a6 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.158786 Jul 25 20:56:10.029010 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3068/6184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:09 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:11.051737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:11.052515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:11.060536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:11.061033 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:11.061773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:11.062382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:11.203912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:11.212126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0acc73cf-6585-4867-95f6-5ea7dae60278 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.164378 Jul 25 20:56:11.212697 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3117/6185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:11 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:12.235615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:12.236275 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:12.248213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:12.248679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:12.253539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:12.254044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:12.423173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:12.431433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5499831-1912-4a3d-9dd8-5a43a20f0ba2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.200752 Jul 25 20:56:12.432380 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3069/6186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:12 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:13.453264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:13.454036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:13.463479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:13.463952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:13.464782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:13.465461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:13.620558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:13.630136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f55dba4e-0d8b-4bdc-be9d-5eb614bcb86d tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.180868 Jul 25 20:56:13.630692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3118/6187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:13 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:14.652689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:14.653328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:14.660774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:14.661205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:14.661942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:14.662419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:14.806733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:14.816638 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-761800dc-87b0-42b7-be94-1a1d2bae212c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.167514 Jul 25 20:56:14.817301 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3070/6188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:14 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:15.838842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:15.839470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:15.847398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:15.847707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:15.848597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:15.849057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:15.993487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:16.001977 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44477b83-755c-4361-89cf-651c61ee609c tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.167054 Jul 25 20:56:16.008856 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3119/6189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:15 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:17.025919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:17.026549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:17.034395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:17.034858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:17.035838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:17.036377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:17.182590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:17.190381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cb31cfcb-4cef-4b02-aee5-6202a816f507 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.168595 Jul 25 20:56:17.190966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3071/6190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:17 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:18.213344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:18.214798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:18.224797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:18.226081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:18.227501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:18.228505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:18.409125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:18.417597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-319c59b0-dde2-4485-ac4f-04828f435ee2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.208378 Jul 25 20:56:18.420089 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3120/6191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:18 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:19.442855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:19.443919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:19.451186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:19.451680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:19.452450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:19.452897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:19.602493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:19.611360 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-915266a1-986a-40c2-8ec7-2a186de7eea9 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.172799 Jul 25 20:56:19.611950 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3072/6192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:19 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:20.635429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:20.636736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:20.644690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:20.645420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:20.646930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:20.647646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:20.828495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:20.839188 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c6bfa588-64fe-473b-a781-5d73f723f054 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1690 microversion: 2.1 time: 0.208540 Jul 25 20:56:20.839784 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3121/6193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:20 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:21.862564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:21.863425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:21.873497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:21.873854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:21.874640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:21.875087 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:22.024327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:22.032966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-129b9414-e571-48eb-8b70-9a27e5f055a2 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1696 microversion: 2.1 time: 0.174391 Jul 25 20:56:22.033559 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3073/6194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:21 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:23.056844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:23.057499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:23.065997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:23.066475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:23.067306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:23.067770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:23.236892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:23.245130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-924f41b0-8729-4eff-a8b7-0c21df0b167a tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1696 microversion: 2.1 time: 0.193803 Jul 25 20:56:23.245736 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3122/6195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:23 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:24.266781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:56:24.267577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:24.275547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:24.276012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:24.276879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:24.278182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:24.443222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:56:24.451580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2880437a-c105-4b98-84d6-32d46f378069 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1681 microversion: 2.1 time: 0.188732 Jul 25 20:56:24.452248 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3074/6196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:56:24 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:56:25.050145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-a9c87020-ebff-4730-939d-801bf1d43590 req-e7a2ad5a-4e8f-4cbd-b6f0-248151b3f23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "name": "network-vif-unplugged", "status": "completed", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:56:25.061440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a9c87020-ebff-4730-939d-801bf1d43590 req-e7a2ad5a-4e8f-4cbd-b6f0-248151b3f23b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:25.061936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-a9c87020-ebff-4730-939d-801bf1d43590 req-e7a2ad5a-4e8f-4cbd-b6f0-248151b3f23b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:25.073728 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-a9c87020-ebff-4730-939d-801bf1d43590 req-e7a2ad5a-4e8f-4cbd-b6f0-248151b3f23b service nova] Creating event network-vif-unplugged:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:56:25.079743 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-a9c87020-ebff-4730-939d-801bf1d43590 req-e7a2ad5a-4e8f-4cbd-b6f0-248151b3f23b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033304 Jul 25 20:56:25.082768 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3123/6197] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:56:27.099802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9092fee8-5350-42f9-bc42-b92f8cc961c2 req-424626e9-60e6-4402-a345-844720aad5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "name": "network-vif-plugged", "status": "completed", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:56:27.110699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9092fee8-5350-42f9-bc42-b92f8cc961c2 req-424626e9-60e6-4402-a345-844720aad5f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:27.111157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9092fee8-5350-42f9-bc42-b92f8cc961c2 req-424626e9-60e6-4402-a345-844720aad5f4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:27.126958 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9092fee8-5350-42f9-bc42-b92f8cc961c2 req-424626e9-60e6-4402-a345-844720aad5f4 service nova] Creating event network-vif-plugged:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:56:27.132247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9092fee8-5350-42f9-bc42-b92f8cc961c2 req-424626e9-60e6-4402-a345-844720aad5f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Jul 25 20:56:27.132910 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3075/6198] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:56:48.683961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:56:48.686323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:56:48.689144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=16 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:48.689965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=44 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:56:48.696199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:48.696705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:48.697514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:56:48.698076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:56:48.752606 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd4cea1e-b1b3-4ab7-b253-ed13650d1557 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action" status: 200 len: 24571 microversion: 2.1 time: 0.072835 Jul 25 20:56:48.753648 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3124/6199] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:56:48 2022] POST /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 20:57:00.691863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:00.692567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ef247c83-0507-42cc-8212-f0684e6e9062 req-5a160d1e-1c28-4f86-a207-15ae56b60d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:00.692974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:00.697162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=22 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:00.698234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:00.698420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:00.698974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:00.707159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ef247c83-0507-42cc-8212-f0684e6e9062 req-5a160d1e-1c28-4f86-a207-15ae56b60d28 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:00.707763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ef247c83-0507-42cc-8212-f0684e6e9062 req-5a160d1e-1c28-4f86-a207-15ae56b60d28 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:00.711990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:00.712900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:00.714121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:00.714584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:00.721506 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ef247c83-0507-42cc-8212-f0684e6e9062 req-5a160d1e-1c28-4f86-a207-15ae56b60d28 service nova] Creating event network-changed:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:57:00.730760 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ef247c83-0507-42cc-8212-f0684e6e9062 req-5a160d1e-1c28-4f86-a207-15ae56b60d28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038939 Jul 25 20:57:00.730760 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3125/6200] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:00.744911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:57:00.840553 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-19988202-a797-47da-b13e-3eb545d69150 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 204 len: 0 microversion: 2.1 time: 0.156573 Jul 25 20:57:00.842780 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3076/6201] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:57:00 2022] DELETE /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 20:57:00.852284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:00.853969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:00.860948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:00.861426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:00.862344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:00.862847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:01.045116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:01.057051 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8ec1f9ed-df53-413b-a09b-1cb4ce7c76ad tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1687 microversion: 2.1 time: 0.210119 Jul 25 20:57:01.057560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3126/6202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:00 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1687 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:02.081752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:02.082549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:02.091989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:02.092884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:02.094548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:02.095177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:02.269444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a299cd4f7ca94602bbff10845fd5ec11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32caaa0172c4538a1ecf083b5d2df21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:02.277459 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2e5cd9dc-b05a-4cdc-a9d5-b1984ef7bcee tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 200 len: 1687 microversion: 2.1 time: 0.201033 Jul 25 20:57:02.278041 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3077/6203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:02 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:02.846981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-64e119b2-743d-4ea9-92a0-e438c0a58d64 req-bf661e19-92f4-4927-ab46-0831fd96f2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147d91e7-23bf-48e9-94d2-5c8f111552fe", "name": "network-vif-deleted", "tag": "76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:02.858235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64e119b2-743d-4ea9-92a0-e438c0a58d64 req-bf661e19-92f4-4927-ab46-0831fd96f2c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:02.858701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64e119b2-743d-4ea9-92a0-e438c0a58d64 req-bf661e19-92f4-4927-ab46-0831fd96f2c2 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:02.871136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-64e119b2-743d-4ea9-92a0-e438c0a58d64 req-bf661e19-92f4-4927-ab46-0831fd96f2c2 service nova] Creating event network-vif-deleted:76cf0fb3-9cb0-43e8-b200-6d1cd8fde4bd for instance 147d91e7-23bf-48e9-94d2-5c8f111552fe on n-h2-845775-3 Jul 25 20:57:02.877257 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-64e119b2-743d-4ea9-92a0-e438c0a58d64 req-bf661e19-92f4-4927-ab46-0831fd96f2c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033765 Jul 25 20:57:02.878097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3127/6204] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:03.300390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:03.301014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] [instance: 147d91e7-23bf-48e9-94d2-5c8f111552fe] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:03.308705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:03.309279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:03.310738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:03.311197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:03.326244 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] HTTP exception thrown: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Request method failure captured: Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe HTTP/1.1 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wHMnTeCtAorbDdpthDlJLe79CcDnbALEtNw5HYwAY-U1Mh6Qtkv7x5MfJQ3MNwbBU3TKW92L_pUTYgOdjELGNvnJvjFCjEbcYjHiS8Li2EhE4qplY_A4trHCTAPsJNWRtA5fJNaUzZMGKZEkGQWTgSCJGNu-YcAjSnBWJbFlPRlgzk Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a32caaa0172c4538a1ecf083b5d2df21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a32caaa0172c4538a1ecf083b5d2df21"}]}] Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: a32caaa0172c4538a1ecf083b5d2df21 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800921486 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: a299cd4f7ca94602bbff10845fd5ec11 Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800921486-project Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '147d91e7-23bf-48e9-94d2-5c8f111552fe'} Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:03.327911 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Returning 404 to user: Instance 147d91e7-23bf-48e9-94d2-5c8f111552fe could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ec6f660-ef6f-459f-b18c-a2781e2aad23 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe" status: 404 len: 111 microversion: 2.1 time: 0.033320 Jul 25 20:57:03.333054 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3078/6205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:03 2022] GET /compute/v2.1/servers/147d91e7-23bf-48e9-94d2-5c8f111552fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:57:06.681179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f8e960f7-4b3b-46a9-9eeb-871040248364 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] Calling method '.version_select at 0x7f19682cf700>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:06.706610 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f8e960f7-4b3b-46a9-9eeb-871040248364 tempest-TestNetworkAdvancedServerOps-1800921486 tempest-TestNetworkAdvancedServerOps-1800921486-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1438972503" status: 202 len: 0 microversion: 2.1 time: 0.034508 Jul 25 20:57:06.707207 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3128/6206] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 20:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1438972503 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:57:29.038674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:29.039476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:29.151078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1703648802", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:29.384619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] validate_networks() for None {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:57:29.582875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:57:29.583305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:57:29.583789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:57:29.584258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:57:29.584680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:57:29.594335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:29.594875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:29.595686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:29.596181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:29.613086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Getting quotas for project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:57:29.619052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Getting quotas for user 340cdf943ca747c3b0750005f550b174 and project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:57:29.633748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:57:29.636257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:57:29.682629 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-751fc721-fcf2-42be-9106-511aa9e0e360 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648866 Jul 25 20:57:29.683275 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3079/6207] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:57:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:57:29.693676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:29.694539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:29.698678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-025c7249-8ca4-4d8f-a6ed-bda0276bf53f tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:29.700540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-025c7249-8ca4-4d8f-a6ed-bda0276bf53f tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:29.868088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-025c7249-8ca4-4d8f-a6ed-bda0276bf53f tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:29.875417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-025c7249-8ca4-4d8f-a6ed-bda0276bf53f tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1222 microversion: 2.1 time: 0.183752 Jul 25 20:57:29.878587 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3129/6208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:29 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:30.897918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:30.898610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:30.907081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:30.907548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:30.908615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:30.909250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:30.980154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:30.988804 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b5720a40-04e1-49b8-953b-9c4d9a13f97e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1280 microversion: 2.1 time: 0.095014 Jul 25 20:57:30.989650 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3080/6209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:30 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:57:32.014929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:32.015639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:32.023021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:32.023490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:32.024321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:32.024977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:32.231447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:32.240403 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b938b0e-df14-4b57-9db7-b4e80e31b316 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.229785 Jul 25 20:57:32.241231 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3130/6210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:32 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:32.395675 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4da35dac-15db-4513-a45b-1cd817a9d1f6 req-65479a6c-34a3-4436-b6c4-13aa76a2f2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17f453e-8b62-4855-b1a5-e6857b604643", "tag": "c9c8e4e2-64e8-4a9c-a847-8e1280b0a738"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:32.412137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4da35dac-15db-4513-a45b-1cd817a9d1f6 req-65479a6c-34a3-4436-b6c4-13aa76a2f2cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:32.412611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4da35dac-15db-4513-a45b-1cd817a9d1f6 req-65479a6c-34a3-4436-b6c4-13aa76a2f2cb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:32.425796 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4da35dac-15db-4513-a45b-1cd817a9d1f6 req-65479a6c-34a3-4436-b6c4-13aa76a2f2cb service nova] Creating event network-changed:c9c8e4e2-64e8-4a9c-a847-8e1280b0a738 for instance a17f453e-8b62-4855-b1a5-e6857b604643 on n-h2-845775-3 Jul 25 20:57:32.432514 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4da35dac-15db-4513-a45b-1cd817a9d1f6 req-65479a6c-34a3-4436-b6c4-13aa76a2f2cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040556 Jul 25 20:57:32.434862 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3081/6211] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:33.263277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:33.263918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:33.271006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:33.271476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:33.272307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:33.272764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:33.406991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:33.415178 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5556a186-75d0-4e74-96c0-04726bdeaff6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.156222 Jul 25 20:57:33.415772 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3131/6212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:33 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:34.437362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:34.438073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:34.444510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:34.444968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:34.445742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:34.446190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:34.586999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:34.595565 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-adc2a399-7dfa-4140-ac90-8896ad2579a1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.163320 Jul 25 20:57:34.596164 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3082/6213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:34 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:35.616641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:35.617305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:35.624422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:35.624891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:35.625685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:35.626139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:35.768503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:35.776350 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-00bea53e-eb5d-40e3-9e4a-63295acf22e6 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.163489 Jul 25 20:57:35.776951 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3132/6214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:35 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:36.798248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:36.798852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:36.805890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:36.806343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:36.807106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:36.807545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:36.939354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:36.947132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-024a0a55-d20e-4c3b-b2da-ad1e1cdd54c3 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.153281 Jul 25 20:57:36.947707 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3083/6215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:36 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:37.346867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-201c9165-c4f3-4292-85f4-329932e3f0cf req-0e10c591-f766-4375-9bed-17e86e62bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17f453e-8b62-4855-b1a5-e6857b604643", "name": "network-vif-plugged", "status": "completed", "tag": "c9c8e4e2-64e8-4a9c-a847-8e1280b0a738"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:37.360471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-201c9165-c4f3-4292-85f4-329932e3f0cf req-0e10c591-f766-4375-9bed-17e86e62bf83 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:37.361221 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-201c9165-c4f3-4292-85f4-329932e3f0cf req-0e10c591-f766-4375-9bed-17e86e62bf83 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:37.373539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-201c9165-c4f3-4292-85f4-329932e3f0cf req-0e10c591-f766-4375-9bed-17e86e62bf83 service nova] Creating event network-vif-plugged:c9c8e4e2-64e8-4a9c-a847-8e1280b0a738 for instance a17f453e-8b62-4855-b1a5-e6857b604643 on n-h2-845775-3 Jul 25 20:57:37.378940 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-201c9165-c4f3-4292-85f4-329932e3f0cf req-0e10c591-f766-4375-9bed-17e86e62bf83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Jul 25 20:57:37.379707 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3133/6216] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:57:37.968746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:37.969357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:37.976703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:37.977161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:37.977945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:37.978390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:38.124855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:38.133029 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6cab5143-5f43-4913-ab6c-699c666ef2e5 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1322 microversion: 2.1 time: 0.168558 Jul 25 20:57:38.135024 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3084/6217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:37 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:39.160516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:39.161238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:39.167495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.167972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.169599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.170095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.305652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:39.313761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49285ee0-c34e-4233-b7d1-2111df5d688c tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1472 microversion: 2.1 time: 0.158567 Jul 25 20:57:39.314347 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3134/6218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:39 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:39.386271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ddd1374f-4588-46a1-81bd-d8621a3ddf15 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '.version_select at 0x7f19699f7670>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:39.453103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ddd1374f-4588-46a1-81bd-d8621a3ddf15 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/017c1f4f15e74843967f012f18ecf41f" status: 200 len: 371 microversion: 2.1 time: 0.120844 Jul 25 20:57:39.453683 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3085/6219] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:57:39 2022] GET /compute/v2.1/os-quota-sets/017c1f4f15e74843967f012f18ecf41f => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:39.464982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aef09666-a483-4487-adf7-e6210e6a6816 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1435548484", "id": 1487680771, "os-flavor-access:is_public": "True"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:39.468389 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:57:39.468389 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:57:39.483519 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aef09666-a483-4487-adf7-e6210e6a6816 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022172 Jul 25 20:57:39.484113 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3135/6220] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:57:39 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:39.495803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1487680771"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:39.498895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:39.505177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.505559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.506341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.506788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.591701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9d56a607f5ac4c949461a7a13fe30a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c1f4f15e74843967f012f18ecf41f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:39.598413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1435548484 {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:57:39.603175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:39.605759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.606225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.607033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.607480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.630784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Getting quotas for project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:57:39.635913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Getting quotas for user 340cdf943ca747c3b0750005f550b174 and project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:57:39.650481 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.compute.api [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] ram quota exceeded for 017c1f4f15e74843967f012f18ecf41f, tried to resize instance. Jul 25 20:57:39.651029 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Request method failure captured: Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action HTTP/1.1 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 39 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wO4NTX1qGbRR2uGk9v1jl4qjPegbKXBZsjIUtBBBZGLsARtt-HgRp1XYxg0WENia-X64HlccY0i3lC5FFnb6Ml6PsXR0oWY83ldbOFYj8SnxkS5vBSljU8wllSUUsIbZWxxg5sdOLsE7imO95z0Qwy9Xc4gOJxvcUQ7xmps3xTzEmM Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 017c1f4f15e74843967f012f18ecf41f Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Role: admin,reader,member Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: admin,reader,member Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/017c1f4f15e74843967f012f18ecf41f"}]}] Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 017c1f4f15e74843967f012f18ecf41f Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminNegativeTestJSON-1060637494-project-admin Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 9d56a607f5ac4c949461a7a13fe30a19 Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1060637494-project-admin Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: {"resize": {"flavorRef": "1487680771"}} Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a17f453e-8b62-4855-b1a5-e6857b604643', 'body': {'resize': {'flavorRef': '1487680771'}}} Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:39.653192 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23eeb3d2-a99a-48fe-b126-38daaedfb58e tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action" status: 403 len: 118 microversion: 2.1 time: 0.162774 Jul 25 20:57:39.659419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3086/6221] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:57:39 2022] POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action => generated 118 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 25 20:57:39.664673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-be5fcb19-efe0-4f6e-aaf5-469e611cf9df tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:39.664885 n-d-845775-3 devstack@n-api.service[119724]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:57:39.664885 n-d-845775-3 devstack@n-api.service[119724]: warnings.warn(msg) Jul 25 20:57:39.681513 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-be5fcb19-efe0-4f6e-aaf5-469e611cf9df tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1487680771" status: 202 len: 0 microversion: 2.1 time: 0.021494 Jul 25 20:57:39.682087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3136/6222] 10.222.0.48 () {58 vars in 1161 bytes} [Mon Jul 25 20:57:39 2022] DELETE /compute/v2.1/flavors/1487680771 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:57:39.690819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2aa3a78-74a5-4d79-85b4-f911d62055bf tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:39.711080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2aa3a78-74a5-4d79-85b4-f911d62055bf tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023931 Jul 25 20:57:39.711647 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3087/6223] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:57:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:39.731250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-da66b8b9-c220-4a52-9640-c0ea92ad64ae tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '.version_select at 0x7f19680d8d30>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:39.808751 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-da66b8b9-c220-4a52-9640-c0ea92ad64ae tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/017c1f4f15e74843967f012f18ecf41f" status: 200 len: 371 microversion: 2.1 time: 0.081568 Jul 25 20:57:39.809979 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3137/6224] 10.222.0.48 () {58 vars in 1242 bytes} [Mon Jul 25 20:57:39 2022] GET /compute/v2.1/os-quota-sets/017c1f4f15e74843967f012f18ecf41f => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:39.821175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5682e3d1-259f-44f9-9134-9f861b4e31dd tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-615171829", "id": 292994070, "os-flavor-access:is_public": "True"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:39.824081 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:57:39.824081 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:57:39.839441 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5682e3d1-259f-44f9-9134-9f861b4e31dd tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021994 Jul 25 20:57:39.840027 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3088/6225] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:57:39 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:39.851883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "292994070"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:39.854448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:39.861347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.861811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.862591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:39.863043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:39.999517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9d56a607f5ac4c949461a7a13fe30a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c1f4f15e74843967f012f18ecf41f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:40.006289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-615171829 {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:57:40.012726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.013187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.014066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.014519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.035002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Getting quotas for project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:57:40.039914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Getting quotas for user 340cdf943ca747c3b0750005f550b174 and project bcb1803bc4ce491cb5f2d53b4c70091b. Resources: {'cores', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:57:40.052764 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] cores quota exceeded for 017c1f4f15e74843967f012f18ecf41f, tried to resize instance. Jul 25 20:57:40.053319 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Request method failure captured: Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action HTTP/1.1 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 38 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wO4NTX1qGbRR2uGk9v1jl4qjPegbKXBZsjIUtBBBZGLsARtt-HgRp1XYxg0WENia-X64HlccY0i3lC5FFnb6Ml6PsXR0oWY83ldbOFYj8SnxkS5vBSljU8wllSUUsIbZWxxg5sdOLsE7imO95z0Qwy9Xc4gOJxvcUQ7xmps3xTzEmM Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 017c1f4f15e74843967f012f18ecf41f Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Role: admin,reader,member Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: admin,reader,member Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/017c1f4f15e74843967f012f18ecf41f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/017c1f4f15e74843967f012f18ecf41f"}]}] Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 017c1f4f15e74843967f012f18ecf41f Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1060637494 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersAdminNegativeTestJSON-1060637494-project-admin Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 9d56a607f5ac4c949461a7a13fe30a19 Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1060637494-project-admin Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: {"resize": {"flavorRef": "292994070"}} Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a17f453e-8b62-4855-b1a5-e6857b604643', 'body': {'resize': {'flavorRef': '292994070'}}} Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:40.055449 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea22d526-fd17-4552-bfc4-8b1dc3793c81 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action" status: 403 len: 113 microversion: 2.1 time: 0.208908 Jul 25 20:57:40.061756 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3138/6226] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:57:39 2022] POST /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643/action => generated 113 bytes in 210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:57:40.066291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c34ce494-9c49-4f62-a300-f01f54c7a13b tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:40.067046 n-d-845775-3 devstack@n-api.service[119723]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 20:57:40.067046 n-d-845775-3 devstack@n-api.service[119723]: warnings.warn(msg) Jul 25 20:57:40.083453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c34ce494-9c49-4f62-a300-f01f54c7a13b tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/292994070" status: 202 len: 0 microversion: 2.1 time: 0.020603 Jul 25 20:57:40.084341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3089/6227] 10.222.0.48 () {58 vars in 1158 bytes} [Mon Jul 25 20:57:40 2022] DELETE /compute/v2.1/flavors/292994070 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:57:40.092766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ca0ff97-9ba4-46c3-bfb8-5b1a53a9f2e4 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:40.113298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ca0ff97-9ba4-46c3-bfb8-5b1a53a9f2e4 tempest-ServersAdminNegativeTestJSON-1060637494 tempest-ServersAdminNegativeTestJSON-1060637494-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024810 Jul 25 20:57:40.113898 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3139/6228] 10.222.0.48 () {58 vars in 1146 bytes} [Mon Jul 25 20:57:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:40.133351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:40.133863 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:40.140027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.140513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.141282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.141723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.172503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:57:40.251589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a81d0400-1435-4fcf-bb20-32a164533770 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 204 len: 0 microversion: 2.1 time: 0.121826 Jul 25 20:57:40.252198 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3090/6229] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:57:40 2022] DELETE /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:57:40.260760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:40.261398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:40.268483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.268965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.269801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:40.270255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:40.413431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:40.422032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-53d17441-b1a4-44d1-b8ab-d7d7a1f8fe5e tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1478 microversion: 2.1 time: 0.165194 Jul 25 20:57:40.422613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3140/6230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:40 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1478 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:41.443303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:41.444068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:41.453004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:41.453499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:41.454338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:41.454783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:41.622426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '340cdf943ca747c3b0750005f550b174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb1803bc4ce491cb5f2d53b4c70091b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:41.632011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-14d0dceb-c2d3-4e8c-a879-42023c3d6646 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 200 len: 1478 microversion: 2.1 time: 0.192925 Jul 25 20:57:41.632502 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3091/6231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:41 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:42.061784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-f92ba958-01a3-46d8-8073-bf2926f348ca req-ae670da6-2f88-4376-a433-675395b77be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17f453e-8b62-4855-b1a5-e6857b604643", "name": "network-vif-deleted", "tag": "c9c8e4e2-64e8-4a9c-a847-8e1280b0a738"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:42.073043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f92ba958-01a3-46d8-8073-bf2926f348ca req-ae670da6-2f88-4376-a433-675395b77be0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:42.073511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-f92ba958-01a3-46d8-8073-bf2926f348ca req-ae670da6-2f88-4376-a433-675395b77be0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:42.091784 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-f92ba958-01a3-46d8-8073-bf2926f348ca req-ae670da6-2f88-4376-a433-675395b77be0 service nova] Creating event network-vif-deleted:c9c8e4e2-64e8-4a9c-a847-8e1280b0a738 for instance a17f453e-8b62-4855-b1a5-e6857b604643 on n-h2-845775-3 Jul 25 20:57:42.097175 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-f92ba958-01a3-46d8-8073-bf2926f348ca req-ae670da6-2f88-4376-a433-675395b77be0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039757 Jul 25 20:57:42.097792 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3141/6232] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:42.653420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:42.653981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] [instance: a17f453e-8b62-4855-b1a5-e6857b604643] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:42.661035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:42.661500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:42.662280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:42.662732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:42.676991 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] HTTP exception thrown: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Request method failure captured: Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 HTTP/1.1 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wO43m5WGAvO3cXM2MABDVTZoqW_egF-qslBGdpEPiTSFBlF7TCYkt0r4rBk1owGArLsGE7iT2u_-v4MGzTNu7ZBqSrhQ4B1P0rATv1O8Ov8nA8XnHkkf9qw-XNQpK3SG30WGKuOQjqYo2UuY3wpfdP1Nsd-Y3Cf9B6Jx0VU8mYyL4s Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: bcb1803bc4ce491cb5f2d53b4c70091b Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2110785890 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bcb1803bc4ce491cb5f2d53b4c70091b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bcb1803bc4ce491cb5f2d53b4c70091b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bcb1803bc4ce491cb5f2d53b4c70091b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bcb1803bc4ce491cb5f2d53b4c70091b"}]}] Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2110785890 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: bcb1803bc4ce491cb5f2d53b4c70091b Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2110785890 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersAdminNegativeTestJSON-2110785890-project Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 340cdf943ca747c3b0750005f550b174 Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2110785890-project Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a17f453e-8b62-4855-b1a5-e6857b604643'} Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:42.678656 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] Returning 404 to user: Instance a17f453e-8b62-4855-b1a5-e6857b604643 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-691e5ccf-4c28-4533-82a8-0a7c8e770ea1 tempest-ServersAdminNegativeTestJSON-2110785890 tempest-ServersAdminNegativeTestJSON-2110785890-project] 10.222.0.48 "GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643" status: 404 len: 111 microversion: 2.1 time: 0.030729 Jul 25 20:57:42.684381 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3092/6233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:42 2022] GET /compute/v2.1/servers/a17f453e-8b62-4855-b1a5-e6857b604643 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:57:49.164891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1549084257", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "d250c6e1-e4fd-4100-80ec-b62f2094cac2"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:49.226799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] validate_networks() for [('d250c6e1-e4fd-4100-80ec-b62f2094cac2', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:57:49.635286 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:57:49.635829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:57:49.636459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:57:49.636946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:57:49.637454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:57:49.647421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:49.647887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:49.648766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:49.649259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:49.666779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Getting quotas for project e9b4552e1003426cb284bf86f0eaaf1f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:57:49.673190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Getting quotas for user 28f0ebf239f74447a537a77d96b627b9 and project e9b4552e1003426cb284bf86f0eaaf1f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:57:49.687397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:57:49.689988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:57:49.737612 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0ebd58f-c18a-418b-adac-c0c6df25e32f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719137 Jul 25 20:57:49.738352 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3142/6234] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:57:49.751080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-26bab5a2-0bce-4560-a09b-0ac755ba4ede tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:49.752692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-26bab5a2-0bce-4560-a09b-0ac755ba4ede tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:49.757134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:49.758846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:49.820236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-26bab5a2-0bce-4560-a09b-0ac755ba4ede tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:49.827186 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-26bab5a2-0bce-4560-a09b-0ac755ba4ede tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1215 microversion: 2.1 time: 0.081476 Jul 25 20:57:49.827873 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3093/6235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:49 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:50.848568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:50.849295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:50.857282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:50.857821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:50.858844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:50.859356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:51.322278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:51.340450 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9b6b2792-3914-4178-8125-87d9ce73769b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1285 microversion: 2.1 time: 0.495892 Jul 25 20:57:51.341468 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3143/6236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:50 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1285 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:52.363387 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:52.364738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:52.379303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:52.380380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:52.381773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:52.382224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:52.661145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:52.675245 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-50a9c076-ba4a-4c96-92a1-f5d67264feb7 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.316069 Jul 25 20:57:52.678603 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3094/6237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:52 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:52.928566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c8306c9f-5c1d-4afe-87a7-e2fc721bc850 req-c60523a5-be64-4687-9f19-d1a24debe58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:52.947315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c8306c9f-5c1d-4afe-87a7-e2fc721bc850 req-c60523a5-be64-4687-9f19-d1a24debe58e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:52.948205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c8306c9f-5c1d-4afe-87a7-e2fc721bc850 req-c60523a5-be64-4687-9f19-d1a24debe58e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:52.962521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c8306c9f-5c1d-4afe-87a7-e2fc721bc850 req-c60523a5-be64-4687-9f19-d1a24debe58e service nova] Creating event network-changed:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h2-845775-3 Jul 25 20:57:52.968945 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c8306c9f-5c1d-4afe-87a7-e2fc721bc850 req-c60523a5-be64-4687-9f19-d1a24debe58e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045722 Jul 25 20:57:52.970163 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3144/6238] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:53.697879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:53.698539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:53.706195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:53.706657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:53.707438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:53.707885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:53.845356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:53.853104 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0b30a2b7-8fcb-4527-848f-cf2785d9a731 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.159169 Jul 25 20:57:53.853700 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3095/6239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:53 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:57:54.875934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:54.876683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:54.882953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:54.883425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:54.884246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:54.884707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:55.020200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:55.028418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1810d348-3373-4172-bf6d-cf5178e6bc62 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.157943 Jul 25 20:57:55.029283 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3145/6240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:54 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:56.049470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:56.050084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:56.057367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:56.057705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:56.058550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:56.058961 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:56.192350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:56.199813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7d2583dc-c231-4900-a4fc-d8e1f2e96b30 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.154325 Jul 25 20:57:56.200415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3096/6241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:56 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:57:57.221522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:57.222150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:57.228777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:57.229222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:57.229999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:57.230444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:57.363828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:57.377643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73b5d147-866d-493d-a5d3-d74bda2ae001 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.160094 Jul 25 20:57:57.378235 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3146/6242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:57 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:57.431678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5d7c08a4-488a-4bdd-9e33-9f8a241cb84e req-02e83b59-0528-4481-9f5f-acbbdffa21ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "name": "network-vif-plugged", "status": "completed", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:57.443689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d7c08a4-488a-4bdd-9e33-9f8a241cb84e req-02e83b59-0528-4481-9f5f-acbbdffa21ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:57.444178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5d7c08a4-488a-4bdd-9e33-9f8a241cb84e req-02e83b59-0528-4481-9f5f-acbbdffa21ab service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:57.460820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5d7c08a4-488a-4bdd-9e33-9f8a241cb84e req-02e83b59-0528-4481-9f5f-acbbdffa21ab service nova] Creating event network-vif-plugged:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h2-845775-3 Jul 25 20:57:57.466012 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5d7c08a4-488a-4bdd-9e33-9f8a241cb84e req-02e83b59-0528-4481-9f5f-acbbdffa21ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038061 Jul 25 20:57:57.466917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3097/6243] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:57:58.401237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:58.402143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:58.415086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:58.415672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:58.416811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:58.417467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:58.563427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:58.572447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-10ff8029-8360-4edb-8e6e-f6ce758e12bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1315 microversion: 2.1 time: 0.176426 Jul 25 20:57:58.573472 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3147/6244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:58 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:59.595798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:59.596528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:59.598414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.605482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.605964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:59.607386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.607851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:59.612531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.745949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:59.753905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4238496b-4eb6-4ccd-a255-7b95a825fa8d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1502 microversion: 2.1 time: 0.163729 Jul 25 20:57:59.754479 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3098/6245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:59 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:57:59.774249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:57:59.776603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:59.779975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.780706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=10 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.781387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.788466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.788941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:59.789741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.790214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:59.794821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=76 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.820970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:57:59.826946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:57:59.833254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:57:59.833690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:57:59.834179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:57:59.834614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:57:59.835039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:57:59.897998 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9037d33f-4926-4675-a749-d3927a50018d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "POST /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7/action" status: 202 len: 0 microversion: 2.1 time: 0.127522 Jul 25 20:57:59.898624 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3148/6246] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:57:59 2022] POST /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:57:59.907410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:57:59.907978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:57:59.909955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:57:59.915496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.915953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:57:59.916774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:57:59.917221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:00.055622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:00.063825 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76f727d5-892d-46c2-a244-a78be72e81a1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1511 microversion: 2.1 time: 0.160944 Jul 25 20:58:00.064449 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3099/6247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:57:59 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:01.086335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:01.086961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:01.096908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:01.097373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:01.098163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:01.098918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:01.228714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:01.236917 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-614386de-6442-438c-8fa5-71093264944f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1511 microversion: 2.1 time: 0.155378 Jul 25 20:58:01.237498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3149/6248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:01 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:02.258989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:02.259606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:02.266842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:02.267294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:02.268098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:02.268540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:02.413340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:02.421660 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-810c7b2b-2fc7-4bfe-bfe0-413fc8f40d5d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.166933 Jul 25 20:58:02.422237 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3100/6249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:02 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:03.443369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:03.443997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:03.451501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:03.451972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:03.452788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:03.453252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:03.591579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:03.599021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab738b3f-0a2f-4c03-8cae-4d4fb2b78451 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.159584 Jul 25 20:58:03.599592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3150/6250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:03 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:04.620472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:04.621077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:04.629721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:04.630189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:04.630962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:04.631401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:04.770954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:04.779007 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e45ac495-1638-4599-a128-4fb45ecb6870 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.163007 Jul 25 20:58:04.779607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3101/6251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:04 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:05.800482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:05.801272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:05.808080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:05.808562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:05.809353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:05.809811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:05.940981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:05.948473 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6b224f1d-86a8-4fd2-9119-511eedd64220 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.151951 Jul 25 20:58:05.949049 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3151/6252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:05 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:06.970612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:06.971217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:06.978157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:06.978614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:06.979378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:06.979829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:07.111750 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:07.119484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-394da09f-5550-42d3-8eab-a416525c3828 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.152793 Jul 25 20:58:07.120090 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3102/6253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:06 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:08.140338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:08.140951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:08.147906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:08.148480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:08.149267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:08.149725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:08.285817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:08.293953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-93029843-bacd-401f-8c40-eabac27572fb tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.157521 Jul 25 20:58:08.295074 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3152/6254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:08 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:09.315482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:09.316076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:09.323132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:09.323591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:09.324414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:09.325486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:09.462353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:09.469996 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-286ce719-b7b7-4ab3-9d40-b64892430f72 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.158553 Jul 25 20:58:09.470574 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3103/6255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:09 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:10.492097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:10.492728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:10.500323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:10.500794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:10.501588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:10.502076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:10.642294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:10.650381 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a79275b-c3d1-49a0-ac1e-82c41ae90a14 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.162447 Jul 25 20:58:10.650998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3153/6256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:10 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:11.672645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:11.673273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:11.680422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:11.680884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:11.681662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:11.682109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:11.817903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:11.826051 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-15c89918-2a31-4fa6-8f41-01e15fa8813d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.157667 Jul 25 20:58:11.826630 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3104/6257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:11 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:12.849891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:12.850528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:12.858063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:12.858533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:12.859323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:12.859784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:12.993408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:13.001225 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-972d67b4-d86e-4aaf-b650-7d44ce0e66ab tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.156925 Jul 25 20:58:13.001804 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3154/6258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:12 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:14.022683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:14.023300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:14.030923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:14.031477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:14.032324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:14.032771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:14.169983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:14.177746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b65f635-8254-480e-baaf-c5a666dff514 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.158959 Jul 25 20:58:14.178333 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3105/6259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:14 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:15.199328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:15.200639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:15.207788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:15.208300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:15.209091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:15.209549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:15.630017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:15.637873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d6e5f3c6-eea9-45b9-88e7-a933544076d1 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.442706 Jul 25 20:58:15.638452 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3155/6260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:15 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:16.659340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:16.659924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:16.667249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:16.667708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:16.668666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:16.669113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:16.807327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:16.815219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cbf5c692-d2c9-474e-a109-b516e2c646ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.160027 Jul 25 20:58:16.815785 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3106/6261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:16 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:17.837365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:17.838004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:17.845742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:17.846210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:17.847006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:17.847458 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:17.985519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:17.993271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-706a8be9-ef6b-437f-a32e-6c05ac2f572d tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.159884 Jul 25 20:58:17.993850 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3156/6262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:17 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:19.013678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:19.014348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:19.022085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:19.022543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:19.023327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:19.023770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:19.164315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:19.173202 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-276f25b2-f255-49db-a929-d86f1c1d9f34 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.163541 Jul 25 20:58:19.173789 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3107/6263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:19 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:20.195273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:20.195902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:20.203139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:20.204332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:20.205134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:20.205592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:20.350197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:20.357841 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9614e371-3a80-40b1-87d6-8c6520543011 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.166681 Jul 25 20:58:20.358423 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3157/6264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:20 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:21.379517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:21.380149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:21.387167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:21.387628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:21.388436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:21.388887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:21.537828 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:21.552013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-974f8c7c-e3ac-4f42-b745-27a2794be24e tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.176601 Jul 25 20:58:21.553141 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3108/6265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:21 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:21.948962 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 20:58:21.949263 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 20:58:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 20:58:22.576977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:22.577884 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:22.585425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:22.586172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:22.587456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:22.588320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:22.730308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:22.738574 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6ca7407-ddd6-4e18-bb0a-4d51b7fd8bea tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.165556 Jul 25 20:58:22.739150 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3158/6266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:22 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:23.759502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:23.760178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:23.767752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:23.768247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:23.769033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:23.769473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:23.901424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:23.909018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59bb35e5-1693-4a1b-8f58-9a0eafb963ee tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.153560 Jul 25 20:58:23.909585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3109/6267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:23 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:24.930495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:24.931113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:24.938772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:24.939237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:24.940056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:24.940502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:25.078288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:25.086600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8ba3855d-32df-4f68-8813-06b2dbcfcb70 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.160051 Jul 25 20:58:25.087182 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3159/6268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:24 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:58:26.108590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:26.109246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:26.117068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:26.117530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:26.118350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:26.118796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:26.252531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:26.260354 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5993c07-d2f8-46d4-8816-92683b709305 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.155608 Jul 25 20:58:26.260937 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3110/6269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:26 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:27.281743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:27.282383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:27.289152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:27.289625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:27.290411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:27.290867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:27.445455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:27.453332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb0b992d-d426-4638-9a2d-a9bf7ae8e06b tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.175656 Jul 25 20:58:27.453966 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3160/6270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:27 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:28.474816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:28.475432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:28.482830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:28.483286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:28.484155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:28.484844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:28.635012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:28.643801 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41169120-1479-4c71-9005-5c11489dcb74 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1516 microversion: 2.1 time: 0.172841 Jul 25 20:58:28.644438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3111/6271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:28 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:29.546044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "name": "network-vif-unplugged", "status": "completed", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:29.557413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:29.557987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:29.571812 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] Creating event network-vif-unplugged:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h1-845775-3 Jul 25 20:58:29.577398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:58:29.588776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5cce6d35-54f3-4150-acdd-4301eb535df8 req-4c1e478b-c977-458a-be05-85dc8698aa8b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046433 Jul 25 20:58:29.589742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3161/6272] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:58:29.664536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:29.665181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:29.668140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=28 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:29.679003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:29.679462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:29.680517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:29.681141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:29.684878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=84 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:29.922195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:29.931788 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-230bd7b7-cf01-43d9-89c3-2bcfbb2cc6ac tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1515 microversion: 2.1 time: 0.271439 Jul 25 20:58:29.933439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3112/6273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:29 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:30.957163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:30.958542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:30.960553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=32 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:30.966421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:30.966889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:30.967688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:30.968179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:30.971261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:31.106626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:31.114950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf4da0d6-a0cd-4001-ab35-fe1cdeb1d8ff tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1513 microversion: 2.1 time: 0.163843 Jul 25 20:58:31.115543 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3162/6274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:30 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:31.603251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:31.616249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:31.617689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:31.632545 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] Creating event network-changed:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h1-845775-3 Jul 25 20:58:31.639136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:58:31.652127 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-18ee4a2f-39d4-49d5-8bf4-7913b6bd2cc1 req-578d391d-6615-4501-82f9-1f967449fabb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052495 Jul 25 20:58:31.653374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3113/6275] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:58:32.140635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:32.141490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:32.148645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:32.149119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:32.149923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:32.150382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:32.789754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:32.797481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e4fafd0e-0309-408b-a689-5b50f381316f tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1513 microversion: 2.1 time: 0.663195 Jul 25 20:58:32.798583 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3163/6276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:32 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1513 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:33.819504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:33.820249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:33.827706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:33.828214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:33.829129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:33.829581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:33.962606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:33.971049 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f6b9c21-ac2c-4916-8143-3784a30171f8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1510 microversion: 2.1 time: 0.155610 Jul 25 20:58:33.971524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3114/6277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:33 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:33.992155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:33.992708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:33.999376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:33.999841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:34.000649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:34.001103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:34.026476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:58:34.076457 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Found an unconfirmed migration during delete, id: 16, status: finished Jul 25 20:58:35.038102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "name": "network-vif-plugged", "status": "completed", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:35.049421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:35.049851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:35.062433 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] Creating event network-vif-plugged:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h1-845775-3 Jul 25 20:58:35.069023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:58:35.080358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-950f69e1-4d07-41ac-81e1-d6227b4b5f73 req-d7a1949a-0311-40e8-97f1-5fe888221ad5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046581 Jul 25 20:58:35.080973 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3115/6278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:58:35.406787 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9547e50f-7406-4358-8226-d05747c5e24a tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "DELETE /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 204 len: 0 microversion: 2.1 time: 1.418013 Jul 25 20:58:35.407507 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3164/6279] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:58:33 2022] DELETE /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 0 bytes in 1419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:58:35.415813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:35.416558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:35.423718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:35.424223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:35.425005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:35.425453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:35.566045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:35.573728 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b7376179-19a9-485a-93ba-fc5fe11eb3a9 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1502 microversion: 2.1 time: 0.162172 Jul 25 20:58:35.574309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3116/6280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:35 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:36.596004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:36.596833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:36.603462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:36.603926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:36.604734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:36.605186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:36.740126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28f0ebf239f74447a537a77d96b627b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9b4552e1003426cb284bf86f0eaaf1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:36.747610 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a91f5873-60f4-40c3-bde3-6497540a76bd tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 200 len: 1502 microversion: 2.1 time: 0.156608 Jul 25 20:58:36.748211 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3165/6281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:36 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:37.263669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-effaaa92-ceca-447e-9b59-f809f7e12290 req-ea102ddc-93d5-4224-864f-c3cb8ffe45a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7", "name": "network-vif-deleted", "tag": "62d45ec2-40de-48cf-8973-8b506f161b04"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:37.275479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-effaaa92-ceca-447e-9b59-f809f7e12290 req-ea102ddc-93d5-4224-864f-c3cb8ffe45a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.275922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-effaaa92-ceca-447e-9b59-f809f7e12290 req-ea102ddc-93d5-4224-864f-c3cb8ffe45a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.291205 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-effaaa92-ceca-447e-9b59-f809f7e12290 req-ea102ddc-93d5-4224-864f-c3cb8ffe45a0 service nova] Creating event network-vif-deleted:62d45ec2-40de-48cf-8973-8b506f161b04 for instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 on n-h1-845775-3 Jul 25 20:58:37.296601 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-effaaa92-ceca-447e-9b59-f809f7e12290 req-ea102ddc-93d5-4224-864f-c3cb8ffe45a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036500 Jul 25 20:58:37.297221 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3117/6282] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:58:37.769329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:37.769966 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:37.785035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.785510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.786368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.786835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.801815 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] HTTP exception thrown: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Request method failure captured: Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 HTTP/1.1 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wPMAnUZPvhO2bdDsendg3iq3zhOW8291aclRofugbjcuD00wdcsu50JApSSQZ_Z20XUCu-6AHYfUCcP5CutVVYiWSM5cK03lp2qhwJapN4HKMo9dZ3FYDbhy-mOoGafD0GqWPGtyCWMwY1djaHMH6CM195O3gpJ6T_Wpsz_U5d0Tys Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}] Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 28f0ebf239f74447a537a77d96b627b9 Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7'} Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.803568 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Returning 404 to user: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed7fa461-1c19-4a06-aea0-2a18a44653d8 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 404 len: 111 microversion: 2.1 time: 0.040209 Jul 25 20:58:37.809329 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3166/6283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:37 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:58:37.821958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:37.822540 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:37.828948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.829909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.830668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.831106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.844273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] HTTP exception thrown: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Request method failure captured: Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 HTTP/1.1 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wPMAnUZPvhO2bdDsendg3iq3zhOW8291aclRofugbjcuD00wdcsu50JApSSQZ_Z20XUCu-6AHYfUCcP5CutVVYiWSM5cK03lp2qhwJapN4HKMo9dZ3FYDbhy-mOoGafD0GqWPGtyCWMwY1djaHMH6CM195O3gpJ6T_Wpsz_U5d0Tys Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}] Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 28f0ebf239f74447a537a77d96b627b9 Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7'} Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:58:37.846535 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Returning 404 to user: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-488e6ba0-62a4-499b-9a9f-61a8696dfa97 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "DELETE /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 404 len: 111 microversion: 2.1 time: 0.030222 Jul 25 20:58:37.852071 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3118/6284] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:58:37 2022] DELETE /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:58:37.856363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:37.856994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] [instance: 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:37.863060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.863521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.864329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:37.864780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:37.877906 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] HTTP exception thrown: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Request method failure captured: Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 HTTP/1.1 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wPMAnUZPvhO2bdDsendg3iq3zhOW8291aclRofugbjcuD00wdcsu50JApSSQZ_Z20XUCu-6AHYfUCcP5CutVVYiWSM5cK03lp2qhwJapN4HKMo9dZ3FYDbhy-mOoGafD0GqWPGtyCWMwY1djaHMH6CM195O3gpJ6T_Wpsz_U5d0Tys Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e9b4552e1003426cb284bf86f0eaaf1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e9b4552e1003426cb284bf86f0eaaf1f"}]}] Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: e9b4552e1003426cb284bf86f0eaaf1f Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860909239 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 28f0ebf239f74447a537a77d96b627b9 Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-DeleteServersTestJSON-1860909239-project Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7'} Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 20:58:37.879432 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] Returning 404 to user: Instance 72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e7d4a4a-4d19-45eb-a13b-82cc0740a8f4 tempest-DeleteServersTestJSON-1860909239 tempest-DeleteServersTestJSON-1860909239-project] 10.222.0.48 "GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7" status: 404 len: 111 microversion: 2.1 time: 0.028345 Jul 25 20:58:37.884993 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3167/6285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:37 2022] GET /compute/v2.1/servers/72ab4b1b-cfbc-4bfa-8f7b-d8639da0baf7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 20:58:46.613506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-998653825", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "af3dda91-7fb8-41d6-a8bf-4a8870554523"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:46.669390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] validate_networks() for [('af3dda91-7fb8-41d6-a8bf-4a8870554523', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:58:47.077183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:58:47.077617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:58:47.078111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:58:47.078530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:58:47.078989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:58:47.088055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:47.088546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:47.089356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:47.089802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:47.107713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for project 0752907ffdc949a88e694a1f147b957b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:58:47.114119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for user cf95ad6a27f94db0a88ec17fb5171cec and project 0752907ffdc949a88e694a1f147b957b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:58:47.127469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:58:47.129823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:58:47.181127 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1262e333-1123-4b06-9040-d3bbf803af3f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719118 Jul 25 20:58:47.182158 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3119/6286] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:58:47.193207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7e2dff7-3e9e-4eec-b636-ef8a3abaed4b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:47.193943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7e2dff7-3e9e-4eec-b636-ef8a3abaed4b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:47.255577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a7e2dff7-3e9e-4eec-b636-ef8a3abaed4b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:47.264925 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7e2dff7-3e9e-4eec-b636-ef8a3abaed4b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1217 microversion: 2.1 time: 0.075631 Jul 25 20:58:47.276064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3168/6287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:47 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:48.288426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:48.290015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:48.302165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:48.302942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:48.303947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:48.304576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:48.415421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:48.440464 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-43159d78-d7a4-4a5c-8e0a-0622f3386310 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1277 microversion: 2.1 time: 0.153080 Jul 25 20:58:48.441118 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3120/6288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:48 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:49.462837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:49.464738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:49.467374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:49.478596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:49.479077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:49.479890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:49.480385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:49.710321 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:49.718598 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b3ad21d-0cd4-4c0d-b0cf-18bd113b2e7a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.260062 Jul 25 20:58:49.723654 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3169/6289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:49 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:49.834110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f1083173-7772-471e-b174-015306b3936a req-ef883324-ee70-4566-96c9-79984c557618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:49.856331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f1083173-7772-471e-b174-015306b3936a req-ef883324-ee70-4566-96c9-79984c557618 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:49.856763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f1083173-7772-471e-b174-015306b3936a req-ef883324-ee70-4566-96c9-79984c557618 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:49.869614 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f1083173-7772-471e-b174-015306b3936a req-ef883324-ee70-4566-96c9-79984c557618 service nova] Creating event network-changed:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h1-845775-3 Jul 25 20:58:49.876712 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f1083173-7772-471e-b174-015306b3936a req-ef883324-ee70-4566-96c9-79984c557618 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048629 Jul 25 20:58:49.877995 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3121/6290] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:58:50.744502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:50.745067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:50.752464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:50.752990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:50.753787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:50.754248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:50.885703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:50.893909 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-50a7659e-f22b-44a2-9902-6be466958d7e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.153401 Jul 25 20:58:50.894463 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3170/6291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:50 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:51.916531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:51.917243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:51.923885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:51.924373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:51.925152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:51.925596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:52.059786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:52.068008 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec05df96-fa12-4ea6-af2b-d1d5fbe84da7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.156793 Jul 25 20:58:52.068614 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3122/6292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:51 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:53.089004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:53.089767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:53.096919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:53.097396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:53.098466 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:53.098934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:53.233102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:53.240861 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66bfc6f9-d6de-4bee-b8e1-c03ad9339770 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.155841 Jul 25 20:58:53.241448 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3171/6293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:53 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:54.262858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:54.263548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:54.271160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:54.271618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:54.272431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:54.272875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:54.406032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:54.414369 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11e9e842-a714-43d6-9ccf-8bc3279495c7 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.155424 Jul 25 20:58:54.414948 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3123/6294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:54 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:55.113302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b250a31e-ac08-478e-8bc9-ddb46e098cd8 req-2f95b8d9-5898-4483-ae6f-070fd1fee9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "name": "network-vif-plugged", "status": "completed", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:55.123896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b250a31e-ac08-478e-8bc9-ddb46e098cd8 req-2f95b8d9-5898-4483-ae6f-070fd1fee9b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:55.124630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b250a31e-ac08-478e-8bc9-ddb46e098cd8 req-2f95b8d9-5898-4483-ae6f-070fd1fee9b4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:55.137086 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b250a31e-ac08-478e-8bc9-ddb46e098cd8 req-2f95b8d9-5898-4483-ae6f-070fd1fee9b4 service nova] Creating event network-vif-plugged:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h1-845775-3 Jul 25 20:58:55.142375 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b250a31e-ac08-478e-8bc9-ddb46e098cd8 req-2f95b8d9-5898-4483-ae6f-070fd1fee9b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033486 Jul 25 20:58:55.143012 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3172/6295] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:58:55.434573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:55.435195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:55.442211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:55.442674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:55.443450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:55.443896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:55.575452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:55.584003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d154a580-6d68-4291-b602-040d564aafed tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1317 microversion: 2.1 time: 0.153270 Jul 25 20:58:55.584622 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3124/6296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:55 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:56.606436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:56.607145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:56.613555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.614022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:56.615139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.615598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:56.751248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:56.759544 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fabde125-732d-428d-acd1-b30cd73974d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1505 microversion: 2.1 time: 0.157884 Jul 25 20:58:56.760240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3173/6297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:56 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:56.782011 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:56.782727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:56.790302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.790759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:56.791534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.791973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:56.926386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:56.934063 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5490015a-8cd9-421a-a46f-f061b7a34959 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1505 microversion: 2.1 time: 0.157088 Jul 25 20:58:56.934650 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3125/6298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:56 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:56.954864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:56.957230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:56.963312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.963789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:56.964604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:56.965068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.035130 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df16f6ef-e15f-4ca9-84f0-a3538742d5b1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "PUT /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1077 microversion: 2.1 time: 0.084777 Jul 25 20:58:57.035758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3174/6299] 10.222.0.48 () {60 vars in 1256 bytes} [Mon Jul 25 20:58:56 2022] PUT /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1077 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:57.054152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:57.054808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:57.061318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.061777 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.062565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.063074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.096671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:57.121132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:57.202933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:57.210497 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0030c50-1425-47b8-8f15-35712593f1d3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1503 microversion: 2.1 time: 0.160530 Jul 25 20:58:57.211009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3126/6300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:57 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:57.229949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:57.230583 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:57.237438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.237909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.238697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.239156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.260366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:58:57.373816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:57.382136 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7760f04-02f0-440a-b013-0ff3bf89e31a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1503 microversion: 2.1 time: 0.156137 Jul 25 20:58:57.382709 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3175/6301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:57 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:57.402131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:58:57.404428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:57.410568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.411030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.411799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.412270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.486794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:57.492638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Old instance type m1.heat2, new instance type m1.heat {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:58:57.498747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:58:57.499267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:58:57.499749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:58:57.500197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:58:57.500618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:58:57.612978 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-634a8996-ed6c-437b-b8e2-8689b3259028 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198/action" status: 202 len: 0 microversion: 2.1 time: 0.214611 Jul 25 20:58:57.616790 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3127/6302] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:58:57 2022] POST /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:58:57.624317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:57.627806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:57.635392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.636007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.637226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:57.637809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:57.781343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:57.789623 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82ebe84c-96aa-449a-ba0b-d52d79c9ae40 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1514 microversion: 2.1 time: 0.171235 Jul 25 20:58:57.790188 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3176/6303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:57 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:58:58.812174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:58:58.812845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:58:58.820783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:58.821249 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:58.822048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:58:58.822492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:58:59.008017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:58:59.016345 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d382a7f7-a9b8-4850-84f0-02646afc389a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1514 microversion: 2.1 time: 0.208969 Jul 25 20:58:59.016966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3128/6304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:58:58 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:00.039419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:00.039989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:00.046878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:00.047341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:00.048145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:00.048605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:00.180290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:00.188478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-790c7c55-b2ed-4b02-8fc4-abf5a34a3387 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.152963 Jul 25 20:59:00.189739 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3177/6305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:00 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:01.211026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:01.211642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:01.214362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:01.221020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:01.221483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:01.222264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:01.222714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:01.225949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:01.361290 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:01.368905 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-209c4a6d-b2fd-4743-9a6a-044b09260c45 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.161836 Jul 25 20:59:01.369514 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3129/6306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:01 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:02.391484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:02.392340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:02.395492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:02.401028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:02.401510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:02.405438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:02.405438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:02.544556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:02.552827 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-969479c3-6222-4420-bc64-610232a86156 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.165639 Jul 25 20:59:02.553405 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3178/6307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:02 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:03.573958 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:03.574570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:03.581517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:03.581974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:03.582735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:03.583170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:03.718001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:03.726189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e6bec66-b5bc-45ae-b7fe-a1121f2759c3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.156113 Jul 25 20:59:03.726762 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3130/6308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:03 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:04.747490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:04.748133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:04.755189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:04.755639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:04.756616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:04.757074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:04.894357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:04.903218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-474bd2bf-307e-4be4-a179-f2f45c1aff0c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.159618 Jul 25 20:59:04.903808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3179/6309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:04 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:05.925328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:05.925945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:05.933353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:05.933813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:05.934594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:05.935045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:06.064414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:06.072535 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93aef1ee-fbe5-44e3-b1d7-38e93907157c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.151110 Jul 25 20:59:06.073116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3131/6310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:05 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:07.094424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:07.095047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:07.102081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:07.102555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:07.103348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:07.103810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:07.244441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:07.252509 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f695699f-39de-40fe-885f-6dae8a5abdcf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.162068 Jul 25 20:59:07.253092 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3180/6311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:07 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:08.275197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:08.275820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:08.283326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:08.283783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:08.284587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:08.285031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:08.417563 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:08.425749 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8eeed894-e01a-4286-94ac-c1540f346ea3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.155095 Jul 25 20:59:08.426857 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3132/6312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:08 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:09.450551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:09.451189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:09.460376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:09.460855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:09.461699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:09.462162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:09.599084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:09.606684 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36faa823-431c-4c62-8e02-861faa0280b4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.161229 Jul 25 20:59:09.607255 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3181/6313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:09 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:10.626874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:10.627451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:10.634941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:10.635391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:10.636191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:10.636638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:10.771873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:10.779373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4fc07856-5d85-4c08-a7d7-acd87644109c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.156517 Jul 25 20:59:10.779953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3133/6314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:10 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:11.803187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:11.803808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:11.809833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:11.810305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:11.811069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:11.811518 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:11.941858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:11.949393 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ca4995f-0c5e-46c8-b913-cb05aa242934 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.151272 Jul 25 20:59:11.949950 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3182/6315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:11 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:12.970308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:12.970929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:12.978564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:12.979017 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:12.979792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:12.980271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:13.116256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:13.123860 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-65b2c78a-d0f4-477d-a82e-d89a857a39af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.157472 Jul 25 20:59:13.124575 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3134/6316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:12 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:14.145912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:14.146503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:14.153688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:14.154153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:14.154938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:14.155387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:14.291418 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:14.299504 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7c96c41-b7a2-44d7-9296-21189737d453 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.157623 Jul 25 20:59:14.300107 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3183/6317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:14 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:15.321565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:15.322218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:15.329294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:15.329747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:15.330533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:15.330972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:15.466484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:15.474626 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a8b5197a-08b1-45a8-81ca-5edafd2d864b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.156901 Jul 25 20:59:15.475197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3135/6318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:15 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:16.495738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:16.496411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:16.503506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:16.504653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:16.505453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:16.505904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:16.641857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:16.649677 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-517d2335-2074-4e86-a40e-173fdcd93684 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.157887 Jul 25 20:59:16.650255 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3184/6319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:16 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:17.674225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:17.674890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:17.682376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:17.682836 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:17.683610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:17.684077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:17.814782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:17.822895 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a7366a1-1054-459f-b2e9-f598bb9cb3a1 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.152936 Jul 25 20:59:17.823468 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3136/6320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:17 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:18.844539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:18.845211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:18.852568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:18.853060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:18.853859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:18.854317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:18.872939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:19.330180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:19.338946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-49bffd95-9b8b-4f3a-bfd7-e1d4c08985dd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.498395 Jul 25 20:59:19.339531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3185/6321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:18 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:20.360568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:20.361183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:20.368113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:20.368565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:20.369330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:20.369762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:20.501616 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:20.509319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71ca38e1-9a59-478d-a72b-bc5c1c398c41 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.152731 Jul 25 20:59:20.509908 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3137/6322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:20 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:21.530813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:21.531364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:21.539203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:21.539676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:21.540506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:21.540971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:21.676905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:21.684837 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b25e3995-f2f1-4eda-9f75-1be6136ee290 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.157973 Jul 25 20:59:21.685418 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3186/6323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:21 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:22.706366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:22.706984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:22.714088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:22.714544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:22.715342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:22.715754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:22.846537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:22.854125 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c00820ee-9254-444a-a9e8-68c230a9ff62 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.151697 Jul 25 20:59:22.854713 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3138/6324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:22 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:23.874988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:23.875641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:23.883933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:23.884441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:23.885258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:23.885727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:24.034139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:24.042053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6e0a3b0-243f-44bf-a5a7-612e43861a09 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.171017 Jul 25 20:59:24.042656 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3187/6325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:23 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:25.064202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:25.064936 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:25.072494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:25.072956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:25.073733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:25.074181 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:25.211932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:25.219827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-75fc42cc-7392-4c28-8ffb-53991ae363af tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.159635 Jul 25 20:59:25.220742 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3139/6326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:25 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:26.243594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:26.244266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:26.251391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:26.251864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:26.252735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:26.253190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:26.398032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:26.405929 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b623f7e-0008-4ffc-9ede-c8c0d11026fb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1519 microversion: 2.1 time: 0.168697 Jul 25 20:59:26.406519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3188/6327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:26 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:27.291316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "name": "network-vif-unplugged", "status": "completed", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:27.303461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:27.303977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:27.319301 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] Creating event network-vif-unplugged:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h2-845775-3 Jul 25 20:59:27.326186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] Instance cbdf90b0-22ee-4680-be35-addd0587d198 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:59:27.346351 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c052495e-272e-40f7-911d-6c0923bd18fb req-964e9a44-5ce6-46c8-9eee-c0b7cf86c8d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145153 Jul 25 20:59:27.347339 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3140/6328] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:59:27.429923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:27.431467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:27.439233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:27.439836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:27.441219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:27.441682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:27.738063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:27.745605 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-13c3e8b8-04f5-443f-80a0-98e2f464dbe8 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1518 microversion: 2.1 time: 0.321613 Jul 25 20:59:27.746172 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3189/6329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:27 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1518 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:28.771611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:28.772347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:28.780172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:28.780714 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:28.781511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:28.781955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:28.979656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:28.988209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-60865085-2e2d-4b3a-90ac-4e41a206953c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1516 microversion: 2.1 time: 0.221379 Jul 25 20:59:28.988901 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3141/6330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:28 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:29.365308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:29.375732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:29.376237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:29.390724 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] Creating event network-changed:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h2-845775-3 Jul 25 20:59:29.397187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] Instance cbdf90b0-22ee-4680-be35-addd0587d198 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 20:59:29.410371 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-865753cc-c494-4508-afd0-a0d79610a643 req-aa5e3737-7747-460a-ae69-af262521dde1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049694 Jul 25 20:59:29.411228 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3190/6331] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:59:30.010716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:30.011379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:30.018602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.019082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.019915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.020445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.344699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:30.354327 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f2e80df-267e-47a0-aff6-be9cfa4ba900 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1513 microversion: 2.1 time: 0.347733 Jul 25 20:59:30.355576 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3142/6332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:30 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:30.378517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:30.379254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:30.386935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.387407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.388259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.388721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.452096 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1cc99dc0-bcb7-4ac4-8254-f9938760080d tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198/action" status: 204 len: 0 microversion: 2.1 time: 0.078521 Jul 25 20:59:30.452761 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3191/6333] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:59:30 2022] POST /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:59:30.464229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:30.465848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:30.473608 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.474481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.475392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:30.475867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:30.699436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:30.707997 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-46accc1a-180b-43ad-a487-3b09e706cead tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1513 microversion: 2.1 time: 0.250808 Jul 25 20:59:30.708626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3143/6334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:30 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:59:31.732116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:31.733207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:31.740883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:31.741726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:31.742550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:31.742989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:31.914711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:31.927002 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-025d1bb9-d1b0-469f-bfc6-9bcfd3662584 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1513 microversion: 2.1 time: 0.199807 Jul 25 20:59:31.927846 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3192/6335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:31 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:32.950910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:32.951529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:32.954501 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=30 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:32.961283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:32.961703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:32.962483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:32.962924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:32.965919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=88 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:33.111110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:33.120475 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1929479a-51bc-46e1-a35a-8a3ada438b57 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1505 microversion: 2.1 time: 0.173626 Jul 25 20:59:33.121074 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3144/6336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:32 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:33.148860 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:33.149502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:33.152437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=30 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:33.158293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:33.158771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:33.159570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:33.160182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:33.300951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:33.309539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82a92c87-a8e8-4ce9-b21b-06761d833844 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1505 microversion: 2.1 time: 0.164641 Jul 25 20:59:33.310127 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3193/6337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:33 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:33.337996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b0c7c6bc-fef2-42e1-ac65-5b436c3af5c9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'create', calling method: .version_select at 0x7f19688ddf70>, body: {"keypair": {"name": "tempest-keypair-844511376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0w1bkq3zHX/znXewFychu4CKEjAD/UV/pfWUPFw3qrRh/oFfJ3TWI9Le1FNzmNdMcs6BnEx7sSRs2fFHqKWngAPGCoa3XWJW4TVt0HD4Ye2g+C0wJ8vXFC8lOkjqgzNA=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:33.356447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b0c7c6bc-fef2-42e1-ac65-5b436c3af5c9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for project 0752907ffdc949a88e694a1f147b957b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:59:33.363292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b0c7c6bc-fef2-42e1-ac65-5b436c3af5c9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for user cf95ad6a27f94db0a88ec17fb5171cec and project 0752907ffdc949a88e694a1f147b957b. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:59:33.397103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b0c7c6bc-fef2-42e1-ac65-5b436c3af5c9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064817 Jul 25 20:59:33.397959 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3145/6338] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 20:59:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:59:33.988073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5caafd41-f3ec-4cc4-b289-655da4e9e0b3 req-8a379e00-6bb9-416f-9ed6-7b7defb5eeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "name": "network-vif-plugged", "status": "completed", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:34.008494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5caafd41-f3ec-4cc4-b289-655da4e9e0b3 req-8a379e00-6bb9-416f-9ed6-7b7defb5eeca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:34.009646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5caafd41-f3ec-4cc4-b289-655da4e9e0b3 req-8a379e00-6bb9-416f-9ed6-7b7defb5eeca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:34.037158 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5caafd41-f3ec-4cc4-b289-655da4e9e0b3 req-8a379e00-6bb9-416f-9ed6-7b7defb5eeca service nova] Creating event network-vif-plugged:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h2-845775-3 Jul 25 20:59:34.047281 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5caafd41-f3ec-4cc4-b289-655da4e9e0b3 req-8a379e00-6bb9-416f-9ed6-7b7defb5eeca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174050 Jul 25 20:59:34.048403 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3194/6339] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:59:34.742463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:34.743065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:34.750390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:34.750847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:34.751932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:34.752422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:34.915363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:34.923786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bca7c551-a461-456f-b7bd-456b6b4a2cd9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 200 len: 1505 microversion: 2.1 time: 0.186559 Jul 25 20:59:34.924421 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3146/6340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:34 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:59:34.946550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:34.947114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:34.953764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:34.954316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:34.955126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:34.955599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:34.982618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 20:59:35.066314 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-716c503e-92f7-48e8-8d7e-562a651f8d0b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 204 len: 0 microversion: 2.1 time: 0.125361 Jul 25 20:59:35.067269 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3195/6341] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 20:59:34 2022] DELETE /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 20:59:35.145587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1903679386", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "af3dda91-7fb8-41d6-a8bf-4a8870554523"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:35.206457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] validate_networks() for [('af3dda91-7fb8-41d6-a8bf-4a8870554523', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 20:59:35.646880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:59:35.647664 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:59:35.648254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:59:35.648719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:59:35.649455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:59:35.661151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:35.661838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:35.663220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:35.663995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:35.686970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for project 0752907ffdc949a88e694a1f147b957b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 20:59:35.693431 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Getting quotas for user cf95ad6a27f94db0a88ec17fb5171cec and project 0752907ffdc949a88e694a1f147b957b. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 20:59:35.710302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 20:59:35.712751 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 20:59:35.761871 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08e88f1b-5e1b-4542-8ab3-755989294721 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620805 Jul 25 20:59:35.762588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3147/6342] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 20:59:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 20:59:35.774972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b72e288b-9557-4017-8506-0536cc090c6e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:35.775704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b72e288b-9557-4017-8506-0536cc090c6e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:35.845756 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b72e288b-9557-4017-8506-0536cc090c6e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:35.854552 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b72e288b-9557-4017-8506-0536cc090c6e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1218 microversion: 2.1 time: 0.084358 Jul 25 20:59:35.855328 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3196/6343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:35 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:36.880749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:36.882498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:36.892343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:36.892796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:36.893570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:36.894001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:36.982159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:36.993773 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0edfae20-bd98-4be3-b801-2e831023a4cc tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1270 microversion: 2.1 time: 0.120074 Jul 25 20:59:36.994693 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3148/6344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:36 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:37.475924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e67d145f-be34-4191-a280-a50f4af11797 req-b93c49b1-63ca-40d2-88ec-1f9113e81a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdf90b0-22ee-4680-be35-addd0587d198", "name": "network-vif-deleted", "tag": "98afcc1a-1ca8-4a08-bfcd-411987c6d7bf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:37.490034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e67d145f-be34-4191-a280-a50f4af11797 req-b93c49b1-63ca-40d2-88ec-1f9113e81a1c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:37.490034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e67d145f-be34-4191-a280-a50f4af11797 req-b93c49b1-63ca-40d2-88ec-1f9113e81a1c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:37.507125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e67d145f-be34-4191-a280-a50f4af11797 req-b93c49b1-63ca-40d2-88ec-1f9113e81a1c service nova] Creating event network-vif-deleted:98afcc1a-1ca8-4a08-bfcd-411987c6d7bf for instance cbdf90b0-22ee-4680-be35-addd0587d198 on n-h2-845775-3 Jul 25 20:59:37.521955 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e67d145f-be34-4191-a280-a50f4af11797 req-b93c49b1-63ca-40d2-88ec-1f9113e81a1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049855 Jul 25 20:59:37.522994 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3197/6345] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:59:38.018846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:38.019594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:38.027989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:38.028478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:38.029258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:38.029713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:38.200174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:38.210174 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-660acae5-7f8b-4023-90f3-c1893f233889 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.196630 Jul 25 20:59:38.224620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3149/6346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:38 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:38.921968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-12399fb7-37a8-42b5-a79f-746a72cf94ff req-b9bbff12-8028-4230-b996-02b7a410361e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:38.932832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12399fb7-37a8-42b5-a79f-746a72cf94ff req-b9bbff12-8028-4230-b996-02b7a410361e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:38.933450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12399fb7-37a8-42b5-a79f-746a72cf94ff req-b9bbff12-8028-4230-b996-02b7a410361e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:38.947498 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-12399fb7-37a8-42b5-a79f-746a72cf94ff req-b9bbff12-8028-4230-b996-02b7a410361e service nova] Creating event network-changed:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h2-845775-3 Jul 25 20:59:38.954887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-12399fb7-37a8-42b5-a79f-746a72cf94ff req-b9bbff12-8028-4230-b996-02b7a410361e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131793 Jul 25 20:59:38.956178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3198/6347] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 20:59:39.233413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:39.234444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:39.242238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:39.242691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:39.243473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:39.243914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:39.383856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:39.391564 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01109b4c-ccee-4223-a0a4-527f53aa6fc5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.162064 Jul 25 20:59:39.392116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3150/6348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:39 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:40.414359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:40.415080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:40.422109 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:40.422521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:40.423326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:40.423780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:41.002190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:41.010027 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-221e6505-d841-4917-bad0-c5b9bb7c4e95 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.600978 Jul 25 20:59:41.010604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3199/6349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:40 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:42.033761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:42.034626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:42.045033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:42.045748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:42.046544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:42.047550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:42.233044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:42.241463 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f471baa0-4d92-4b60-9fa8-7db093cc783e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.213673 Jul 25 20:59:42.242293 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3151/6350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:42 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:43.263131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:43.263798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:43.271750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:43.272259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:43.273067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:43.273525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:43.405536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:43.413154 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64016d2b-0116-496d-a128-0ef4d5ee373a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.154157 Jul 25 20:59:43.413754 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3200/6351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:43 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:44.072699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2990ee2e-b08a-4807-a7dd-c508a664f10f req-339cb5a9-7204-4c48-9b1e-f0c8db814365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "name": "network-vif-plugged", "status": "completed", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:44.087521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2990ee2e-b08a-4807-a7dd-c508a664f10f req-339cb5a9-7204-4c48-9b1e-f0c8db814365 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:44.087979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2990ee2e-b08a-4807-a7dd-c508a664f10f req-339cb5a9-7204-4c48-9b1e-f0c8db814365 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:44.100066 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2990ee2e-b08a-4807-a7dd-c508a664f10f req-339cb5a9-7204-4c48-9b1e-f0c8db814365 service nova] Creating event network-vif-plugged:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h2-845775-3 Jul 25 20:59:44.109215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2990ee2e-b08a-4807-a7dd-c508a664f10f req-339cb5a9-7204-4c48-9b1e-f0c8db814365 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036893 Jul 25 20:59:44.109215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3152/6352] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 20:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 20:59:44.434262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:44.435001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:44.442359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:44.442840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:44.443648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:44.444151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:44.589366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:44.597565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ff68c518-3349-4208-abdd-2d5917a8535b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1318 microversion: 2.1 time: 0.167130 Jul 25 20:59:44.598087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3201/6353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:44 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:59:45.620479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:45.621197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:45.628787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:45.629196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:45.630020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:45.630467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:45.674861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:45.701306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:45.784562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:45.793739 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d5c6ba2c-b149-437a-95b2-04c75d90d2cd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1506 microversion: 2.1 time: 0.177971 Jul 25 20:59:45.794356 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3153/6354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:45 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:59:45.814698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:45.815348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:45.823399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:45.823878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:45.824730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:45.825203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:45.853417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:45.978076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:45.980400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 20:59:45.987316 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63c8fd93-8b87-49a9-9ed9-2bf4ea3b0098 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1506 microversion: 2.1 time: 0.176669 Jul 25 20:59:45.987926 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3202/6355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:45 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:46.009526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 20:59:46.011829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:46.018780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:46.019260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:46.020197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:46.020799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:46.052147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:46.062187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Old instance type m1.heat2, new instance type m1.heat {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 20:59:46.069816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 20:59:46.070236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 20:59:46.070709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 20:59:46.071115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 20:59:46.071525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 20:59:46.145896 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5a577838-39ac-46b4-abc4-7bca5f4a68cb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18/action" status: 202 len: 0 microversion: 2.1 time: 0.140222 Jul 25 20:59:46.149512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3154/6356] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 20:59:46 2022] POST /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 20:59:46.165808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:46.166453 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:46.188794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:46.189176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:46.190174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:46.190723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:46.552674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:46.560914 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bddc4732-2dfd-4ab4-b178-13b395421540 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1513 microversion: 2.1 time: 0.400247 Jul 25 20:59:46.561504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3203/6357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:46 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:47.585464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:47.586307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:47.596949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:47.597432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:47.599209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:47.599376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:47.749384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:47.758247 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ebd2d953-836a-41ca-a243-c23ffb9569b9 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1513 microversion: 2.1 time: 0.178425 Jul 25 20:59:47.758842 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3155/6358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:47 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 20:59:48.779130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:48.779764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:48.789030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:48.789504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:48.790319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:48.790778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:48.943571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:48.951199 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b73be652-5c93-4bca-bab9-1459e5cacf79 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.176032 Jul 25 20:59:48.951779 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3204/6359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:48 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:49.973471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:49.974215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:49.981034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:49.981495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:49.982360 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:49.982743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:50.214581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:50.222135 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6d0ca97-c468-4866-9fc4-42e7c6c0cfd3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.253553 Jul 25 20:59:50.222842 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3156/6360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:49 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:51.245399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:51.246027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:51.252121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:51.252599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:51.253388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:51.253846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:51.390343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:51.397645 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f2bf234f-b08b-4f2b-b666-2b7e915ba2ee tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.157288 Jul 25 20:59:51.398225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3205/6361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:51 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:52.419094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:52.419730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:52.428596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:52.429363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:52.430248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:52.430760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:52.565356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:52.573672 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb811502-fca4-4975-82d1-5299b8e7e546 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.158516 Jul 25 20:59:52.574498 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3157/6362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:52 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:53.596115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:53.596704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:53.603824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:53.604324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:53.605116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:53.605568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:53.740183 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:53.747761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c8387839-5878-4620-afa5-29d463c509f6 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.155970 Jul 25 20:59:53.748453 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3206/6363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:53 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:54.768905 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:54.770132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:54.777284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:54.777743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:54.778517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:54.778962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:54.917381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:54.926236 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-be8927a4-3e15-4703-88b5-f2f28338468c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.160738 Jul 25 20:59:54.926812 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3158/6364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:54 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:55.948426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:55.949132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:55.956347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:55.956824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:55.958260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:55.958721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:56.094303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:56.102700 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5cd131ba-47ba-41df-a652-06f5bf2df6b0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.158358 Jul 25 20:59:56.103277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3207/6365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:55 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:57.125060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:57.125597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:57.133453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:57.134070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:57.134674 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:57.135225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:57.275312 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:57.283224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e1fc94fa-30b8-4e56-9eae-70bb94045e4e tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.162175 Jul 25 20:59:57.283805 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3159/6366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:57 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:58.305613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:58.306244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:58.313041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:58.313507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:58.314299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:58.314757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:58.454709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:58.462253 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09ad2773-5cbc-45e7-a019-d00494dc1990 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.161215 Jul 25 20:59:58.462824 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3208/6367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:58 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 20:59:59.484595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 20:59:59.485216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 20:59:59.492744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:59.493207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:59.493978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 20:59:59.494421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 20:59:59.629660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 20:59:59.637291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df4621d9-a9cb-470d-8a24-c4692f8fd42c tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.156535 Jul 25 20:59:59.637869 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3160/6368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 20:59:59 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:00.663716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:00.664517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:00.674362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:00.674834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:00.675767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:00.676292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:00.809635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:00.817930 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4187f001-10a3-4d9d-812d-13390d3305d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.159277 Jul 25 21:00:00.818510 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3209/6369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:00 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:01.839120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:01.839771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:01.847197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:01.848269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:01.849052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:01.849494 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:01.993020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:01.995223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:02.002557 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-738c0fbf-acc0-4432-8f9c-0a3be7136bea tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.167395 Jul 25 21:00:02.003320 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3161/6370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:01 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:02.333835 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:00:02.334357 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:00:02.477291 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:00:02.477436 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:00:03.025864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:03.026500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:03.034677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:03.035700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:03.036559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:03.037015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:03.176896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:03.184656 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6d607a29-cecf-481b-a7ea-0eebb1c2b3ae tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.163308 Jul 25 21:00:03.185221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3210/6371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:03 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:04.206144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:04.207007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:04.210099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:04.216322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:04.216775 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:04.217556 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:04.218001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:04.378232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:04.386639 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b6271a12-7513-4d2a-a22f-a129a89ab8a2 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.184659 Jul 25 21:00:04.387236 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3162/6372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:04 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:00:05.410765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:05.411395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:05.414141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:05.419566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:05.420153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:05.421942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:05.422391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:05.565640 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:05.573397 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62384ac0-6e4a-472d-96ef-eae0760eb64f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.167126 Jul 25 21:00:05.574013 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3211/6373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:05 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:06.595445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:06.595974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:06.602571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:06.603023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:06.603792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:06.604281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:06.753123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:06.762263 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f893468-020e-4604-b63d-6775e10b6dcd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.171116 Jul 25 21:00:06.762899 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3163/6374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:06 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:07.790930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:07.791865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:07.802081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:07.802854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:07.803857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:07.804588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:07.947840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:07.955894 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3d7f476-ee54-440a-9b7d-f863190443fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.170631 Jul 25 21:00:07.956602 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3212/6375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:07 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:08.978203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:08.978847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:08.985924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:08.986383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:08.987162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:08.987613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:09.122438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:09.130291 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e426980c-52da-44fa-96aa-715692a4311a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.155948 Jul 25 21:00:09.130861 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3164/6376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:08 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:10.151981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:10.152671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:10.162303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:10.162773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:10.164223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:10.164988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:10.310580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:10.319864 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b34e0388-b1c3-429e-bd89-3d324f7007fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.171830 Jul 25 21:00:10.320481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3213/6377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:10 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:11.346896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:11.347404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:11.356203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:11.356668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:11.357452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:11.357899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:11.491158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:11.499080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d829bfa-2994-4476-9c6f-7d0694559a5f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.158774 Jul 25 21:00:11.500174 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3165/6378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:11 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:12.520745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:12.521415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:12.528781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:12.529234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:12.530040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:12.530498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:12.689674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:12.702981 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b2c73b05-523b-42a0-a2cb-4fb9871e64fd tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.186249 Jul 25 21:00:12.703631 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3214/6379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:12 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:13.725041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:13.725668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:13.732779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:13.733239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:13.734022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:13.734470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:13.872793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:13.880597 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aefdd76f-9a70-46b3-a299-88f1b14b07fa tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.159382 Jul 25 21:00:13.881811 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3166/6380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:13 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:14.905579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:14.906257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:14.913493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:14.913904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:14.914708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:14.915170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:15.051393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:15.059775 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-556d3974-78ef-4f15-8388-fd96c31ed57a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1518 microversion: 2.1 time: 0.158454 Jul 25 21:00:15.060641 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3215/6381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:14 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:15.867677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "name": "network-vif-unplugged", "status": "completed", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:15.878771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:15.879217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:15.896703 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] Creating event network-vif-unplugged:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h1-845775-3 Jul 25 21:00:15.903480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] Instance fd77fe37-0a24-4582-86e3-e979749c2f18 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:00:15.916950 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8241a8e3-e0cb-432b-951c-f4425791d07f req-1850a407-f085-486e-9ad7-4264077d8c28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116222 Jul 25 21:00:15.917900 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3167/6382] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:16.083262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:16.084544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:16.092378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:16.092851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:16.093791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:16.094252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:16.347459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:16.349976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=84 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:16.356551 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9a5ddc8-11cc-4ad9-bf5d-83ecad06cbc3 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1517 microversion: 2.1 time: 0.277577 Jul 25 21:00:16.357142 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3216/6383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:16 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:17.379516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:17.380258 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:17.388456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:17.388939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:17.389722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:17.390161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:17.533280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:17.541034 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e6c4c03a-a65d-4f09-b8d1-19042ea8a909 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1515 microversion: 2.1 time: 0.166656 Jul 25 21:00:17.541609 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3168/6384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:17 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:17.932746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:17.943978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:17.944500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:17.956777 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] Creating event network-changed:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h1-845775-3 Jul 25 21:00:17.962194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] Instance fd77fe37-0a24-4582-86e3-e979749c2f18 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:00:17.973483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-28abf9c2-052a-4337-add9-2bb35353dda7 req-8423f5ae-a9d7-4fef-9a53-692f86985654 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044621 Jul 25 21:00:17.974131 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3217/6385] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:18.563604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:18.564348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:18.571695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.572260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:18.573129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.573640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:18.772078 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:18.779866 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b9cf68b5-b82d-48c7-89cd-d893a2660ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1512 microversion: 2.1 time: 0.220894 Jul 25 21:00:18.780514 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3169/6386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:18 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:18.800885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:18.801533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:18.808290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.808764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:18.809572 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.810092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:18.870851 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d23b56e9-dfcc-4ede-bca1-4bcb333374d0 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "POST /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18/action" status: 204 len: 0 microversion: 2.1 time: 0.073399 Jul 25 21:00:18.871935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3218/6387] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:00:18 2022] POST /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:00:18.881974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:18.882773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:18.889609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.890406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:18.891318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:18.891803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:19.039284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:19.048579 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fc00e5a9-7c00-4047-bc8a-9ba873dc0911 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1512 microversion: 2.1 time: 0.171311 Jul 25 21:00:19.049758 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3170/6388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:18 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:20.074751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.075519 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.082865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.083337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.084241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.084701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.231761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:20.239808 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-15417fd7-d97c-4c57-8e3a-62553bb2073a tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1504 microversion: 2.1 time: 0.170327 Jul 25 21:00:20.240708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3219/6389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:20 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:20.261445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.262060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.269125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.269564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.270446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.271896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.409315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:20.416935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e0c77ab-af6f-4496-8ff0-c43516974ae4 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1504 microversion: 2.1 time: 0.159590 Jul 25 21:00:20.417696 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3171/6390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:20 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:20.438549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.439190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.445962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.446434 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.447229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.447688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.582585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:20.590409 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5c944f38-2b18-438e-8dcd-f58230483395 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1504 microversion: 2.1 time: 0.156052 Jul 25 21:00:20.590914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3220/6391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:20 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:20.610161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.610665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.617245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.617703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.618469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.618910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.644316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:00:20.720746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f73b8e6b-8a51-409c-bd29-0054cbd955b5 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 204 len: 0 microversion: 2.1 time: 0.113945 Jul 25 21:00:20.721569 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3172/6392] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:00:20 2022] DELETE /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:00:20.735311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.735824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.742499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.742965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.743744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.744227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.770723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:00:20.816045 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.compute.api [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Instance is already in deleting state, ignoring this request Jul 25 21:00:20.816900 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57037cdc-93cb-4dca-aaca-bd130e119c56 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 204 len: 0 microversion: 2.1 time: 0.085632 Jul 25 21:00:20.817473 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3221/6393] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:00:20 2022] DELETE /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:00:20.826112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:20.826870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:20.832981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.833441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.834220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:20.834666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:20.968199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:20.976363 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e9f3cdc-6b16-4c19-a4df-96068352d112 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1510 microversion: 2.1 time: 0.154577 Jul 25 21:00:20.976944 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3173/6394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:20 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:00:21.653174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3e71124a-782e-470c-a9e0-f0e037505574 req-c42a5915-2c18-4684-bc27-5a5861d6d41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "name": "network-vif-plugged", "status": "completed", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:21.663478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3e71124a-782e-470c-a9e0-f0e037505574 req-c42a5915-2c18-4684-bc27-5a5861d6d41e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:21.663949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3e71124a-782e-470c-a9e0-f0e037505574 req-c42a5915-2c18-4684-bc27-5a5861d6d41e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:21.675390 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3e71124a-782e-470c-a9e0-f0e037505574 req-c42a5915-2c18-4684-bc27-5a5861d6d41e service nova] Creating event network-vif-plugged:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h1-845775-3 Jul 25 21:00:21.682734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3e71124a-782e-470c-a9e0-f0e037505574 req-c42a5915-2c18-4684-bc27-5a5861d6d41e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083701 Jul 25 21:00:21.683582 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3222/6395] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:21.997391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:21.997998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:22.005653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:22.006185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:22.007075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:22.007521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:22.144274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:22.152505 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d371c847-d18c-4113-8734-9ffc53e9e76f tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1510 microversion: 2.1 time: 0.159175 Jul 25 21:00:22.153086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3174/6396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:21 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:22.670846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-97fd20cd-f8fd-4c67-bf0d-af178d80fee0 req-32ccbe98-aea4-44b1-913e-b6029e722d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd77fe37-0a24-4582-86e3-e979749c2f18", "name": "network-vif-deleted", "tag": "9c751c15-334d-4744-9db0-be4c82a97f96"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:22.681945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-97fd20cd-f8fd-4c67-bf0d-af178d80fee0 req-32ccbe98-aea4-44b1-913e-b6029e722d5b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:22.682648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-97fd20cd-f8fd-4c67-bf0d-af178d80fee0 req-32ccbe98-aea4-44b1-913e-b6029e722d5b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:22.695565 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-97fd20cd-f8fd-4c67-bf0d-af178d80fee0 req-32ccbe98-aea4-44b1-913e-b6029e722d5b service nova] Creating event network-vif-deleted:9c751c15-334d-4744-9db0-be4c82a97f96 for instance fd77fe37-0a24-4582-86e3-e979749c2f18 on n-h1-845775-3 Jul 25 21:00:22.700759 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-97fd20cd-f8fd-4c67-bf0d-af178d80fee0 req-32ccbe98-aea4-44b1-913e-b6029e722d5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035067 Jul 25 21:00:22.701278 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3223/6397] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:23.178944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:23.179516 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:23.186748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:23.187196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:23.187955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:23.188422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:23.218422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:23.218871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:23.219323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lazy-loading 'fault' on Instance uuid fd77fe37-0a24-4582-86e3-e979749c2f18 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:00:23.264629 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf95ad6a27f94db0a88ec17fb5171cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0752907ffdc949a88e694a1f147b957b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:23.273034 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-718e8d6e-b912-4e35-abf3-5171e12f69ba tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 200 len: 1306 microversion: 2.1 time: 0.102252 Jul 25 21:00:23.273620 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3175/6398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:23 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:24.295789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:24.296556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: fd77fe37-0a24-4582-86e3-e979749c2f18] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:24.303386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:24.303862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:24.304688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:24.305161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:24.323850 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] HTTP exception thrown: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Request method failure captured: Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 HTTP/1.1 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wQGx4A2y13cjjHwz7ojP0kWTvvKH-Z7w5BuKM7YTr2D--yLJsjysyH4qfdUIaZi-5BwIH_vAWeqqldpezDrI-eP_-dDEbdNDZgG8cdgEsJanY55mYxdYVOyVEf_qkwYxIXFWKFuJyleMQGwU6Ws43Lm9bi_K8vx5bJgKULiU-MxUHs Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0752907ffdc949a88e694a1f147b957b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}] Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: cf95ad6a27f94db0a88ec17fb5171cec Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'fd77fe37-0a24-4582-86e3-e979749c2f18'} Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:24.326164 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Returning 404 to user: Instance fd77fe37-0a24-4582-86e3-e979749c2f18 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a561f9c5-aaba-4e56-82bb-d32b070cca1b tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18" status: 404 len: 111 microversion: 2.1 time: 0.037759 Jul 25 21:00:24.333539 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3224/6399] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:24 2022] GET /compute/v2.1/servers/fd77fe37-0a24-4582-86e3-e979749c2f18 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:00:24.338762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-05a5cc2b-052a-425d-a128-16b92e45c947 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '.version_select at 0x7f19687dd160>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:24.359763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-05a5cc2b-052a-425d-a128-16b92e45c947 tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-844511376" status: 202 len: 0 microversion: 2.1 time: 0.024853 Jul 25 21:00:24.360430 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3176/6400] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Jul 25 21:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-844511376 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:00:25.046951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:25.047472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:25.055174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:25.055940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:25.056778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:25.057241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:25.072125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] HTTP exception thrown: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Request method failure captured: Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 HTTP/1.1 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wQGx4A2y13cjjHwz7ojP0kWTvvKH-Z7w5BuKM7YTr2D--yLJsjysyH4qfdUIaZi-5BwIH_vAWeqqldpezDrI-eP_-dDEbdNDZgG8cdgEsJanY55mYxdYVOyVEf_qkwYxIXFWKFuJyleMQGwU6Ws43Lm9bi_K8vx5bJgKULiU-MxUHs Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0752907ffdc949a88e694a1f147b957b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}] Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: cf95ad6a27f94db0a88ec17fb5171cec Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'cbdf90b0-22ee-4680-be35-addd0587d198'} Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:00:25.073728 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Returning 404 to user: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-90a5864e-8172-4e61-b870-8cd85e3f2ddf tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 404 len: 111 microversion: 2.1 time: 0.032651 Jul 25 21:00:25.077310 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3225/6401] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:00:25 2022] DELETE /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:00:25.084265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:25.084896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] [instance: cbdf90b0-22ee-4680-be35-addd0587d198] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:25.091646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:25.092261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:25.092932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:25.093414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:25.108074 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] HTTP exception thrown: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Request method failure captured: Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 HTTP/1.1 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wQGx4A2y13cjjHwz7ojP0kWTvvKH-Z7w5BuKM7YTr2D--yLJsjysyH4qfdUIaZi-5BwIH_vAWeqqldpezDrI-eP_-dDEbdNDZgG8cdgEsJanY55mYxdYVOyVEf_qkwYxIXFWKFuJyleMQGwU6Ws43Lm9bi_K8vx5bJgKULiU-MxUHs Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0752907ffdc949a88e694a1f147b957b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0752907ffdc949a88e694a1f147b957b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0752907ffdc949a88e694a1f147b957b"}]}] Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 0752907ffdc949a88e694a1f147b957b Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2075159930 Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: cf95ad6a27f94db0a88ec17fb5171cec Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerDiskConfigTestJSON-2075159930-project Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'cbdf90b0-22ee-4680-be35-addd0587d198'} Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:00:25.109746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] Returning 404 to user: Instance cbdf90b0-22ee-4680-be35-addd0587d198 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6239bc0c-8af3-426a-a874-d28a8badb5eb tempest-ServerDiskConfigTestJSON-2075159930 tempest-ServerDiskConfigTestJSON-2075159930-project] 10.222.0.48 "GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198" status: 404 len: 111 microversion: 2.1 time: 0.030916 Jul 25 21:00:25.114171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3177/6402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:25 2022] GET /compute/v2.1/servers/cbdf90b0-22ee-4680-be35-addd0587d198 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:00:34.518947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0522de1-af03-43e3-bd52-fc40930fdbb1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: .version_select at 0x7f196972af70>, body: {"keypair": {"name": "tempest-keypair-1416569182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGoTDfGz3BMWMQzyMSadaF/73gwbGRTb9CM3EW8+BudcapMX7GYyk0pMpySR8fSUji0QHY0YHVU8VwkyPRqzh6MPwZgCgNewvyri4C7J/83X1xoE0Jj+kVR/HSYzd98gw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:34.536240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c0522de1-af03-43e3-bd52-fc40930fdbb1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:00:34.541891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-c0522de1-af03-43e3-bd52-fc40930fdbb1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:00:34.574421 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0522de1-af03-43e3-bd52-fc40930fdbb1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201044 Jul 25 21:00:34.575362 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3226/6403] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:00:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:36.058481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-110970932", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85d31561-f208-4286-b787-684fc9dbb29f"}], "security_groups": [{"name": "tempest-securitygroup--2104765133"}], "key_name": "tempest-keypair-1416569182", "user_data": "}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:36.067469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:36.068729 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:36.178182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] validate_networks() for [('85d31561-f208-4286-b787-684fc9dbb29f', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:00:36.660000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:00:36.660645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:00:36.661243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:00:36.662343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:00:36.663397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:00:36.673622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:36.674390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:36.675305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:36.675853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:36.694880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:00:36.700580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:00:36.714614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:00:36.717492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:00:36.774103 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b4b4a188-6cd8-4f22-8713-493b382fb004 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.720253 Jul 25 21:00:36.775019 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3178/6404] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:00:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:00:36.785995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-201c51ee-439b-4bb9-b180-59ae1f9a7f95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:36.786693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-201c51ee-439b-4bb9-b180-59ae1f9a7f95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:36.794051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:36.795887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:36.873203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-201c51ee-439b-4bb9-b180-59ae1f9a7f95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:36.880195 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-201c51ee-439b-4bb9-b180-59ae1f9a7f95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1238 microversion: 2.1 time: 0.097973 Jul 25 21:00:36.880817 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3227/6405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:36 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:37.904438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:37.905066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:37.912928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:37.913390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:37.914187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:37.914795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:37.986248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:37.994575 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-829293b2-52ac-41c4-96f0-932a6111f60c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1290 microversion: 2.1 time: 0.095663 Jul 25 21:00:37.995250 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3179/6406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:37 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:39.016468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:39.017690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:39.026398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:39.027104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:39.028291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:39.028944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:39.179142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:39.187656 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55245129-b7fa-4f23-887e-f69e44f1a4db tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.175115 Jul 25 21:00:39.189760 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3228/6407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:39 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:00:39.992408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5a101edf-bcac-40ad-82c8-4ad2c58af13d req-03b3c2fc-1314-43dc-bda5-b52c2e26fcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:40.003064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5a101edf-bcac-40ad-82c8-4ad2c58af13d req-03b3c2fc-1314-43dc-bda5-b52c2e26fcc5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:40.003804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5a101edf-bcac-40ad-82c8-4ad2c58af13d req-03b3c2fc-1314-43dc-bda5-b52c2e26fcc5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:40.017018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5a101edf-bcac-40ad-82c8-4ad2c58af13d req-03b3c2fc-1314-43dc-bda5-b52c2e26fcc5 service nova] Creating event network-changed:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h2-845775-3 Jul 25 21:00:40.022937 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5a101edf-bcac-40ad-82c8-4ad2c58af13d req-03b3c2fc-1314-43dc-bda5-b52c2e26fcc5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096770 Jul 25 21:00:40.024024 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3180/6408] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:40.211009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:40.211556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:40.218711 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:40.219184 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:40.219994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:40.220469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:40.363691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:40.373453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e824f479-eedc-42a7-b113-dbf13c2d9acd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.166419 Jul 25 21:00:40.374064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3229/6409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:40 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:41.396801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:41.397561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:41.404151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:41.404624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:41.405433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:41.406054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:41.553317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:41.562725 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f698e36a-d5d8-4571-8d0b-3b1fa33abfd9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.171207 Jul 25 21:00:41.563389 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3181/6410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:41 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:42.588415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:42.588991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:42.596660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:42.597126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:42.597930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:42.598523 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:42.751504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:42.759927 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0ba4ab0-1474-4d58-b080-4384beb0d766 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.176220 Jul 25 21:00:42.760560 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3230/6411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:42 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:43.781421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:43.782031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:43.789079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:43.789531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:43.790404 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:43.790740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:43.937002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:43.945001 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-313ad7c6-509d-4fa3-81b2-4e7d73feec78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.167455 Jul 25 21:00:43.945589 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3182/6412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:43 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:44.153512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1aabff87-b2ba-4471-9073-cb6068333ba0 req-db3aa9b6-588b-4a55-a3bf-5311053979d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "name": "network-vif-plugged", "status": "completed", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:44.165492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1aabff87-b2ba-4471-9073-cb6068333ba0 req-db3aa9b6-588b-4a55-a3bf-5311053979d7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:44.165959 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1aabff87-b2ba-4471-9073-cb6068333ba0 req-db3aa9b6-588b-4a55-a3bf-5311053979d7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:44.179483 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1aabff87-b2ba-4471-9073-cb6068333ba0 req-db3aa9b6-588b-4a55-a3bf-5311053979d7 service nova] Creating event network-vif-plugged:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h2-845775-3 Jul 25 21:00:44.185256 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1aabff87-b2ba-4471-9073-cb6068333ba0 req-db3aa9b6-588b-4a55-a3bf-5311053979d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035493 Jul 25 21:00:44.186092 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3231/6413] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:00:44.967884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:44.968544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:44.975741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:44.976243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:44.977027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:44.978165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:45.125653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:45.136214 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ea7f910-b205-409b-9422-9e1b55339346 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1364 microversion: 2.1 time: 0.173464 Jul 25 21:00:45.137267 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3183/6414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:44 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:46.159202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:46.159918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:46.166485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:46.166949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:46.167748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:46.168311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:46.311878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:00:46.320859 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa3daab8-2632-4f72-a669-f019bcc7bdca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1550 microversion: 2.1 time: 0.167013 Jul 25 21:00:46.321436 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3232/6415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:00:46 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:00:46.342612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:00:46.343105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:00:46.350370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:46.350768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:46.351534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:46.351975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:46.436845 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8846f3d5-5f3a-4b5e-914b-1be66bf43591 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098269 Jul 25 21:00:46.437491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3184/6416] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 21:00:46 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:00:47.820619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1c1f1d32-1856-4c5b-b792-1c77e9cb5c80 req-640405df-6e55-4dec-836b-d3e37bf3875c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:00:47.825876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:00:47.832814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1c1f1d32-1856-4c5b-b792-1c77e9cb5c80 req-640405df-6e55-4dec-836b-d3e37bf3875c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:00:47.833275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1c1f1d32-1856-4c5b-b792-1c77e9cb5c80 req-640405df-6e55-4dec-836b-d3e37bf3875c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:00:47.845270 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1c1f1d32-1856-4c5b-b792-1c77e9cb5c80 req-640405df-6e55-4dec-836b-d3e37bf3875c service nova] Creating event network-changed:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h2-845775-3 Jul 25 21:00:47.850688 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1c1f1d32-1856-4c5b-b792-1c77e9cb5c80 req-640405df-6e55-4dec-836b-d3e37bf3875c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034473 Jul 25 21:00:47.851240 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3233/6417] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:01:22.787843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.788579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.790319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.790925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=32 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.795548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:22.796475 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:22.809118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:22.809571 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:22.810362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:22.810808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:22.953894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:22.962538 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd9b8ea9-740b-4b59-abfa-ea548224d903 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.175609 Jul 25 21:01:22.963131 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3185/6418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:22 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:22.983369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=15 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.984220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=28 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:22.988691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:22.989423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:22.999485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:22.999955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.000788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.001247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.145342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:23.153957 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2eae8258-b4e1-4837-9d7e-c9039a0ea48a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.172588 Jul 25 21:01:23.154533 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3234/6419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:22 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:23.175279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:23.175913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:23.182888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.183351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.184272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.184720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.324762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:23.332806 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5300885f-6a21-471b-904e-bbec03a19096 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.161617 Jul 25 21:01:23.334156 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3186/6420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:23 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:01:23.356816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:23.358190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:23.364143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.364633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.365432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.365891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.396941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:23.404449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Old instance type m1.heat2, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 21:01:23.411864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:01:23.412340 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:01:23.412832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:01:23.413258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:01:23.413690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:01:23.486201 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-773e0c49-d1a7-4143-8440-41b45e748f41 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/action" status: 202 len: 0 microversion: 2.1 time: 0.134856 Jul 25 21:01:23.486998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3235/6421] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:01:23 2022] POST /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:01:23.494928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:23.495551 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:23.502552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.503014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.503801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:23.504328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:23.657274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:23.666317 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f0bf5a0f-05a5-482f-95aa-2286b3598979 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1677 microversion: 2.1 time: 0.175096 Jul 25 21:01:23.666964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3187/6422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:23 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:24.689701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:24.690344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:24.702330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:24.703161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:24.705036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:24.705856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:24.885823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:24.901519 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d02ffd54-2efd-4eb5-a03a-34f39d4a66af tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1677 microversion: 2.1 time: 0.216236 Jul 25 21:01:24.902721 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3236/6423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:24 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:25.931317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:25.931978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:25.939710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:25.940227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:25.941004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:25.941464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:26.085261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:26.093733 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-944e042e-01bb-4796-8804-50abd48ca223 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.166246 Jul 25 21:01:26.094360 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3188/6424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:25 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:27.116342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:27.117006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:27.123818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:27.124371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:27.125110 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:27.125694 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:27.274407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:27.283346 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-389a2387-51cd-4bd9-9988-76c374fe4e2d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.170930 Jul 25 21:01:27.283941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3237/6425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:27 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:28.307097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:28.307747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:28.314680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:28.315136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:28.315945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:28.316415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:28.468613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:28.477443 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-10d32d93-58a4-4a24-8a28-24678b091fff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.174200 Jul 25 21:01:28.478045 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3189/6426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:28 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:29.499282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:29.499922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:29.507255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:29.507727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:29.508565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:29.509032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:29.647330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:29.655803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63a7bcc6-7c6d-4dfb-9ed0-2c8b35ffcff0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.160766 Jul 25 21:01:29.656420 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3238/6427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:29 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:30.680133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:30.680918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:30.689505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:30.689963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:30.690757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:30.691205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:30.831416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:30.839296 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cf14468-7637-4b8d-93c0-089ea5432ef5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.164997 Jul 25 21:01:30.840169 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3190/6428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:30 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:01:31.860914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:31.861544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:31.868633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:31.869046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:31.869832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:31.870325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:32.005215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:32.013819 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7460440-52ca-4bf6-a3d5-daf179df993d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.156872 Jul 25 21:01:32.014398 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3239/6429] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:31 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:33.036591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:33.037829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:33.045047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:33.045497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:33.046526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:33.046963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:33.189685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:33.197349 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ecac1b8-3043-4cf5-a318-f028d3d0bec9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.164619 Jul 25 21:01:33.198062 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3191/6430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:33 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:34.219546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:34.220223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:34.227919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:34.228424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:34.229224 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:34.229685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:34.380512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:34.388627 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0dda8f86-a6e1-4d63-ba54-4c989aedd1df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.173042 Jul 25 21:01:34.389209 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3240/6431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:34 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:35.409868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:35.410484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:35.418107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:35.418567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:35.419428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:35.419878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:35.562471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:35.570810 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5cf63998-ecd2-4c79-9c59-206a38b31e1a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.164742 Jul 25 21:01:35.571526 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3192/6432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:35 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:36.595231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:36.596288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:36.605243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:36.605707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:36.606691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:36.607145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:36.755479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:36.764153 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-42d0b25c-0754-4301-92ed-e932ffa1f03b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.175541 Jul 25 21:01:36.764749 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3241/6433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:36 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:37.786657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:37.788089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:37.799897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:37.800789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:37.802229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:37.803072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:37.946613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:37.954672 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e783f8c-66ee-4bd1-9995-29f478210882 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.171855 Jul 25 21:01:37.955264 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3193/6434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:37 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:38.977071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:38.977707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:38.984676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:38.985149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:38.985946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:38.986405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:39.118939 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:39.128701 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52c78c4b-6798-448f-b5ef-ebe75cb294b3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.156038 Jul 25 21:01:39.129292 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3242/6435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:38 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:40.150043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:40.150684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:40.157787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:40.158253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:40.159030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:40.159477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:40.293175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:40.301034 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8e7124f0-04ed-486c-91a9-249a82cc4e63 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.155025 Jul 25 21:01:40.301607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3194/6436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:40 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:41.324414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:41.325058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:41.335909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:41.336431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:41.337330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:41.337812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:41.483239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:41.494801 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-73ac1246-3b0c-4476-83a9-ea93cfa21351 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.174425 Jul 25 21:01:41.495608 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3243/6437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:41 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:42.518862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:42.519490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:42.526998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:42.527287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:42.527972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:42.528442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:42.674243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:42.682769 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0eebfec1-61dc-411d-a513-627aa0a52923 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1682 microversion: 2.1 time: 0.168037 Jul 25 21:01:42.683342 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3195/6438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:42 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:01:43.393646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "name": "network-vif-unplugged", "status": "completed", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:43.404830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:43.405307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:43.417690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] Creating event network-vif-unplugged:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h1-845775-3 Jul 25 21:01:43.423506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] Instance d18eee31-3715-4559-b68d-e02e0c695a93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:01:43.436071 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-934d91c5-5654-4644-af0e-4c9999ed9449 req-dad01933-7d5e-405b-9888-c41485c7959f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046063 Jul 25 21:01:43.437118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3244/6439] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:01:43.703133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:43.703613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:43.710878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:43.711338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:43.712152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:43.712628 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:43.970417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:43.982375 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61b1bdb8-8576-4ed0-b622-6df9de15f8d2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1681 microversion: 2.1 time: 0.283185 Jul 25 21:01:43.982985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3196/6440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:43 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:45.006789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:45.007507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:45.013846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:45.014315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:45.015094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:45.015545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:45.151154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:45.159473 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c31b6e4-db94-4ee8-9ef7-84d01acd6371 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1679 microversion: 2.1 time: 0.158468 Jul 25 21:01:45.160286 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3245/6441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:44 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:45.451528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:45.461959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:45.462411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:45.475762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] Creating event network-changed:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h1-845775-3 Jul 25 21:01:45.481648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] Instance d18eee31-3715-4559-b68d-e02e0c695a93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:01:45.493252 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1e42de92-b412-4306-8ec1-b1c54bb2f071 req-e1c29e62-33ae-43e5-a002-07faea85ca3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045351 Jul 25 21:01:45.493865 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3197/6442] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:01:46.186908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:46.189051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:46.201012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:46.201501 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:46.202309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:46.202798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:46.800750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:46.808448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf7d5dbd-b54b-48d2-a1fc-552799348ccc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1679 microversion: 2.1 time: 0.630214 Jul 25 21:01:46.809047 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3246/6443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:46 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1679 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:47.831735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:47.832498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:47.839406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:47.839866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:47.840673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:47.841118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:47.982780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:47.990935 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79452b5b-7b0a-459b-a81e-5db3460cc080 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1676 microversion: 2.1 time: 0.163756 Jul 25 21:01:47.991725 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3198/6444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:47 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:48.012950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:48.013502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:48.020598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:48.021073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:48.021901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:48.022358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:48.065500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "name": "network-vif-plugged", "status": "completed", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:48.077232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:48.077797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:48.086080 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8a524dc9-0854-4df3-a893-2a1843522de7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/action" status: 204 len: 0 microversion: 2.1 time: 0.076857 Jul 25 21:01:48.090642 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3247/6445] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:01:48 2022] POST /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:01:48.093791 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] Creating event network-vif-plugged:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h1-845775-3 Jul 25 21:01:48.097190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:48.098090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:48.099993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] Instance d18eee31-3715-4559-b68d-e02e0c695a93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:01:48.105654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:48.106102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:48.106918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:48.107396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:48.116746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-fb601bc2-0bee-4d93-a8d9-18509a97fca0 req-a5515aa9-b13e-45f5-b9a1-d49ed88259b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053980 Jul 25 21:01:48.118784 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3199/6446] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:01:48.126877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:48.253570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:48.261885 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ea91557-5f86-4249-8537-b7044f468f86 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1676 microversion: 2.1 time: 0.169845 Jul 25 21:01:48.262467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3248/6447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:48 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:49.284371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:49.285072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:49.291252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.291703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.292530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.292974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.434007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:49.441540 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6198edf8-e405-4be4-b3c0-c40b2618fd56 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.162273 Jul 25 21:01:49.442121 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3200/6448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:49 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:49.462699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:49.463331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:49.470295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.470765 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.471558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.472223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.605136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:49.612817 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7b6f6734-e772-4125-9518-2bea4ba69410 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.154569 Jul 25 21:01:49.613393 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3249/6449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:49 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:49.634626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:49.635242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:49.641415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.641868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.642637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.643079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.771759 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:49.779833 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-73b762fd-d056-4086-8e6e-d0b5f129ba57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1668 microversion: 2.1 time: 0.149745 Jul 25 21:01:49.780500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3201/6450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:49 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:49.800635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:49.801148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:49.808160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.808342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.809145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.809605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.834615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:01:49.914597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9d2d5eff-3361-4092-a198-d3a5e9a51fe8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 204 len: 0 microversion: 2.1 time: 0.117605 Jul 25 21:01:49.915286 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3250/6451] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:01:49 2022] DELETE /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:01:49.924519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:49.925147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:49.933554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.934100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.934983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:49.935768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:49.942969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=100 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:50.078352 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:50.085936 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1854d0a3-9186-4fe5-a283-470d27e11283 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1674 microversion: 2.1 time: 0.165727 Jul 25 21:01:50.086529 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3202/6452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:49 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:51.107743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:51.108478 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:51.115342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:51.115808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:51.116620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:51.117074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:51.251489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:51.259186 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c92fb4b0-6ff2-4bb1-9f33-e910a4534dfb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1674 microversion: 2.1 time: 0.155752 Jul 25 21:01:51.259762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3251/6453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:51 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:52.235049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3f381e89-7589-4e7d-a54a-0eee0baa67b9 req-f56e2dab-ba69-4e29-b3b4-9216a821d331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18eee31-3715-4559-b68d-e02e0c695a93", "name": "network-vif-deleted", "tag": "15f1ec83-346d-4b9f-8e12-2a4070aa9afb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:52.249709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3f381e89-7589-4e7d-a54a-0eee0baa67b9 req-f56e2dab-ba69-4e29-b3b4-9216a821d331 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:52.250166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3f381e89-7589-4e7d-a54a-0eee0baa67b9 req-f56e2dab-ba69-4e29-b3b4-9216a821d331 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:52.264491 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3f381e89-7589-4e7d-a54a-0eee0baa67b9 req-f56e2dab-ba69-4e29-b3b4-9216a821d331 service nova] Creating event network-vif-deleted:15f1ec83-346d-4b9f-8e12-2a4070aa9afb for instance d18eee31-3715-4559-b68d-e02e0c695a93 on n-h1-845775-3 Jul 25 21:01:52.269850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3f381e89-7589-4e7d-a54a-0eee0baa67b9 req-f56e2dab-ba69-4e29-b3b4-9216a821d331 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Jul 25 21:01:52.270461 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3203/6454] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:01:52.281537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:52.282124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:52.289605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:52.290156 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:52.291023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:52.291550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:52.358029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:52.367078 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b4f26e4-5be8-48a0-ba41-32c45fa922bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 200 len: 1323 microversion: 2.1 time: 0.090442 Jul 25 21:01:52.368195 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3252/6455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:52 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 1323 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:53.389325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:53.389967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:53.392838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=39 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:53.398754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:53.399217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:53.399989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:53.400461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:53.416381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 HTTP/1.1 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd18eee31-3715-4559-b68d-e02e0c695a93'} Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:01:53.418062 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c25978f-f3e3-48ef-ad61-e915fbd4836d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 404 len: 111 microversion: 2.1 time: 0.034571 Jul 25 21:01:53.422694 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3204/6456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:53 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:01:53.432318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:53.432958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:53.435766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:01:53.441182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:53.441657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:53.442444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:53.442906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:53.457971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 HTTP/1.1 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd18eee31-3715-4559-b68d-e02e0c695a93'} Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:01:53.459712 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fb4cd3da-5182-4f0d-ab36-15292e9c75c2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 404 len: 111 microversion: 2.1 time: 0.033316 Jul 25 21:01:53.463635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3253/6457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:53 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:01:53.509763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1635382270", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "85d31561-f208-4286-b787-684fc9dbb29f"}], "security_groups": [{"name": "tempest-securitygroup--2104765133"}], "key_name": "tempest-keypair-1416569182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:53.616354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] validate_networks() for [('85d31561-f208-4286-b787-684fc9dbb29f', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:01:54.085309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:01:54.085734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:01:54.086206 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:01:54.086619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:01:54.087028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:01:54.098120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:54.098573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:54.099372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:54.100359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:54.119285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:01:54.124682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:01:54.137185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:01:54.139273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:01:54.186847 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd7b3348-508c-4a67-be14-f6d0d97fb643 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681562 Jul 25 21:01:54.187695 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3205/6458] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:01:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 21:01:54.198821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed895751-8309-49d6-8516-4e7dad96577b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:54.199795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed895751-8309-49d6-8516-4e7dad96577b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:54.259051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ed895751-8309-49d6-8516-4e7dad96577b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:54.269883 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed895751-8309-49d6-8516-4e7dad96577b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1239 microversion: 2.1 time: 0.075087 Jul 25 21:01:54.270466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3254/6459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:54 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:55.291600 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:55.292261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:55.302484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:55.302484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:55.302773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:55.303758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:55.390266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:55.397865 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-161dcb59-94cf-4879-8965-acc2c5552e62 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1297 microversion: 2.1 time: 0.111058 Jul 25 21:01:55.398437 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3206/6460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:55 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:56.419621 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:56.420986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:56.431137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:56.431834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:56.433507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:56.433816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:56.678284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:56.694539 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d7f017d1-e287-4276-bf82-46e3e6260880 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.278866 Jul 25 21:01:56.695750 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3255/6461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:56 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:56.697107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1dbe1a3b-04da-4638-aff2-631d41aa5ffa req-a9828e28-008a-4fcc-ba15-285249d6af9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:01:56.717537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1dbe1a3b-04da-4638-aff2-631d41aa5ffa req-a9828e28-008a-4fcc-ba15-285249d6af9a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:56.717993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1dbe1a3b-04da-4638-aff2-631d41aa5ffa req-a9828e28-008a-4fcc-ba15-285249d6af9a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:56.733033 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1dbe1a3b-04da-4638-aff2-631d41aa5ffa req-a9828e28-008a-4fcc-ba15-285249d6af9a service nova] Creating event network-changed:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h1-845775-3 Jul 25 21:01:56.738332 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1dbe1a3b-04da-4638-aff2-631d41aa5ffa req-a9828e28-008a-4fcc-ba15-285249d6af9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045110 Jul 25 21:01:56.739046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3207/6462] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:01:57.716806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:57.717428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:57.723934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:57.724472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:57.725246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:57.725697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:57.858047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:57.866063 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9c3aaa6c-9a13-48a9-9208-88c17479a1da tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.152997 Jul 25 21:01:57.866635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3256/6463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:57 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:01:58.888468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:01:58.889098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:01:58.895476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:58.895937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:58.896755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:01:58.897242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:01:59.030201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:01:59.038160 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f08024e-1386-41cf-9b21-507671a77a14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.154968 Jul 25 21:01:59.038744 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3208/6464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:01:58 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:00.059898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:00.061130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:00.067544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:00.068026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:00.069445 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:00.069908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:00.212865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:00.222237 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c043c409-7bed-4224-affa-28004f5ffe7f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.166377 Jul 25 21:02:00.222718 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3257/6465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:00 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:01.243895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:01.244543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:01.251456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:01.251907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:01.252707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:01.253154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:01.385809 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:01.393406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fab582e0-65cb-4605-9bf9-732d7ceb5dad tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.153651 Jul 25 21:02:01.393980 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3209/6466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:01 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:02.097454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-038da133-337c-4b02-8cc5-6aa463a18854 req-38b8dbb3-f2ee-4fd2-b566-5202adc2994c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "name": "network-vif-plugged", "status": "completed", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:02.109047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-038da133-337c-4b02-8cc5-6aa463a18854 req-38b8dbb3-f2ee-4fd2-b566-5202adc2994c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:02.109510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-038da133-337c-4b02-8cc5-6aa463a18854 req-38b8dbb3-f2ee-4fd2-b566-5202adc2994c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:02.121915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-038da133-337c-4b02-8cc5-6aa463a18854 req-38b8dbb3-f2ee-4fd2-b566-5202adc2994c service nova] Creating event network-vif-plugged:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h1-845775-3 Jul 25 21:02:02.127132 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-038da133-337c-4b02-8cc5-6aa463a18854 req-38b8dbb3-f2ee-4fd2-b566-5202adc2994c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033452 Jul 25 21:02:02.127748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3258/6467] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:02:02.415507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:02.416202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:02.423577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:02.424046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:02.424826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:02.425265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:02.559394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:02.567057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-51e850cf-e63e-45eb-b3a3-5cc1a3bce93d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1365 microversion: 2.1 time: 0.156013 Jul 25 21:02:02.567656 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3210/6468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:02 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:03.589243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:03.589972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:03.596353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:03.596831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:03.597624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:03.598082 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:03.735070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:03.742706 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a5dfd2b8-d5ab-48b1-aff5-514ea16424e2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1552 microversion: 2.1 time: 0.158671 Jul 25 21:02:03.743285 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3259/6469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:03 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:03.763992 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:03.764610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:03.771438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:03.772468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:03.773245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:03.773692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:03.855233 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c07bf0a-502d-4434-82f0-bf4eabae7144 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095575 Jul 25 21:02:03.855858 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3211/6470] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 21:02:03 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:02:04.799468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-abedb39e-6cf7-45d2-b9d5-3abb6f532f8e req-d137e3ad-716c-4673-ae38-d60ddd7769fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:04.804868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:04.811873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-abedb39e-6cf7-45d2-b9d5-3abb6f532f8e req-d137e3ad-716c-4673-ae38-d60ddd7769fd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:04.812365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-abedb39e-6cf7-45d2-b9d5-3abb6f532f8e req-d137e3ad-716c-4673-ae38-d60ddd7769fd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:04.824455 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-abedb39e-6cf7-45d2-b9d5-3abb6f532f8e req-d137e3ad-716c-4673-ae38-d60ddd7769fd service nova] Creating event network-changed:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h1-845775-3 Jul 25 21:02:04.830321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-abedb39e-6cf7-45d2-b9d5-3abb6f532f8e req-d137e3ad-716c-4673-ae38-d60ddd7769fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Jul 25 21:02:04.831007 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3260/6471] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:02:39.959794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:39.960596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:39.963111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:39.963855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=40 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:39.968833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-182fa251-1eeb-4550-a569-763f023f22d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:39.977186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-182fa251-1eeb-4550-a569-763f023f22d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:39.978303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-182fa251-1eeb-4550-a569-763f023f22d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:40.001950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-182fa251-1eeb-4550-a569-763f023f22d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Going to try to stop instance {{(pid=119723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 21:02:40.044281 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-182fa251-1eeb-4550-a569-763f023f22d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.085309 Jul 25 21:02:40.044953 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3212/6472] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:02:39 2022] POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:02:40.051836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=17 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:40.053149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:02:40.057439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:40.058170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:40.065848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:40.066377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:40.067123 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:40.067584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:40.204994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:40.213425 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-868cc6ce-4f8a-437d-bba9-b0d9799fe611 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.163520 Jul 25 21:02:40.213932 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3261/6473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:40 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:41.236167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:41.236911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:41.243201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:41.243697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:41.244508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:41.244953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:41.379063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:41.386626 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71d3bb05-7a50-4f91-9b79-0561362dddd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.155584 Jul 25 21:02:41.387207 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3213/6474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:41 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:42.408454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:42.409124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:42.416104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:42.416836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:42.417895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:42.418364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:42.553260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:42.561916 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0cea67a-6e72-4d4d-812d-89b91764ce57 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.157426 Jul 25 21:02:42.562509 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3262/6475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:42 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:43.583086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:43.583708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:43.590929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:43.591334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:43.592137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:43.592601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:43.722097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:43.730426 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1378795c-77a6-4a21-8fc2-2aa6ec4b2b6c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.150788 Jul 25 21:02:43.731000 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3214/6476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:43 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:44.752945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:44.753565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:44.760730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:44.761699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:44.762474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:44.762925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:44.897826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:44.905548 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2e1c6d84-8d6b-4754-9201-4e1de62cc8cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.156499 Jul 25 21:02:44.906159 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3263/6477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:44 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:45.927476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:45.928126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:45.935748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:45.936233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:45.937020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:45.937462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:46.073954 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:46.081569 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bc9379af-66b5-488f-8800-f24632fc11a5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.158384 Jul 25 21:02:46.082145 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3215/6478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:45 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:47.103474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:47.104146 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:47.111172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:47.111648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:47.112513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:47.112974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:47.254474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:47.262370 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f12bbf7-ae50-4957-9df3-c5c617c5fb46 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.162836 Jul 25 21:02:47.262968 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3264/6479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:47 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:48.284044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:48.284672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:48.291335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:48.291794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:48.292610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:48.293057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:48.424055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:48.431655 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-88c6ff60-ca31-4a9b-9c47-cb87330228ce tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.151640 Jul 25 21:02:48.432273 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3216/6480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:48 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:49.453647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:49.454273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:49.461291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:49.461758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:49.462543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:49.463367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:49.592926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:49.600425 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1ab80492-9bf5-46d7-93c5-4d2f027e3818 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.150670 Jul 25 21:02:49.601000 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3265/6481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:49 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:50.622991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:50.623535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:50.630486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.630940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:50.631702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.632159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:50.766914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:50.774484 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45b4b386-ab19-490e-9589-ec6a19971053 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1657 microversion: 2.1 time: 0.156073 Jul 25 21:02:50.775062 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3217/6482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:50 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:50.795705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:50.798555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:50.805667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.806121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:50.806916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.807368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:50.835901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:50.842276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 21:02:50.848531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:02:50.848971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:02:50.849461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:02:50.849889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:02:50.850317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:02:50.914669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3551205-42fa-4830-a492-109ab09a0082 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.123558 Jul 25 21:02:50.915225 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3266/6483] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:02:50 2022] POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:02:50.925104 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:50.926428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:50.934117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.934579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:50.935532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:50.935981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:51.073021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:51.081320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-853d1805-8b63-4341-b0c7-02b166c053cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.161225 Jul 25 21:02:51.081903 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3218/6484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:50 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:02:52.104015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:52.105699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:52.111481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:52.111958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:52.112797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:52.113259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:52.284807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:52.293200 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ea81c477-fe34-4363-b5c5-12fbdd160a2a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1680 microversion: 2.1 time: 0.193372 Jul 25 21:02:52.293625 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3267/6485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:52 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:53.317433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:53.318058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:53.326297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:53.326760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:53.327603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:53.328118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:53.466156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:53.473807 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8921a62c-d51d-4cd1-9ef6-f50c3eb70026 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1685 microversion: 2.1 time: 0.160610 Jul 25 21:02:53.474388 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3219/6486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:53 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:54.494906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:54.495544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:54.502589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:54.503060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:54.503854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:54.504346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:54.642613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:54.651172 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b6dab798-8aaa-4d5a-b696-d1de0c06dc32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1685 microversion: 2.1 time: 0.160282 Jul 25 21:02:54.651738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3268/6487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:54 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:55.484263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "name": "network-vif-unplugged", "status": "completed", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:55.495960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:55.496452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:55.509651 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] Creating event network-vif-unplugged:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h2-845775-3 Jul 25 21:02:55.515883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] Instance 146426d2-b7b1-4b13-8146-529266267bf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:02:55.528434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6ca970a6-e716-4158-9a1f-f4f112bedef1 req-566372b2-3505-4e6a-b6d8-0f7b241a0a67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047796 Jul 25 21:02:55.529626 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3220/6488] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:02:55.673975 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:55.674684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:55.682858 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:55.683654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:55.684734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:55.685394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:55.825903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:55.833689 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c20153a3-e7a6-46c1-baf6-7b501f39251b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1684 microversion: 2.1 time: 0.164331 Jul 25 21:02:55.834265 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3269/6489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:55 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:56.858030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:56.858735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:56.865022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:56.865478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:56.866233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:56.866671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:57.001832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:57.009904 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-067a6e7d-9f88-47c4-8cc2-752dbb7e7464 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1682 microversion: 2.1 time: 0.158067 Jul 25 21:02:57.010485 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3221/6490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:56 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:57.544492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:57.554886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:57.555341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:57.572448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] Creating event network-changed:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h2-845775-3 Jul 25 21:02:57.580817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] Instance 146426d2-b7b1-4b13-8146-529266267bf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:02:57.592257 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4ea44671-d470-4db0-ad8e-36b4e8eacf8b req-671946e5-e3a4-493f-b8da-57f652fa3c8b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051756 Jul 25 21:02:57.592883 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3270/6491] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:02:58.031911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:58.033331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:58.040239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:58.040816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:58.041846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:58.042527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:58.253260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:58.262376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4ce58fcc-806a-4ceb-931f-deb23f12850c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1682 microversion: 2.1 time: 0.234549 Jul 25 21:02:58.262993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3222/6492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:58 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:59.285758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:59.287136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:59.294141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.294617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.295424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.295887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.440634 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:59.449267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-18f732b5-b922-488e-bde4-817d0856652f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1678 microversion: 2.1 time: 0.168127 Jul 25 21:02:59.449869 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3271/6493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:59 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:02:59.469922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:02:59.470496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:59.477680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.478363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.479223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.480285 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.545811 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9426e619-8b38-4f34-99bd-1a435a537b44 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action" status: 204 len: 0 microversion: 2.1 time: 0.079594 Jul 25 21:02:59.546390 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3223/6494] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:02:59 2022] POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:02:59.554799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:02:59.555436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:02:59.562637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.563112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.563951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:02:59.564437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:02:59.767706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:02:59.775446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-28662e9f-f896-4937-9a9b-6afb65325a39 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1678 microversion: 2.1 time: 0.224469 Jul 25 21:02:59.776206 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3272/6495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:02:59 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:00.801618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:00.802479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:00.810252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:00.810833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:00.811764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:00.812324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:00.946612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-db205736-f3bb-4dae-9149-d8e27fca1a3e req-c058ecde-079e-4c92-8f9d-913f4676bd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "name": "network-vif-plugged", "status": "completed", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:00.959575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-db205736-f3bb-4dae-9149-d8e27fca1a3e req-c058ecde-079e-4c92-8f9d-913f4676bd99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:00.960181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-db205736-f3bb-4dae-9149-d8e27fca1a3e req-c058ecde-079e-4c92-8f9d-913f4676bd99 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:00.977787 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-db205736-f3bb-4dae-9149-d8e27fca1a3e req-c058ecde-079e-4c92-8f9d-913f4676bd99 service nova] Creating event network-vif-plugged:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h2-845775-3 Jul 25 21:03:00.983535 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-db205736-f3bb-4dae-9149-d8e27fca1a3e req-c058ecde-079e-4c92-8f9d-913f4676bd99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040675 Jul 25 21:03:00.984481 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3273/6496] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:03:00.995853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:01.010226 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d424ffcc-9124-46cb-b717-cfaf681e9765 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1657 microversion: 2.1 time: 0.215761 Jul 25 21:03:01.012252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3224/6497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:00 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1657 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:01.037355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:01.040425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:01.048345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:01.048832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:01.049644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:01.050113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:01.203911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:01.211763 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71dcc8ec-4664-40ad-8871-7651fbda0bd4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1657 microversion: 2.1 time: 0.180422 Jul 25 21:03:01.212375 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3274/6498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:01 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1657 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:01.233652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7b598e75-eb3a-412a-869e-a0d0937e575b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:01.240266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b598e75-eb3a-412a-869e-a0d0937e575b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:01.240730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7b598e75-eb3a-412a-869e-a0d0937e575b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:01.266031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7b598e75-eb3a-412a-869e-a0d0937e575b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Going to try to start instance {{(pid=119723) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 21:03:01.302599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:01.314753 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7b598e75-eb3a-412a-869e-a0d0937e575b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.086234 Jul 25 21:03:01.315611 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3225/6499] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:03:01 2022] POST /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:03:01.326190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:01.326834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:01.333288 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:01.335355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:01.336447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:01.336664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:01.489591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:01.497840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aad52bf1-51e5-45f3-9e4d-213c1cc00940 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1666 microversion: 2.1 time: 0.176359 Jul 25 21:03:01.498551 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3275/6500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:01 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:02.520295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:02.521003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:02.527546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.527995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:02.528779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.529215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:02.671009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:02.678851 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae32bfe8-dede-45f8-97a5-f6fa5ab2a671 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1670 microversion: 2.1 time: 0.163823 Jul 25 21:03:02.679426 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3226/6501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:02 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:02.700655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:02.701481 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:02.710534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.710992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:02.711817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.712301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:02.740809 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:03:02.755525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:02.826437 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6f3fdfbc-afad-4648-abf4-df134422af73 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 204 len: 0 microversion: 2.1 time: 0.130155 Jul 25 21:03:02.826988 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3276/6502] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:03:02 2022] DELETE /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:03:02.839784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:02.840460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:02.849981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.850448 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:02.851367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:02.851866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:03.008859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:03.018394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5c99e02d-475c-47b5-9f4e-162a888ae945 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1676 microversion: 2.1 time: 0.185716 Jul 25 21:03:03.018994 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3227/6503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:02 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:04.041215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:04.042753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:04.050586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:04.051092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:04.051890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:04.052362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:04.200350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:04.208118 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d32bfa84-5d29-4cbe-91db-83f24e9ee507 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1676 microversion: 2.1 time: 0.171270 Jul 25 21:03:04.208708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3277/6504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:04 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:05.231008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:05.231890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:05.240672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:05.242223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:05.242395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-7239cf40-0e09-45af-9616-49c2e8330781 req-06331d50-a750-46ee-97da-24bdabd52c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146426d2-b7b1-4b13-8146-529266267bf4", "name": "network-vif-deleted", "tag": "b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:05.243582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:05.244486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:05.270196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7239cf40-0e09-45af-9616-49c2e8330781 req-06331d50-a750-46ee-97da-24bdabd52c71 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:05.270785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-7239cf40-0e09-45af-9616-49c2e8330781 req-06331d50-a750-46ee-97da-24bdabd52c71 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:05.292891 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-7239cf40-0e09-45af-9616-49c2e8330781 req-06331d50-a750-46ee-97da-24bdabd52c71 service nova] Creating event network-vif-deleted:b2357bf9-b4bb-4c2f-b1dd-271eebd2a4bb for instance 146426d2-b7b1-4b13-8146-529266267bf4 on n-h2-845775-3 Jul 25 21:03:05.299749 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-7239cf40-0e09-45af-9616-49c2e8330781 req-06331d50-a750-46ee-97da-24bdabd52c71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060661 Jul 25 21:03:05.300877 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3278/6505] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:03:05.343201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:05.351525 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b85dbdf4-eb06-4d6e-894a-7ccacdd127e0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 200 len: 1608 microversion: 2.1 time: 0.125005 Jul 25 21:03:05.352163 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3228/6506] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:05 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 1608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:06.374273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:06.374988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:06.382116 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:06.382675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:06.383452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:06.383899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:06.398180 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 HTTP/1.1 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '146426d2-b7b1-4b13-8146-529266267bf4'} Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:03:06.399830 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-382d0b09-c5b4-490a-809a-6b04528b60a7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 404 len: 111 microversion: 2.1 time: 0.031694 Jul 25 21:03:06.404786 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3279/6507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:06 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:03:06.417782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:06.418407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:06.428849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:06.429310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:06.430088 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:06.430539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:06.445423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 HTTP/1.1 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '146426d2-b7b1-4b13-8146-529266267bf4'} Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:03:06.447162 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-41163d01-82f2-4132-aa00-dcd627483898 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 404 len: 111 microversion: 2.1 time: 0.035377 Jul 25 21:03:06.451084 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3229/6508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:06 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:03:06.498341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2123623869", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "85d31561-f208-4286-b787-684fc9dbb29f"}], "security_groups": [{"name": "tempest-securitygroup--2104765133"}], "key_name": "tempest-keypair-1416569182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:06.610334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] validate_networks() for [('85d31561-f208-4286-b787-684fc9dbb29f', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:03:07.120138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:03:07.120594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:03:07.121098 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:03:07.121590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:03:07.122026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:03:07.131315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:07.131788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:07.132657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:07.133122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:07.154838 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:03:07.160393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:03:07.174355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:03:07.176687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:03:07.228829 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ed6a1510-506a-4b39-89b1-f9d910bc9536 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733901 Jul 25 21:03:07.229078 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3280/6509] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:03:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:03:07.240513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ae9c0b48-908f-4b77-98c3-26a60fc548cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:07.241147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ae9c0b48-908f-4b77-98c3-26a60fc548cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:07.296517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ae9c0b48-908f-4b77-98c3-26a60fc548cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:07.303750 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ae9c0b48-908f-4b77-98c3-26a60fc548cf tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1239 microversion: 2.1 time: 0.067071 Jul 25 21:03:07.304344 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3230/6510] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:07 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:08.327807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:08.329926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:08.336542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:08.337036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:08.337835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:08.338566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:08.415717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:08.424242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-75bf2a12-ca46-47ea-8329-e33b5b975fbe tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1309 microversion: 2.1 time: 0.102082 Jul 25 21:03:08.424914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3281/6511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:08 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:09.446788 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:09.449205 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:09.458476 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:09.459099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:09.460010 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:09.460739 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:09.663949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:09.671929 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-604e72ed-0731-4441-aea6-b2dac938afcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.229024 Jul 25 21:03:09.672801 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3231/6512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:09 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:09.781636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4d4e60c1-7c50-44d6-915a-d632d52844cb req-c57b6109-62cd-4f2f-8a9c-3524e136404c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:09.798773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4d4e60c1-7c50-44d6-915a-d632d52844cb req-c57b6109-62cd-4f2f-8a9c-3524e136404c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:09.799510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4d4e60c1-7c50-44d6-915a-d632d52844cb req-c57b6109-62cd-4f2f-8a9c-3524e136404c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:09.819266 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4d4e60c1-7c50-44d6-915a-d632d52844cb req-c57b6109-62cd-4f2f-8a9c-3524e136404c service nova] Creating event network-changed:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:03:09.825417 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4d4e60c1-7c50-44d6-915a-d632d52844cb req-c57b6109-62cd-4f2f-8a9c-3524e136404c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053300 Jul 25 21:03:09.826040 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3282/6513] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:03:10.694440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:10.695095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:10.698449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=43 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:10.703848 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:10.704324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:10.705094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:10.705539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:10.841389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:10.848903 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ea3ad4e5-2ae1-4187-95e5-efe3898d3a2f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.158362 Jul 25 21:03:10.849508 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3232/6514] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:10 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:11.872254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:11.872967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:11.874933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:11.880599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:11.881062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:11.882046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:11.882613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:12.089399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:12.097144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-81abf514-9da8-419b-8f62-bfcafb53cdc1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.230815 Jul 25 21:03:12.097915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3283/6515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:11 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:13.119222 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:13.119854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:13.127186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:13.127648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:13.128469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:13.128919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:13.520567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:13.528193 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2bb390e9-1236-4775-8585-1e9bfa3b5d35 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.413073 Jul 25 21:03:13.528767 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3233/6516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:13 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:14.377579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-12540f19-b92b-49ce-ac78-d5bcf06ecd3a req-6e42a987-00a7-40cb-9cd5-2e1977d4d17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "name": "network-vif-plugged", "status": "completed", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:14.389443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12540f19-b92b-49ce-ac78-d5bcf06ecd3a req-6e42a987-00a7-40cb-9cd5-2e1977d4d17f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:14.390053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-12540f19-b92b-49ce-ac78-d5bcf06ecd3a req-6e42a987-00a7-40cb-9cd5-2e1977d4d17f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:14.403803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-12540f19-b92b-49ce-ac78-d5bcf06ecd3a req-6e42a987-00a7-40cb-9cd5-2e1977d4d17f service nova] Creating event network-vif-plugged:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:03:14.408872 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-12540f19-b92b-49ce-ac78-d5bcf06ecd3a req-6e42a987-00a7-40cb-9cd5-2e1977d4d17f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035368 Jul 25 21:03:14.409488 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3284/6517] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:03:14.550454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:14.551083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:14.558876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:14.559426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:14.560266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:14.560722 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:14.703414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:14.711140 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1c9ec495-2c72-422e-8567-1dcc9393405e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.165082 Jul 25 21:03:14.711710 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3234/6518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:14 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:15.734302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:15.735018 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:15.742318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:15.742787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:15.743582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:15.744053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:15.893871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:15.901518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-99c3b582-983d-4974-83fc-bff3f3cfa2a8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1365 microversion: 2.1 time: 0.172138 Jul 25 21:03:15.902621 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3285/6519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:15 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:03:16.923584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:16.924226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:16.931350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:16.931806 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:16.932687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:16.933126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:17.062854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:17.070418 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ac752b06-f25c-41f4-a8c5-12efa5e5f294 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1551 microversion: 2.1 time: 0.151082 Jul 25 21:03:17.070988 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3235/6520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:16 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:17.093393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:17.093906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:17.100774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:17.101242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:17.102365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:17.102819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:17.144731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:17.167674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:17.185368 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7ad29411-558c-478d-8d52-bec04fe389a3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095996 Jul 25 21:03:17.185991 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3286/6521] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 21:03:17 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:03:18.147896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-99b3e79c-8194-464b-9531-7ea71c3f6dc6 req-7a8f8294-6c7b-4ceb-99ec-5d54b9b42208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:18.153727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:18.161273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99b3e79c-8194-464b-9531-7ea71c3f6dc6 req-7a8f8294-6c7b-4ceb-99ec-5d54b9b42208 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:18.161731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99b3e79c-8194-464b-9531-7ea71c3f6dc6 req-7a8f8294-6c7b-4ceb-99ec-5d54b9b42208 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:18.174175 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-99b3e79c-8194-464b-9531-7ea71c3f6dc6 req-7a8f8294-6c7b-4ceb-99ec-5d54b9b42208 service nova] Creating event network-changed:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:03:18.179338 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-99b3e79c-8194-464b-9531-7ea71c3f6dc6 req-7a8f8294-6c7b-4ceb-99ec-5d54b9b42208 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035168 Jul 25 21:03:18.179968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3236/6522] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:03:21.960924 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:03:21.961606 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:03:22.342744 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:03:22.343205 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:03:53.312000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=7 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:53.312795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:53.317013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:03:53.319246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:53.327919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:53.328851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:53.329643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:53.330104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:53.360194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:53.366049 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Old instance type m1.heat2, new instance type m1.heat {{(pid=119724) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 21:03:53.372381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:03:53.372826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:03:53.373319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:03:53.374327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:03:53.374758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:03:53.437836 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-117f5524-d47e-4493-a099-2f12500aad97 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/action" status: 202 len: 0 microversion: 2.1 time: 0.127636 Jul 25 21:03:53.438467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3287/6523] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:03:53 2022] POST /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:03:53.444955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=9 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:53.445765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=52 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:03:53.450140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:53.451354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:53.459313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:53.459832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:53.460597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:53.461117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:53.602392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:53.610110 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ca46cd98-23e1-41c7-b588-d65660719a4d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1678 microversion: 2.1 time: 0.167294 Jul 25 21:03:53.610688 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3237/6524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:53 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:54.633219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:54.633882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:54.640642 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:54.641171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:54.641905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:54.642350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:54.790851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:54.799478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79d717ba-b32e-47be-bd8e-fa82bc315505 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1678 microversion: 2.1 time: 0.171065 Jul 25 21:03:54.800087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3288/6525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:54 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:55.821326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:55.821983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:55.829324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:55.829779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:55.830550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:55.830997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:55.962291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:55.970385 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-56a7c63f-d300-415d-b977-85cd4451be78 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.153040 Jul 25 21:03:55.970946 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3238/6526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:55 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:56.992615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:56.993559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:57.001333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:57.001892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:57.002682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:57.003138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:57.137357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:57.146345 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c674bd3-ea48-413c-a7d5-02b4ec5f6fe7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.157150 Jul 25 21:03:57.147012 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3289/6527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:56 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:58.168689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:58.169306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:58.176927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:58.177383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:58.178184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:58.178623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:58.311785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:58.319387 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3d967a37-ded6-4325-a641-90a552c6cf83 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.154613 Jul 25 21:03:58.319965 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3239/6528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:58 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:03:59.340752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:03:59.341390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:03:59.348425 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:59.348901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:59.349691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:03:59.350150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:03:59.485670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:03:59.493296 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6dbef579-6002-453f-999a-1703c784a2c9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.156540 Jul 25 21:03:59.493872 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3290/6529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:03:59 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:00.515310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:00.515925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:00.522868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:00.523324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:00.524128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:00.524572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:00.657843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:00.665884 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-97c7016e-5057-4299-8110-18312bea7660 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.155026 Jul 25 21:04:00.666463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3240/6530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:00 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:01.687076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:01.687748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:01.694922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:01.695395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:01.696228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:01.696700 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:01.830045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:01.837830 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45449bf4-bba9-4712-a6c5-eddc911b1f14 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.154853 Jul 25 21:04:01.838416 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3291/6531] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:01 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:02.860272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:02.860819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:02.867871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:02.868367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:02.869437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:02.869893 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:03.002981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:03.010708 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f13babb4-6cd2-42ef-bdf6-72c4638acc13 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.155128 Jul 25 21:04:03.011279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3241/6532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:02 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:04.031764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:04.032427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:04.039526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:04.039984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:04.040793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:04.041242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:04.179596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:04.188109 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-876028bf-65f3-403a-a7be-6c47ff03e412 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.160178 Jul 25 21:04:04.188692 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3292/6533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:04 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:05.209508 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:05.210128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:05.217211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:05.218204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:05.218981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:05.219428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:05.354617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:05.362999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d33340d9-8496-4b07-b8b6-290522b96338 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.158242 Jul 25 21:04:05.363586 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3242/6534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:05 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:06.384358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:06.385025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:06.392635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:06.393107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:06.393903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:06.394364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:06.531504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:06.539480 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-948281bd-0089-4e64-a03e-5816a00e2d79 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.159006 Jul 25 21:04:06.540136 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3293/6535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:06 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:07.561785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:07.562407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:07.569307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:07.569763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:07.570532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:07.570971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:07.707227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:07.715814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99418f98-830e-449c-bd6c-a6be080742b5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.157897 Jul 25 21:04:07.716432 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3243/6536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:07 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:08.738550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:08.739179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:08.746986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:08.747451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:08.748274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:08.748729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:08.879910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:08.887559 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fbef911f-b0c0-4f57-9ff6-7022d762b89e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.153041 Jul 25 21:04:08.888155 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3294/6537] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:08 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:09.910559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:09.911190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:09.918177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:09.918640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:09.919420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:09.919871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:10.049966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:10.057707 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-54def685-e00a-4f5a-b8d6-78c76fa44d3b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.152247 Jul 25 21:04:10.058290 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3244/6538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:09 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:11.079683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:11.080881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:11.087990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:11.088496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:11.089316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:11.089776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:11.224934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:11.232491 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82a8223e-cb89-4c5a-8cf6-8d51da20166b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.157503 Jul 25 21:04:11.233098 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3295/6539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:11 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:04:12.254281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:12.254914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:12.262004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:12.262467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:12.263253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:12.263706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:12.396569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:12.404392 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2f80c32-dd2f-4208-9404-0dd5484d98c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.153977 Jul 25 21:04:12.404980 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3245/6540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:12 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:13.426890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:13.427576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:13.435008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:13.435476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:13.436303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:13.436761 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:13.581027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:13.588884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b404b53-33d9-4a66-b195-f8e5740a8a95 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.166306 Jul 25 21:04:13.589461 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3296/6541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:13 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:14.611971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:14.612612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:14.620345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:14.620813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:14.621603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:14.622057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:14.755620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:14.763759 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a7c10c8d-f416-47fe-9094-1f9da35f2064 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.156667 Jul 25 21:04:14.764386 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3246/6542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:14 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:04:15.785403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:15.786063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:15.793896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:15.794362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:15.795172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:15.795627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:15.964937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:15.973887 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a80067a1-ab58-4ed7-95f3-a6ae3213f1ec tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.192429 Jul 25 21:04:15.974476 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3297/6543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:15 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:16.995738 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:16.996382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:17.004009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:17.004497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:17.005279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:17.005733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:17.145636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:17.154341 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f8e22a2d-1ca8-420d-9fce-5d1c587ee06f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1683 microversion: 2.1 time: 0.162496 Jul 25 21:04:17.154922 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3247/6544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:16 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:18.176876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:18.177514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:18.185618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:18.186084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:18.187456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:18.187905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:18.224142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "name": "network-vif-unplugged", "status": "completed", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:18.241951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:18.242870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:18.263712 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] Creating event network-vif-unplugged:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h2-845775-3 Jul 25 21:04:18.270036 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] Instance a2a085ea-a310-4db5-a973-a6932c711e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:04:18.284829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bb62c8b9-9986-49c8-bb59-8cf99052d568 req-7d5d2f9e-d4c3-42c5-b579-301b92620d8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065213 Jul 25 21:04:18.287006 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3248/6545] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:18.351400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:18.359905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ae77fca-576d-4adc-b53f-d51c1029f35a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1682 microversion: 2.1 time: 0.187178 Jul 25 21:04:18.360711 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3298/6546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:18 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:19.383720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:19.384460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:19.390970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:19.391427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:19.392247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:19.392692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:19.536544 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:19.544745 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7122af35-7583-43ec-bfee-1b2630a8756f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1680 microversion: 2.1 time: 0.166139 Jul 25 21:04:19.545332 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3249/6547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:19 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:20.302757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:20.313470 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:20.313937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:20.326197 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] Creating event network-changed:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h2-845775-3 Jul 25 21:04:20.332000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] Instance a2a085ea-a310-4db5-a973-a6932c711e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:04:20.344932 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-fab75ed1-1928-492f-801c-13a613394592 req-34ad7e42-8f23-488c-9554-42cda6520f5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045852 Jul 25 21:04:20.345762 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3299/6548] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:04:20.567537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:20.568619 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:20.582692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:20.582692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:20.583421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:20.583872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:20.828736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:20.844074 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a90b6b63-db66-466a-8d7d-97730b241f99 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1680 microversion: 2.1 time: 0.279453 Jul 25 21:04:20.845506 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3250/6549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:20 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:21.870195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:21.870916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:21.879250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:21.879726 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:21.880582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:21.881047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.029567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:22.037704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-388d27c2-e4e7-4747-89a5-022e13d4dde7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1677 microversion: 2.1 time: 0.172755 Jul 25 21:04:22.038308 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3300/6550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:21 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:22.069215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:22.069769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:22.077819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.078276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.079054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.079504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.120962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.121426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.122246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.122691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.146532 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:04:22.151985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:04:22.227977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:22.266388 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d149fe17-8324-4ecc-9a8e-1dda14e765d4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/action" status: 202 len: 0 microversion: 2.1 time: 0.201069 Jul 25 21:04:22.268093 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3251/6551] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:04:22 2022] POST /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:04:22.281216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:22.282415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:22.292893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.293380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.294244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:22.294752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:22.442464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:22.450659 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b41f604f-bded-42c8-a859-dab695f25f1c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.176932 Jul 25 21:04:22.451400 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3301/6552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:22 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:23.357445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "name": "network-vif-plugged", "status": "completed", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:23.369496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:23.370122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:23.385373 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] Creating event network-vif-plugged:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h2-845775-3 Jul 25 21:04:23.393245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] Instance a2a085ea-a310-4db5-a973-a6932c711e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:04:23.404846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-26c5431c-8a69-4728-a562-1e21331077a0 req-fc24f028-ed8a-4c80-b639-09eaf125d055 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052633 Jul 25 21:04:23.405489 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3252/6553] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:23.480618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:23.482263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:23.485510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=35 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:23.491058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:23.491713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:23.492562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:23.493019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:23.496823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:23.661862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:23.671141 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-908a4425-787f-42ae-b1c2-18a7eacab33e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.194108 Jul 25 21:04:23.671743 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3302/6554] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:23 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:24.696254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:24.696979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:24.699051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:24.705833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:24.706295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:24.707084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:24.707531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:24.865373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:24.873577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-477bbeb5-5688-4067-9423-c0c0a9bed982 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.183637 Jul 25 21:04:24.874752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3253/6555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:24 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:25.897063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:25.897587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:25.906187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:25.906770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:25.907577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:25.908027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:26.131173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:26.139030 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-94b8d1e6-fdd1-43a2-8ba7-d3f6f785c78e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.246149 Jul 25 21:04:26.139941 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3303/6556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:25 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:26.235712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "name": "network-vif-unplugged", "status": "completed", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:26.247042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:26.247943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:26.260872 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] Creating event network-vif-unplugged:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:04:26.267504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] Instance a2a085ea-a310-4db5-a973-a6932c711e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:04:26.279358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e053487c-7aec-41ed-9846-67a786c18db2 req-9cf1ef3b-19d0-4930-aff0-89de30defe5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048049 Jul 25 21:04:26.280597 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3254/6557] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:27.166646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:27.167687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:27.190187 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:27.190653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:27.192063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:27.192533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:27.424893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:27.433424 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35845c00-2da3-4e49-af4f-068d528be6ed tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.272005 Jul 25 21:04:27.434017 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3304/6558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:27 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:28.298525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:28.308236 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:28.308781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:28.321509 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] Creating event network-changed:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:04:28.327680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] Instance a2a085ea-a310-4db5-a973-a6932c711e71 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:04:28.339431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9e33f1bb-083b-4821-bda7-66bfb5424155 req-f5a20371-d8b0-421d-9e7b-a02c1d52df9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046062 Jul 25 21:04:28.340096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3255/6559] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:28.456532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:28.457162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:28.463981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:28.464483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:28.465276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:28.465733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:28.610746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:28.618668 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e1a78335-cd35-4634-bf63-b77effd4ba43 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1676 microversion: 2.1 time: 0.166676 Jul 25 21:04:28.619267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3305/6560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:28 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:29.641566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:29.642278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:29.648797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:29.649281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:29.650068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:29.650510 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:29.788177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:29.798462 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-973ca029-21ea-4819-8027-24ba091050b2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1669 microversion: 2.1 time: 0.161648 Jul 25 21:04:29.799299 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3256/6561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:29 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:04:29.823797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:29.824463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:29.831734 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:29.832239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:29.833035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:29.833493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:29.979806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:29.988566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6604d065-a66a-4a24-b5e1-342fe2740320 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1669 microversion: 2.1 time: 0.172157 Jul 25 21:04:29.989088 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3306/6562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:29 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:30.008866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:30.009631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:30.016202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.016662 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.017567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.018012 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.156120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:30.164144 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5f41b0c8-edcb-4eee-9d76-f8dbe9a95ffb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1669 microversion: 2.1 time: 0.159319 Jul 25 21:04:30.164995 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3257/6563] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:30 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:04:30.185797 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:30.186308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:30.192703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.193202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.193984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.194480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.222166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:04:30.300279 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-64c47dd8-8adb-449a-a106-97760dce06ca tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 204 len: 0 microversion: 2.1 time: 0.118169 Jul 25 21:04:30.300993 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3307/6564] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:04:30 2022] DELETE /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:04:30.309595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:30.310223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:30.317247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.317702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.318481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:30.318931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:30.466760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:30.475398 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2023367b-199d-4d2f-aae9-bbe682198b1d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1675 microversion: 2.1 time: 0.170168 Jul 25 21:04:30.475984 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3258/6565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:30 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:31.497816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:31.498659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:31.506166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:31.506633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:31.507450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:31.507883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:31.685141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:31.692995 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67f6287b-fc40-4852-8a13-a3eb046f8a1e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1675 microversion: 2.1 time: 0.199767 Jul 25 21:04:31.693597 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3308/6566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:31 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:32.550713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ac56dd03-fd13-4c81-ab4e-00d3b0f63f48 req-c4dd7d23-cca2-4862-8f11-84eeb7e3ab1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a085ea-a310-4db5-a973-a6932c711e71", "name": "network-vif-deleted", "tag": "398c909d-99af-4f98-b6e3-97769d2afb77"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:32.564637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:32.570192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ac56dd03-fd13-4c81-ab4e-00d3b0f63f48 req-c4dd7d23-cca2-4862-8f11-84eeb7e3ab1a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:32.570647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ac56dd03-fd13-4c81-ab4e-00d3b0f63f48 req-c4dd7d23-cca2-4862-8f11-84eeb7e3ab1a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:32.599762 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ac56dd03-fd13-4c81-ab4e-00d3b0f63f48 req-c4dd7d23-cca2-4862-8f11-84eeb7e3ab1a service nova] Creating event network-vif-deleted:398c909d-99af-4f98-b6e3-97769d2afb77 for instance a2a085ea-a310-4db5-a973-a6932c711e71 on n-h1-845775-3 Jul 25 21:04:32.606574 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ac56dd03-fd13-4c81-ab4e-00d3b0f63f48 req-c4dd7d23-cca2-4862-8f11-84eeb7e3ab1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063965 Jul 25 21:04:32.608489 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3259/6567] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:32.716119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:32.717406 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:32.724193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:32.724910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:32.725649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:32.726269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:32.778511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:32.779329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:32.780664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lazy-loading 'fault' on Instance uuid a2a085ea-a310-4db5-a973-a6932c711e71 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:04:32.833948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:32.845566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-265e62e8-8967-4ccc-8ee3-866d1a56538b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 200 len: 1329 microversion: 2.1 time: 0.134169 Jul 25 21:04:32.846913 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3309/6568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:32 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 1329 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:33.868306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:33.869268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:33.876234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:33.876697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:33.877470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:33.877916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:33.892530 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 HTTP/1.1 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a2a085ea-a310-4db5-a973-a6932c711e71'} Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:04:33.894207 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cdf52529-3b5a-4ab4-8674-f4244f38d0f1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 404 len: 111 microversion: 2.1 time: 0.032489 Jul 25 21:04:33.898278 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3260/6569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:33 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:04:33.914810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:33.915584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:33.923552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:33.924028 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:33.924853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:33.925312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:33.939884 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 HTTP/1.1 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a2a085ea-a310-4db5-a973-a6932c711e71'} Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:04:33.941637 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-711257f4-bba9-4f7b-9452-5b140ced11c4 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 404 len: 111 microversion: 2.1 time: 0.032304 Jul 25 21:04:33.946137 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3310/6570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:33 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:04:34.049579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-547228129", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "85d31561-f208-4286-b787-684fc9dbb29f"}], "security_groups": [{"name": "tempest-securitygroup--2104765133"}], "key_name": "tempest-keypair-1416569182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:34.155923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] validate_networks() for [('85d31561-f208-4286-b787-684fc9dbb29f', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:04:34.533913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:04:34.534393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:04:34.534884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:04:34.535367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:04:34.535810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:04:34.545176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:34.545647 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:34.546464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:34.546916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:34.565397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:04:34.570843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:04:34.584408 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:04:34.586658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:04:34.632339 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [aa5bef4a-5629-4309-b906-260c9ad922b9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:04:35.641263 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [aa5bef4a-5629-4309-b906-260c9ad922b9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58566. Jul 25 21:04:35.645660 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d0085d40-9580-4836-959c-b27fc2434f05 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.600841 Jul 25 21:04:35.646445 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3261/6571] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:04:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:04:35.658500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a2e3beb-d3a5-48b3-a318-75cc5708e387 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:35.659162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5a2e3beb-d3a5-48b3-a318-75cc5708e387 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:35.726022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5a2e3beb-d3a5-48b3-a318-75cc5708e387 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:35.734104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a2e3beb-d3a5-48b3-a318-75cc5708e387 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1238 microversion: 2.1 time: 0.080400 Jul 25 21:04:35.734699 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3311/6572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:35 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:36.762199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:36.762825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:36.770207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:36.770719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:36.771567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:36.771991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:36.843852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:36.851492 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b44a0194-9b40-4f73-a7b2-15f89b77d5bb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1298 microversion: 2.1 time: 0.100144 Jul 25 21:04:36.852091 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3262/6573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:36 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:37.876437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:37.877101 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:37.884346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:37.884823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:37.886035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:37.886155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:38.036165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:38.046545 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6dc0519-c19e-45ce-acc7-82ddbb57eb9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.173846 Jul 25 21:04:38.049353 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3312/6574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:37 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:38.274113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a339cc53-b013-423c-9d35-242727daa070 req-243cecfb-ad9c-47b6-a828-2eac3a82b970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:38.287183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a339cc53-b013-423c-9d35-242727daa070 req-243cecfb-ad9c-47b6-a828-2eac3a82b970 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:38.287888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a339cc53-b013-423c-9d35-242727daa070 req-243cecfb-ad9c-47b6-a828-2eac3a82b970 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:38.304482 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a339cc53-b013-423c-9d35-242727daa070 req-243cecfb-ad9c-47b6-a828-2eac3a82b970 service nova] Creating event network-changed:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:04:38.313750 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a339cc53-b013-423c-9d35-242727daa070 req-243cecfb-ad9c-47b6-a828-2eac3a82b970 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046180 Jul 25 21:04:38.315141 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3263/6575] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:39.069149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:39.069716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:39.077106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:39.077598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:39.078558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:39.078908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:39.232698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:39.242805 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-811da954-85bb-4bdf-bde7-b12c0d97e461 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.177665 Jul 25 21:04:39.243405 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3313/6576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:39 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:40.266270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:40.266909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:40.274313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:40.274779 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:40.275567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:40.276134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:40.415396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:40.424061 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1fb4ecc9-0f6c-4352-b616-c870c702c92f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.162938 Jul 25 21:04:40.424772 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3264/6577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:40 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:41.445629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:41.446785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:41.453499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:41.453969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:41.454770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:41.455228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:41.627249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:41.635060 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-65083510-b1f0-4cb1-a808-14d154a34761 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.193531 Jul 25 21:04:41.635653 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3314/6578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:41 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:42.657555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:42.658132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:42.665490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:42.665960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:42.666834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:42.667223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:42.809255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:42.817406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77b37e20-743b-4d98-a10d-0a7da4a1093c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.163908 Jul 25 21:04:42.817981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3265/6579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:42 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:43.445830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3682b86a-fe4e-4cc6-be05-b8da312626dc req-281c4419-eda4-4f72-aff9-68ba2cd16707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-plugged", "status": "completed", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:43.456937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3682b86a-fe4e-4cc6-be05-b8da312626dc req-281c4419-eda4-4f72-aff9-68ba2cd16707 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:43.457409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3682b86a-fe4e-4cc6-be05-b8da312626dc req-281c4419-eda4-4f72-aff9-68ba2cd16707 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:43.469420 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3682b86a-fe4e-4cc6-be05-b8da312626dc req-281c4419-eda4-4f72-aff9-68ba2cd16707 service nova] Creating event network-vif-plugged:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:04:43.474467 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3682b86a-fe4e-4cc6-be05-b8da312626dc req-281c4419-eda4-4f72-aff9-68ba2cd16707 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032498 Jul 25 21:04:43.475242 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3315/6580] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:43.841597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:43.842428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:43.852768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:43.853444 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:43.854602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:43.855252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:44.002499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:44.010926 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d858ec13-feda-4616-b7bf-a6e0e665ccd0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1364 microversion: 2.1 time: 0.175574 Jul 25 21:04:44.011530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3266/6581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:43 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:45.035066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:45.035778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:45.042207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:45.042672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:45.043451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:45.043900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:45.184670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:04:45.192990 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a3fffb62-93ec-4e32-b798-168d73c41f32 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1551 microversion: 2.1 time: 0.163656 Jul 25 21:04:45.193589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3316/6582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:04:45 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:04:45.214538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:04:45.215191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:04:45.217299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:45.218909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:45.226265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:45.226926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:45.227504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:45.227955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:45.316000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a318002-f803-436b-a5f0-9dafc0ca3655 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105105 Jul 25 21:04:45.317029 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3267/6583] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 21:04:45 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:04:46.660166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1ca2e93d-0a6a-4783-a16f-a45c742244ed req-8d4bd764-054e-4e2f-974a-82fd63121d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:04:46.665044 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:04:46.673545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1ca2e93d-0a6a-4783-a16f-a45c742244ed req-8d4bd764-054e-4e2f-974a-82fd63121d54 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:04:46.674113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1ca2e93d-0a6a-4783-a16f-a45c742244ed req-8d4bd764-054e-4e2f-974a-82fd63121d54 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:04:46.687210 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1ca2e93d-0a6a-4783-a16f-a45c742244ed req-8d4bd764-054e-4e2f-974a-82fd63121d54 service nova] Creating event network-changed:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:04:46.693682 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1ca2e93d-0a6a-4783-a16f-a45c742244ed req-8d4bd764-054e-4e2f-974a-82fd63121d54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035926 Jul 25 21:04:46.693682 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3317/6584] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:05:23.994978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:23.996337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:24.000857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:24.001493 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:24.008825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:24.009324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:24.010120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:24.010570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:24.228896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:24.237242 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f4f9985e-0684-4311-a0d1-9df754761ebc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1669 microversion: 2.1 time: 0.244240 Jul 25 21:05:24.237829 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3268/6585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:23 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:24.256571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:24.257442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:24.261989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "321a640e-3d77-454f-9334-cb2c26ba5988"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:05:24.264486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:24.273798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:24.274261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:24.275051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:24.275625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:24.665810 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0a1b8fe2-8bd1-4da7-aa23-9a79732aa3ee tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411155 Jul 25 21:05:24.666708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3318/6586] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 21:05:24 2022] POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:05:35.485393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:05:35.487731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:35.490286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:35.490949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:35.497611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:35.498076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:35.498988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:35.499703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:35.533800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:35.540962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 21:05:35.547839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:05:35.548300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:05:35.549049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:05:35.549466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:05:35.549883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:05:35.620678 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3ba83c4b-454f-4582-ba84-9fef41db56c1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.139274 Jul 25 21:05:35.622131 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3269/6587] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:05:35 2022] POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:05:35.627881 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:35.628788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:05:35.632996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:35.633632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:35.641812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:35.642316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:35.643107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:35.643558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:35.785477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:35.794569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d4dbebf7-449e-48ed-b3c9-ab4194a26163 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1724 microversion: 2.1 time: 0.168624 Jul 25 21:05:35.795161 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3319/6588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:35 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:36.821801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:36.822684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:36.829569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:36.830030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:36.834142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:36.834627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:36.998027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:37.007216 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-68568969-0fdb-4ec4-ac70-8ef39648c7e9 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1724 microversion: 2.1 time: 0.192362 Jul 25 21:05:37.007804 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3270/6589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:36 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:05:38.031721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:38.032335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:38.039404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:38.039908 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:38.040737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:38.041212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:38.185907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:38.194198 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7c3ee262-301b-424e-a3d7-00f17ba6ef9d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.166291 Jul 25 21:05:38.194583 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3320/6590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:38 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:39.214875 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:39.215492 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:39.223132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:39.223591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:39.224416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:39.224862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:39.360793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:39.368883 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-240426e3-cbec-42fa-bb49-28964b0d6f6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.157936 Jul 25 21:05:39.369469 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3271/6591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:39 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:40.390392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:40.391022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:40.398089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:40.398558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:40.399351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:40.399803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:40.535981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:40.544342 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c7a88833-6c26-4556-9c54-380d038b3de6 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.157964 Jul 25 21:05:40.544935 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3321/6592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:40 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:41.567486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:41.568042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:41.575235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:41.575698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:41.576520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:41.576967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:41.716065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:41.724746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e91aa81e-07d1-4cdb-be13-54c7e407843b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.161317 Jul 25 21:05:41.725319 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3272/6593] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:41 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:42.745484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:42.746136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:42.753723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:42.754200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:42.754999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:42.755464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:42.891218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:42.899920 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6fcaa900-37af-465c-96fd-7281eb5e8585 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.158362 Jul 25 21:05:42.900639 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3322/6594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:42 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:43.921539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:43.922183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:43.929472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:43.929942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:43.930717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:43.931162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:44.065374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:44.073564 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-93b1764f-c1d8-4a48-94ea-2e6ae8208cb8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.155942 Jul 25 21:05:44.074138 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3273/6595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:43 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:45.094096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:45.094745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:45.101682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:45.102145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:45.102927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:45.103384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:45.241016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:45.249150 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-27a57084-20e4-4a49-befd-47a20a5093c8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.158881 Jul 25 21:05:45.250254 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3323/6596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:45 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:05:46.271897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:46.272601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:46.281031 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:46.281500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:46.282300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:46.282754 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:46.435635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:46.446768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-483c153b-c2c0-4f6b-af85-72f8dca11a88 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.178734 Jul 25 21:05:46.447371 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3274/6597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:46 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:47.469779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:47.470325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:47.477727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:47.478196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:47.478995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:47.479446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:47.612568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:47.621840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22bc3145-d5e4-4f23-a689-0c5cee007e70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.157010 Jul 25 21:05:47.622455 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3324/6598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:47 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:48.646090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:48.646717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:48.657151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:48.657609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:48.658396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:48.658837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:48.802471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:48.813041 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-440ffd72-aaf0-4342-8e78-8dc1ee4de188 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.170404 Jul 25 21:05:48.813646 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3275/6599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:48 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:49.835153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:49.835927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:49.843657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:49.844703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:49.845502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:49.845950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:49.987885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:49.996265 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc6c66b3-773b-4932-8220-d98265af70c3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.165149 Jul 25 21:05:49.997036 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3325/6600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:49 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:51.018717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:51.019487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:51.026633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:51.027094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:51.027884 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:51.028398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:51.167094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:51.176187 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f581abe1-f9f3-4761-bb7e-52a0068012c7 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1729 microversion: 2.1 time: 0.161944 Jul 25 21:05:51.176783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3276/6601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:51 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:52.198844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:52.199503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:52.207573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:52.208059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:52.208848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:52.209300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:52.417186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:52.425758 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e48b782c-c314-4854-8d17-54767b0b7dd3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1728 microversion: 2.1 time: 0.230890 Jul 25 21:05:52.426432 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3326/6602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:52 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:52.510921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:05:52.521521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:52.522277 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:52.537168 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] Creating event network-vif-unplugged:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h1-845775-3 Jul 25 21:05:52.549228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:05:52.561729 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c8f8c4a4-f1ac-475a-a5f0-2cf2ebbd9f42 req-3dff0947-7755-421c-88b6-560d7ece73a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121915 Jul 25 21:05:52.563067 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3277/6603] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:05:53.448500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:53.449176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:53.456679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:53.457159 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:53.457958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:53.458420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:53.595503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:53.604418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20fe5377-4d07-4581-a348-daa1d6c14af0 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1728 microversion: 2.1 time: 0.159869 Jul 25 21:05:53.606064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3327/6604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:53 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:05:54.584413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:05:54.594804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:54.595257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:54.606877 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] Creating event network-changed:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h1-845775-3 Jul 25 21:05:54.613063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:05:54.624440 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-e90abb1b-c375-41c6-9a61-e7576ea9fc33 req-2b8990a4-0695-423e-ab4b-5d3f94d47578 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045225 Jul 25 21:05:54.625431 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3278/6605] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:05:54.629430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:54.630196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:54.648433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:54.649606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:54.651252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:54.651777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:54.886913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:54.898064 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f9adcf4-a9ce-4cda-a35c-3a24ae86fa74 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.276332 Jul 25 21:05:54.898865 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3328/6606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:54 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:05:55.922025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:55.922850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:55.929736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:55.930202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:55.931135 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:55.931585 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:56.069618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:56.077818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03ac515f-f2a6-41dc-9cd6-93b4d81683d1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.161452 Jul 25 21:05:56.078354 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3279/6607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:55 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:57.102008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:57.102675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:57.109927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:57.110437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:57.111234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:57.111693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:57.255945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:57.264147 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-62f97d21-fe1c-4e47-bd13-58fe1fb9ee5e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.166284 Jul 25 21:05:57.264729 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3329/6608] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:57 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:58.285428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:58.285937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:58.293321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:58.293784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:58.294569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:58.295059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:58.436200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:58.444763 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-644045bb-b551-4b1f-93e5-3829f3f44b59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.163843 Jul 25 21:05:58.445294 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3280/6609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:58 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:05:59.466359 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:05:59.466994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:05:59.475602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:59.476107 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:59.476999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:05:59.477494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:05:59.613804 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:05:59.621923 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d46bbec-2ed6-4b57-adfb-b94242df032a tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.159561 Jul 25 21:05:59.622504 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3330/6610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:05:59 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:00.642957 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:00.643620 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:00.650784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:00.651244 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:00.652048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:00.652509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:00.786607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:00.794670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1027bbd1-e335-4adf-b070-355a6aa73b96 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.155754 Jul 25 21:06:00.795256 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3281/6611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:00 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:01.816530 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:01.817171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:01.824301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:01.824800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:01.825629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:01.826090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:01.956997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:01.965093 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c4d1e418-59bf-42de-bef2-cb8c10b36c06 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.153130 Jul 25 21:06:01.965676 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3331/6612] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:01 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:02.987698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:02.988353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:02.995670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:02.996194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:02.996986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:02.997436 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:03.134861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:03.142972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e46d3479-973f-4534-9e97-ef6fe0403bea tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.160089 Jul 25 21:06:03.143552 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3282/6613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:02 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:04.164575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:04.165157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:04.171662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:04.172175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:04.172967 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:04.173430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:04.305679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:04.314362 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7433112-3c70-4449-a2b9-dbf23cc01c28 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.154540 Jul 25 21:06:04.314944 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3332/6614] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:04 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:05.336693 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:05.337311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:05.344748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:05.345204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:05.345970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:05.346406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:05.482268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:05.492108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bbbe3479-ca63-4ad0-a72c-524052fa6b1f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1726 microversion: 2.1 time: 0.159359 Jul 25 21:06:05.492814 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3283/6615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:05 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:06.514301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:06.515585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:06.518342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=29 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:06.523564 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.524054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.524888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.525352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.528486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=85 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:06.661798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:06.670571 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3eb09540-9b4f-4c22-8408-a821629d7721 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1723 microversion: 2.1 time: 0.160197 Jul 25 21:06:06.671789 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3333/6616] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:06 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:06.692986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:06.693515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:06.696324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=35 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:06.701765 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.702230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.703709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.704200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.708946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:06.743673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.744155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.744973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.745426 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.767152 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:06:06.772371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Getting quotas for user f0439e4361e241cc97531e9e9615242d and project 514df952ac094b0bb6275ea114c9a1f0. Resources: {'cores', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:06:06.877778 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d00405f0-17cb-4e2c-ba2a-1db2c6457398 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.188920 Jul 25 21:06:06.878425 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3284/6617] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:06:06 2022] POST /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:06:06.886798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:06.887424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:06.893892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.894373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:06.895323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:06.895899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:07.099559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:07.108511 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-20e2e5aa-6af1-4cc5-ae1e-c67029785f70 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.225563 Jul 25 21:06:07.116277 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3334/6618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:06 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:08.131640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:08.132396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:08.138756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:08.139220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:08.140072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:08.140525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:08.274280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:08.282910 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a397fe4b-bdde-4a2e-99e0-e071a94871df tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.156480 Jul 25 21:06:08.283499 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3285/6619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:08 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:09.242438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-plugged", "status": "completed", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:09.253990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:09.254456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:09.271793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] Creating event network-vif-plugged:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h1-845775-3 Jul 25 21:06:09.277306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:06:09.289179 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-221a7927-0709-4faf-9f03-4454bd93ae3a req-ee0f13ec-4d44-434d-b74c-f92ef4820bd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106825 Jul 25 21:06:09.289807 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3335/6620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:09.304900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:09.305525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:09.312698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:09.313157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:09.313930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:09.314377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:09.460021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:09.468521 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08e176b1-c245-4135-a338-1099847b35b1 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.167512 Jul 25 21:06:09.469119 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3286/6621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:09 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:10.490766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:10.491521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:10.498036 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:10.498512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:10.500772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:10.500772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:10.638318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:10.647063 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-54348177-ecea-4d8e-b965-a744adc5de0c tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.161366 Jul 25 21:06:10.647651 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3336/6622] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:10 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:11.669878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:11.670633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:11.680207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:11.680672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:11.681468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:11.681918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:11.829931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:11.840340 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9dcdfa62-d00a-417f-a3e6-4915c6f8ef89 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.175228 Jul 25 21:06:11.841285 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3287/6623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:11 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:12.408507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:12.418934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:12.419401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:12.435463 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] Creating event network-vif-unplugged:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:06:12.441871 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:06:12.456363 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-bca50eca-7ccc-4e74-b6d3-5639df7ec3fd req-3815f2cd-799f-4d24-b401-a7a55dac171a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107231 Jul 25 21:06:12.457005 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3337/6624] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:12.866353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:12.867077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:12.875725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:12.876679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:12.877659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:12.878264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:13.022708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:13.031577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17859e6a-9cac-474f-b203-e6d82aa331a2 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.170016 Jul 25 21:06:13.034585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3288/6625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:12 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:14.053538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:14.054334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:14.061452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:14.062419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:14.063219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:14.063653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:14.204073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:14.212212 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e52583d3-4a2f-4b6f-a588-464a10aff060 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.163159 Jul 25 21:06:14.212793 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3338/6626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:14 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:14.472273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:14.483175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:14.484264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:14.496183 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] Creating event network-changed:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:06:14.502100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-845775-3', 'n-h1-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:06:14.513209 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f10f4b64-336a-415d-b64b-5af08768e5f6 req-cf3d228a-02ca-46f5-9a27-f941ac21fa34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044934 Jul 25 21:06:14.513842 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3289/6627] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:15.235078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:15.235845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:15.243873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:15.244375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:15.245171 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:15.245652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:15.383622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:15.392738 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-08c5b570-c9b5-4992-a7e1-41fc733b0cac tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.161806 Jul 25 21:06:15.393321 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3339/6628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:15 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:16.417846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:16.418579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:16.426801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:16.427265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:16.428157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:16.428549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:16.574829 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:16.584303 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-914284ac-db19-4237-a931-2623937047e3 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.171507 Jul 25 21:06:16.584892 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3290/6629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:16 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:17.606363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:17.606898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:17.614404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:17.614882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:17.615713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:17.616195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:17.759655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:17.767969 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5d647cec-5106-4298-a34b-5e2deb38341b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.165738 Jul 25 21:06:17.768693 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3340/6630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:17 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:18.790953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:18.791559 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:18.793594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:18.800429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:18.800894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:18.801686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:18.802158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:18.938997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:18.947711 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c5dd7c7-221e-4774-b6fb-6b366efc2209 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.161352 Jul 25 21:06:18.948343 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3291/6631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:18 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:19.971355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:19.971991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:19.979090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:19.979571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:19.980399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:19.980861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:20.114567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:20.122840 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80376fd2-c805-4fd3-b6cc-e512a77dd06e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.156031 Jul 25 21:06:20.123425 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3341/6632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:19 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:06:21.144737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:21.145362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:21.152323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:21.152776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:21.153536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:21.153973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:21.283633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:21.291819 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d1f5059d-9599-40b3-a928-707ccffc7c42 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.150949 Jul 25 21:06:21.292435 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3292/6633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:21 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:22.313536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:22.314163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:22.321385 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:22.321855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:22.322643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:22.323097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:22.454636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:22.462788 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ee1fcecb-753d-40e8-9844-0365edc5cf6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.153695 Jul 25 21:06:22.463354 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3342/6634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:22 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:23.485058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:23.485914 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:23.493004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:23.493468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:23.494250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:23.494699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:23.634711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:23.642990 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e720d18a-9e38-4e62-a739-5cb455ef392e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.162359 Jul 25 21:06:23.643666 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3293/6635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:23 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:06:24.665042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:24.665941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:24.673377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:24.674111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:24.674909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:24.675370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:24.833681 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:24.845353 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86663c19-d6b8-4804-a912-ad6f92178790 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1722 microversion: 2.1 time: 0.184524 Jul 25 21:06:24.846122 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3343/6636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:24 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:25.867266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:25.867921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:25.875071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:25.875528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:25.876350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:25.876799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.019184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:26.028320 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ccc84ee-2c83-4eae-9ea5-8062a584a133 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1715 microversion: 2.1 time: 0.164877 Jul 25 21:06:26.028924 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3294/6637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:25 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:26.050016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:26.050650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:26.057831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.058311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.059106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.059567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.208427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:26.217082 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d39455c-2db3-42c7-8a54-05f8aa6c5deb tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1715 microversion: 2.1 time: 0.171241 Jul 25 21:06:26.218118 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3344/6638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:26 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:26.239445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:26.240106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:26.247056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.247390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.248213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.248671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.398917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:26.408246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f1abb29f-ba04-40ad-b746-6119854a1e08 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1715 microversion: 2.1 time: 0.173563 Jul 25 21:06:26.408951 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3295/6639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:26 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:26.437375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:26.437945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:26.444721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.445497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.446521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.446982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.475903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:06:26.570715 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-58b3c3e0-ab76-4f07-be5b-76940a8930dd tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 204 len: 0 microversion: 2.1 time: 0.136805 Jul 25 21:06:26.575315 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3345/6640] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:06:26 2022] DELETE /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:06:26.581392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:26.582433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:26.588853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.589522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.590099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:26.590712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:26.742802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:26.752030 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6c4508d3-b5bf-4b0f-b240-81d9c953096f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1721 microversion: 2.1 time: 0.175302 Jul 25 21:06:26.752655 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3296/6641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:26 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:27.775118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:27.775834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:27.783088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:27.783569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:27.784429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:27.784885 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:27.959396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:27.967996 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-594b37e5-0e9f-4a08-bb3b-cef987d5f032 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1721 microversion: 2.1 time: 0.197148 Jul 25 21:06:27.968735 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3346/6642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:27 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:27.996298 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a21b5124-73d1-4008-8599-ef84c79ae4ed req-9a17cd07-68bc-44d8-ac62-ec332ed4523f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-plugged", "status": "completed", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:28.009951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a21b5124-73d1-4008-8599-ef84c79ae4ed req-9a17cd07-68bc-44d8-ac62-ec332ed4523f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:28.010414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a21b5124-73d1-4008-8599-ef84c79ae4ed req-9a17cd07-68bc-44d8-ac62-ec332ed4523f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:28.023018 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a21b5124-73d1-4008-8599-ef84c79ae4ed req-9a17cd07-68bc-44d8-ac62-ec332ed4523f service nova] Creating event network-vif-plugged:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:06:28.028789 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a21b5124-73d1-4008-8599-ef84c79ae4ed req-9a17cd07-68bc-44d8-ac62-ec332ed4523f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036906 Jul 25 21:06:28.029222 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3297/6643] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:28.990710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:28.991342 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:28.998588 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:28.999058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:29.000441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:29.000895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:29.073929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:29.083239 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c5673906-4745-4ee5-a5ae-a6cb226b5065 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1653 microversion: 2.1 time: 0.096726 Jul 25 21:06:29.084027 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3347/6644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:28 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:29.136051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-dc03af62-75a0-4e5f-84f6-a604d21c7e2f req-c1d77087-f242-409a-94ff-fa804101097f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9104c25d-c396-4deb-9099-7a5b9863f9d9", "name": "network-vif-deleted", "tag": "5468e702-b90d-414e-8810-09e393650674"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:29.153398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dc03af62-75a0-4e5f-84f6-a604d21c7e2f req-c1d77087-f242-409a-94ff-fa804101097f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:29.153922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-dc03af62-75a0-4e5f-84f6-a604d21c7e2f req-c1d77087-f242-409a-94ff-fa804101097f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:29.166776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-dc03af62-75a0-4e5f-84f6-a604d21c7e2f req-c1d77087-f242-409a-94ff-fa804101097f service nova] Creating event network-vif-deleted:5468e702-b90d-414e-8810-09e393650674 for instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 on n-h2-845775-3 Jul 25 21:06:29.171893 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-dc03af62-75a0-4e5f-84f6-a604d21c7e2f req-c1d77087-f242-409a-94ff-fa804101097f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046470 Jul 25 21:06:29.172960 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3298/6645] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:30.105695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:30.106545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:30.113371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:30.113848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:30.114802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:30.115526 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:30.192118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:30.194553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:30.206734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a030fa9-8feb-4b70-99d7-8d35d04e873f tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1369 microversion: 2.1 time: 0.104895 Jul 25 21:06:30.207488 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3348/6646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:30 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:31.230211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:31.230923 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:31.237427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:31.237887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:31.238658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:31.239100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:31.254800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:31.309876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:31.318558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-eb94f63a-59cb-4ca4-b4f0-aeb48849369b tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1369 microversion: 2.1 time: 0.093600 Jul 25 21:06:31.319165 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3299/6647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:31 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:32.341272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:32.342237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:32.350624 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:32.351097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:32.351918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:32.352602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:32.425057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:32.433344 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88334dbc-1b35-4482-a890-9a7b7bd9344d tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1369 microversion: 2.1 time: 0.096438 Jul 25 21:06:32.434203 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3349/6648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:32 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:33.455625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:33.456194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:33.463211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:33.463671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:33.464497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:33.464948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:33.498154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:33.498605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:33.499065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lazy-loading 'fault' on Instance uuid 9104c25d-c396-4deb-9099-7a5b9863f9d9 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:06:33.546071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0439e4361e241cc97531e9e9615242d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '514df952ac094b0bb6275ea114c9a1f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:33.554673 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6df43c17-37cf-4f15-9a04-5c330ba3d151 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 200 len: 1374 microversion: 2.1 time: 0.103662 Jul 25 21:06:33.555263 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3300/6649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:33 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 1374 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:34.578917 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:34.579565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:34.586803 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:34.587268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:34.588064 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:34.588516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:34.603118 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 HTTP/1.1 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '9104c25d-c396-4deb-9099-7a5b9863f9d9'} Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:34.604808 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b122fb76-8681-4c02-9dc0-8b922356e244 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 404 len: 111 microversion: 2.1 time: 0.031758 Jul 25 21:06:34.609006 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3350/6650] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:34 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:34.670409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:34.672706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:34.679579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:34.680048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:34.680830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:34.681267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:34.694173 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-volume_attachments HTTP/1.1 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': '9104c25d-c396-4deb-9099-7a5b9863f9d9'} Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:34.695868 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c95c410b-633a-49ab-8782-6c7bd35febf5 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030878 Jul 25 21:06:34.699968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3301/6651] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:06:34 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.026656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.027305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.030173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:38.037141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.037614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.038416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.038875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.054334 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 HTTP/1.1 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '9104c25d-c396-4deb-9099-7a5b9863f9d9'} Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.055938 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d45b7255-1dcf-4e0a-9b5b-6c6c04b6f3b8 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 404 len: 111 microversion: 2.1 time: 0.034735 Jul 25 21:06:38.060351 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3351/6652] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:06:38 2022] DELETE /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.066689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.067317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 9104c25d-c396-4deb-9099-7a5b9863f9d9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.070297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:38.076163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.076630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.077413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.078400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.092916 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 HTTP/1.1 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9104c25d-c396-4deb-9099-7a5b9863f9d9'} Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.095158 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 9104c25d-c396-4deb-9099-7a5b9863f9d9 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-830f95ed-e368-483d-9caf-b84ad485825e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9" status: 404 len: 111 microversion: 2.1 time: 0.033793 Jul 25 21:06:38.099483 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3302/6653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:38 2022] GET /compute/v2.1/servers/9104c25d-c396-4deb-9099-7a5b9863f9d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.105515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.106034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.112179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.112657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.113450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.113912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.127489 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 HTTP/1.1 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a2a085ea-a310-4db5-a973-a6932c711e71'} Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.129120 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c17075e1-29d4-491c-9a54-681fc95debcc tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 404 len: 111 microversion: 2.1 time: 0.029038 Jul 25 21:06:38.133826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3352/6654] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:06:38 2022] DELETE /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.139321 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.139951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: a2a085ea-a310-4db5-a973-a6932c711e71] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.146624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.147079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.147858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.148605 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.162527 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 HTTP/1.1 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'a2a085ea-a310-4db5-a973-a6932c711e71'} Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.164100 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance a2a085ea-a310-4db5-a973-a6932c711e71 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-202e33ab-5184-47a7-989d-56d34c98ed59 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71" status: 404 len: 111 microversion: 2.1 time: 0.030127 Jul 25 21:06:38.168106 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3303/6655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:38 2022] GET /compute/v2.1/servers/a2a085ea-a310-4db5-a973-a6932c711e71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.174355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.174874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.181117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.181849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.182413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.183075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.196601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 HTTP/1.1 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '146426d2-b7b1-4b13-8146-529266267bf4'} Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.198212 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-489b9e82-4025-4f12-bcc2-5afb7b5fad6e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 404 len: 111 microversion: 2.1 time: 0.029471 Jul 25 21:06:38.202337 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3353/6656] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:06:38 2022] DELETE /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.209209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.209846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: 146426d2-b7b1-4b13-8146-529266267bf4] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.216762 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.217228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.218032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.219082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.234580 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 HTTP/1.1 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '146426d2-b7b1-4b13-8146-529266267bf4'} Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.236259 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance 146426d2-b7b1-4b13-8146-529266267bf4 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-939bae20-82ad-4240-b1aa-b88f40d7daff tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4" status: 404 len: 111 microversion: 2.1 time: 0.032503 Jul 25 21:06:38.239941 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3304/6657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:38 2022] GET /compute/v2.1/servers/146426d2-b7b1-4b13-8146-529266267bf4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.246542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.247060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.253986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.254375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.255199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.255752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.270982 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 HTTP/1.1 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'd18eee31-3715-4559-b68d-e02e0c695a93'} Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.272629 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.276786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a03d9647-e7d3-42cd-9153-5c3b16e0dd9e tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 404 len: 111 microversion: 2.1 time: 0.031519 Jul 25 21:06:38.277896 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3354/6658] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:06:38 2022] DELETE /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.283757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.284428 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [instance: d18eee31-3715-4559-b68d-e02e0c695a93] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:38.291302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.291432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.292227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:38.292671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:38.307145 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] HTTP exception thrown: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Request method failure captured: Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 HTTP/1.1 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wRyZUYchcQVyeJxQCy_1l7JowFqG64ArpeuAxVq-ZcArGO5Vt2CgybfgG1OyN2fAnlOyHEx6kvnqNWpyke2pJBeM30HR1850qahRVWWj9gWBOU_vOGxDWyhUEuc7Qb0zohwDbVGz7ilUnWVRXkrPcEf-M20GGJDg-PheaXLSIPeno4 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/514df952ac094b0bb6275ea114c9a1f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/514df952ac094b0bb6275ea114c9a1f0"}]}] Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 514df952ac094b0bb6275ea114c9a1f0 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServerActionsTestJSON-154555179 Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: f0439e4361e241cc97531e9e9615242d Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServerActionsTestJSON-154555179-project Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd18eee31-3715-4559-b68d-e02e0c695a93'} Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:06:38.308771 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Returning 404 to user: Instance d18eee31-3715-4559-b68d-e02e0c695a93 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-453356f6-e350-49fa-8ceb-4a25117ee239 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93" status: 404 len: 111 microversion: 2.1 time: 0.031162 Jul 25 21:06:38.312364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3305/6659] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:38 2022] GET /compute/v2.1/servers/d18eee31-3715-4559-b68d-e02e0c695a93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:06:38.319463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e4d3042e-ecc9-4e21-9eb1-2fa4fd3ecf07 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] Calling method '.version_select at 0x7f1969d4da60>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:38.323594 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e4d3042e-ecc9-4e21-9eb1-2fa4fd3ecf07 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [4456bed7-0b8f-4b92-8dff-64c9d3ff5e7b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:06:39.331031 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [None req-e4d3042e-ecc9-4e21-9eb1-2fa4fd3ecf07 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] [4456bed7-0b8f-4b92-8dff-64c9d3ff5e7b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 58866. Jul 25 21:06:39.353585 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e4d3042e-ecc9-4e21-9eb1-2fa4fd3ecf07 tempest-ServerActionsTestJSON-154555179 tempest-ServerActionsTestJSON-154555179-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416569182" status: 202 len: 0 microversion: 2.1 time: 1.038396 Jul 25 21:06:39.354184 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3355/6660] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Jul 25 21:06:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416569182 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:06:41.969404 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:06:41.969924 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:06:42.489810 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:06:42.490734 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:06:49.099220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=7 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:49.100347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=21 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:49.227332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1728036868", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "cf545ae0-863f-4830-b1a0-648e3a8339d8"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:49.283811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] validate_networks() for [('cf545ae0-863f-4830-b1a0-648e3a8339d8', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:06:49.666650 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:06:49.667115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:06:49.667604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:06:49.668051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:06:49.668478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:06:49.677854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:49.678316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:49.679132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:49.679582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:49.703430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Getting quotas for project f75da4969b2d462687641314d25e1b5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:06:49.709862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Getting quotas for user ffa35d5f06274cbe963bdce10a82d8cc and project f75da4969b2d462687641314d25e1b5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:06:49.723214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:06:49.725546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:06:49.772848 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b06993c3-fc9e-427f-8cf4-d0943345760a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679941 Jul 25 21:06:49.773515 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3306/6661] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:06:49.782195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=17 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:49.784157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:06:49.793558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-446ea6dc-0e42-4664-9e27-cb3fe50eeb0e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:49.794195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-446ea6dc-0e42-4664-9e27-cb3fe50eeb0e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:49.871024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-446ea6dc-0e42-4664-9e27-cb3fe50eeb0e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:49.879102 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-446ea6dc-0e42-4664-9e27-cb3fe50eeb0e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1217 microversion: 2.1 time: 0.098671 Jul 25 21:06:49.890967 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3356/6662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:49 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:50.904632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:50.905581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:50.916774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:50.928082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:50.932126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:50.934114 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:51.014711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:51.026577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5510379c-f20e-4cf8-985a-94facf29ef07 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1277 microversion: 2.1 time: 0.129492 Jul 25 21:06:51.027418 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3307/6663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:50 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:52.051494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:52.052483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:52.060660 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:52.061389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:52.062285 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:52.062942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:52.209947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:52.219852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6db51b0f-ec77-450e-ad8b-893c88ff1875 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.174409 Jul 25 21:06:52.232117 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3357/6664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:52 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:52.469341 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b1cc40d6-2107-4f29-a102-1208a823c9ea req-af7af10a-226e-427d-970c-dd84a6d2908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28b874b-21c5-4472-b99b-291cc3622ced", "tag": "2600473f-11a2-4a34-8ee0-3ec436a473cf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:52.489042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b1cc40d6-2107-4f29-a102-1208a823c9ea req-af7af10a-226e-427d-970c-dd84a6d2908d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:52.489781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b1cc40d6-2107-4f29-a102-1208a823c9ea req-af7af10a-226e-427d-970c-dd84a6d2908d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:52.524432 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b1cc40d6-2107-4f29-a102-1208a823c9ea req-af7af10a-226e-427d-970c-dd84a6d2908d service nova] Creating event network-changed:2600473f-11a2-4a34-8ee0-3ec436a473cf for instance c28b874b-21c5-4472-b99b-291cc3622ced on n-h2-845775-3 Jul 25 21:06:52.531531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b1cc40d6-2107-4f29-a102-1208a823c9ea req-af7af10a-226e-427d-970c-dd84a6d2908d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068367 Jul 25 21:06:52.538928 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3308/6665] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:06:53.243632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:53.244384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:53.252551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:53.253024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:53.253826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:53.254284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:53.402008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:53.412776 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-93024185-d75f-4b28-9840-f8f121e6d8e6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.173049 Jul 25 21:06:53.413368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3358/6666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:53 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:54.435626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:54.436371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:54.443283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:54.443746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:54.444567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:54.445019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:54.580028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:54.587710 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-50fac9b5-aea5-4d03-9b48-b3c81ddc5628 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.157243 Jul 25 21:06:54.588325 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3309/6667] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:54 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:55.609088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:55.609764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:55.616822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:55.617292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:55.618079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:55.618536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:55.756073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:55.763742 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e01d9ae2-35fd-4ace-94e3-67cdcb12f5c3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.158704 Jul 25 21:06:55.764369 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3359/6668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:55 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:56.785449 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:56.786083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:56.793700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:56.794163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:56.794960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:56.795409 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:56.929157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:56.937509 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6375c46c-6624-483a-85b8-e1421dfce7c8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.155447 Jul 25 21:06:56.938736 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3310/6669] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:56 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:57.959598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:57.960376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:57.967386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:57.967863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:57.969256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:57.969746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:58.119244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:58.127504 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e512dddc-1f40-4e8d-8a7b-61dda573d578 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.172055 Jul 25 21:06:58.128965 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3360/6670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:57 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:06:58.176847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-24b9838e-99ee-4333-a0fd-a1c25c802efb req-e7949967-72c7-47c2-a08b-75d1a862fc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28b874b-21c5-4472-b99b-291cc3622ced", "name": "network-vif-plugged", "status": "completed", "tag": "2600473f-11a2-4a34-8ee0-3ec436a473cf"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:06:58.189667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-24b9838e-99ee-4333-a0fd-a1c25c802efb req-e7949967-72c7-47c2-a08b-75d1a862fc31 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:58.190148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-24b9838e-99ee-4333-a0fd-a1c25c802efb req-e7949967-72c7-47c2-a08b-75d1a862fc31 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:58.205908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-24b9838e-99ee-4333-a0fd-a1c25c802efb req-e7949967-72c7-47c2-a08b-75d1a862fc31 service nova] Creating event network-vif-plugged:2600473f-11a2-4a34-8ee0-3ec436a473cf for instance c28b874b-21c5-4472-b99b-291cc3622ced on n-h2-845775-3 Jul 25 21:06:58.211400 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-24b9838e-99ee-4333-a0fd-a1c25c802efb req-e7949967-72c7-47c2-a08b-75d1a862fc31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038805 Jul 25 21:06:58.212540 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3311/6671] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:06:59.150063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:06:59.150710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:06:59.158328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:59.158837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:59.159659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:06:59.160199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:06:59.316246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:06:59.324251 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bb0f15b-9873-4b18-9fbd-c3440a1063ee tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1317 microversion: 2.1 time: 0.178928 Jul 25 21:06:59.324845 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3361/6672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:06:59 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:00.349357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:00.350149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:00.354282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:00.355173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:00.364384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:00.364881 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:00.365683 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:00.366136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:00.509460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:00.518134 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-42716036-b363-4dd1-9065-f2a3aa9fd1b6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.175210 Jul 25 21:07:00.518648 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3312/6673] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:00 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:00.588232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1302294240", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "cf545ae0-863f-4830-b1a0-648e3a8339d8"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:00.599191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:00.648068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] validate_networks() for [('cf545ae0-863f-4830-b1a0-648e3a8339d8', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:07:01.041986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:07:01.042429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:07:01.042970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:07:01.043381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:07:01.043812 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:07:01.053208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:01.053672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:01.054525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:01.054982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:01.072557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Getting quotas for project f75da4969b2d462687641314d25e1b5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:07:01.078511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Getting quotas for user ffa35d5f06274cbe963bdce10a82d8cc and project f75da4969b2d462687641314d25e1b5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:07:01.090902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:07:01.093270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:07:01.139082 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0138b197-f0b8-46df-8aa9-1ba947d8dd98 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554655 Jul 25 21:07:01.140553 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3362/6674] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:07:01.151323 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3bfa3d7d-3dc8-419b-a8b8-58e786b4fb83 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:01.151949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3bfa3d7d-3dc8-419b-a8b8-58e786b4fb83 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:01.211531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3bfa3d7d-3dc8-419b-a8b8-58e786b4fb83 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:01.218430 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3bfa3d7d-3dc8-419b-a8b8-58e786b4fb83 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1217 microversion: 2.1 time: 0.070969 Jul 25 21:07:01.219049 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3313/6675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:01 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:02.239043 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:02.239866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:02.247931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:02.248536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:02.249628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:02.250361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:02.329843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:02.338349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bdd49c8b-58ae-43d8-9fab-42c338558e9a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1275 microversion: 2.1 time: 0.103348 Jul 25 21:07:02.339126 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3363/6676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:02 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:03.360429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:03.361168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:03.369718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:03.369718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:03.370395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:03.370843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:03.574772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:03.585817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79e6c159-7f69-4d8f-84bf-eb1e7897303a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.229440 Jul 25 21:07:03.586518 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3314/6677] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:03 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:03.644732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-141f61ae-c41b-438b-a9ab-1431f7f1be52 req-4fe58357-c851-4a93-af71-65fec714345e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919f3c73-eeb0-4d3b-97ac-69ba79c3aca1", "tag": "d973fb49-a864-4a60-88d1-2f7bcb5c87c5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:03.667895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-141f61ae-c41b-438b-a9ab-1431f7f1be52 req-4fe58357-c851-4a93-af71-65fec714345e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:03.669103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-141f61ae-c41b-438b-a9ab-1431f7f1be52 req-4fe58357-c851-4a93-af71-65fec714345e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:03.687577 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-141f61ae-c41b-438b-a9ab-1431f7f1be52 req-4fe58357-c851-4a93-af71-65fec714345e service nova] Creating event network-changed:d973fb49-a864-4a60-88d1-2f7bcb5c87c5 for instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 on n-h1-845775-3 Jul 25 21:07:03.693878 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-141f61ae-c41b-438b-a9ab-1431f7f1be52 req-4fe58357-c851-4a93-af71-65fec714345e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067779 Jul 25 21:07:03.694826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3364/6678] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:07:04.607639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:04.608247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:04.615459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:04.615920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:04.616887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:04.617335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:04.761151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:04.768818 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b501a742-f994-4329-88dc-0774e8043004 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.165725 Jul 25 21:07:04.769397 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3315/6679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:04 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:05.791604 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:05.792284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:05.798652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:05.799128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:05.800226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:05.800689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:05.945437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:05.954302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-79dd69c7-8688-40df-b408-d2f08aa141c0 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.167976 Jul 25 21:07:05.954880 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3365/6680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:05 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:06.975192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:06.975820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:06.983335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:06.983518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:06.984328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:06.984780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:07.135050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:07.142696 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-18ddc7fe-7664-4963-a84e-afcab775f273 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.171428 Jul 25 21:07:07.143281 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3316/6681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:06 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:08.164628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:08.165257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:08.173482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:08.173945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:08.174985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:08.175438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:08.326328 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:08.334448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cf263ac5-5dc9-4df0-8651-e91819d6994b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.174013 Jul 25 21:07:08.335324 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3366/6682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:08 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:09.356630 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:09.357292 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:09.363986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:09.364514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:09.365296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:09.365737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:09.486316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5d3c56d4-fb94-4811-96e0-8ae25fb8d2ac req-7c257e70-0ca9-450f-8fe3-19b8f5fc145c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919f3c73-eeb0-4d3b-97ac-69ba79c3aca1", "name": "network-vif-plugged", "status": "completed", "tag": "d973fb49-a864-4a60-88d1-2f7bcb5c87c5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:09.498100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5d3c56d4-fb94-4811-96e0-8ae25fb8d2ac req-7c257e70-0ca9-450f-8fe3-19b8f5fc145c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:09.498643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5d3c56d4-fb94-4811-96e0-8ae25fb8d2ac req-7c257e70-0ca9-450f-8fe3-19b8f5fc145c service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:09.511440 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5d3c56d4-fb94-4811-96e0-8ae25fb8d2ac req-7c257e70-0ca9-450f-8fe3-19b8f5fc145c service nova] Creating event network-vif-plugged:d973fb49-a864-4a60-88d1-2f7bcb5c87c5 for instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 on n-h1-845775-3 Jul 25 21:07:09.520179 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5d3c56d4-fb94-4811-96e0-8ae25fb8d2ac req-7c257e70-0ca9-450f-8fe3-19b8f5fc145c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036841 Jul 25 21:07:09.521535 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3367/6683] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:07:09.532109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:09.539685 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f47a201-e058-46f9-911a-b9e6e6e9e8f5 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.186887 Jul 25 21:07:09.540405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3317/6684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:09 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:10.563960 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:10.564783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:10.571097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:10.571566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:10.572392 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:10.572850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:10.713118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:10.722813 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e6abcaa0-2450-4c76-b9e6-d6a8fbdfbb08 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1317 microversion: 2.1 time: 0.164609 Jul 25 21:07:10.723575 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3368/6685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:10 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:11.744672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:11.745324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:11.748138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:11.755873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:11.756372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:11.757151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:11.757593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:11.896092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:11.903798 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-43327a5b-abba-45c5-bfac-2ae89df79154 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1506 microversion: 2.1 time: 0.163066 Jul 25 21:07:11.904409 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3318/6686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:11 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:11.924128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:11.924924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:11.926861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:11.927528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:11.934253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:11.934715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:11.935499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:11.935950 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:11.965060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:07:12.043803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd4f3e9c-c7c6-4a2a-b749-2c57df44bd0d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 204 len: 0 microversion: 2.1 time: 0.123752 Jul 25 21:07:12.044673 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3369/6687] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:07:11 2022] DELETE /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:07:12.056284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:12.056911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:12.063700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:12.064177 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:12.064967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:12.065405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:12.209355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:12.218562 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-539434e7-7350-4848-8730-e100093c16da tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1512 microversion: 2.1 time: 0.166054 Jul 25 21:07:12.219279 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3319/6688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:12 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:07:13.240279 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:13.241015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:13.248051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:13.248550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:13.249374 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:13.249835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:13.394231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:13.404496 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6cb08b96-8063-4ed3-8e25-c1d4d147cbf8 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1512 microversion: 2.1 time: 0.168518 Jul 25 21:07:13.405998 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3370/6689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:13 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:14.290778 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-1f23573c-275e-419f-b70b-1dadbc9e741a req-ca0980b0-2ad1-4184-98a1-237b7be03a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919f3c73-eeb0-4d3b-97ac-69ba79c3aca1", "name": "network-vif-deleted", "tag": "d973fb49-a864-4a60-88d1-2f7bcb5c87c5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:14.303643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1f23573c-275e-419f-b70b-1dadbc9e741a req-ca0980b0-2ad1-4184-98a1-237b7be03a6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:14.304300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-1f23573c-275e-419f-b70b-1dadbc9e741a req-ca0980b0-2ad1-4184-98a1-237b7be03a6d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:14.323972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-1f23573c-275e-419f-b70b-1dadbc9e741a req-ca0980b0-2ad1-4184-98a1-237b7be03a6d service nova] Creating event network-vif-deleted:d973fb49-a864-4a60-88d1-2f7bcb5c87c5 for instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 on n-h1-845775-3 Jul 25 21:07:14.341675 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-1f23573c-275e-419f-b70b-1dadbc9e741a req-ca0980b0-2ad1-4184-98a1-237b7be03a6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059713 Jul 25 21:07:14.348370 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3320/6690] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:07:14.428343 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:14.428905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:14.440990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:14.442073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:14.443437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:14.444260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:14.491413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:14.491883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:14.492409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lazy-loading 'fault' on Instance uuid 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:07:14.540934 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:14.553901 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-34401c25-9159-4f2f-9dab-09d5339e2368 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 200 len: 1307 microversion: 2.1 time: 0.130421 Jul 25 21:07:14.554738 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3371/6691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:14 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:15.579007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:15.579811 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:15.586380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.586773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.587557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.588005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.610558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 HTTP/1.1 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '919f3c73-eeb0-4d3b-97ac-69ba79c3aca1'} Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:15.612288 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 404 to user: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-82ad399d-368f-4739-a2f1-b752fb747b2b tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 404 len: 111 microversion: 2.1 time: 0.041629 Jul 25 21:07:15.620697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3321/6692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:15 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:07:15.623678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:15.624976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:15.632220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.632696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.633507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.633931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.794666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:15.803072 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-06ad9bb8-4565-4bb5-91d7-1f4b092d71aa tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.184080 Jul 25 21:07:15.803676 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3372/6693] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:15 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:15.825274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:15.828535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 2a210382-cfa7-4630-a42f-95dcfcc67b66] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:15.834658 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/2a210382-cfa7-4630-a42f-95dcfcc67b66/action HTTP/1.1 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 32 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: {"resize": {"flavorRef": "452"}} Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2a210382-cfa7-4630-a42f-95dcfcc67b66', 'body': {'resize': {'flavorRef': '452'}}} Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:07:15.836746 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 404 to user: Instance 2a210382-cfa7-4630-a42f-95dcfcc67b66 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ad5de700-00e8-4533-8af6-1b42c86a7e7f tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "POST /compute/v2.1/servers/2a210382-cfa7-4630-a42f-95dcfcc67b66/action" status: 404 len: 111 microversion: 2.1 time: 0.017246 Jul 25 21:07:15.842273 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3322/6694] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:07:15 2022] POST /compute/v2.1/servers/2a210382-cfa7-4630-a42f-95dcfcc67b66/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:07:15.848602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:15.849311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:15.855513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.855978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.856794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:15.857246 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:15.875507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:15.997353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.005566 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a30b19e1-cb9a-44db-8ce8-cbf6bc40bff6 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.160937 Jul 25 21:07:16.006149 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3373/6695] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:15 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:16.026976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.027606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.034758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.035218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.036003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.036526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.178656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.187424 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0cfcfbf8-2839-423d-a956-5544d0cb88ad tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.164363 Jul 25 21:07:16.187996 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3323/6696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:16 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:16.208003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "c961cc42-146d-46d5-aea3-b9e9ba1a0765"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:16.210644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.216704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.217181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.217993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.218454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.247140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.253364 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: request: POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action HTTP/1.1 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 65 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: {"resize": {"flavorRef": "c961cc42-146d-46d5-aea3-b9e9ba1a0765"}} Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: exception: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c28b874b-21c5-4472-b99b-291cc3622ced', 'body': {'resize': {'flavorRef': 'c961cc42-146d-46d5-aea3-b9e9ba1a0765'}}} Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 21:07:16.255336 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 400 to user: Flavor c961cc42-146d-46d5-aea3-b9e9ba1a0765 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ed78b09-d093-413b-b0e4-279cead58411 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action" status: 400 len: 107 microversion: 2.1 time: 0.053072 Jul 25 21:07:16.259946 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3374/6697] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:07:16 2022] POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 21:07:16.266378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.267035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.273450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.273910 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.274703 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.275151 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.416623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.425089 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf53786d-d40f-4c39-942a-42ddf17304a3 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.163270 Jul 25 21:07:16.425665 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3324/6698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:16 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:16.446989 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.447625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.453792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.454260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.455050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.455506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.586348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.594133 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-619e066d-4960-4104-826d-768d5f9f5c03 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.151099 Jul 25 21:07:16.594711 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3375/6699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:16 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:16.615061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5515a864-1333-4fda-a9bd-a9eb3da4720a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5515a864-1333-4fda-a9bd-a9eb3da4720a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: request: POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action HTTP/1.1 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 29 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: {"resize": {"flavorRef": ""}} Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'c28b874b-21c5-4472-b99b-291cc3622ced', 'body': {'resize': {'flavorRef': ''}}} Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise error Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi '' Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.618700 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5515a864-1333-4fda-a9bd-a9eb3da4720a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5515a864-1333-4fda-a9bd-a9eb3da4720a tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action" status: 400 len: 113 microversion: 2.1 time: 0.009210 Jul 25 21:07:16.625943 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3325/6700] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:07:16 2022] POST /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 21:07:16.629649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.630282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.637468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.637933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.638727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.639181 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.776448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:16.785489 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4d1ce851-e43c-4125-b48a-51ac340d9b64 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1507 microversion: 2.1 time: 0.159631 Jul 25 21:07:16.786181 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3376/6701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:16 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:16.811026 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.811519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.819425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.819878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.820689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.821165 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.837478 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 HTTP/1.1 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '919f3c73-eeb0-4d3b-97ac-69ba79c3aca1'} Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:07:16.839069 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 404 to user: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da676377-11a3-4ba0-955d-1bf4f6c9a074 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 404 len: 111 microversion: 2.1 time: 0.034320 Jul 25 21:07:16.843741 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3326/6702] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:07:16 2022] DELETE /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:07:16.850383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.851022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.857987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.859100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.859909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.860400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.875889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 HTTP/1.1 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '919f3c73-eeb0-4d3b-97ac-69ba79c3aca1'} Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:16.877437 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 404 to user: Instance 919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63b46e1f-7046-4d6c-9030-bce95eed711d tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1" status: 404 len: 111 microversion: 2.1 time: 0.033072 Jul 25 21:07:16.881671 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3377/6703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:16 2022] GET /compute/v2.1/servers/919f3c73-eeb0-4d3b-97ac-69ba79c3aca1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:07:16.887763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:16.888311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:16.894483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.894944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.895730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:16.896271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:16.922594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:07:16.975047 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:17.010146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e90b58e1-c450-4f22-9247-1482009d3e20 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 204 len: 0 microversion: 2.1 time: 0.125740 Jul 25 21:07:17.011074 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3327/6704] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:07:16 2022] DELETE /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:07:17.021464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:17.022322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:17.031902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:17.032410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:17.033249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:17.033692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:17.175020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:17.183627 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6aa530a-d83c-444d-b504-0e8a6f686d26 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1513 microversion: 2.1 time: 0.166439 Jul 25 21:07:17.184269 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3378/6705] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:17 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:07:18.209517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:18.210358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:18.216882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:18.217389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:18.218706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:18.219161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:18.390318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:18.398310 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-515bdcdf-fc73-4a1b-92ed-f618fc70051e tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1513 microversion: 2.1 time: 0.193396 Jul 25 21:07:18.398906 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3328/6706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:18 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:18.984504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d86e97d7-6ef4-45be-9a60-c7551b91be0f req-cbb3eb9d-260c-494c-b4d0-6f8b0c670aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28b874b-21c5-4472-b99b-291cc3622ced", "name": "network-vif-deleted", "tag": "2600473f-11a2-4a34-8ee0-3ec436a473cf"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:18.997395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d86e97d7-6ef4-45be-9a60-c7551b91be0f req-cbb3eb9d-260c-494c-b4d0-6f8b0c670aee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:18.997986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d86e97d7-6ef4-45be-9a60-c7551b91be0f req-cbb3eb9d-260c-494c-b4d0-6f8b0c670aee service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:19.014107 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d86e97d7-6ef4-45be-9a60-c7551b91be0f req-cbb3eb9d-260c-494c-b4d0-6f8b0c670aee service nova] Creating event network-vif-deleted:2600473f-11a2-4a34-8ee0-3ec436a473cf for instance c28b874b-21c5-4472-b99b-291cc3622ced on n-h2-845775-3 Jul 25 21:07:19.022524 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d86e97d7-6ef4-45be-9a60-c7551b91be0f req-cbb3eb9d-260c-494c-b4d0-6f8b0c670aee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042608 Jul 25 21:07:19.023486 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3379/6707] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:07:19.420434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:19.421002 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:19.423859 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:19.429933 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:19.430395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:19.431237 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:19.431716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:19.466808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:19.467251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:19.468335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lazy-loading 'fault' on Instance uuid c28b874b-21c5-4472-b99b-291cc3622ced {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:07:19.521447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffa35d5f06274cbe963bdce10a82d8cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75da4969b2d462687641314d25e1b5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:19.528886 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-627480bd-3145-4f2a-adaf-e5c2373c1dda tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 200 len: 1307 microversion: 2.1 time: 0.112564 Jul 25 21:07:19.529470 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3329/6708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:19 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:20.553826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:20.554550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] [instance: c28b874b-21c5-4472-b99b-291cc3622ced] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:20.556632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:20.562718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:20.563188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:20.563988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:20.564476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:20.580718 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] HTTP exception thrown: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Request method failure captured: Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced HTTP/1.1 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wXoO6O2rBAkur6n9NB9VeHpKNR4ZSyBh8yS9y4VJsd0PSls8F93qBjWlX2mvxixmtC6fba88QV4eIpi1rCWQBHvWRMsuYD-j-hGqh39sGL1RxX6sI94GaesZ-SEcfpN2Z3ABWPQggWQiFaLCcuf_kypFAgyfk6nXo6KVfRSISMUwcs Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f75da4969b2d462687641314d25e1b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f75da4969b2d462687641314d25e1b5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f75da4969b2d462687641314d25e1b5f"}]}] Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: f75da4969b2d462687641314d25e1b5f Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1695311481 Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: ffa35d5f06274cbe963bdce10a82d8cc Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-ServersNegativeTestJSON-1695311481-project Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'c28b874b-21c5-4472-b99b-291cc3622ced'} Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:07:20.582395 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] Returning 404 to user: Instance c28b874b-21c5-4472-b99b-291cc3622ced could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57e446c0-1a4b-4f9f-874d-57f41ae71907 tempest-ServersNegativeTestJSON-1695311481 tempest-ServersNegativeTestJSON-1695311481-project] 10.222.0.48 "GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced" status: 404 len: 111 microversion: 2.1 time: 0.035668 Jul 25 21:07:20.588745 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3380/6709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:20 2022] GET /compute/v2.1/servers/c28b874b-21c5-4472-b99b-291cc3622ced => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 21:07:53.614506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:53.615724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:53.785117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0c90caca-d3f8-48af-b60a-0024e9b3ef44 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: .version_select at 0x7f19695c5f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-587650112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQAUd7Wzv3BcMDIJJgnAo8ABItocFuK1A1/DXF4MxvHZCQ1n4ugyPyNF4GzDSa6hcdOt9DB0iTbR7v6e7vN4fhzW7yLn2xpr7PdtHoxcibc4fFazeA8WboRwtTTqnPPTQ=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:53.803640 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0c90caca-d3f8-48af-b60a-0024e9b3ef44 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for project 54891ead54b94a0b88bba643d9705f43. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:07:53.810120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0c90caca-d3f8-48af-b60a-0024e9b3ef44 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for user df9981b18bf74ddea43562d742c8a386 and project 54891ead54b94a0b88bba643d9705f43. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:07:53.842231 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0c90caca-d3f8-48af-b60a-0024e9b3ef44 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.229051 Jul 25 21:07:53.842969 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3330/6710] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:07:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:07:53.896537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-159044936", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-587650112", "networks": [{"uuid": "d803123c-0cc3-4494-9fe8-ae412d9a0d6c"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:53.907152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=30 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:53.907794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:07:53.961632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] validate_networks() for [('d803123c-0cc3-4494-9fe8-ae412d9a0d6c', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:07:54.375715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:07:54.376213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:07:54.376715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:07:54.377148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:07:54.377610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:07:54.387010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:54.387403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:54.388277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:54.388742 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:54.408819 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for project 54891ead54b94a0b88bba643d9705f43. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:07:54.414617 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for user df9981b18bf74ddea43562d742c8a386 and project 54891ead54b94a0b88bba643d9705f43. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:07:54.427999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:07:54.430363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:07:54.480418 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ce36a36-a595-4885-9fce-d04d0bd7292a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587668 Jul 25 21:07:54.484176 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3381/6711] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:07:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:07:54.492220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ec16d062-bea6-4140-9bc2-3d776e118942 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:54.493354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ec16d062-bea6-4140-9bc2-3d776e118942 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:54.561145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ec16d062-bea6-4140-9bc2-3d776e118942 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:54.568431 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ec16d062-bea6-4140-9bc2-3d776e118942 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1261 microversion: 2.1 time: 0.080347 Jul 25 21:07:54.569031 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3331/6712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:54 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:55.591176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:55.591865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:55.599089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:55.599822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:55.600893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:55.601561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:55.677261 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:55.685534 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eee38e43-0970-4615-9d82-66ee903ad02d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1331 microversion: 2.1 time: 0.099300 Jul 25 21:07:55.686140 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3382/6713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:55 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:56.706810 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:56.707434 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:56.725138 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:56.725596 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:56.726382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:56.726821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:56.949713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:56.959952 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-45330880-2dc2-4658-92f6-64e9dcf6cc66 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.256888 Jul 25 21:07:56.973222 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3332/6714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:56 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:57.045933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-c7b9bc03-eebe-4d7c-a152-73ab2273e64a req-063573bd-a3ed-43a9-96a1-8aecec896b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfff68d1-0378-4327-8dd1-b3ccc46348ab", "tag": "6167e59a-0bbb-4262-a9bc-e79a92eb1ce1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:07:57.067857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c7b9bc03-eebe-4d7c-a152-73ab2273e64a req-063573bd-a3ed-43a9-96a1-8aecec896b18 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:57.068344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-c7b9bc03-eebe-4d7c-a152-73ab2273e64a req-063573bd-a3ed-43a9-96a1-8aecec896b18 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:57.108254 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-c7b9bc03-eebe-4d7c-a152-73ab2273e64a req-063573bd-a3ed-43a9-96a1-8aecec896b18 service nova] Creating event network-changed:6167e59a-0bbb-4262-a9bc-e79a92eb1ce1 for instance bfff68d1-0378-4327-8dd1-b3ccc46348ab on n-h2-845775-3 Jul 25 21:07:57.115768 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-c7b9bc03-eebe-4d7c-a152-73ab2273e64a req-063573bd-a3ed-43a9-96a1-8aecec896b18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077531 Jul 25 21:07:57.116304 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3383/6715] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:07:57.987594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:57.988592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:58.000393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:58.000991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:58.002243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:58.003015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:58.160718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:58.169081 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e50b8af1-b1d1-4feb-9403-b861db6b9c14 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.188303 Jul 25 21:07:58.169629 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3333/6716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:57 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:07:59.192134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:07:59.192915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:07:59.200172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:59.200645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:59.202010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:07:59.202460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:07:59.339201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:07:59.347469 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad583c26-dbe1-4764-a22a-33777573e080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.160264 Jul 25 21:07:59.348066 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3384/6717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:07:59 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:00.368369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:00.369028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:00.376131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:00.376595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:00.377368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:00.377816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:00.518057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:00.525280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39607610-84c5-44c1-9a4f-dcded09ffb41 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.160878 Jul 25 21:08:00.525871 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3334/6718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:00 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:01.546586 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:01.547220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:01.555222 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:01.555699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:01.556535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:01.557001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:01.694790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:01.702357 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-acdf76e8-1db4-4211-8d4e-0990b6a2668d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.159764 Jul 25 21:08:01.702942 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3385/6719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:01 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:02.625547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-01da1658-d3b8-4715-a1c0-af5bc1297526 req-bfdf2994-415b-4bdc-a742-0fef2b9410b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff68d1-0378-4327-8dd1-b3ccc46348ab", "name": "network-vif-plugged", "status": "completed", "tag": "6167e59a-0bbb-4262-a9bc-e79a92eb1ce1"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:02.636382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-01da1658-d3b8-4715-a1c0-af5bc1297526 req-bfdf2994-415b-4bdc-a742-0fef2b9410b8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:02.636845 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-01da1658-d3b8-4715-a1c0-af5bc1297526 req-bfdf2994-415b-4bdc-a742-0fef2b9410b8 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:02.648314 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-01da1658-d3b8-4715-a1c0-af5bc1297526 req-bfdf2994-415b-4bdc-a742-0fef2b9410b8 service nova] Creating event network-vif-plugged:6167e59a-0bbb-4262-a9bc-e79a92eb1ce1 for instance bfff68d1-0378-4327-8dd1-b3ccc46348ab on n-h2-845775-3 Jul 25 21:08:02.653728 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-01da1658-d3b8-4715-a1c0-af5bc1297526 req-bfdf2994-415b-4bdc-a742-0fef2b9410b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033363 Jul 25 21:08:02.654554 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3335/6720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:02.723990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:02.724577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:02.731707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:02.732205 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:02.733002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:02.733452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:02.871402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:02.880315 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb9cca69-5359-4080-880b-3d9fb16c83a2 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.161198 Jul 25 21:08:02.880923 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3386/6721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:02 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:03.902557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:03.903271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:03.910603 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:03.911064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:03.911856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:03.912377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:04.064357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:04.072846 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d3c3400-1994-4318-8f5f-f20518e3e9b4 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1361 microversion: 2.1 time: 0.175507 Jul 25 21:08:04.073428 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3336/6722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:03 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:05.094035 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:05.094679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:05.097594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:05.098330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:05.104339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:05.104816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:05.105610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:05.106069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:05.241244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:05.248946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9efeb129-52de-498a-951a-c529cc7d6e37 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1554 microversion: 2.1 time: 0.158829 Jul 25 21:08:05.249543 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3387/6723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:05 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:05.270265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:05.270888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:05.272882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:05.279196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:05.279660 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:05.280480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:05.280929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:05.414785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:05.422980 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-11e209f5-b601-4d57-be4c-9479395d8305 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1554 microversion: 2.1 time: 0.156276 Jul 25 21:08:05.423563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3337/6724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:05 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:07.035407 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "230e9322-4f4f-458c-a6ba-7cc711ef87da"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:07.037941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:07.044968 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:07.045444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:07.046238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:07.046701 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:07.307850 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-67a0d607-c272-4e39-9514-220ef69f65e3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276337 Jul 25 21:08:07.308635 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3388/6725] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 21:08:07 2022] POST /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:18.034604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:18.035093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:18.037932 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:18.038658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=32 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:18.044898 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:18.045365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:18.046145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:18.046592 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:18.129355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lazy-loading 'services' on Instance uuid bfff68d1-0378-4327-8dd1-b3ccc46348ab {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:08:18.205795 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cf337fbf-1747-4594-b790-a8926dbf3bd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments/230e9322-4f4f-458c-a6ba-7cc711ef87da" status: 202 len: 0 microversion: 2.1 time: 0.174859 Jul 25 21:08:18.206334 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3338/6726] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:08:18 2022] DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments/230e9322-4f4f-458c-a6ba-7cc711ef87da => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:08:18.216306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:18.218743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:18.222845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:18.223653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:18.237641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:18.238120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:18.240678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:18.241937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:18.278782 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5388387a-b644-4a47-b09b-906c965a5d9d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067871 Jul 25 21:08:18.279384 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3389/6727] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:18 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:19.292567 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:19.294927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:19.302212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:19.302748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:19.303989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:19.304466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:19.335558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84968af2-6066-4580-abda-180f7f88d036 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048153 Jul 25 21:08:19.339354 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3339/6728] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:19 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:08:20.347535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:20.350013 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:20.357600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:20.357600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:20.357600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:20.357600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:20.391448 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3fc7945c-107d-4db8-bd50-c000a072af24 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047832 Jul 25 21:08:20.392185 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3390/6729] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:20 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:21.405681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:21.407801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:21.418261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:21.418728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:21.419525 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:21.419980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:21.452086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48c821d8-56b5-4baf-ac85-b25cb8b2761a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050424 Jul 25 21:08:21.452670 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3340/6730] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:21 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:22.465338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:22.467589 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:22.476105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:22.476578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:22.477384 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:22.477840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:22.514971 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2645ee1c-bfe1-4f06-9eee-de53c411542b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053677 Jul 25 21:08:22.515573 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3391/6731] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:22 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:23.528324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:23.530531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:23.541241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:23.541748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:23.542520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:23.542971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:23.572954 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-017c2f0b-a4e3-4123-bfd6-4b26dc30e9f6 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048704 Jul 25 21:08:23.573571 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3341/6732] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:23 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 21:08:23.585749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:23.586306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:23.595024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:23.595419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:23.596257 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:23.596853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:23.680811 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] HTTP exception thrown: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab is not attached to volume 230e9322-4f4f-458c-a6ba-7cc711ef87da Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Request method failure captured: Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments/230e9322-4f4f-458c-a6ba-7cc711ef87da HTTP/1.1 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wYkr6tH2hUs8J9X2-ZvmEhgn6xYO9J9O_QQrDudF5OcUCwKG5HYxhshWlFZ6JX9fAox5QRfQ2L0vdv8uj1ewbz1D89_MyZVk2iL_wWcnt_PWgVY-xTxALY6xYm9-DLaVimdg6qfllb3CKhfBdoZNt_0iOYDU0M_U7pGLg9yl_yN1GA Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54891ead54b94a0b88bba643d9705f43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}] Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: df9981b18bf74ddea43562d742c8a386 Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab is not attached to volume 230e9322-4f4f-458c-a6ba-7cc711ef87da Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': 'bfff68d1-0378-4327-8dd1-b3ccc46348ab', 'id': '230e9322-4f4f-458c-a6ba-7cc711ef87da'} Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 230e9322-4f4f-458c-a6ba-7cc711ef87da. Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab is not attached to volume 230e9322-4f4f-458c-a6ba-7cc711ef87da Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:23.694954 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab is not attached to volume 230e9322-4f4f-458c-a6ba-7cc711ef87da Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Returning 404 to user: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab is not attached to volume 230e9322-4f4f-458c-a6ba-7cc711ef87da {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8e808ba2-cfa7-4303-a7b4-79f98cbb1f5d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments/230e9322-4f4f-458c-a6ba-7cc711ef87da" status: 404 len: 154 microversion: 2.1 time: 0.114867 Jul 25 21:08:23.699525 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3392/6733] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:08:23 2022] DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab/os-volume_attachments/230e9322-4f4f-458c-a6ba-7cc711ef87da => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:08:27.062395 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:27.063045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:27.070336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:27.071071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:27.071856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:27.072488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:27.100691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:08:27.186095 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7620fe53-e659-4e77-8f5c-1376afb41ced tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 204 len: 0 microversion: 2.1 time: 0.127184 Jul 25 21:08:27.187123 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3342/6734] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:08:27 2022] DELETE /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:08:27.198373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:27.199413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:27.212194 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:27.212811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:27.213741 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:27.214599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:27.382845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:27.391857 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bffc9b74-5575-4039-a22a-06f63ccfc2a8 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1560 microversion: 2.1 time: 0.198959 Jul 25 21:08:27.392509 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3393/6735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:27 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:28.415343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:28.416142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:28.423480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:28.423940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:28.424767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:28.426209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:28.577574 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:28.587009 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6fbefc1c-4e32-46e6-aea2-56b64872a1dc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1560 microversion: 2.1 time: 0.176134 Jul 25 21:08:28.587624 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3343/6736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:28 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:29.351429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d8f11daa-d01a-4968-99ca-2e780e5ae053 req-91f5a1f9-c54b-45d6-8d89-a2879b37ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff68d1-0378-4327-8dd1-b3ccc46348ab", "name": "network-vif-deleted", "tag": "6167e59a-0bbb-4262-a9bc-e79a92eb1ce1"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:29.363877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d8f11daa-d01a-4968-99ca-2e780e5ae053 req-91f5a1f9-c54b-45d6-8d89-a2879b37ba11 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:29.364455 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d8f11daa-d01a-4968-99ca-2e780e5ae053 req-91f5a1f9-c54b-45d6-8d89-a2879b37ba11 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:29.377796 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d8f11daa-d01a-4968-99ca-2e780e5ae053 req-91f5a1f9-c54b-45d6-8d89-a2879b37ba11 service nova] Creating event network-vif-deleted:6167e59a-0bbb-4262-a9bc-e79a92eb1ce1 for instance bfff68d1-0378-4327-8dd1-b3ccc46348ab on n-h2-845775-3 Jul 25 21:08:29.383165 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d8f11daa-d01a-4968-99ca-2e780e5ae053 req-91f5a1f9-c54b-45d6-8d89-a2879b37ba11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035673 Jul 25 21:08:29.383868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3394/6737] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:29.608359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:29.608888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:29.616797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:29.617259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:29.618049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:29.618506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:29.651335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:29.651747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:29.652266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lazy-loading 'fault' on Instance uuid bfff68d1-0378-4327-8dd1-b3ccc46348ab {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:08:29.702712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:29.710488 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-17da6192-c697-4298-8762-5dc3085d7215 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 200 len: 1351 microversion: 2.1 time: 0.106100 Jul 25 21:08:29.710993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3344/6738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:29 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:30.733674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:30.734910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bfff68d1-0378-4327-8dd1-b3ccc46348ab] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:30.741371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:30.741842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:30.742632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:30.743090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:30.757314 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] HTTP exception thrown: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Request method failure captured: Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab HTTP/1.1 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wYkr6tH2hUs8J9X2-ZvmEhgn6xYO9J9O_QQrDudF5OcUCwKG5HYxhshWlFZ6JX9fAox5QRfQ2L0vdv8uj1ewbz1D89_MyZVk2iL_wWcnt_PWgVY-xTxALY6xYm9-DLaVimdg6qfllb3CKhfBdoZNt_0iOYDU0M_U7pGLg9yl_yN1GA Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54891ead54b94a0b88bba643d9705f43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}] Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: df9981b18bf74ddea43562d742c8a386 Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'bfff68d1-0378-4327-8dd1-b3ccc46348ab'} Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:30.758970 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Returning 404 to user: Instance bfff68d1-0378-4327-8dd1-b3ccc46348ab could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-759ec17c-017c-4764-9b54-2c0d23434500 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab" status: 404 len: 111 microversion: 2.1 time: 0.032019 Jul 25 21:08:30.763431 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3395/6739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:30 2022] GET /compute/v2.1/servers/bfff68d1-0378-4327-8dd1-b3ccc46348ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:08:30.769293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-034e46ab-476f-493d-90d5-657da0df5551 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '.version_select at 0x7f19698adee0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:30.789633 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-034e46ab-476f-493d-90d5-657da0df5551 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-587650112" status: 202 len: 0 microversion: 2.1 time: 0.024179 Jul 25 21:08:30.790215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3345/6740] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Jul 25 21:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-587650112 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:08:30.807963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-901013ca-5067-4ddb-9e63-6faf2a5b9eed tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: .version_select at 0x7f1968bc6160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1875212537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETViOSuJ5GlDJAVF/kr/oxxb/wMxalBQiZ6Ehzz3/yl84rC31QEhaBj/EDN/Hl66JKL4Qae8SpuYB8WjQcNlDr3C9cuJ6jzzKiyQXl0biCzuusqeOYoGfCJKT6DmA6EWw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:30.824728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-901013ca-5067-4ddb-9e63-6faf2a5b9eed tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for project 54891ead54b94a0b88bba643d9705f43. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:08:30.829951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-901013ca-5067-4ddb-9e63-6faf2a5b9eed tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for user df9981b18bf74ddea43562d742c8a386 and project 54891ead54b94a0b88bba643d9705f43. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:08:30.853924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-901013ca-5067-4ddb-9e63-6faf2a5b9eed tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049980 Jul 25 21:08:30.854572 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3396/6741] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:08:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:30.904857 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-60203554", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1875212537", "networks": [{"uuid": "d803123c-0cc3-4494-9fe8-ae412d9a0d6c"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:30.960102 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] validate_networks() for [('d803123c-0cc3-4494-9fe8-ae412d9a0d6c', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:08:31.680638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:08:31.681069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:08:31.681554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:08:31.681967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:08:31.682420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:08:31.692071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:31.692534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:31.693342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:31.693786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:31.711052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for project 54891ead54b94a0b88bba643d9705f43. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:08:31.716393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Getting quotas for user df9981b18bf74ddea43562d742c8a386 and project 54891ead54b94a0b88bba643d9705f43. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:08:31.728753 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:08:31.731039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:08:31.777914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f96fe11-625a-4689-97ed-15ea7ffeb595 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876927 Jul 25 21:08:31.778601 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3346/6742] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:08:31.789446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d3a1d5a5-d59a-4378-80fb-c3217ede7a02 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:31.790672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d3a1d5a5-d59a-4378-80fb-c3217ede7a02 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:31.848513 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d3a1d5a5-d59a-4378-80fb-c3217ede7a02 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:31.856215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d3a1d5a5-d59a-4378-80fb-c3217ede7a02 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1261 microversion: 2.1 time: 0.070639 Jul 25 21:08:31.856796 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3397/6743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:31 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:32.878065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:32.878730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:32.885256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:32.885719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:32.886504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:32.886947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:32.955411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:32.963742 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b622fd1c-897f-40f6-9087-b6e48acde8ce tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1321 microversion: 2.1 time: 0.090426 Jul 25 21:08:32.964607 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3347/6744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:32 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:33.987314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:33.987953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:33.996315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:33.997103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:33.997924 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:33.998383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:34.146306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:34.156084 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3ec6a2ef-17c9-40a1-8d5b-931fe47b544a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.173427 Jul 25 21:08:34.158282 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3398/6745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:33 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:08:34.589028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-629c4569-b5da-4066-b098-43304e28ee26 req-9c7b5b4e-95ca-48a4-86a2-d156f098fd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd1072d-c0d5-46eb-8158-761c16fa2187", "tag": "4a32e019-4508-4fb4-8752-aa88d7b532e8"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:34.615736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-629c4569-b5da-4066-b098-43304e28ee26 req-9c7b5b4e-95ca-48a4-86a2-d156f098fd08 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:34.616818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-629c4569-b5da-4066-b098-43304e28ee26 req-9c7b5b4e-95ca-48a4-86a2-d156f098fd08 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:34.631073 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-629c4569-b5da-4066-b098-43304e28ee26 req-9c7b5b4e-95ca-48a4-86a2-d156f098fd08 service nova] Creating event network-changed:4a32e019-4508-4fb4-8752-aa88d7b532e8 for instance bdd1072d-c0d5-46eb-8158-761c16fa2187 on n-h2-845775-3 Jul 25 21:08:34.638820 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-629c4569-b5da-4066-b098-43304e28ee26 req-9c7b5b4e-95ca-48a4-86a2-d156f098fd08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054082 Jul 25 21:08:34.639563 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3348/6746] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:35.179370 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:35.179911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:35.186962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:35.188010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:35.188862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:35.189323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:35.329657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:35.337705 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8ba7ca5d-2565-490c-b66d-634a22259080 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.162542 Jul 25 21:08:35.338305 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3399/6747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:35 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:36.360242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:36.360963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:36.367402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:36.367867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:36.368668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:36.369118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:36.514746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:36.522898 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c6ee2cfb-6b00-4e77-be33-24d4c961a280 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.167854 Jul 25 21:08:36.523472 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3349/6748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:36 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:37.543713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:37.544332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:37.551762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:37.552432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:37.553238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:37.553690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:37.682909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:37.691002 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-44f4054a-73ff-4a2b-9ba5-5c995b8cafd1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.151314 Jul 25 21:08:37.691580 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3400/6749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:37 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:38.713483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:38.714506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:38.722776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:38.723243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:38.724377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:38.724685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:38.750052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-67ca9a9e-83f4-4c84-b687-a3b61c157b67 req-8bd5e185-9b6f-434c-b5a2-69915dc2ebe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd1072d-c0d5-46eb-8158-761c16fa2187", "name": "network-vif-plugged", "status": "completed", "tag": "4a32e019-4508-4fb4-8752-aa88d7b532e8"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:38.761536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-67ca9a9e-83f4-4c84-b687-a3b61c157b67 req-8bd5e185-9b6f-434c-b5a2-69915dc2ebe7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:38.762180 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-67ca9a9e-83f4-4c84-b687-a3b61c157b67 req-8bd5e185-9b6f-434c-b5a2-69915dc2ebe7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:38.777021 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-67ca9a9e-83f4-4c84-b687-a3b61c157b67 req-8bd5e185-9b6f-434c-b5a2-69915dc2ebe7 service nova] Creating event network-vif-plugged:4a32e019-4508-4fb4-8752-aa88d7b532e8 for instance bdd1072d-c0d5-46eb-8158-761c16fa2187 on n-h2-845775-3 Jul 25 21:08:38.782978 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-67ca9a9e-83f4-4c84-b687-a3b61c157b67 req-8bd5e185-9b6f-434c-b5a2-69915dc2ebe7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036658 Jul 25 21:08:38.783788 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3401/6750] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:38.881886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:38.889577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ce9fa0e7-ee4f-4033-ac32-752c7b269107 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.180427 Jul 25 21:08:38.890155 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3350/6751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:38 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:39.914052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:39.914777 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:39.922772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:39.923240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:39.924062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:39.924538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:40.085826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:40.094340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8bc9828-66f9-4e41-9612-3c00bc6f5303 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1361 microversion: 2.1 time: 0.185049 Jul 25 21:08:40.094954 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3402/6752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:39 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:08:41.115623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:41.116215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:41.123109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:41.123560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:41.124351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:41.125376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:41.258342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:41.265957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7611ab3f-56f6-4a5e-900b-34d23b311e2b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1554 microversion: 2.1 time: 0.154391 Jul 25 21:08:41.266530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3351/6753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:41 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:41.287408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:41.288060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:41.295317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:41.295788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:41.297163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:41.297623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:41.436907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:08:41.444654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bc70f07b-14d8-4086-8ff1-9134b849257d tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1554 microversion: 2.1 time: 0.161175 Jul 25 21:08:41.445243 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3403/6754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:08:41 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:08:42.974971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea6caf01-473c-4ff4-96c5-24b758a547f6"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:08:42.977478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:42.979498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:42.980215 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:42.987741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:42.988309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:42.989034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:42.989483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:43.228480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:43.239156 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-49937cbe-b56b-42bd-baef-df90c88d4dbc tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "POST /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267975 Jul 25 21:08:43.239785 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3352/6755] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 21:08:42 2022] POST /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:54.002824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:54.003373 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:54.005391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:54.007056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:54.007744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=66 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:54.014854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:54.015330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:54.016166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:54.016631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:54.098587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lazy-loading 'services' on Instance uuid bdd1072d-c0d5-46eb-8158-761c16fa2187 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:08:54.171173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3111fd9b-5086-4017-aeca-ae1dd9f34ed3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments/ea6caf01-473c-4ff4-96c5-24b758a547f6" status: 202 len: 0 microversion: 2.1 time: 0.172768 Jul 25 21:08:54.172546 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3404/6756] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:08:53 2022] DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments/ea6caf01-473c-4ff4-96c5-24b758a547f6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:08:54.179422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:08:54.184348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:54.186896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:54.195901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:54.196393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:54.197184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:54.197645 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:54.236304 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1822dbd5-8aef-4e7f-8590-cc4c10ad76d3 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058694 Jul 25 21:08:54.236905 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3353/6757] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:54 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:08:55.250375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:55.253045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:55.260730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:55.261202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:55.261997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:55.262456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:55.293915 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b96a09ec-0ff2-45d5-b2a6-3251cca0a53b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Jul 25 21:08:55.294507 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3405/6758] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:55 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:56.306797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:56.309276 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:56.316259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:56.316814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:56.317724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:56.318500 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:56.350212 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-13ab06cd-a3c7-40c9-8924-157447eff3f5 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Jul 25 21:08:56.350797 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3354/6759] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:56 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:57.363471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:57.366104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:57.373092 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:57.373562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:57.374424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:57.374886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:57.405518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-867b7cb8-021f-4827-b7f9-e687c3f1674f tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Jul 25 21:08:57.406655 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3406/6760] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:57 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:58.418503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:58.420951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:58.430232 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:58.430689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:58.431477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:58.431920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:58.464897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ca32e3f-49db-49c5-a82a-dc695cbb3238 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050356 Jul 25 21:08:58.465493 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3355/6761] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:58 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:08:59.480362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:59.483605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:59.493713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:59.494245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:59.495114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:59.495575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:59.526392 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9259a71b-9411-4246-9804-269a84fff1f1 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052730 Jul 25 21:08:59.526971 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3407/6762] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:08:59 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 21:08:59.537457 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:08:59.537996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:08:59.547526 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:59.547980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:59.548796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:08:59.549406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:08:59.634973 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] HTTP exception thrown: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 is not attached to volume ea6caf01-473c-4ff4-96c5-24b758a547f6 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Request method failure captured: Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: request: DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments/ea6caf01-473c-4ff4-96c5-24b758a547f6 HTTP/1.1 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wYkr6tH2hUs8J9X2-ZvmEhgn6xYO9J9O_QQrDudF5OcUCwKG5HYxhshWlFZ6JX9fAox5QRfQ2L0vdv8uj1ewbz1D89_MyZVk2iL_wWcnt_PWgVY-xTxALY6xYm9-DLaVimdg6qfllb3CKhfBdoZNt_0iOYDU0M_U7pGLg9yl_yN1GA Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54891ead54b94a0b88bba643d9705f43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}] Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: df9981b18bf74ddea43562d742c8a386 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 is not attached to volume ea6caf01-473c-4ff4-96c5-24b758a547f6 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'server_id': 'bdd1072d-c0d5-46eb-8158-761c16fa2187', 'id': 'ea6caf01-473c-4ff4-96c5-24b758a547f6'} Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea6caf01-473c-4ff4-96c5-24b758a547f6. Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 is not attached to volume ea6caf01-473c-4ff4-96c5-24b758a547f6 Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:08:59.637034 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 is not attached to volume ea6caf01-473c-4ff4-96c5-24b758a547f6 Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Returning 404 to user: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 is not attached to volume ea6caf01-473c-4ff4-96c5-24b758a547f6 {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f28d603a-8ed5-49f8-b739-2b6ad2ee0017 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments/ea6caf01-473c-4ff4-96c5-24b758a547f6" status: 404 len: 154 microversion: 2.1 time: 0.105243 Jul 25 21:08:59.642251 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3356/6763] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:08:59 2022] DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187/os-volume_attachments/ea6caf01-473c-4ff4-96c5-24b758a547f6 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:09:02.994591 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:02.995178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:03.002696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:03.003161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:03.003954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:03.004438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:03.034794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:09:03.123137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc391a6b-ce92-45ec-8865-59f2f51bf60b tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 204 len: 0 microversion: 2.1 time: 0.132228 Jul 25 21:09:03.123959 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3408/6764] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:09:02 2022] DELETE /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:09:03.140672 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:03.141566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:03.152225 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:03.152700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:03.153538 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:03.153994 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:03.322112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:03.340752 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b79c5137-c6e8-40c7-b117-3cc95b2a0eb0 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1560 microversion: 2.1 time: 0.210322 Jul 25 21:09:03.341415 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3357/6765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:03 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:09:04.363861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:04.364611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:04.372413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:04.372886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:04.373699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:04.374152 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:04.528892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:04.539419 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa3c8d74-9d96-495a-8d59-6883f8bf3fe7 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1560 microversion: 2.1 time: 0.179979 Jul 25 21:09:04.540639 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3409/6766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:04 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:05.564553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:05.565226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:05.565739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-62e23ee3-a77d-4609-a6db-0a1806c636d8 req-1f301af2-d1f7-4113-8903-47ca14cc905b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd1072d-c0d5-46eb-8158-761c16fa2187", "name": "network-vif-deleted", "tag": "4a32e019-4508-4fb4-8752-aa88d7b532e8"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:05.572271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:05.572725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:05.573512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:05.574213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:05.576685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-62e23ee3-a77d-4609-a6db-0a1806c636d8 req-1f301af2-d1f7-4113-8903-47ca14cc905b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:05.577151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-62e23ee3-a77d-4609-a6db-0a1806c636d8 req-1f301af2-d1f7-4113-8903-47ca14cc905b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:05.591616 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-62e23ee3-a77d-4609-a6db-0a1806c636d8 req-1f301af2-d1f7-4113-8903-47ca14cc905b service nova] Creating event network-vif-deleted:4a32e019-4508-4fb4-8752-aa88d7b532e8 for instance bdd1072d-c0d5-46eb-8158-761c16fa2187 on n-h2-845775-3 Jul 25 21:09:05.601556 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-62e23ee3-a77d-4609-a6db-0a1806c636d8 req-1f301af2-d1f7-4113-8903-47ca14cc905b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039417 Jul 25 21:09:05.602374 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3410/6767] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:09:05.651256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9981b18bf74ddea43562d742c8a386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54891ead54b94a0b88bba643d9705f43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:05.661334 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-834a746e-1884-4203-89cb-9317f057d95a tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 200 len: 1518 microversion: 2.1 time: 0.103567 Jul 25 21:09:05.661942 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3358/6768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:05 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 1518 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:06.683559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:06.684209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] [instance: bdd1072d-c0d5-46eb-8158-761c16fa2187] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:06.691958 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:06.692945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:06.693239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:06.693696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:06.707083 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] HTTP exception thrown: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Request method failure captured: Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 HTTP/1.1 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wYkr6tH2hUs8J9X2-ZvmEhgn6xYO9J9O_QQrDudF5OcUCwKG5HYxhshWlFZ6JX9fAox5QRfQ2L0vdv8uj1ewbz1D89_MyZVk2iL_wWcnt_PWgVY-xTxALY6xYm9-DLaVimdg6qfllb3CKhfBdoZNt_0iOYDU0M_U7pGLg9yl_yN1GA Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54891ead54b94a0b88bba643d9705f43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54891ead54b94a0b88bba643d9705f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54891ead54b94a0b88bba643d9705f43"}]}] Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 54891ead54b94a0b88bba643d9705f43 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1193684541 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: df9981b18bf74ddea43562d742c8a386 Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestEncryptedCinderVolumes-1193684541-project Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'bdd1072d-c0d5-46eb-8158-761c16fa2187'} Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:09:06.708769 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Returning 404 to user: Instance bdd1072d-c0d5-46eb-8158-761c16fa2187 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c987dbb5-cfb2-45f5-b640-f6226587c542 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187" status: 404 len: 111 microversion: 2.1 time: 0.031173 Jul 25 21:09:06.712999 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3411/6769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:06 2022] GET /compute/v2.1/servers/bdd1072d-c0d5-46eb-8158-761c16fa2187 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:09:06.719097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6f0be086-d1de-4e54-9fd9-a27c366e8539 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] Calling method '.version_select at 0x7f196964e5e0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:06.741109 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6f0be086-d1de-4e54-9fd9-a27c366e8539 tempest-TestEncryptedCinderVolumes-1193684541 tempest-TestEncryptedCinderVolumes-1193684541-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1875212537" status: 202 len: 0 microversion: 2.1 time: 0.025664 Jul 25 21:09:06.741598 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3359/6770] 10.222.0.48 () {58 vars in 1278 bytes} [Mon Jul 25 21:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1875212537 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:09:34.610832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-68fd5016-38ad-4368-ba5d-3b7b13e26623 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: .version_select at 0x7f196eb5da60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1822073073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4uUCo7i44VGR9UqnT6lqKE+l53et7YzD5mGrWJlg3UYsClp+GyUcxYZr1JRfDC/CP7rHcqjW2jXc8HZcIRpg9utdwAruKQP1gNBuU6a0x/+cuQNIXyHn+spi7XXjIGUQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:34.616873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:34.617548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:34.632543 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-68fd5016-38ad-4368-ba5d-3b7b13e26623 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for project 972d82817d9047d0ac8127566c145b09. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:09:34.638140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-68fd5016-38ad-4368-ba5d-3b7b13e26623 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for user 07f2d0134dbf4cb88e087a0ee91e1527 and project 972d82817d9047d0ac8127566c145b09. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:09:34.661614 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-68fd5016-38ad-4368-ba5d-3b7b13e26623 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055147 Jul 25 21:09:34.662222 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3412/6771] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:09:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:09:34.711396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=36 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:34.712235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:34.716505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1198720601", "imageRef": "75f804c2-1306-4542-a0c6-25028f140eed", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1822073073", "networks": [{"uuid": "6ea3e45c-257b-4814-a1ac-d6f556962630"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:34.770833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] validate_networks() for [('6ea3e45c-257b-4814-a1ac-d6f556962630', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:09:35.161175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:09:35.161612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:09:35.162097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:09:35.162513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:09:35.162955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:09:35.172524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:35.172979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:35.173790 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:35.174234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:35.192453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for project 972d82817d9047d0ac8127566c145b09. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:09:35.197743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for user 07f2d0134dbf4cb88e087a0ee91e1527 and project 972d82817d9047d0ac8127566c145b09. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:09:35.210064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:09:35.212300 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75f804c2-1306-4542-a0c6-25028f140eed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:09:35.258780 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-33eca36a-eccc-44b8-8390-b1136c6ec0f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549069 Jul 25 21:09:35.259445 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3360/6772] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:09:35.270231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d307da3c-97e3-43c6-b94b-b38153fe8e42 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:35.270869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d307da3c-97e3-43c6-b94b-b38153fe8e42 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:35.327317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d307da3c-97e3-43c6-b94b-b38153fe8e42 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:35.336798 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d307da3c-97e3-43c6-b94b-b38153fe8e42 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1259 microversion: 2.1 time: 0.070494 Jul 25 21:09:35.337757 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3413/6773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:35 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:36.359459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:36.360122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:36.371304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:36.371913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:36.372745 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:36.373388 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:36.443614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:36.452850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35fb6431-6baf-4367-8b83-179fb20e689d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1317 microversion: 2.1 time: 0.096355 Jul 25 21:09:36.458678 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3361/6774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:36 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:37.473367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:37.474025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:37.481421 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:37.481888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:37.482716 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:37.483690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:37.633585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:37.641185 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8cfa3124-2ef8-40e5-9485-c1a982fc3a54 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.171789 Jul 25 21:09:37.642050 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3414/6775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:37 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:38.662252 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:38.662804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:38.669812 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:38.670294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:38.671080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:38.671527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:38.805009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:38.813381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-934359c7-4c04-42d7-aef5-453139f7d0d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.155164 Jul 25 21:09:38.813964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3362/6776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:38 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:39.834326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:39.834955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:39.842094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:39.842601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:39.843397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:39.843870 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:39.983935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:39.993294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5eac6d07-d758-442a-9bdb-059d7496cdf6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.162948 Jul 25 21:09:39.993896 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3415/6777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:39 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:41.015410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:41.016109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:41.025231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:41.025727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:41.026534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:41.027301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:41.174008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:41.182735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da40d03b-197f-48be-9d10-7534ff8dc6bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.171866 Jul 25 21:09:41.183327 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3363/6778] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:41 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:42.206686 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:42.207463 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:42.214856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:42.215490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:42.216389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:42.216854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:42.358510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:42.366264 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05b547ee-b8ec-4d84-89ab-a8f294222fbb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.164692 Jul 25 21:09:42.366864 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3416/6779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:42 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:43.386877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:43.387521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:43.395943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:43.396522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:43.397379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:43.397940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:43.581479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:43.589027 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-da4cb5c9-70ff-4428-84d2-f398d419df3b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.206095 Jul 25 21:09:43.589605 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3364/6780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:43 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:44.611213 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:44.611835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:44.619001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:44.619472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:44.620278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:44.620730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:44.754829 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:44.762725 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f70cc5f-37ed-4042-9b47-80a91b346a83 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.155993 Jul 25 21:09:44.763345 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3417/6781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:44 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:45.784373 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:45.785124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:45.787872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:45.788734 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:45.796140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:45.796607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:45.797638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:45.798282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:45.944118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:45.952003 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c99dd21-2f5c-4827-8a54-754e7714e83d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.171492 Jul 25 21:09:45.952624 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3365/6782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:45 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:46.974902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:46.975556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:46.977827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:09:46.984954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:46.985494 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:46.986751 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:46.987401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:47.125830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:47.133626 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9129cb5-128d-48a7-83ea-10ba9fa497ae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.162657 Jul 25 21:09:47.134223 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3418/6783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:46 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:48.156686 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:48.158127 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:48.166185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:48.166644 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:48.167511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:48.168050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:48.300764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:48.308662 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f696175c-7de2-410e-b2e6-d4ba6a2c9695 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.157236 Jul 25 21:09:48.309252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3366/6784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:48 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:49.310344 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-89b9fb2b-9609-4275-b873-000e8f1209c4 req-7ccd6e9c-c6ac-46b1-b039-e1b441062965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:49.323176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-89b9fb2b-9609-4275-b873-000e8f1209c4 req-7ccd6e9c-c6ac-46b1-b039-e1b441062965 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:49.324148 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-89b9fb2b-9609-4275-b873-000e8f1209c4 req-7ccd6e9c-c6ac-46b1-b039-e1b441062965 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:49.330880 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:49.332287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:49.346996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:49.349717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:49.351004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:49.354478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:49.361597 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-89b9fb2b-9609-4275-b873-000e8f1209c4 req-7ccd6e9c-c6ac-46b1-b039-e1b441062965 service nova] Creating event network-changed:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:09:49.377979 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-89b9fb2b-9609-4275-b873-000e8f1209c4 req-7ccd6e9c-c6ac-46b1-b039-e1b441062965 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066185 Jul 25 21:09:49.378792 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3419/6785] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:09:49.518636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:49.526447 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-09256494-486c-448e-bc87-f02f35e313f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.200439 Jul 25 21:09:49.527052 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3367/6786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:49 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:09:50.547414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:50.548168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:50.555775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:50.556270 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:50.557065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:50.557516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:50.692595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:50.700304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a959be0-c9cd-424f-8be2-31c70bb2717a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.157140 Jul 25 21:09:50.701018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3420/6787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:50 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:51.723939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:51.724590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:51.731438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:51.731892 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:51.733198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:51.733676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:51.874659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:51.883236 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5c835fb8-c82d-4472-be16-27adb8f891f4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.164538 Jul 25 21:09:51.884390 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3368/6788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:51 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:52.904424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:52.905727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:52.912723 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:52.913199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:52.914001 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:52.914461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:53.054276 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:53.079403 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-45efb32d-1087-4ae8-a4ed-e48fd93ca434 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.177492 Jul 25 21:09:53.080984 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3421/6789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:52 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:53.236455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-90eb6929-4614-4c7a-9842-f227e3202b48 req-24628d7a-6650-4b73-8c13-8c314eef37fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "name": "network-vif-plugged", "status": "completed", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:53.248097 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-90eb6929-4614-4c7a-9842-f227e3202b48 req-24628d7a-6650-4b73-8c13-8c314eef37fb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:53.248642 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-90eb6929-4614-4c7a-9842-f227e3202b48 req-24628d7a-6650-4b73-8c13-8c314eef37fb service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:53.260240 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-90eb6929-4614-4c7a-9842-f227e3202b48 req-24628d7a-6650-4b73-8c13-8c314eef37fb service nova] Creating event network-vif-plugged:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:09:53.266067 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-90eb6929-4614-4c7a-9842-f227e3202b48 req-24628d7a-6650-4b73-8c13-8c314eef37fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033911 Jul 25 21:09:53.266910 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3369/6790] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:09:54.110357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:54.110984 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:54.118750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:54.119218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:54.120008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:54.120492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:54.266671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:54.275192 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9dd34c76-6b4e-4b20-897d-6754b03497b5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1359 microversion: 2.1 time: 0.169190 Jul 25 21:09:54.275808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3422/6791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:54 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:55.299659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:55.300458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:55.307075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.307542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.308336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.308776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.706257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:55.714114 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9607ded-1807-44be-8d00-856888848fb0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1549 microversion: 2.1 time: 0.419597 Jul 25 21:09:55.714705 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3370/6792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:55 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1549 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:55.734710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:55.735336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:55.742315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.742776 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.743558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.744010 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.877806 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:55.885507 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-50b1e6c2-5e33-4a03-811a-53d920c2dcc8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1549 microversion: 2.1 time: 0.155203 Jul 25 21:09:55.886099 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3423/6793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:55 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:55.906130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:55.910698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:55.911491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Searching by: {'deleted': False, 'project_id': '972d82817d9047d0ac8127566c145b09'} {{(pid=119723) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 21:09:55.916989 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.917438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.918264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.918700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.943174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.multi_cell_list [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119723) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 21:09:55.970256 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39f9ee6f-fc17-4d3c-bb64-34d78b2c46d0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067947 Jul 25 21:09:55.970843 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3371/6794] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 21:09:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:09:55.982154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:09:55.982916 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:55.989298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.989764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:55.990550 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:55.991007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:56.125641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:09:56.133295 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-214e9368-410a-4681-88fc-26d0d4bc5c58 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1549 microversion: 2.1 time: 0.155096 Jul 25 21:09:56.133876 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3424/6795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:09:55 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:09:57.682679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cb18501-3990-4388-b81b-5357bd9e1d84"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:09:57.685060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:09:57.692670 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:57.693131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:57.693899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:09:57.694343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:09:57.935011 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a398cf9d-6569-4a7d-b2b4-6e9784d9a69e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255955 Jul 25 21:09:57.935752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3372/6796] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 21:09:57 2022] POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:10:10.981405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:10:10.982040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:10:10.984548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:10:10.985215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=62 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:10:10.990831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:10.991297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:10.992117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:10.992574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:11.132514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:10:11.141963 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-63227689-f546-474f-9e7b-fb024c7f8329 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1595 microversion: 2.1 time: 0.164771 Jul 25 21:10:11.142566 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3425/6797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:10:10 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:10:13.031468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-220f4abd-c63b-4ac3-bbc8-4db76a273b76 req-f2c7f889-2bf6-4492-b735-ac0c4c56a795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:10:13.047982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:10:13.048748 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:10:13.049860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:10:13.053576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-220f4abd-c63b-4ac3-bbc8-4db76a273b76 req-f2c7f889-2bf6-4492-b735-ac0c4c56a795 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:13.054363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-220f4abd-c63b-4ac3-bbc8-4db76a273b76 req-f2c7f889-2bf6-4492-b735-ac0c4c56a795 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:13.070070 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-220f4abd-c63b-4ac3-bbc8-4db76a273b76 req-f2c7f889-2bf6-4492-b735-ac0c4c56a795 service nova] Creating event network-changed:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:10:13.076392 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-220f4abd-c63b-4ac3-bbc8-4db76a273b76 req-f2c7f889-2bf6-4492-b735-ac0c4c56a795 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049390 Jul 25 21:10:13.077830 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3373/6798] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:10:14.274628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2116636601"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:10:14.275189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:10:14.284791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:14.285269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:14.286553 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:14.287389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:14.443567 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.security_group_api [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Adding security group cbb2593b-c3a7-43c9-819d-4d5b28b47bc1 to port ec832de1-cc0f-4ea8-bdd2-98b94de325aa Jul 25 21:10:14.803600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43ed0e0d-d2be-4a01-8021-dca697a5348b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action" status: 202 len: 0 microversion: 2.1 time: 0.532901 Jul 25 21:10:14.804659 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3426/6799] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:10:14 2022] POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:10:14.824519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:10:14.827246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:10:14.844381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:14.845124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:14.845813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:14.846421 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:15.041344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:10:15.055848 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-01ce7690-eb3f-42a3-8b78-1d2a29469cc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1761 microversion: 2.1 time: 0.239940 Jul 25 21:10:15.056530 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3374/6800] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:10:14 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1761 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:10:15.093561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4875c437-b35c-4849-8837-a2c8f2edde1b req-cc215bff-2734-4cbf-a480-51998b088c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:10:15.104136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4875c437-b35c-4849-8837-a2c8f2edde1b req-cc215bff-2734-4cbf-a480-51998b088c9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:10:15.104659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4875c437-b35c-4849-8837-a2c8f2edde1b req-cc215bff-2734-4cbf-a480-51998b088c9b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:10:15.117444 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4875c437-b35c-4849-8837-a2c8f2edde1b req-cc215bff-2734-4cbf-a480-51998b088c9b service nova] Creating event network-changed:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:10:15.124195 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4875c437-b35c-4849-8837-a2c8f2edde1b req-cc215bff-2734-4cbf-a480-51998b088c9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Jul 25 21:10:15.124742 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3427/6801] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:11:41.981123 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:11:41.981730 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:11:41.996540 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:11:41.996710 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:11:42.357498 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:11:42.358037 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:11:53.724554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:11:53.725469 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=8 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:11:53.729344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:11:53.731659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:11:53.738673 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:53.739137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:53.739918 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:53.740407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:53.815723 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-84a4aaca-6818-4bd3-92f5-dc2c8fc57858 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action" status: 202 len: 0 microversion: 2.1 time: 0.093548 Jul 25 21:11:53.816684 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3375/6802] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:11:53 2022] POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:11:53.825079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:11:53.825844 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:11:53.831091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:11:53.832022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:11:53.843142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:53.844499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:53.845072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:53.845682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:54.110094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:11:54.118610 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c039ad39-7f9f-42c3-b749-4cc0901ad4f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1763 microversion: 2.1 time: 0.296881 Jul 25 21:11:54.119196 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3428/6803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:11:53 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1763 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:11:55.142120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:11:55.142838 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:11:55.150536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:55.151006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:55.151825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:11:55.152310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:11:55.357422 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:11:55.366091 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-13147d1d-9975-4138-8ad1-c49dba3be101 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1761 microversion: 2.1 time: 0.228399 Jul 25 21:11:55.366664 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3376/6804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:11:55 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1761 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:12:19.324842 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:12:19.325391 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:13:09.363773 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:13:09.364752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:09.365507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:09.370496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2116636601"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:09.371048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:09.378034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:09.378496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:09.379275 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:09.379725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:09.511870 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.network.security_group_api [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Removing security group cbb2593b-c3a7-43c9-819d-4d5b28b47bc1 from port ec832de1-cc0f-4ea8-bdd2-98b94de325aa Jul 25 21:13:09.865298 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-07d566c5-9f1d-451f-bab3-b7290acaa7d5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action" status: 202 len: 0 microversion: 2.1 time: 0.502958 Jul 25 21:13:09.867090 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3429/6805] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:13:09 2022] POST /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:13:09.880304 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:13:09.895625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:09.896684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:09.988952 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-cde6258f-471f-4cf8-8d94-7ea05f12081e req-fa10ca41-e74a-490f-92ef-2a0cdfd84cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:10.004437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cde6258f-471f-4cf8-8d94-7ea05f12081e req-fa10ca41-e74a-490f-92ef-2a0cdfd84cc4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:10.005365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-cde6258f-471f-4cf8-8d94-7ea05f12081e req-fa10ca41-e74a-490f-92ef-2a0cdfd84cc4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:10.021566 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-cde6258f-471f-4cf8-8d94-7ea05f12081e req-fa10ca41-e74a-490f-92ef-2a0cdfd84cc4 service nova] Creating event network-changed:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:13:10.028957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-cde6258f-471f-4cf8-8d94-7ea05f12081e req-fa10ca41-e74a-490f-92ef-2a0cdfd84cc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151769 Jul 25 21:13:10.030391 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3377/6806] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:11.385866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:11.386393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:11.394953 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60066. Jul 25 21:13:11.400024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:11.400510 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:11.401305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:11.401753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:11.490128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lazy-loading 'services' on Instance uuid 496e4a1c-6216-4935-b66d-bbdded1d2e5f {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:13:11.564936 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d9d638b7-f7f5-4060-ad64-971c5ad80d9f tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments/8cb18501-3990-4388-b81b-5357bd9e1d84" status: 202 len: 0 microversion: 2.1 time: 0.186816 Jul 25 21:13:11.565982 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3430/6807] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:13:11 2022] DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments/8cb18501-3990-4388-b81b-5357bd9e1d84 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:13:11.577595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:11.580056 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:11.587903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:11.588466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:11.589313 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:11.589824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:11.600888 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60074. Jul 25 21:13:11.631942 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5610905f-1418-4eac-a0ab-d9cf79f6acc2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058905 Jul 25 21:13:11.632867 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3378/6808] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:11 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:12.046162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8dd1812c-887a-48db-ab83-ccd65111fc3d req-cb14e471-9ee1-4651-ac20-69634a9413ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:12.057585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8dd1812c-887a-48db-ab83-ccd65111fc3d req-cb14e471-9ee1-4651-ac20-69634a9413ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:12.058050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8dd1812c-887a-48db-ab83-ccd65111fc3d req-cb14e471-9ee1-4651-ac20-69634a9413ba service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:12.073284 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8dd1812c-887a-48db-ab83-ccd65111fc3d req-cb14e471-9ee1-4651-ac20-69634a9413ba service nova] Creating event network-changed:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:13:12.078440 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8dd1812c-887a-48db-ab83-ccd65111fc3d req-cb14e471-9ee1-4651-ac20-69634a9413ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036535 Jul 25 21:13:12.079888 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3431/6809] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:12.645126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:12.647345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:12.655073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:12.655536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:12.656351 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:12.656804 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:12.687023 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c4717f40-91ca-4808-9bab-9080ff20edbf tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Jul 25 21:13:12.687621 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3379/6810] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:12 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:13.702710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:13.705489 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:13.712609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:13.713087 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:13.713893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:13.714358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:13.750332 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e2541365-74a5-4e85-94e3-6b57f8acc297 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054491 Jul 25 21:13:13.751600 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3432/6811] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:13 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:14.765218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:14.767406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:14.774439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:14.774899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:14.775676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:14.776141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:14.810890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-47904bb7-bdd2-48df-8337-9b87fb7dfb61 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Jul 25 21:13:14.811501 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3380/6812] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:14 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:15.823574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:15.825886 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:15.833065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:15.833535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:15.834327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:15.834778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:15.864744 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f5259204-b835-42e1-b0ad-7b0e9c9e99b4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Jul 25 21:13:15.865332 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3433/6813] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:15 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:16.877635 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:16.879791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:16.887413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:16.887874 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:16.888692 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:16.889140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:16.919793 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f3dcaa31-b500-43d6-885e-639e40288251 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046084 Jul 25 21:13:16.920442 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3381/6814] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:13:16 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 21:13:16.931910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:16.932483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:16.944830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:16.945296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:16.946902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:16.947293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:17.025677 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] HTTP exception thrown: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f is not attached to volume 8cb18501-3990-4388-b81b-5357bd9e1d84 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Request method failure captured: Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments/8cb18501-3990-4388-b81b-5357bd9e1d84 HTTP/1.1 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wZ_HU_V-sOAebnbCpdxzw0Af_Ceb5PGtbt8YmsgvBl4lxAhZtuwEDDfzq4Uv6KjNIDzynjNpsBWuG6CyaAfP5bhlFbASkBy8_iNzp04Bt6ho7dJ7b8XRrkPlNQxMGcAQXRkocUutbY7aiUG3DKCpwmKwooFD0yRKfAlNqm3w19PHQc Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_972d82817d9047d0ac8127566c145b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/972d82817d9047d0ac8127566c145b09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}] Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 07f2d0134dbf4cb88e087a0ee91e1527 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f is not attached to volume 8cb18501-3990-4388-b81b-5357bd9e1d84 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': '496e4a1c-6216-4935-b66d-bbdded1d2e5f', 'id': '8cb18501-3990-4388-b81b-5357bd9e1d84'} Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8cb18501-3990-4388-b81b-5357bd9e1d84. Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f is not attached to volume 8cb18501-3990-4388-b81b-5357bd9e1d84 Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:13:17.027310 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f is not attached to volume 8cb18501-3990-4388-b81b-5357bd9e1d84 Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Returning 404 to user: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f is not attached to volume 8cb18501-3990-4388-b81b-5357bd9e1d84 {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ca873090-905a-4e35-bb20-5b897e996cda tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments/8cb18501-3990-4388-b81b-5357bd9e1d84" status: 404 len: 154 microversion: 2.1 time: 0.101802 Jul 25 21:13:17.031940 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3434/6815] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:13:16 2022] DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f/os-volume_attachments/8cb18501-3990-4388-b81b-5357bd9e1d84 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:13:20.287609 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:20.288140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:20.294746 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:20.295202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:20.295975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:20.296466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:20.321455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:13:20.405568 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2187230f-66c8-4a70-b3d5-15bf7bc27f86 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 204 len: 0 microversion: 2.1 time: 0.121703 Jul 25 21:13:20.406730 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3382/6816] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:13:20 2022] DELETE /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:13:20.414942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:20.415585 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:20.423792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:20.424350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:20.425164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:20.425620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:20.571542 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:20.580227 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c21df0e1-91de-4f5f-97a6-433f8a787e72 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1555 microversion: 2.1 time: 0.169119 Jul 25 21:13:20.580826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3435/6817] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:20 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:21.602239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:21.602906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:21.610725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:21.611185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:21.611977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:21.612450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:21.753582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:21.764850 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-38c88193-e99b-45bf-b1c9-67443774abb2 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1555 microversion: 2.1 time: 0.166941 Jul 25 21:13:21.765446 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3383/6818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:21 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:22.509086 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:13:22.509086 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Jul 25 21:13:22.588646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b8e6a6f4-cccd-4e22-9d29-79b4bfd92e12 req-4ae12e1a-38d6-405a-881b-20fa7b43e96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496e4a1c-6216-4935-b66d-bbdded1d2e5f", "name": "network-vif-deleted", "tag": "ec832de1-cc0f-4ea8-bdd2-98b94de325aa"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:22.599705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8e6a6f4-cccd-4e22-9d29-79b4bfd92e12 req-4ae12e1a-38d6-405a-881b-20fa7b43e96b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:22.600203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b8e6a6f4-cccd-4e22-9d29-79b4bfd92e12 req-4ae12e1a-38d6-405a-881b-20fa7b43e96b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:22.612008 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b8e6a6f4-cccd-4e22-9d29-79b4bfd92e12 req-4ae12e1a-38d6-405a-881b-20fa7b43e96b service nova] Creating event network-vif-deleted:ec832de1-cc0f-4ea8-bdd2-98b94de325aa for instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f on n-h2-845775-3 Jul 25 21:13:22.617157 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b8e6a6f4-cccd-4e22-9d29-79b4bfd92e12 req-4ae12e1a-38d6-405a-881b-20fa7b43e96b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115477 Jul 25 21:13:22.618632 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3436/6819] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:22.788271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:22.788909 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:22.797602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:22.798203 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:22.799202 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:22.799816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:22.835279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:22.835844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:22.836860 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lazy-loading 'fault' on Instance uuid 496e4a1c-6216-4935-b66d-bbdded1d2e5f {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:13:22.890847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:22.899636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bbc68ddf-2724-47e9-b988-4f6030a5bf7b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 200 len: 1349 microversion: 2.1 time: 0.115302 Jul 25 21:13:22.900337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3384/6820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:22 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:23.930709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:23.931429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: 496e4a1c-6216-4935-b66d-bbdded1d2e5f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:23.938728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:23.939298 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:23.940138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:23.940601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:23.955693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] HTTP exception thrown: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Request method failure captured: Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f HTTP/1.1 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wZ_HU_V-sOAebnbCpdxzw0Af_Ceb5PGtbt8YmsgvBl4lxAhZtuwEDDfzq4Uv6KjNIDzynjNpsBWuG6CyaAfP5bhlFbASkBy8_iNzp04Bt6ho7dJ7b8XRrkPlNQxMGcAQXRkocUutbY7aiUG3DKCpwmKwooFD0yRKfAlNqm3w19PHQc Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_972d82817d9047d0ac8127566c145b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/972d82817d9047d0ac8127566c145b09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}] Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 07f2d0134dbf4cb88e087a0ee91e1527 Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '496e4a1c-6216-4935-b66d-bbdded1d2e5f'} Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:13:23.957444 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Returning 404 to user: Instance 496e4a1c-6216-4935-b66d-bbdded1d2e5f could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-09ccd9dc-4594-4af8-a038-62ffc54b69d6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f" status: 404 len: 111 microversion: 2.1 time: 0.033441 Jul 25 21:13:23.962218 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3437/6821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:23 2022] GET /compute/v2.1/servers/496e4a1c-6216-4935-b66d-bbdded1d2e5f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:13:23.968141 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ffcfdd0b-7adc-4719-ad81-e76fe1659ec0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '.version_select at 0x7f196962b4c0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:23.993099 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ffcfdd0b-7adc-4719-ad81-e76fe1659ec0 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1822073073" status: 202 len: 0 microversion: 2.1 time: 0.028521 Jul 25 21:13:23.993917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3385/6822] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 21:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1822073073 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:13:33.004509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e569bfe5-5cca-4aca-9ca3-ebb32b1c091d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: .version_select at 0x7f1968c14af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1441276254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT6JRgIYUUT2ITAPRizfohp7vMQZSBTsgyJZbnvhm2jhR3PkEzIIhHIP7LZtkuN8JN4Dr5a+9EMDvtZFCl5LY0CEPOi9ChkuPPOtA4/MIzUiNivcspwiPUIffu+VVwECA=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:33.020991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e569bfe5-5cca-4aca-9ca3-ebb32b1c091d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for project 972d82817d9047d0ac8127566c145b09. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:13:33.027446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-e569bfe5-5cca-4aca-9ca3-ebb32b1c091d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for user 07f2d0134dbf4cb88e087a0ee91e1527 and project 972d82817d9047d0ac8127566c145b09. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:13:33.054347 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e569bfe5-5cca-4aca-9ca3-ebb32b1c091d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053734 Jul 25 21:13:33.055001 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3438/6823] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:13:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:33.101757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:33.106625 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1533675930", "imageRef": "0496a2c7-03a3-4c30-a229-f3aee640339d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1441276254", "networks": [{"uuid": "6ea3e45c-257b-4814-a1ac-d6f556962630"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:33.160261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] validate_networks() for [('6ea3e45c-257b-4814-a1ac-d6f556962630', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:13:33.594867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:13:33.595301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:13:33.595787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:13:33.596325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:13:33.596679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:13:33.605584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:33.606040 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:33.606847 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:33.607291 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:33.624488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for project 972d82817d9047d0ac8127566c145b09. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:13:33.629671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Getting quotas for user 07f2d0134dbf4cb88e087a0ee91e1527 and project 972d82817d9047d0ac8127566c145b09. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:13:33.642464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:13:33.644694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0496a2c7-03a3-4c30-a229-f3aee640339d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:13:33.690709 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35e8d22a-8cf2-42fc-8b78-ee137e48e4bd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590731 Jul 25 21:13:33.691374 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3386/6824] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:13:33.702721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a91726de-d15e-48a7-8c7e-13f8324eb3e4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:33.703349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a91726de-d15e-48a7-8c7e-13f8324eb3e4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:33.759965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a91726de-d15e-48a7-8c7e-13f8324eb3e4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:33.766934 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a91726de-d15e-48a7-8c7e-13f8324eb3e4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1259 microversion: 2.1 time: 0.068249 Jul 25 21:13:33.767562 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3439/6825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:33 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:34.789524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:34.790149 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:34.797366 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:34.798066 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:34.799021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:34.799461 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:34.874112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:34.882212 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-147bdfd6-e2f6-4542-a831-24ff27daa5b3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1319 microversion: 2.1 time: 0.097844 Jul 25 21:13:34.883968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3387/6826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:34 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:35.904760 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:35.905390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:35.907369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:35.914807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:35.915508 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:35.916515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:35.917118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:36.087699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:36.096349 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-38d41ba5-a8af-4b13-ad06-68e1f57e403b tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.195340 Jul 25 21:13:36.097226 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3440/6827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:35 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:37.118593 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:37.119980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:37.126879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:37.127333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:37.128154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:37.128599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:37.285053 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:37.296695 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d569466d-46d6-401d-b28d-ab48e956db21 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.181593 Jul 25 21:13:37.297893 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3388/6828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:37 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:38.322833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:38.323747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:38.331242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:38.331719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:38.332559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:38.333019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:38.505244 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:38.517974 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-71ef0c5f-4230-4e7d-aab3-dbbaa2d9091e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.198740 Jul 25 21:13:38.518720 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3441/6829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:38 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:39.539008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:39.540711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:39.548123 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:39.548679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:39.549548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:39.550063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:39.700488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:39.708858 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3365441b-e05a-4f83-831f-8a4cc8cde34e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.173806 Jul 25 21:13:39.712463 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3389/6830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:39 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:40.730153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:40.730851 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:40.734034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:40.739491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:40.739999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:40.740867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:40.741381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:40.889399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:40.899396 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2f5b8006-f18a-46d9-8df8-46e75bd3f276 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.171773 Jul 25 21:13:40.908748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3442/6831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:40 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:41.922533 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:41.924021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:41.931950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:41.933487 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:41.933950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:41.934735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:41.935171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:42.083279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:42.093150 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a26b8eb6-8002-4907-beea-7d06a1017312 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.175715 Jul 25 21:13:42.094059 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3390/6832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:41 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:43.118709 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:43.119484 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:43.126186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:43.126649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:43.127627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:43.128278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:43.350249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:43.358734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4ee806aa-a466-48a9-aee3-b190fd1d1ee5 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.244153 Jul 25 21:13:43.359571 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3443/6833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:43 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:43.594871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5330b981-038f-4ff5-a6ba-a4f55df7695f req-778ebeef-a00c-4a1d-a581-281d02d8affa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:43.613124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5330b981-038f-4ff5-a6ba-a4f55df7695f req-778ebeef-a00c-4a1d-a581-281d02d8affa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:43.614089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5330b981-038f-4ff5-a6ba-a4f55df7695f req-778ebeef-a00c-4a1d-a581-281d02d8affa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:43.634858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:43.638117 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:43.642355 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5330b981-038f-4ff5-a6ba-a4f55df7695f req-778ebeef-a00c-4a1d-a581-281d02d8affa service nova] Creating event network-changed:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:13:43.652859 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5330b981-038f-4ff5-a6ba-a4f55df7695f req-778ebeef-a00c-4a1d-a581-281d02d8affa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061340 Jul 25 21:13:43.653978 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3391/6834] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:44.378907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:44.379545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:44.381476 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:13:44.387783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:44.388290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:44.389086 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:44.389539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:44.523118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:44.531182 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-04dc32b3-80eb-4c39-a08e-c35677f1f607 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.156287 Jul 25 21:13:44.531760 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3444/6835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:44 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:45.554666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:45.555716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:45.562731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:45.563678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:45.564565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:45.565424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:45.703403 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:45.712231 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-db9b9209-df24-4b8c-9e4e-c813d2dfca15 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.163239 Jul 25 21:13:45.713172 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3392/6836] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:45 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:46.734133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:46.734768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:46.742197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:46.742666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:46.743472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:46.743932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:46.938072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:46.945924 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-db88690f-a55f-475a-ad05-3941b82378f6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.215765 Jul 25 21:13:46.946511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3445/6837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:46 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:47.972308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:47.972938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:47.979873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:47.980437 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:47.981381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:47.982400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:48.123723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:48.136507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9f250f6f-1a01-4b21-9619-334bc4d3936e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.168044 Jul 25 21:13:48.137239 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3393/6838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:47 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:49.159293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:49.160253 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:49.168867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:49.168867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:49.169622 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:49.170142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:49.240512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-ce25441f-15ad-4c83-ace8-826d5aa9b2c1 req-98a7d6fc-96af-4861-9bf6-cd650cad9343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "name": "network-vif-plugged", "status": "completed", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:49.254076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ce25441f-15ad-4c83-ace8-826d5aa9b2c1 req-98a7d6fc-96af-4861-9bf6-cd650cad9343 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:49.254736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-ce25441f-15ad-4c83-ace8-826d5aa9b2c1 req-98a7d6fc-96af-4861-9bf6-cd650cad9343 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:49.266280 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-ce25441f-15ad-4c83-ace8-826d5aa9b2c1 req-98a7d6fc-96af-4861-9bf6-cd650cad9343 service nova] Creating event network-vif-plugged:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:13:49.271676 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-ce25441f-15ad-4c83-ace8-826d5aa9b2c1 req-98a7d6fc-96af-4861-9bf6-cd650cad9343 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110422 Jul 25 21:13:49.272187 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3394/6839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:13:49.337290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:49.345921 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f14b817-4c20-4751-afaf-3887d5f525f3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.190573 Jul 25 21:13:49.347249 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3446/6840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:49 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:50.368523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:50.369239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:50.375613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:50.376096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:50.376873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:50.377319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:50.774353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:50.782123 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a88d76f0-7a06-47d5-9b79-8d981bf4ca77 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1359 microversion: 2.1 time: 0.418797 Jul 25 21:13:50.782801 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3395/6841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:50 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:51.803052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:51.804072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:51.811169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:51.811632 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:51.812460 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:51.812911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:51.952717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:51.961290 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0536fa1b-4c76-41f6-a71f-057d676e10a6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1550 microversion: 2.1 time: 0.162212 Jul 25 21:13:51.961888 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3447/6842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:51 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:51.982090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:51.982808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:51.990535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:51.991081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:51.991871 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:51.992873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:52.137993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:52.145955 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b934b1cc-675d-4e2d-9772-48f35d58125c tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1550 microversion: 2.1 time: 0.167912 Jul 25 21:13:52.146551 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3396/6843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:51 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:52.169128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:52.174051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:52.174832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Searching by: {'deleted': False, 'project_id': '972d82817d9047d0ac8127566c145b09'} {{(pid=119724) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 21:13:52.181306 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:52.181766 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:52.182601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:52.183051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:52.208173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.multi_cell_list [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 21:13:52.235294 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9dd27bac-dc73-49fb-9cba-4c45c0550f40 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070260 Jul 25 21:13:52.235887 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3448/6844] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Jul 25 21:13:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:13:52.247786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:13:52.248482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:52.254595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:52.255061 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:52.255840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:52.256319 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:52.392234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:13:52.400215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dd084b13-8073-42e0-b553-842ce2c98764 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1550 microversion: 2.1 time: 0.156221 Jul 25 21:13:52.401208 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3397/6845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:13:52 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:13:53.926048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d43aa3-a060-4cfb-a1db-147a3c5afecd"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:13:53.928721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:13:53.936142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:53.936680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:53.937485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:13:53.937936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:13:54.189704 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0718e824-f081-48f2-8f3b-3148965cd012 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267457 Jul 25 21:13:54.190604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3449/6846] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Jul 25 21:13:53 2022] POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:14:04.963702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:04.964365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:04.967417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=15 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:04.968142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=60 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:04.973966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:04.974425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:04.975207 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:04.975652 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:05.109185 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:05.117878 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5881af4e-c545-4a61-8767-958ad9b15995 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1596 microversion: 2.1 time: 0.158521 Jul 25 21:14:05.118469 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3398/6847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:04 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:06.733331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:06.734649 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=15 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:06.735573 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:06.740081 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-04a4d4ed-85c2-48d4-b4d9-569d88f2ff4a req-a0687839-939c-4983-b347-a5d042ac2bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:14:06.753178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-04a4d4ed-85c2-48d4-b4d9-569d88f2ff4a req-a0687839-939c-4983-b347-a5d042ac2bfd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:06.753995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-04a4d4ed-85c2-48d4-b4d9-569d88f2ff4a req-a0687839-939c-4983-b347-a5d042ac2bfd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:06.767446 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-04a4d4ed-85c2-48d4-b4d9-569d88f2ff4a req-a0687839-939c-4983-b347-a5d042ac2bfd service nova] Creating event network-changed:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:14:06.773173 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-04a4d4ed-85c2-48d4-b4d9-569d88f2ff4a req-a0687839-939c-4983-b347-a5d042ac2bfd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042178 Jul 25 21:14:06.775079 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3450/6848] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:14:08.005626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1184611864"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:14:08.006168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:08.013876 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:08.014329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:08.015106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:08.015545 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:08.153577 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Adding security group 63c61bab-97ab-4f76-8c9a-7e4486d044c7 to port c73b4957-43a8-4308-8831-19c58d4ac0c9 Jul 25 21:14:08.502155 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-08f1e716-b528-4dbd-abca-261d74945d55 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action" status: 202 len: 0 microversion: 2.1 time: 0.500241 Jul 25 21:14:08.502792 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3399/6849] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:14:08 2022] POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:14:08.513544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:08.515996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:08.527692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:08.532400 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:08.533603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:08.534141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:08.704349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:08.714304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6fa2f78f-9552-4108-87ed-c7f82b4bc13a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1761 microversion: 2.1 time: 0.206088 Jul 25 21:14:08.715641 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3451/6850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:08 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1761 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:08.789870 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a19a6b2a-770b-4b27-ab59-6bb287b7f5d4 req-4b65e129-030e-40c1-b4f5-b5497becaa1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:14:08.799496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a19a6b2a-770b-4b27-ab59-6bb287b7f5d4 req-4b65e129-030e-40c1-b4f5-b5497becaa1d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:08.799943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a19a6b2a-770b-4b27-ab59-6bb287b7f5d4 req-4b65e129-030e-40c1-b4f5-b5497becaa1d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:08.813208 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a19a6b2a-770b-4b27-ab59-6bb287b7f5d4 req-4b65e129-030e-40c1-b4f5-b5497becaa1d service nova] Creating event network-changed:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:14:08.818482 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a19a6b2a-770b-4b27-ab59-6bb287b7f5d4 req-4b65e129-030e-40c1-b4f5-b5497becaa1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032906 Jul 25 21:14:08.819326 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3400/6851] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:14:30.433965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:30.435163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=8 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:30.490486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:14:30.492946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:30.499443 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:30.500027 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:30.500754 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:30.501212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:30.575366 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0dacb449-5e26-4aa2-a8e5-d31baf2226db tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action" status: 202 len: 0 microversion: 2.1 time: 0.146415 Jul 25 21:14:30.576028 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3452/6852] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:14:30 2022] POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:14:30.583450 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:30.584315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:14:30.590180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:30.591133 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:30.600129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:30.600595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:30.601391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:30.601846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:30.847367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:30.855631 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5212fe98-f2cd-4ba6-b061-07c46e2ec76d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1753 microversion: 2.1 time: 0.274336 Jul 25 21:14:30.856178 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3401/6853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:30 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1753 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:31.878121 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:31.878757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:31.886757 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:31.887214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:31.887986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:31.888465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:32.034308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:32.042930 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3e3c2de-8933-4c83-98f8-21a73cb5dda4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.169193 Jul 25 21:14:32.043511 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3453/6854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:31 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:33.065873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:33.066490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:33.073947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:33.074396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:33.075161 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:33.075599 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:33.226899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:33.235019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf532652-e4ad-4ba6-b775-aea29328a385 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.173170 Jul 25 21:14:33.235587 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3402/6855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:33 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:34.256964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:34.257626 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:34.265350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:34.265826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:34.266620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:34.267078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:34.411876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:34.420188 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f05f4611-6532-44b2-81bd-302fa8de02fd tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.167148 Jul 25 21:14:34.420808 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3454/6856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:34 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:35.441877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:35.442552 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:35.451471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:35.452146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:35.453041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:35.453578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:35.610684 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:35.619619 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5221a7b4-4212-4100-82c0-7a86a5c9e086 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.181111 Jul 25 21:14:35.620241 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3403/6857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:35 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:36.644932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:36.646069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:36.658970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:36.659630 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:36.660787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:36.661247 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:36.806423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:36.814617 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9ef30c95-55c8-405f-bb55-7c8c90396910 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.175243 Jul 25 21:14:36.815208 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3455/6858] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:36 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:37.837220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:37.837891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:37.844904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:37.845361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:37.846143 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:37.846583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:37.992265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:38.001107 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f9235d6e-e288-43e4-bc49-07ce355f26d7 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.167970 Jul 25 21:14:38.001682 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3404/6859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:37 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:39.022362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:39.023182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:39.030900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:39.031361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:39.032175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:39.032627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:39.182108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:39.190496 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bf4ec70f-b2cf-4b22-8248-61328a494121 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.172137 Jul 25 21:14:39.191097 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3456/6860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:39 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:40.211606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:40.212269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:40.219627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:40.220111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:40.220924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:40.221367 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:40.369702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:40.377897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2ea4c8fc-c15a-4f96-b26f-909798ecad82 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.170171 Jul 25 21:14:40.378482 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3405/6861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:40 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:41.399293 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:41.399926 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:41.407658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:41.408169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:41.408970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:41.409430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:41.563042 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:41.571466 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-35c8d1c8-7190-498c-8091-f95c4ed9ac6e tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.176095 Jul 25 21:14:41.572083 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3457/6862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:41 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:42.593166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:42.593710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:42.600648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:42.601113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:42.601895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:42.602345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:42.752988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:42.762098 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62246243-4870-4bde-95a8-6dd479294368 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.172868 Jul 25 21:14:42.762687 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3406/6863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:42 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:43.783012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:43.783666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:43.790813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:43.791225 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:43.792073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:43.792539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:43.941978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:43.951014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1e29fd89-1368-4292-af19-7b87625a5827 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.171933 Jul 25 21:14:43.951613 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3458/6864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:43 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:44.973001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:44.973803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:44.981382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:44.981382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:44.982211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:44.982633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:45.137802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:45.146545 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-868e4ccd-8648-45af-a946-13ea49386e5a tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.177456 Jul 25 21:14:45.147166 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3407/6865] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:44 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:46.169992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:46.170539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:46.177733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:46.178210 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:46.179318 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:46.179781 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:46.346514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:46.354786 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a190b81c-a454-421c-abc1-36e7456120c3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.189816 Jul 25 21:14:46.355567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3459/6866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:46 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:47.377190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:47.377840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:47.384945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:47.385398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:47.386167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:47.386604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:47.541784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:47.551402 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c04e95a1-bb21-478c-b9bb-8f9a14d715d8 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1758 microversion: 2.1 time: 0.178152 Jul 25 21:14:47.551993 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3408/6867] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:47 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:14:48.573475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:14:48.574239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:14:48.581202 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:48.581669 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:48.582461 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:14:48.582919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:14:48.741792 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:14:48.753207 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b6be7ac-0644-4a49-8692-94c30849fda3 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1761 microversion: 2.1 time: 0.183544 Jul 25 21:14:48.753892 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3460/6868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:14:48 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1761 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:21.398749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1184611864"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:21.399322 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:21.401747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=16 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:21.402406 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=48 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:21.409197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:21.409656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:21.410553 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:21.411004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:21.545732 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.network.security_group_api [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Removing security group 63c61bab-97ab-4f76-8c9a-7e4486d044c7 from port c73b4957-43a8-4308-8831-19c58d4ac0c9 Jul 25 21:15:21.888945 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f2cbfa41-866b-4f54-a7a0-6e7e338609cb tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action" status: 202 len: 0 microversion: 2.1 time: 0.493951 Jul 25 21:15:21.890009 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3409/6869] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:15:21 2022] POST /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:15:21.901644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-1ca6b921-9b29-4582-8142-b069b1814173 req-8dd10a24-9bef-467e-8698-becf9b73585b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:21.911319 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=18 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:21.912483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:21.937946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1ca6b921-9b29-4582-8142-b069b1814173 req-8dd10a24-9bef-467e-8698-becf9b73585b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:21.937946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-1ca6b921-9b29-4582-8142-b069b1814173 req-8dd10a24-9bef-467e-8698-becf9b73585b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:21.954760 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-1ca6b921-9b29-4582-8142-b069b1814173 req-8dd10a24-9bef-467e-8698-becf9b73585b service nova] Creating event network-changed:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:15:21.961303 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-1ca6b921-9b29-4582-8142-b069b1814173 req-8dd10a24-9bef-467e-8698-becf9b73585b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066990 Jul 25 21:15:21.962488 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3461/6870] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:23.303820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d5721d66-6891-4bc1-ac7d-06ea6afc103b req-a0c20ae1-02c0-4920-ad6c-67021183439d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:23.304781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:23.305158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:23.314661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:23.315145 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:23.316230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:23.317332 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:23.318731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5721d66-6891-4bc1-ac7d-06ea6afc103b req-a0c20ae1-02c0-4920-ad6c-67021183439d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:23.319954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d5721d66-6891-4bc1-ac7d-06ea6afc103b req-a0c20ae1-02c0-4920-ad6c-67021183439d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:23.336282 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d5721d66-6891-4bc1-ac7d-06ea6afc103b req-a0c20ae1-02c0-4920-ad6c-67021183439d service nova] Creating event network-changed:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:15:23.344336 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d5721d66-6891-4bc1-ac7d-06ea6afc103b req-a0c20ae1-02c0-4920-ad6c-67021183439d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046934 Jul 25 21:15:23.345368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3462/6871] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:23.413991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lazy-loading 'services' on Instance uuid a20fc65c-7eb0-4692-baa0-a317cfd6cb54 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:15:23.498547 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-746e350c-2ebe-40c7-a51c-4d43c132952d tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments/32d43aa3-a060-4cfb-a1db-147a3c5afecd" status: 202 len: 0 microversion: 2.1 time: 0.203695 Jul 25 21:15:23.505154 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3410/6872] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:15:23 2022] DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments/32d43aa3-a060-4cfb-a1db-147a3c5afecd => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:15:23.509361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:23.512937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:23.520557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:23.521367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:23.522378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:23.523026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:23.558108 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fdb809c3-fd03-417d-ad5e-3e10978c11a4 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053672 Jul 25 21:15:23.563074 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3463/6873] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:23 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:15:24.571638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:24.574224 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:24.581539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:24.582005 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:24.582796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:24.583241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:24.614219 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-849911fe-cbad-4043-a651-4a96fe1c5dd6 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Jul 25 21:15:24.614812 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3411/6874] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:24 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:25.626795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:25.628929 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:25.636102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:25.636602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:25.637403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:25.637856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:25.670732 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7afc5215-148e-4dcd-8de8-f08e79a5a745 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Jul 25 21:15:25.671340 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3464/6875] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:25 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:26.683491 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:26.685690 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:26.692710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:26.693174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:26.693960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:26.694413 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:26.724957 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f5226298-1bb2-47e5-a8fb-2af57d275987 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Jul 25 21:15:26.725546 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3412/6876] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:26 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:27.737117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:27.739333 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:27.746296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:27.746763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:27.747554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:27.748016 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:27.776889 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8743481b-9f94-4a34-a40e-d4dcabaf0643 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Jul 25 21:15:27.777468 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3465/6877] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:27 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:28.790172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:28.792512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:28.800107 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:28.800570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:28.801348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:28.801796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:28.830776 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83bb868a-c402-4dc4-80e7-cb96b7e90cae tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044782 Jul 25 21:15:28.831335 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3413/6878] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Jul 25 21:15:28 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 21:15:28.844491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:28.845053 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:28.851200 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:28.851678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:28.852533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:28.852992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:28.930945 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] HTTP exception thrown: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 is not attached to volume 32d43aa3-a060-4cfb-a1db-147a3c5afecd Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Request method failure captured: Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: request: DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments/32d43aa3-a060-4cfb-a1db-147a3c5afecd HTTP/1.1 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wZ_HU_V-sOAebnbCpdxzw0Af_Ceb5PGtbt8YmsgvBl4lxAhZtuwEDDfzq4Uv6KjNIDzynjNpsBWuG6CyaAfP5bhlFbASkBy8_iNzp04Bt6ho7dJ7b8XRrkPlNQxMGcAQXRkocUutbY7aiUG3DKCpwmKwooFD0yRKfAlNqm3w19PHQc Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_972d82817d9047d0ac8127566c145b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/972d82817d9047d0ac8127566c145b09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}] Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 07f2d0134dbf4cb88e087a0ee91e1527 Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 is not attached to volume 32d43aa3-a060-4cfb-a1db-147a3c5afecd Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'server_id': 'a20fc65c-7eb0-4692-baa0-a317cfd6cb54', 'id': '32d43aa3-a060-4cfb-a1db-147a3c5afecd'} Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 32d43aa3-a060-4cfb-a1db-147a3c5afecd. Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 is not attached to volume 32d43aa3-a060-4cfb-a1db-147a3c5afecd Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:15:28.933128 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 is not attached to volume 32d43aa3-a060-4cfb-a1db-147a3c5afecd Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Returning 404 to user: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 is not attached to volume 32d43aa3-a060-4cfb-a1db-147a3c5afecd {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1610076a-ce02-4bdc-a2b7-a051648438fa tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments/32d43aa3-a060-4cfb-a1db-147a3c5afecd" status: 404 len: 154 microversion: 2.1 time: 0.096834 Jul 25 21:15:28.939574 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3466/6879] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Jul 25 21:15:28 2022] DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54/os-volume_attachments/32d43aa3-a060-4cfb-a1db-147a3c5afecd => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:15:32.198245 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:32.198802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:32.206747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:32.207216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:32.208028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:32.208499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:32.237410 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:15:32.326608 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31d818e5-c186-4f8c-9a7c-0651e8f86ccc tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 204 len: 0 microversion: 2.1 time: 0.132180 Jul 25 21:15:32.328913 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3414/6880] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:15:32 2022] DELETE /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:15:32.343856 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:32.344528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:32.351667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:32.352179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:32.352980 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:32.353441 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:32.495413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:32.503377 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-aa460b5c-fad5-4a06-b567-7db58c1bab91 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1556 microversion: 2.1 time: 0.169482 Jul 25 21:15:32.503977 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3467/6881] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:32 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:15:33.525685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:33.526327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:33.534355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:33.534802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:33.535580 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:33.536029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:33.667710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:33.675969 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fb40c9fa-06d6-42f8-be6a-04db2ad46008 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1556 microversion: 2.1 time: 0.154676 Jul 25 21:15:33.676588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3415/6882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:33 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:15:34.698251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:34.698877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:34.706021 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:34.706482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:34.707265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:34.707714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:34.924918 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f2d0134dbf4cb88e087a0ee91e1527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972d82817d9047d0ac8127566c145b09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:34.932962 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f7075494-6be3-4ebe-93d5-383153f41470 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 200 len: 1556 microversion: 2.1 time: 0.238728 Jul 25 21:15:34.933550 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3468/6883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:34 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:35.141820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-04b06494-27ef-4b39-89b4-a4b52c6488dd req-6b8beb85-7709-42fb-983f-7737ee17194a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20fc65c-7eb0-4692-baa0-a317cfd6cb54", "name": "network-vif-deleted", "tag": "c73b4957-43a8-4308-8831-19c58d4ac0c9"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:35.153834 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-04b06494-27ef-4b39-89b4-a4b52c6488dd req-6b8beb85-7709-42fb-983f-7737ee17194a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:35.155080 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-04b06494-27ef-4b39-89b4-a4b52c6488dd req-6b8beb85-7709-42fb-983f-7737ee17194a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:35.167933 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-04b06494-27ef-4b39-89b4-a4b52c6488dd req-6b8beb85-7709-42fb-983f-7737ee17194a service nova] Creating event network-vif-deleted:c73b4957-43a8-4308-8831-19c58d4ac0c9 for instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 on n-h1-845775-3 Jul 25 21:15:35.174499 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-04b06494-27ef-4b39-89b4-a4b52c6488dd req-6b8beb85-7709-42fb-983f-7737ee17194a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035977 Jul 25 21:15:35.175316 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3416/6884] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:35.955327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:35.955955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] [instance: a20fc65c-7eb0-4692-baa0-a317cfd6cb54] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:35.962907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:35.963567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:35.964174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:35.964646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:35.978873 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] HTTP exception thrown: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Request method failure captured: Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 HTTP/1.1 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wZ_HU_V-sOAebnbCpdxzw0Af_Ceb5PGtbt8YmsgvBl4lxAhZtuwEDDfzq4Uv6KjNIDzynjNpsBWuG6CyaAfP5bhlFbASkBy8_iNzp04Bt6ho7dJ7b8XRrkPlNQxMGcAQXRkocUutbY7aiUG3DKCpwmKwooFD0yRKfAlNqm3w19PHQc Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_972d82817d9047d0ac8127566c145b09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/972d82817d9047d0ac8127566c145b09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/972d82817d9047d0ac8127566c145b09"}]}] Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 972d82817d9047d0ac8127566c145b09 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938578443 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 07f2d0134dbf4cb88e087a0ee91e1527 Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestMinimumBasicScenario-938578443-project Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': 'a20fc65c-7eb0-4692-baa0-a317cfd6cb54'} Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:15:35.980497 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Returning 404 to user: Instance a20fc65c-7eb0-4692-baa0-a317cfd6cb54 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9a16e0a8-92d0-4745-b50b-c6ee80e64095 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54" status: 404 len: 111 microversion: 2.1 time: 0.031196 Jul 25 21:15:35.985368 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3469/6885] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:35 2022] GET /compute/v2.1/servers/a20fc65c-7eb0-4692-baa0-a317cfd6cb54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:15:35.991557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d687d306-966e-4ab0-8685-3193b7d37b07 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] Calling method '.version_select at 0x7f19698df040>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:36.011922 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d687d306-966e-4ab0-8685-3193b7d37b07 tempest-TestMinimumBasicScenario-938578443 tempest-TestMinimumBasicScenario-938578443-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441276254" status: 202 len: 0 microversion: 2.1 time: 0.024696 Jul 25 21:15:36.012535 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3417/6886] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Jul 25 21:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441276254 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:15:45.356618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: .version_select at 0x7f196828cd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-181333838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Kk1D8DMHCZnmbp3l8hxuXZecEC1tsmufrrAjzRZrwv3foyVY8KYfx5sefMObI3Y8Krb7Z2drYZAsCLVMO3k9vosRlalbqPxO/QlZlqJgl6s5pKYyLb2w5B+hcy57hyw=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:45.381103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:15:45.387000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:15:45.403151 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [4456bed7-0b8f-4b92-8dff-64c9d3ff5e7b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:15:45.970703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=42 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:46.410842 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [4456bed7-0b8f-4b92-8dff-64c9d3ff5e7b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60622. Jul 25 21:15:46.426104 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-46f9fd05-d3f0-47e8-8923-1af849c79966 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.300192 Jul 25 21:15:46.426708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3470/6887] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:15:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:15:52.640435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:52.641204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:52.646267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-108691006", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "2299286e-7e12-40a7-9025-8869b319298f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-181333838", "security_groups": [{"name": "tempest-secgroup-smoke-904356085"}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:52.775302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] validate_networks() for [('2299286e-7e12-40a7-9025-8869b319298f', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:15:53.208263 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:15:53.208695 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:15:53.209182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:15:53.209602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:15:53.210024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:15:53.222144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:53.222864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:53.224772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:53.225949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:53.246356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:15:53.253051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:15:53.273081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:15:53.277146 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:15:53.365119 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [aa5bef4a-5629-4309-b906-260c9ad922b9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:15:54.372809 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [aa5bef4a-5629-4309-b906-260c9ad922b9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 60668. Jul 25 21:15:54.378261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d2bec678-b732-4388-8e3c-fe248345a10a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.739764 Jul 25 21:15:54.391666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-36009ee7-f30a-4d7b-be6d-c0989fc39fa6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:54.392946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-36009ee7-f30a-4d7b-be6d-c0989fc39fa6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:54.395923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:15:54.396616 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3418/6888] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:15:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:15:54.478902 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-36009ee7-f30a-4d7b-be6d-c0989fc39fa6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:54.486927 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-36009ee7-f30a-4d7b-be6d-c0989fc39fa6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1265 microversion: 2.1 time: 0.099845 Jul 25 21:15:54.489267 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3471/6889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:54 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:55.513148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:55.515980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:55.524305 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:55.525134 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:55.526162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:55.527059 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:55.618438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:55.633381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8034dc73-dfd0-4936-b497-6b5944194806 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1317 microversion: 2.1 time: 0.126256 Jul 25 21:15:55.634403 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3419/6890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:55 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:56.655800 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:56.656280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:56.664843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:56.665324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:56.666324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:56.666778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:56.799748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:56.807803 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9291da9f-1681-4d2a-8d69-bb6e5329bbb1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.156738 Jul 25 21:15:56.808414 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3472/6891] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:56 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:57.122361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bfb3836d-2789-483a-a5bb-09b9453d386c req-33451b4e-9794-42de-8e37-1f38e60b36dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eea80c3-53cb-461b-925b-080516bfbe2f", "tag": "242cb1d4-5359-44c0-844e-7d66e0493632"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:15:57.142045 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bfb3836d-2789-483a-a5bb-09b9453d386c req-33451b4e-9794-42de-8e37-1f38e60b36dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:57.142908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bfb3836d-2789-483a-a5bb-09b9453d386c req-33451b4e-9794-42de-8e37-1f38e60b36dd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:57.158358 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bfb3836d-2789-483a-a5bb-09b9453d386c req-33451b4e-9794-42de-8e37-1f38e60b36dd service nova] Creating event network-changed:242cb1d4-5359-44c0-844e-7d66e0493632 for instance 9eea80c3-53cb-461b-925b-080516bfbe2f on n-h2-845775-3 Jul 25 21:15:57.164266 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bfb3836d-2789-483a-a5bb-09b9453d386c req-33451b4e-9794-42de-8e37-1f38e60b36dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047548 Jul 25 21:15:57.165917 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3420/6892] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:15:57.829554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:57.830117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:57.837295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:57.837772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:57.838577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:57.839039 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:57.980721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:57.989048 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3901cfc-ae34-4592-b9b6-70b083af7a69 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.163472 Jul 25 21:15:57.989641 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3473/6893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:57 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:15:59.011723 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:15:59.012456 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:15:59.019361 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:59.019755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:59.020561 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:15:59.021007 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:15:59.163667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:15:59.171809 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c49efd82-5e06-45b7-b0c6-a3cd4f18bb81 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.165251 Jul 25 21:15:59.172440 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3421/6894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:15:59 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:00.192767 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:00.193499 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:00.201268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:00.201732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:00.202525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:00.202976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:00.345469 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:00.353180 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ae384748-de19-42cd-bab5-85614c06f9f5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.164372 Jul 25 21:16:00.353789 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3474/6895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:00 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:01.374090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:01.374708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:01.382287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:01.382757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:01.383543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:01.383998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:01.530125 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:01.537919 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-48172eb2-7846-4388-aa1f-7e65385656b0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.167734 Jul 25 21:16:01.538500 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3422/6896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:01 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:02.559325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:02.559906 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:02.567260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:02.567733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:02.568576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:02.569041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:02.713024 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:02.721354 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-66a4e8a3-093a-4934-bb6c-c496407b3e11 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.166335 Jul 25 21:16:02.722183 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3475/6897] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:02 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:02.982991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-649d5a3f-b1fc-45a3-a344-7cd3823ba0f5 req-17a5dbe9-8e39-478a-9537-379427d2540b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eea80c3-53cb-461b-925b-080516bfbe2f", "name": "network-vif-plugged", "status": "completed", "tag": "242cb1d4-5359-44c0-844e-7d66e0493632"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:02.994842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-649d5a3f-b1fc-45a3-a344-7cd3823ba0f5 req-17a5dbe9-8e39-478a-9537-379427d2540b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:02.995378 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-649d5a3f-b1fc-45a3-a344-7cd3823ba0f5 req-17a5dbe9-8e39-478a-9537-379427d2540b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:03.007945 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-649d5a3f-b1fc-45a3-a344-7cd3823ba0f5 req-17a5dbe9-8e39-478a-9537-379427d2540b service nova] Creating event network-vif-plugged:242cb1d4-5359-44c0-844e-7d66e0493632 for instance 9eea80c3-53cb-461b-925b-080516bfbe2f on n-h2-845775-3 Jul 25 21:16:03.013423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-649d5a3f-b1fc-45a3-a344-7cd3823ba0f5 req-17a5dbe9-8e39-478a-9537-379427d2540b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Jul 25 21:16:03.014681 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3423/6898] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:16:03.742877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:03.743487 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:03.751144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:03.751611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:03.752444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:03.752901 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:03.889946 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:03.899469 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-57e7da1e-3752-4d0d-be40-3f1ef25fd75f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1390 microversion: 2.1 time: 0.159639 Jul 25 21:16:03.899469 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3476/6899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:03 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:04.917186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:04.917969 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:04.922912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:04.923617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:04.930993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:04.931424 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:04.932372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:04.932824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:05.072153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:05.080305 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-612e3193-bfee-418a-a39e-f9a4ef883662 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1561 microversion: 2.1 time: 0.164199 Jul 25 21:16:05.080903 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3424/6900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:04 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:05.101245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:05.101876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:05.103899 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:05.110493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:05.110965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:05.111755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:05.112242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:05.244008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:05.252413 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f118590a-eceb-4667-b1c6-41417e9a35e0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1561 microversion: 2.1 time: 0.155115 Jul 25 21:16:05.252983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3477/6901] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:05 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:07.149872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:07.150523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:07.150875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-20cb9aba-ee7d-4c71-9974-b3a3ab5d9a72 req-76f1c2f0-efb7-4026-9d5b-ee96f7e934ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eea80c3-53cb-461b-925b-080516bfbe2f", "tag": "242cb1d4-5359-44c0-844e-7d66e0493632"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:07.159445 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:07.159903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:07.160915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:07.162212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:07.163687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-20cb9aba-ee7d-4c71-9974-b3a3ab5d9a72 req-76f1c2f0-efb7-4026-9d5b-ee96f7e934ed service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:07.164243 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-20cb9aba-ee7d-4c71-9974-b3a3ab5d9a72 req-76f1c2f0-efb7-4026-9d5b-ee96f7e934ed service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:07.175953 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-20cb9aba-ee7d-4c71-9974-b3a3ab5d9a72 req-76f1c2f0-efb7-4026-9d5b-ee96f7e934ed service nova] Creating event network-changed:242cb1d4-5359-44c0-844e-7d66e0493632 for instance 9eea80c3-53cb-461b-925b-080516bfbe2f on n-h2-845775-3 Jul 25 21:16:07.182615 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-20cb9aba-ee7d-4c71-9974-b3a3ab5d9a72 req-76f1c2f0-efb7-4026-9d5b-ee96f7e934ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035655 Jul 25 21:16:07.183328 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3478/6902] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:16:07.317274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:07.329231 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b9a1ce8-19f3-4fe6-a8b5-c4b5de87e1e4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1561 microversion: 2.1 time: 0.184496 Jul 25 21:16:07.330082 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3425/6903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:07 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:30.592336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=17 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:30.593080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=38 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:30.598170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:30.600503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:30.607579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:30.608600 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:30.609398 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:30.609853 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:30.661158 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3b995959-b2a0-41cb-8722-191f92095e24 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action" status: 200 len: 24572 microversion: 2.1 time: 0.071155 Jul 25 21:16:30.662015 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3479/6904] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:16:30 2022] POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action => generated 24572 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:16:37.036800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:37.037425 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:37.039633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:37.040518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=36 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:37.047229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:37.047697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:37.048521 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:37.048972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:37.120543 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a33460b7-ced0-49c1-8692-b2e8c47958b4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action" status: 202 len: 0 microversion: 2.1 time: 0.088400 Jul 25 21:16:37.121286 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3426/6905] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:16:37 2022] POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:16:37.134568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:37.135862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:37.146442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:37.147356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:37.147874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:37.148366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:37.305784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:37.314890 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fab109ad-943a-4b03-b4b2-0d429538f3b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1684 microversion: 2.1 time: 0.188079 Jul 25 21:16:37.315474 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3480/6906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:37 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:38.339767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:38.340527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:38.347136 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:38.347591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:38.348381 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:38.348822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:38.481832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:38.489717 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74dc4b01-f9c7-4c57-9f4c-b2b6782bc63d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1664 microversion: 2.1 time: 0.155420 Jul 25 21:16:38.490309 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3427/6907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:38 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:39.583032 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:39.585310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:39.594201 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.594673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.595471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.595931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.645097 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-808dfefa-4a27-4ff2-880a-ae7e1dd991e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action" status: 200 len: 32644 microversion: 2.1 time: 0.065756 Jul 25 21:16:39.645769 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3481/6908] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:16:39 2022] POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action => generated 32644 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:16:39.658004 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:39.658529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:39.665601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.666058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.666826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.667273 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.740174 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-edfb8141-165f-4010-a808-528f56c0e621 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action" status: 202 len: 0 microversion: 2.1 time: 0.086314 Jul 25 21:16:39.741003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3428/6909] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:16:39 2022] POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:16:39.752051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:39.752778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:39.760093 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.760568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.761356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:39.761811 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:39.914799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:39.924137 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ec4e27e3-b25d-44cc-a0ba-04df5b906b93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1671 microversion: 2.1 time: 0.176745 Jul 25 21:16:39.924753 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3482/6910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:39 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:40.951497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:40.952789 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:40.965213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:40.965679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:40.966474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:40.966953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:41.113707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:41.121858 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-12db350b-0467-4ac8-8fda-1a68c22717c4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1679 microversion: 2.1 time: 0.178115 Jul 25 21:16:41.122460 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3429/6911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:40 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:41.223551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:41.225795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:41.234486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:41.234952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:41.235746 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:41.236263 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:41.288866 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f7fe1cb-a26c-4714-8a6e-6439d689d78d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action" status: 200 len: 35114 microversion: 2.1 time: 0.068983 Jul 25 21:16:41.290221 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3483/6912] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:16:41 2022] POST /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f/action => generated 35114 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:16:42.518942 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:16:42.519652 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:16:42.766282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-00b190f4-e0a7-428f-b4b3-f2284cab6527 req-565e188c-272b-4be2-a8d6-79f15b6ed305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eea80c3-53cb-461b-925b-080516bfbe2f", "tag": "242cb1d4-5359-44c0-844e-7d66e0493632"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:42.776687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:42.777834 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00b190f4-e0a7-428f-b4b3-f2284cab6527 req-565e188c-272b-4be2-a8d6-79f15b6ed305 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:42.778927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-00b190f4-e0a7-428f-b4b3-f2284cab6527 req-565e188c-272b-4be2-a8d6-79f15b6ed305 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:42.779100 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:42.790446 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:42.790908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:42.791886 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:42.792523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:42.798550 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-00b190f4-e0a7-428f-b4b3-f2284cab6527 req-565e188c-272b-4be2-a8d6-79f15b6ed305 service nova] Creating event network-changed:242cb1d4-5359-44c0-844e-7d66e0493632 for instance 9eea80c3-53cb-461b-925b-080516bfbe2f on n-h2-845775-3 Jul 25 21:16:42.804892 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-00b190f4-e0a7-428f-b4b3-f2284cab6527 req-565e188c-272b-4be2-a8d6-79f15b6ed305 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042527 Jul 25 21:16:42.804892 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3484/6913] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:16:42.835546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:16:42.966868 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-76441b51-c953-43d7-9184-8d51f81b3980 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 204 len: 0 microversion: 2.1 time: 0.200510 Jul 25 21:16:42.967925 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3430/6914] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:16:42 2022] DELETE /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:16:42.978787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:42.979779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:42.991111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:42.992290 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:42.995026 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:42.995698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:43.176907 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:43.191674 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d2868272-cfbc-44de-995d-c90589cb10e2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1685 microversion: 2.1 time: 0.218430 Jul 25 21:16:43.192828 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3485/6915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:42 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:44.229495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:44.230350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:44.238096 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:44.238555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:44.239432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:44.239887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:44.403483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:44.413727 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-206b000c-6553-49ba-bc0d-7827dc5d64f2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1685 microversion: 2.1 time: 0.188458 Jul 25 21:16:44.414337 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3431/6916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:44 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:45.438620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:45.439363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:45.447991 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:45.449361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:45.450353 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:45.450808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:45.490204 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f6dd6a96-c30a-4df3-bd49-2ebe9d49e0bd req-88928599-a226-4d8b-a9e0-9fcd45f90a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eea80c3-53cb-461b-925b-080516bfbe2f", "name": "network-vif-deleted", "tag": "242cb1d4-5359-44c0-844e-7d66e0493632"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:45.522214 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f6dd6a96-c30a-4df3-bd49-2ebe9d49e0bd req-88928599-a226-4d8b-a9e0-9fcd45f90a75 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:45.522825 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f6dd6a96-c30a-4df3-bd49-2ebe9d49e0bd req-88928599-a226-4d8b-a9e0-9fcd45f90a75 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:45.537671 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f6dd6a96-c30a-4df3-bd49-2ebe9d49e0bd req-88928599-a226-4d8b-a9e0-9fcd45f90a75 service nova] Creating event network-vif-deleted:242cb1d4-5359-44c0-844e-7d66e0493632 for instance 9eea80c3-53cb-461b-925b-080516bfbe2f on n-h2-845775-3 Jul 25 21:16:45.545486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:45.545790 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f6dd6a96-c30a-4df3-bd49-2ebe9d49e0bd req-88928599-a226-4d8b-a9e0-9fcd45f90a75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060965 Jul 25 21:16:45.546588 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3432/6917] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:16:45.554438 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16e936c9-62e7-4032-92c7-9ad306bb1caf tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 200 len: 1500 microversion: 2.1 time: 0.120252 Jul 25 21:16:45.559087 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3486/6918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:45 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 1500 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:16:46.579568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:46.580391 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 9eea80c3-53cb-461b-925b-080516bfbe2f] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:46.586795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:46.587182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:46.587973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:46.588454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:46.602434 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] HTTP exception thrown: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Request method failure captured: Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f HTTP/1.1 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wgAx5D3VJ6y7cFiKb-ztyAP3PReDzZ7ei1CItbCpQiLW3DvBusNc4WwkdC-W34G94aqGlaH6ia1etBcoAjWOzrSav5ZFCLs-vZWtVFmRCjQP8MDhO1ZVUjQsKU3H42c-oqHGn-xqP4SZf726FPtBqOz5M4ToXUValqiQe4qrzz9omY Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}] Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 19a498d1597840498123d02b586426c1 Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '9eea80c3-53cb-461b-925b-080516bfbe2f'} Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:16:46.604140 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Returning 404 to user: Instance 9eea80c3-53cb-461b-925b-080516bfbe2f could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3aaec519-16c4-44f9-a3e0-a5d131d2ad34 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f" status: 404 len: 111 microversion: 2.1 time: 0.032713 Jul 25 21:16:46.612331 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3433/6919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:46 2022] GET /compute/v2.1/servers/9eea80c3-53cb-461b-925b-080516bfbe2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:16:50.081207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a081fb5d-c81d-4abf-a645-b2e47807fcac tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '.version_select at 0x7f196964e9d0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:50.111562 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a081fb5d-c81d-4abf-a645-b2e47807fcac tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181333838" status: 202 len: 0 microversion: 2.1 time: 0.037566 Jul 25 21:16:50.112637 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3487/6920] 10.222.0.48 () {58 vars in 1281 bytes} [Mon Jul 25 21:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181333838 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:16:50.145774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7ebf184d-3766-448d-9e3c-3a325cced329 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: .version_select at 0x7f19695d14c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1110487525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiRt0PIYoHlK+BqB+RoxVRapa6qUf0L+COsP4hh/4HSNNC1HcdRxjAVMSesuRyT7UU48zW3Epx6HaDG4kmztoK6iEal2Z40QMv1DqOmAfhtUSvhwbVThutgJ0MVikUGSg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:50.165833 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7ebf184d-3766-448d-9e3c-3a325cced329 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:16:50.175784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-7ebf184d-3766-448d-9e3c-3a325cced329 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:16:50.209086 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7ebf184d-3766-448d-9e3c-3a325cced329 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070870 Jul 25 21:16:50.209968 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3434/6921] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:16:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:16:56.163935 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=38 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:56.169097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-529506044", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "2723c034-df02-4d04-94dc-bccee65cceab"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1110487525", "security_groups": [{"name": "tempest-secgroup-smoke-1897056588"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:16:56.439904 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] validate_networks() for [('2723c034-df02-4d04-94dc-bccee65cceab', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:16:56.941731 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:16:56.942216 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:16:56.942705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:16:56.943136 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:16:56.943565 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:16:56.952986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:56.953536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:56.954362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:56.954817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:56.972687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:16:56.978401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:16:56.992262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:16:56.994582 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:16:57.045749 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4bb96281-a474-4353-a448-b1670e0dbe6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883690 Jul 25 21:16:57.046657 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3488/6922] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:16:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:16:57.055636 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:16:57.062440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-71ab1768-f14f-49c1-8538-116b34879a2a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:57.063148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-71ab1768-f14f-49c1-8538-116b34879a2a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:57.200417 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-71ab1768-f14f-49c1-8538-116b34879a2a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:57.210959 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-71ab1768-f14f-49c1-8538-116b34879a2a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1266 microversion: 2.1 time: 0.157374 Jul 25 21:16:57.221918 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3435/6923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:57 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:16:58.236698 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:58.238002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:58.260855 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:58.261982 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:58.265521 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:58.267584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:58.446534 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:58.460549 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23e8fbad-8022-427a-924b-c0783948fc87 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1326 microversion: 2.1 time: 0.230226 Jul 25 21:16:58.472275 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3489/6924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:58 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1326 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:16:59.484927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:16:59.486270 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:16:59.503109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:59.504094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:59.504912 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:16:59.505384 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:16:59.793983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:16:59.801666 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0e0bd63f-7e89-4584-8fc9-e16123cdcd09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.320998 Jul 25 21:16:59.802252 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3436/6925] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:16:59 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:00.345327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-27a7fe3b-c029-4c98-97c6-672378cc0748 req-75c1d504-a14c-45a3-9a53-394472c9cdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d7e3d-1d7e-4746-a4ca-b51b04ae483e", "tag": "446063fc-362b-4741-89e1-9fabf8a86324"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:17:00.365891 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-27a7fe3b-c029-4c98-97c6-672378cc0748 req-75c1d504-a14c-45a3-9a53-394472c9cdc4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:00.366945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-27a7fe3b-c029-4c98-97c6-672378cc0748 req-75c1d504-a14c-45a3-9a53-394472c9cdc4 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:00.380302 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-27a7fe3b-c029-4c98-97c6-672378cc0748 req-75c1d504-a14c-45a3-9a53-394472c9cdc4 service nova] Creating event network-changed:446063fc-362b-4741-89e1-9fabf8a86324 for instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e on n-h1-845775-3 Jul 25 21:17:00.387926 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-27a7fe3b-c029-4c98-97c6-672378cc0748 req-75c1d504-a14c-45a3-9a53-394472c9cdc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049275 Jul 25 21:17:00.390601 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3490/6926] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:17:00.824919 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:00.825537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:00.833260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:00.833716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:00.834498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:00.834938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:00.972752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:00.980369 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-28c4488b-d8c5-4789-a3a7-ab90754409ea tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.159661 Jul 25 21:17:00.980946 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3437/6927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:00 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:02.005375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:02.006094 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:02.008590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:02.014954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:02.015429 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:02.016331 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:02.016933 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:02.226357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:02.234383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-de7c1f1a-15ff-4df6-8aca-a10be1502aa4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.235260 Jul 25 21:17:02.234970 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3491/6928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:01 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:03.257091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:03.258383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:03.267014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:03.267474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:03.268371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:03.268819 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:03.414259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:03.423036 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5163c4bf-852e-4384-8132-8896b2547e08 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.169737 Jul 25 21:17:03.423646 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3438/6929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:03 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:17:04.446084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:04.447265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:04.457105 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:04.457559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:04.458357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:04.458807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:04.609827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:04.617601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef59dfd4-9e74-4824-b8ef-34e8810d53a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.175547 Jul 25 21:17:04.618190 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3492/6930] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:04 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:05.639039 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:05.639590 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:05.646497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:05.646949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:05.647712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:05.648327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:05.785913 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:05.793567 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69b3d7db-68f2-4757-8c28-76c5a5a4bf54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.158739 Jul 25 21:17:05.794146 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3439/6931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:05 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:06.053679 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-48da185c-f7fa-49d4-9206-d26daee6b36a req-3a7b3d4b-19af-4219-84af-1746c8db3a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d7e3d-1d7e-4746-a4ca-b51b04ae483e", "name": "network-vif-plugged", "status": "completed", "tag": "446063fc-362b-4741-89e1-9fabf8a86324"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:17:06.065977 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-48da185c-f7fa-49d4-9206-d26daee6b36a req-3a7b3d4b-19af-4219-84af-1746c8db3a07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:06.066448 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-48da185c-f7fa-49d4-9206-d26daee6b36a req-3a7b3d4b-19af-4219-84af-1746c8db3a07 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:06.078311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-48da185c-f7fa-49d4-9206-d26daee6b36a req-3a7b3d4b-19af-4219-84af-1746c8db3a07 service nova] Creating event network-vif-plugged:446063fc-362b-4741-89e1-9fabf8a86324 for instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e on n-h1-845775-3 Jul 25 21:17:06.083795 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-48da185c-f7fa-49d4-9206-d26daee6b36a req-3a7b3d4b-19af-4219-84af-1746c8db3a07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Jul 25 21:17:06.084457 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3493/6932] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:17:06.815472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:06.816119 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:06.823679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:06.824172 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:06.824955 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:06.825402 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:06.963633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:06.971337 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-13e8533c-7a64-426d-82f5-7ddd2e9787a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1392 microversion: 2.1 time: 0.159807 Jul 25 21:17:06.971925 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3440/6933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:06 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:07.989978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:07.990771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:07.995864 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:07.996598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:08.003962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:08.004456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:08.005235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:08.005680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:08.142595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:08.150453 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fe75c6ed-a107-4fab-ab7c-a64f988b0ecc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1565 microversion: 2.1 time: 0.161408 Jul 25 21:17:08.151018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3494/6934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:07 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:08.171651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:08.172301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:08.174162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:08.175800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:08.182942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:08.183439 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:08.184246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:08.184694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:08.324606 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:08.333045 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-25890d55-79b0-4d1c-869e-ac3bc08ccd03 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1565 microversion: 2.1 time: 0.165354 Jul 25 21:17:08.340084 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3441/6935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:08 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:10.015190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:10.015832 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:10.017744 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-8cc16f03-66d3-4044-ab7a-33846b4ad2c0 req-11c64a13-7928-4e9b-a025-753545ae0583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d7e3d-1d7e-4746-a4ca-b51b04ae483e", "tag": "446063fc-362b-4741-89e1-9fabf8a86324"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:17:10.024295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:10.024996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:10.025996 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:10.026612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:10.029680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8cc16f03-66d3-4044-ab7a-33846b4ad2c0 req-11c64a13-7928-4e9b-a025-753545ae0583 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:10.030129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-8cc16f03-66d3-4044-ab7a-33846b4ad2c0 req-11c64a13-7928-4e9b-a025-753545ae0583 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:10.042000 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-8cc16f03-66d3-4044-ab7a-33846b4ad2c0 req-11c64a13-7928-4e9b-a025-753545ae0583 service nova] Creating event network-changed:446063fc-362b-4741-89e1-9fabf8a86324 for instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e on n-h1-845775-3 Jul 25 21:17:10.048071 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-8cc16f03-66d3-4044-ab7a-33846b4ad2c0 req-11c64a13-7928-4e9b-a025-753545ae0583 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Jul 25 21:17:10.048724 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3442/6936] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:17:10.267408 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:10.275655 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4a0d8ef4-d4c6-4557-9894-a168ddc7d328 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1565 microversion: 2.1 time: 0.264788 Jul 25 21:17:10.276483 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3495/6937] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:10 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1565 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:33.604956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:33.605639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=38 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:33.610288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:17:33.613581 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:33.621713 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:33.622405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:33.623184 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:33.623623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:33.674487 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-409a9f24-a872-4f9c-aa42-64856544e0ff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action" status: 200 len: 24566 microversion: 2.1 time: 0.071409 Jul 25 21:17:33.675181 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3443/6938] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:17:33 2022] POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action => generated 24566 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 21:17:44.581442 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:17:44.583650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:44.586459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=9 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:44.587070 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=36 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:44.593231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:44.593691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:44.594485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:44.594932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:44.670369 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c24c9745-2fee-4927-bba6-41049d2b1900 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action" status: 202 len: 0 microversion: 2.1 time: 0.092849 Jul 25 21:17:44.671031 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3496/6939] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:17:44 2022] POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:17:44.681981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:44.682824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:44.685477 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:44.686231 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:17:44.693787 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:44.694250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:44.695046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:44.695495 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:44.922365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:44.930002 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c0c68891-9ad8-45e1-aced-1319ad35801d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1674 microversion: 2.1 time: 0.253518 Jul 25 21:17:44.931067 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3444/6940] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:44 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:45.951402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:45.953412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:45.961294 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:45.961774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:45.962575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:45.963037 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:46.104880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:46.113159 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a30c1ec5-5cfc-4e62-a65b-b8c8167aa463 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.166035 Jul 25 21:17:46.128438 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3497/6941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:45 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:47.136634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:47.137228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:47.144953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:47.145407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:47.146171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:47.146612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:47.280539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:47.288956 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6ada932c-fc99-4649-8e19-c142d77f959b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.156230 Jul 25 21:17:47.289533 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3445/6942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:47 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:48.311836 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:48.312486 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:48.319324 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:48.319795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:48.320612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:48.321062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:48.455029 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:48.462635 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d240a490-244d-4618-bc67-52a9e7fc1dfc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.156084 Jul 25 21:17:48.463205 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3498/6943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:48 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:49.484663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:49.485289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:49.492977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:49.493441 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:49.494213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:49.494659 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:49.626110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:49.634276 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c046e537-1f01-4c7e-ae66-a1799bbf7aae tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.153538 Jul 25 21:17:49.634851 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3446/6944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:49 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:50.655175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:50.655743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:50.662807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:50.663500 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:50.664485 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:50.664945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:50.810759 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:50.820062 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-453e197e-a206-4001-baf4-93476106e017 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.169091 Jul 25 21:17:50.820990 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3499/6945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:50 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:51.841724 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:51.842349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:51.849950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:51.850419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:51.851209 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:51.851657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:51.987513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:51.995413 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3061c71f-c9e6-4b39-bfbc-90ba0b50d717 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.157671 Jul 25 21:17:51.996003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3447/6946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:51 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:53.018892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:53.019432 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:53.026308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:53.026817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:53.027594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:53.028072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:53.159490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:53.167328 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ad17151-6c54-420e-a032-359b5b0a4f5f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.153158 Jul 25 21:17:53.167914 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3500/6947] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:53 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:54.189260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:54.189878 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:54.197014 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:54.197468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:54.198242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:54.198682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:54.336282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:54.343890 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64a52e7b-68bd-429e-a330-e039ed75ed8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.158734 Jul 25 21:17:54.344491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3448/6948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:54 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:17:55.367326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:55.367937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:55.375091 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:55.375562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:55.376395 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:55.376854 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:55.506287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:55.513837 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4887134e-d11e-4931-9be4-4d75c4fa5b7a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1679 microversion: 2.1 time: 0.152055 Jul 25 21:17:55.514419 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3501/6949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:55 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:17:56.535471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:17:56.536112 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:17:56.543928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:56.544420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:56.545192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:17:56.545638 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:17:56.679419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:17:56.687855 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f818076a-a817-4ee8-9980-f891b64771c9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1682 microversion: 2.1 time: 0.156923 Jul 25 21:17:56.688476 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3449/6950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:17:56 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:22.888561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:22.890743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:22.893230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=12 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:22.893898 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:22.900541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:22.901011 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:22.901808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:22.902262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:22.965022 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9378a71c-9f9e-4f07-9487-e79f25a37be0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action" status: 200 len: 69156 microversion: 2.1 time: 0.080447 Jul 25 21:18:22.965704 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3502/6951] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:18:22 2022] POST /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e/action => generated 69156 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:18:30.045274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:30.045785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:30.047974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:30.048865 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=36 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:30.059000 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:30.061732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:30.062800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:30.063264 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:30.096350 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:18:30.112292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-92372df9-6280-421b-94fa-3a9e76d4a92b req-c9d83846-b970-417d-8400-7488eae42e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f82d7e3d-1d7e-4746-a4ca-b51b04ae483e", "tag": "446063fc-362b-4741-89e1-9fabf8a86324"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:30.124230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-92372df9-6280-421b-94fa-3a9e76d4a92b req-c9d83846-b970-417d-8400-7488eae42e61 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:30.124695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-92372df9-6280-421b-94fa-3a9e76d4a92b req-c9d83846-b970-417d-8400-7488eae42e61 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:30.136263 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-92372df9-6280-421b-94fa-3a9e76d4a92b req-c9d83846-b970-417d-8400-7488eae42e61 service nova] Creating event network-changed:446063fc-362b-4741-89e1-9fabf8a86324 for instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e on n-h1-845775-3 Jul 25 21:18:30.141479 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-92372df9-6280-421b-94fa-3a9e76d4a92b req-c9d83846-b970-417d-8400-7488eae42e61 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097919 Jul 25 21:18:30.142369 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3503/6952] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:18:30.185963 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-df49d74d-c79e-4ca4-aa59-f4c3e230f6d8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 204 len: 0 microversion: 2.1 time: 0.145094 Jul 25 21:18:30.190903 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3450/6953] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:18:30 2022] DELETE /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:18:30.196467 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:30.197203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:30.205366 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:30.205835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:30.206641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:30.207103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:30.344778 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:30.352478 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ba94702-01e5-4eba-91e5-d79042258462 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1688 microversion: 2.1 time: 0.160340 Jul 25 21:18:30.353595 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3504/6954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:30 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:18:31.375968 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:31.376701 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:31.383736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:31.384999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:31.385939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:31.386393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:31.530698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:31.538567 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-03b3766a-ea99-4471-9134-c853e9623edc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1688 microversion: 2.1 time: 0.166913 Jul 25 21:18:31.539164 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3451/6955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:31 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:32.562733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:32.563355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:32.570305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:32.570771 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:32.571571 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:32.572212 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:32.582643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3affa4d4-5409-481b-a30c-cd1de1920b56 req-f0d13efd-2a74-426f-aa9d-0bd2f06b45b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f82d7e3d-1d7e-4746-a4ca-b51b04ae483e", "name": "network-vif-deleted", "tag": "446063fc-362b-4741-89e1-9fabf8a86324"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:32.603070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3affa4d4-5409-481b-a30c-cd1de1920b56 req-f0d13efd-2a74-426f-aa9d-0bd2f06b45b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:32.604951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3affa4d4-5409-481b-a30c-cd1de1920b56 req-f0d13efd-2a74-426f-aa9d-0bd2f06b45b7 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:32.619480 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3affa4d4-5409-481b-a30c-cd1de1920b56 req-f0d13efd-2a74-426f-aa9d-0bd2f06b45b7 service nova] Creating event network-vif-deleted:446063fc-362b-4741-89e1-9fabf8a86324 for instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e on n-h1-845775-3 Jul 25 21:18:32.626519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3affa4d4-5409-481b-a30c-cd1de1920b56 req-f0d13efd-2a74-426f-aa9d-0bd2f06b45b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047454 Jul 25 21:18:32.627377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3452/6956] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:18:32.650663 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:32.666879 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-685499bf-fbc7-4e04-b401-d66852c8950a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 200 len: 1503 microversion: 2.1 time: 0.106705 Jul 25 21:18:32.667634 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3505/6957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:32 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 1503 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:33.691287 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:33.692009 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: f82d7e3d-1d7e-4746-a4ca-b51b04ae483e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:33.699175 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:33.699633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:33.700463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:33.700906 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:33.715176 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] HTTP exception thrown: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Request method failure captured: Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e HTTP/1.1 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wgAx5D3VJ6y7cFiKb-ztyAP3PReDzZ7ei1CItbCpQiLW3DvBusNc4WwkdC-W34G94aqGlaH6ia1etBcoAjWOzrSav5ZFCLs-vZWtVFmRCjQP8MDhO1ZVUjQsKU3H42c-oqHGn-xqP4SZf726FPtBqOz5M4ToXUValqiQe4qrzz9omY Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}] Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 19a498d1597840498123d02b586426c1 Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'f82d7e3d-1d7e-4746-a4ca-b51b04ae483e'} Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:18:33.716904 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Returning 404 to user: Instance f82d7e3d-1d7e-4746-a4ca-b51b04ae483e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-30c0cf88-cb48-4811-99c6-500346ba1bc5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e" status: 404 len: 111 microversion: 2.1 time: 0.032954 Jul 25 21:18:33.722075 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3453/6958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:33 2022] GET /compute/v2.1/servers/f82d7e3d-1d7e-4746-a4ca-b51b04ae483e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:18:37.272323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25dde415-e15c-44dd-8fa1-5cd8e63f1130 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '.version_select at 0x7f1968c55550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:37.298287 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25dde415-e15c-44dd-8fa1-5cd8e63f1130 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110487525" status: 202 len: 0 microversion: 2.1 time: 0.030332 Jul 25 21:18:37.299296 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3506/6959] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 21:18:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110487525 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:18:37.330325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bbb326e9-08de-450a-85fe-79d2a80606b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: .version_select at 0x7f1968695790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1809135471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISUL05l92dPFiYcKHKNBDGb5gL4Twuia89ULoeobze62d5GZ7jmFIC47IImXonuyMKSAvJ0HiyB+klfBHbcuOGAZgKZP0ucKhNHaUxqmWB274fykS/oTxHtmET3M3Qjvg=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:37.356648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-bbb326e9-08de-450a-85fe-79d2a80606b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:18:37.363925 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-bbb326e9-08de-450a-85fe-79d2a80606b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:18:37.397993 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bbb326e9-08de-450a-85fe-79d2a80606b3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.071515 Jul 25 21:18:37.405159 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3454/6960] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:18:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:18:43.208728 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=18 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:43.214349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1693750374", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "62c3fbb2-0ce0-4ce9-8a56-c97e76d4fcce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1809135471", "security_groups": [{"name": "tempest-secgroup-smoke-816256264"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:43.355229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] validate_networks() for [('62c3fbb2-0ce0-4ce9-8a56-c97e76d4fcce', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:18:43.836762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:18:43.837211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:18:43.838047 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:18:43.838866 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:18:43.839525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:18:43.853020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:43.853895 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:43.855046 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:43.855577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:43.885147 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:18:43.893515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:18:43.908793 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:18:43.911744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:18:43.971944 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6efd7045-a2f7-4939-baf4-f543a9d1bb54 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764868 Jul 25 21:18:43.986050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e508cd11-15f6-45e3-ab99-de5ec34b1309 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:43.987311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e508cd11-15f6-45e3-ab99-de5ec34b1309 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:43.992525 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3507/6961] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:18:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:18:43.996935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:44.080733 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e508cd11-15f6-45e3-ab99-de5ec34b1309 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:44.094470 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e508cd11-15f6-45e3-ab99-de5ec34b1309 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1267 microversion: 2.1 time: 0.112017 Jul 25 21:18:44.095258 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3455/6962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:43 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:45.119821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:45.120772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:45.129117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:45.129587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:45.130784 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:45.131077 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:45.208413 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:45.221861 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5392fb54-45f3-4b82-96c4-1f000dfcc87a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1271 microversion: 2.1 time: 0.106677 Jul 25 21:18:45.223217 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3508/6963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:45 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:46.244095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:46.246109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:46.255075 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:46.255541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:46.256368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:46.257072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:46.363342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:46.375430 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-83284415-f955-4f58-adc6-484e7df31708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1337 microversion: 2.1 time: 0.135260 Jul 25 21:18:46.376058 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3456/6964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:46 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1337 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:47.396849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:47.397643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:47.405717 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:47.406281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:47.407168 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:47.407699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:47.638135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:47.647321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c8052329-5d54-4298-8c28-8d6b03ff7553 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.254185 Jul 25 21:18:47.648303 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3509/6965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:47 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:47.850793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-439ee503-1111-4912-9830-49228a4a2670 req-a2a83048-8ff1-4e43-9448-338938c5df08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:47.862624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-439ee503-1111-4912-9830-49228a4a2670 req-a2a83048-8ff1-4e43-9448-338938c5df08 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:47.863083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-439ee503-1111-4912-9830-49228a4a2670 req-a2a83048-8ff1-4e43-9448-338938c5df08 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:47.876942 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-439ee503-1111-4912-9830-49228a4a2670 req-a2a83048-8ff1-4e43-9448-338938c5df08 service nova] Creating event network-changed:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h2-845775-3 Jul 25 21:18:47.883059 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-439ee503-1111-4912-9830-49228a4a2670 req-a2a83048-8ff1-4e43-9448-338938c5df08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116960 Jul 25 21:18:47.883697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3457/6966] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:18:48.669999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:48.670618 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:48.679120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:48.679587 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:48.680415 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:48.681143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:48.826951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:48.837308 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-12e5dc8b-19b8-4753-b08e-d026f472631c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.171702 Jul 25 21:18:48.837926 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3510/6967] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:48 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:49.860443 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:49.861160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:49.867711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:49.868196 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:49.868978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:49.869928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:50.005082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:50.013813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9a41af5f-9528-449e-b30d-4610085ddc98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.158657 Jul 25 21:18:50.014405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3458/6968] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:49 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:51.034911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:51.035529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:51.042787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:51.043262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:51.044090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:51.044558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:51.181186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:51.189270 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e565f1f7-0470-41ea-b894-5c26a22a13fb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.158350 Jul 25 21:18:51.189851 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3511/6969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:51 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:52.211380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:52.212541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:52.222130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:52.222983 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:52.224394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:52.225195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:52.390201 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:52.397965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3083b76d-ef50-4d65-8c2a-274260e23b48 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.191060 Jul 25 21:18:52.398560 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3459/6970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:52 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:53.425913 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:53.426541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:53.429304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:53.435493 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:53.435951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:53.436772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:53.437232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:53.585843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:53.593472 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4743561f-1aa0-4f7f-8583-32b7b7fa948d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.171605 Jul 25 21:18:53.594064 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3512/6971] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:53 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:53.689631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9183f48e-6b68-4720-8a71-2f9909f6cefc req-aca024d7-b67d-4064-899e-941e2f9ed304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "name": "network-vif-plugged", "status": "completed", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:53.699843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9183f48e-6b68-4720-8a71-2f9909f6cefc req-aca024d7-b67d-4064-899e-941e2f9ed304 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:53.700331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9183f48e-6b68-4720-8a71-2f9909f6cefc req-aca024d7-b67d-4064-899e-941e2f9ed304 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:53.711154 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9183f48e-6b68-4720-8a71-2f9909f6cefc req-aca024d7-b67d-4064-899e-941e2f9ed304 service nova] Creating event network-vif-plugged:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h2-845775-3 Jul 25 21:18:53.716119 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9183f48e-6b68-4720-8a71-2f9909f6cefc req-aca024d7-b67d-4064-899e-941e2f9ed304 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091503 Jul 25 21:18:53.716716 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3460/6972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:18:54.616944 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:54.617568 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:54.619598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:54.620970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:54.628503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:54.628971 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:54.629857 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:54.630227 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:54.779051 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:54.786838 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb258b04-7f35-4d6d-9742-23be498c07ca tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1392 microversion: 2.1 time: 0.174128 Jul 25 21:18:54.788251 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3513/6973] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:54 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:55.807712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:18:55.813008 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:55.813743 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:55.820349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:55.820802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:55.821622 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:55.822063 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:55.958347 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:55.966622 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cbd6e5c5-8102-4f9c-9869-beb2ddf2111a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1563 microversion: 2.1 time: 0.159957 Jul 25 21:18:55.967211 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3461/6974] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:55 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:55.986705 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:55.987330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:55.994357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:55.994875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:55.995659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:55.996144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:56.126835 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:56.134620 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-08c57cfd-4622-4c3a-ba1c-32b1bcdcd25c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1563 microversion: 2.1 time: 0.151808 Jul 25 21:18:56.135785 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3514/6975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:55 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:18:58.045749 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6ad61311-dfd4-4e2b-880a-487c3088af2a req-33beca8e-3841-4bd0-81d1-09ca5e0d3c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:18:58.047700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:18:58.048440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:18:58.059405 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6ad61311-dfd4-4e2b-880a-487c3088af2a req-33beca8e-3841-4bd0-81d1-09ca5e0d3c0b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:58.059863 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6ad61311-dfd4-4e2b-880a-487c3088af2a req-33beca8e-3841-4bd0-81d1-09ca5e0d3c0b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:58.062327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:58.062755 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:58.064335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:18:58.064335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:18:58.072337 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6ad61311-dfd4-4e2b-880a-487c3088af2a req-33beca8e-3841-4bd0-81d1-09ca5e0d3c0b service nova] Creating event network-changed:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h2-845775-3 Jul 25 21:18:58.078398 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6ad61311-dfd4-4e2b-880a-487c3088af2a req-33beca8e-3841-4bd0-81d1-09ca5e0d3c0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Jul 25 21:18:58.080201 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3515/6976] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:18:58.300462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:18:58.309265 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b5409238-6ddc-4d81-8a6c-fe5c731ad56d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1563 microversion: 2.1 time: 0.273414 Jul 25 21:18:58.310107 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3462/6977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:18:58 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1563 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:19.553689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=7 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:19.554456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=46 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:19.559008 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:19.561349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:19.568503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:19.568979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:19.569772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:19.570231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:19.629139 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c5f7938-520c-4917-9222-11724adb229d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action" status: 200 len: 24558 microversion: 2.1 time: 0.077110 Jul 25 21:19:19.629915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3516/6978] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:19:19 2022] POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action => generated 24558 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:19:30.686586 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:30.688947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:30.691325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:30.691991 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=34 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:30.698466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:30.698929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:30.699850 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:30.700607 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:30.795978 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:30.803802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Old instance type m1.heat2, new instance type m1.heat {{(pid=119723) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 25 21:19:30.811411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:19:30.811842 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:19:30.812354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:19:30.812772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:19:30.813191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:19:30.883313 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-131c2b14-8ae1-4922-9cb0-e1fcbfdc43a0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action" status: 202 len: 0 microversion: 2.1 time: 0.201304 Jul 25 21:19:30.884073 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3463/6979] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:19:30 2022] POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:19:30.892788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:30.893495 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:30.896436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:30.897114 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:19:30.904718 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:30.905250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:30.906100 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:30.906650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:31.066636 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:31.075606 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a7df0c74-15f9-4787-a723-9294f59b13a8 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1691 microversion: 2.1 time: 0.187020 Jul 25 21:19:31.076174 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3517/6980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:30 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:32.101542 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:32.102518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:32.110068 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:32.110548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:32.111333 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:32.111916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:32.260180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:32.268503 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-faca365a-e6ae-465b-99d7-23a6a9bfaa4d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1691 microversion: 2.1 time: 0.172131 Jul 25 21:19:32.269086 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3464/6981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:32 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:33.290732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:33.291464 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:33.304831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:33.305313 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:33.306381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:33.306868 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:33.458943 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:33.467769 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f52d527e-bdd6-4d95-a553-5b03a022e64f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1691 microversion: 2.1 time: 0.180952 Jul 25 21:19:33.468408 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3518/6982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:33 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:34.489050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:34.489678 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:34.496512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:34.496975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:34.497760 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:34.498210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:34.642427 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:34.651052 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6bf6d8d6-d1b3-4bf6-976b-3a8c75884ee5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.165866 Jul 25 21:19:34.651639 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3465/6983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:34 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:35.673076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:35.673999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:35.681383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:35.681862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:35.682670 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:35.683133 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:35.934462 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:35.942545 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1de2fdec-7d5e-4a8c-8ecd-2d441852ca09 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.273343 Jul 25 21:19:35.943112 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3519/6984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:35 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:36.965549 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:36.966169 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:36.973034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:36.973496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:36.974268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:36.974705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:37.118093 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:37.125746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c9178ea-dba5-4d24-a1d9-a216961a454a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.164602 Jul 25 21:19:37.126321 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3466/6985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:36 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:38.147498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:38.148166 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:38.155199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:38.155668 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:38.156509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:38.156969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:38.289883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:38.298205 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bdb287e2-e695-4e2e-94bb-c96975ae8175 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.154812 Jul 25 21:19:38.298983 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3520/6986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:38 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:39.318791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:39.319453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:39.326570 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:39.327021 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:39.327801 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:39.328296 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:39.467515 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:39.475310 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-85e3d702-8ece-466d-83f4-47225c6c287c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.160533 Jul 25 21:19:39.475911 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3467/6987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:39 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:40.497569 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:40.498193 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:40.505208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:40.505680 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:40.506471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:40.506936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:40.638763 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:40.646345 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bea91dfe-7f54-4e45-a1dd-6bd26809ad66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.152740 Jul 25 21:19:40.646915 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3521/6988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:40 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:41.679293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:41.679907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:41.686156 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:41.686615 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:41.687374 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:41.687813 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:41.828855 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:41.837356 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ea38cc0b-330e-4714-b10c-95da98c46ac3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.163454 Jul 25 21:19:41.837939 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3468/6989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:41 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:42.859584 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:42.860245 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:42.868274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:42.868738 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:42.869525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:42.869972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:43.009993 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:43.018330 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2d70ca81-d85d-4a8b-bb83-cd951bc74970 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.162722 Jul 25 21:19:43.018919 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3522/6990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:42 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:44.038882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:44.039505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:44.046530 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:44.046997 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:44.047772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:44.048254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:44.188454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:44.196152 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-435c86ac-6829-4dbc-bb06-20da4613ecdd tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.161166 Jul 25 21:19:44.196725 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3469/6991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:44 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:45.220377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:45.220999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:45.229297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:45.229764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:45.230683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:45.231504 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:45.374883 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:45.383028 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc818af4-6389-45d1-9a0a-39da4abe9c5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.168810 Jul 25 21:19:45.383651 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3523/6992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:45 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:46.405499 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:46.406044 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:46.413728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:46.414038 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:46.415294 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:46.415681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:46.560064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:46.569872 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-560f9378-6dbc-4e35-9104-21c7570e99f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.169076 Jul 25 21:19:46.570609 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3470/6993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:46 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:47.594949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:47.595479 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:47.602720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:47.603195 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:47.603988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:47.604544 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:47.742154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:47.749723 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-32ab8d88-1da4-46a7-942a-feb4b30df98e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.159422 Jul 25 21:19:47.750307 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3524/6994] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:47 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:48.771661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:48.772304 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:48.779854 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:48.780338 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:48.781187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:48.781631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:48.927130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:48.935841 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b902819f-f3ea-402d-84bd-54e1ad4dcbbc tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.168251 Jul 25 21:19:48.936467 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3471/6995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:48 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:49.959254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:49.959951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:49.967502 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:49.967972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:49.968798 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:49.969251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:50.146533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:50.154367 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-52987b6b-9668-44a0-816f-1f2ff6a4c559 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1696 microversion: 2.1 time: 0.200652 Jul 25 21:19:50.155470 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3525/6996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:49 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:50.773907 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "name": "network-vif-unplugged", "status": "completed", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:50.785866 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:50.786280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:50.800657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] Creating event network-vif-unplugged:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h1-845775-3 Jul 25 21:19:50.806069 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119723) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:19:50.818052 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-57d0c882-154b-4ced-9032-a69253aecec9 req-c1e481e0-65cf-48b8-a086-67bb3ac994ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047874 Jul 25 21:19:50.819046 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3472/6997] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:19:51.176909 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:51.177662 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:51.185580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:51.186658 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:51.187561 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:51.188112 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:51.348859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:51.357144 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a9e3c04a-7586-4781-b7b2-0b1c69750de6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1695 microversion: 2.1 time: 0.184471 Jul 25 21:19:51.358591 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3526/6998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:51 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:52.379799 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:52.380541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:52.390094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:52.390550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:52.391326 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:52.391772 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:52.530597 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:52.539146 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3174c3ee-ff02-4af9-a1ac-fdc7d923ce6a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1693 microversion: 2.1 time: 0.163589 Jul 25 21:19:52.539742 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3473/6999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:52 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:52.832629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:52.842847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:52.843307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:52.855097 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] Creating event network-changed:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h1-845775-3 Jul 25 21:19:52.860949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845775-3', 'n-h2-845775-3'} {{(pid=119724) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 25 21:19:52.871986 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-64cb903e-a777-4e5f-a0bd-2370c49a24f0 req-d8649004-83d7-4eab-9b75-0fc57d894b5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043102 Jul 25 21:19:52.872567 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3527/7000] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:19:53.560589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:53.561211 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:53.569460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:53.569920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:53.570712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:53.571157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:53.734631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:53.742507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8d824f24-7157-4a0e-98a4-6febd246afc7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1693 microversion: 2.1 time: 0.186360 Jul 25 21:19:53.743085 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3474/7001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:53 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:54.767652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:54.768506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:54.775250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:54.775808 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:54.776914 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:54.777387 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:54.915616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:54.923759 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5bc157dd-c0fe-41b1-805e-36434ac838ef tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1690 microversion: 2.1 time: 0.161777 Jul 25 21:19:54.924374 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3528/7002] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:54 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:54.945318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:54.946095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:54.954085 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:54.954550 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:54.955340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:54.955791 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:55.016394 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39ba3b09-3321-40ef-bed7-139105914233 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action" status: 204 len: 0 microversion: 2.1 time: 0.074785 Jul 25 21:19:55.017060 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3475/7003] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:19:54 2022] POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:19:55.025498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:55.026167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:55.032158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:55.032629 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:55.033422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:55.033876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:55.256411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:55.264285 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f783d23-fff2-44d8-a305-2e52aea33b6d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1690 microversion: 2.1 time: 0.242553 Jul 25 21:19:55.264791 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3529/7004] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:55 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:55.285120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:55.285867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:55.293050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:55.293513 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:55.294308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:55.295328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:55.517718 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:55.525786 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0159e03a-4c60-4827-b193-e575d82f3195 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1690 microversion: 2.1 time: 0.245031 Jul 25 21:19:55.526646 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3476/7005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:55 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:56.547727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:19:56.548381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:19:56.555277 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:56.555748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:56.557022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:56.557326 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:56.692555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:19:56.700151 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5399c71c-0e13-471c-8fb5-c492404a3d70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1682 microversion: 2.1 time: 0.156331 Jul 25 21:19:56.700728 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3530/7006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:19:56 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:19:56.871032 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2a0a4cd4-cf38-4c30-addd-46cbf65d3879 req-c7f38966-0f4a-4f2e-b3a6-969f168105a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "name": "network-vif-plugged", "status": "completed", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:19:56.882588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2a0a4cd4-cf38-4c30-addd-46cbf65d3879 req-c7f38966-0f4a-4f2e-b3a6-969f168105a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:19:56.883033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2a0a4cd4-cf38-4c30-addd-46cbf65d3879 req-c7f38966-0f4a-4f2e-b3a6-969f168105a6 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:19:56.895263 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2a0a4cd4-cf38-4c30-addd-46cbf65d3879 req-c7f38966-0f4a-4f2e-b3a6-969f168105a6 service nova] Creating event network-vif-plugged:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h1-845775-3 Jul 25 21:19:56.900409 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2a0a4cd4-cf38-4c30-addd-46cbf65d3879 req-c7f38966-0f4a-4f2e-b3a6-969f168105a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Jul 25 21:19:56.901063 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3477/7007] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:20:20.896631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:20.898816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:20.901301 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=28 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:20.902113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=82 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:20.908673 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:20.909142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:20.910020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:20.910375 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:20.964996 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d76d24bf-0a41-4114-aed9-70e9259fc699 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action" status: 200 len: 24552 microversion: 2.1 time: 0.072062 Jul 25 21:20:20.965680 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3531/7008] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:20:20 2022] POST /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2/action => generated 24552 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:20:28.170490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=34 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:28.171239 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:28.175942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5649a6e3-7064-40ee-9430-73112a63edca req-75a5650a-7e4e-4225-9a0d-daba2ccfbfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:28.177090 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:28.177712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:28.187037 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:28.187502 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:28.188345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:28.188795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:28.188927 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5649a6e3-7064-40ee-9430-73112a63edca req-75a5650a-7e4e-4225-9a0d-daba2ccfbfd3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:28.189422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5649a6e3-7064-40ee-9430-73112a63edca req-75a5650a-7e4e-4225-9a0d-daba2ccfbfd3 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:28.202352 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5649a6e3-7064-40ee-9430-73112a63edca req-75a5650a-7e4e-4225-9a0d-daba2ccfbfd3 service nova] Creating event network-changed:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h1-845775-3 Jul 25 21:20:28.208581 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5649a6e3-7064-40ee-9430-73112a63edca req-75a5650a-7e4e-4225-9a0d-daba2ccfbfd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037632 Jul 25 21:20:28.209466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3532/7009] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:20:28.223815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:20:28.308102 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-98332c8d-afb8-47ea-ad5f-01dc045e6f76 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 204 len: 0 microversion: 2.1 time: 0.139438 Jul 25 21:20:28.308966 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3478/7010] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:20:28 2022] DELETE /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:20:28.319252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:28.320361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:28.327727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:28.328579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:28.340850 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:28.341948 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:28.491657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:28.499569 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a16a3381-b03a-4245-b12f-4ac00e88ae70 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1688 microversion: 2.1 time: 0.185811 Jul 25 21:20:28.500182 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3533/7011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:28 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:29.523051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:29.525189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:29.536189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:29.537024 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:29.538331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:29.539257 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:29.679519 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:29.687319 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5f8bf9bb-6910-4d4a-b874-bbe562e9b2f6 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 200 len: 1688 microversion: 2.1 time: 0.168647 Jul 25 21:20:29.687897 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3479/7012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:29 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:30.287019 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e3723937-ec64-4559-a190-c771965a8b40 req-4a31bd16-08bf-41c9-b912-6dbfbe0eabca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eba9d0-9977-4a27-9aba-4ed813914cc2", "name": "network-vif-deleted", "tag": "8c411c69-0d86-4c47-8d79-931a36b84174"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:30.301004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3723937-ec64-4559-a190-c771965a8b40 req-4a31bd16-08bf-41c9-b912-6dbfbe0eabca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:30.301490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e3723937-ec64-4559-a190-c771965a8b40 req-4a31bd16-08bf-41c9-b912-6dbfbe0eabca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:30.315236 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e3723937-ec64-4559-a190-c771965a8b40 req-4a31bd16-08bf-41c9-b912-6dbfbe0eabca service nova] Creating event network-vif-deleted:8c411c69-0d86-4c47-8d79-931a36b84174 for instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 on n-h1-845775-3 Jul 25 21:20:30.320194 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e3723937-ec64-4559-a190-c771965a8b40 req-4a31bd16-08bf-41c9-b912-6dbfbe0eabca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036964 Jul 25 21:20:30.320864 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3534/7013] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:20:30.708891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:30.709517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 23eba9d0-9977-4a27-9aba-4ed813914cc2] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:30.716682 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:30.717170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:30.717943 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:30.718389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:30.732507 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] HTTP exception thrown: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Request method failure captured: Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 HTTP/1.1 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wgAx5D3VJ6y7cFiKb-ztyAP3PReDzZ7ei1CItbCpQiLW3DvBusNc4WwkdC-W34G94aqGlaH6ia1etBcoAjWOzrSav5ZFCLs-vZWtVFmRCjQP8MDhO1ZVUjQsKU3H42c-oqHGn-xqP4SZf726FPtBqOz5M4ToXUValqiQe4qrzz9omY Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}] Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 19a498d1597840498123d02b586426c1 Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '23eba9d0-9977-4a27-9aba-4ed813914cc2'} Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:20:30.734159 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Returning 404 to user: Instance 23eba9d0-9977-4a27-9aba-4ed813914cc2 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7e8fe185-ccd4-4b61-83fb-db800cf60f17 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2" status: 404 len: 111 microversion: 2.1 time: 0.030684 Jul 25 21:20:30.739057 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3480/7014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:30 2022] GET /compute/v2.1/servers/23eba9d0-9977-4a27-9aba-4ed813914cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:20:34.315130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-828538b3-e8f7-4074-8d1e-88a231315dd5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '.version_select at 0x7f196eaa5af0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:34.344655 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-828538b3-e8f7-4074-8d1e-88a231315dd5 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1809135471" status: 202 len: 0 microversion: 2.1 time: 0.038734 Jul 25 21:20:34.346046 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3535/7015] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 21:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1809135471 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:20:34.373144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bf7b9946-92b4-4bd6-8ee7-d9961b9477fa tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: .version_select at 0x7f1968ac9c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1919706562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFNDNFTJtuhlp+19LnwU8bOVAreNjPTDDcPsJLlDVkasosWwnw423eAbbI4qz7v6Rky99DOUAzHNrcsQy0AiRQxTDPsN40LIkxc+i1QzUn9rKtU4Xrw/Pc5i0LUF3Rb9A=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:34.389716 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-bf7b9946-92b4-4bd6-8ee7-d9961b9477fa tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:20:34.396142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-bf7b9946-92b4-4bd6-8ee7-d9961b9477fa tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:20:34.421175 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bf7b9946-92b4-4bd6-8ee7-d9961b9477fa tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052006 Jul 25 21:20:34.421792 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3481/7016] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:20:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:20:39.798430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-244969562", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "7990ef42-93cf-4b00-8d91-0b854d91c206"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1919706562", "security_groups": [{"name": "tempest-secgroup-smoke-388788052"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:39.951272 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] validate_networks() for [('7990ef42-93cf-4b00-8d91-0b854d91c206', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:20:40.308350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=14 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:40.402652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:20:40.403191 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:20:40.403755 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:20:40.404299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:20:40.404799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:20:40.415165 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:40.415813 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:40.416788 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:40.417302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:40.437163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:20:40.443003 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:20:40.455525 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:20:40.457954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:20:40.507558 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-556d13c0-79b5-469c-b9a7-18e0b62a0651 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719234 Jul 25 21:20:40.514005 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3536/7017] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:20:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:20:40.520568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bee80ca8-606e-457d-bfbf-2d8085e0d74b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:40.521896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bee80ca8-606e-457d-bfbf-2d8085e0d74b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:40.594281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bee80ca8-606e-457d-bfbf-2d8085e0d74b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:40.602802 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bee80ca8-606e-457d-bfbf-2d8085e0d74b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1266 microversion: 2.1 time: 0.087372 Jul 25 21:20:40.603414 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3482/7018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:40 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:41.625566 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:41.626785 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:41.640758 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:41.641235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:41.642078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:41.648896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:41.956338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:41.965543 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ac41d2f4-6fc2-4579-88b6-cd6f75910c7b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1336 microversion: 2.1 time: 0.344823 Jul 25 21:20:41.966293 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3537/7019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:41 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1336 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:42.987633 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:42.988920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:42.994601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:42.998459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:42.999256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:43.000523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:43.001420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:43.236336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:43.247261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61ac142e-d050-41f2-bd12-e9f1c61cb91d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.263743 Jul 25 21:20:43.247906 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3483/7020] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:42 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:43.540607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-d6b407e0-7dc7-4c93-ad7c-2d5d83598366 req-5462d40e-9a10-4a49-88aa-20d00b464766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d812a301-6a3a-423e-b8fd-77c04d7dc765", "tag": "6e3ed034-7aaf-410e-927e-429303964847"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:43.564338 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d6b407e0-7dc7-4c93-ad7c-2d5d83598366 req-5462d40e-9a10-4a49-88aa-20d00b464766 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:43.565226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-d6b407e0-7dc7-4c93-ad7c-2d5d83598366 req-5462d40e-9a10-4a49-88aa-20d00b464766 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:43.581415 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-d6b407e0-7dc7-4c93-ad7c-2d5d83598366 req-5462d40e-9a10-4a49-88aa-20d00b464766 service nova] Creating event network-changed:6e3ed034-7aaf-410e-927e-429303964847 for instance d812a301-6a3a-423e-b8fd-77c04d7dc765 on n-h1-845775-3 Jul 25 21:20:43.588229 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-d6b407e0-7dc7-4c93-ad7c-2d5d83598366 req-5462d40e-9a10-4a49-88aa-20d00b464766 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054441 Jul 25 21:20:43.589515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3538/7021] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:20:44.268853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:44.269343 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:44.276230 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:44.276699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:44.277479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:44.277927 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:44.417265 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:44.425213 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8bb7ee6d-8e74-40fa-bd38-4c8eac3d9f66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.160625 Jul 25 21:20:44.425752 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3484/7022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:44 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:45.526457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:45.527859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:45.535846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:45.536645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:45.537567 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:45.538096 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:45.678807 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:45.686945 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a0336c0-12fd-4ddd-a84f-2b3abc7aaf92 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.244224 Jul 25 21:20:45.687527 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3539/7023] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:45 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:46.708330 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:46.708963 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:46.715959 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:46.716455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:46.717234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:46.717681 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:46.852928 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:46.860518 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-16b3bfe8-d821-461a-9183-166ebd4ae6c1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.156845 Jul 25 21:20:46.861104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3485/7024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:46 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:47.882066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:47.882719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:47.890022 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:47.890490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:47.891938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:47.892427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:48.039274 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:48.046992 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3fb7bf19-c140-40d9-8111-d8839409eaa7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.168940 Jul 25 21:20:48.047582 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3540/7025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:47 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:49.069213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:49.069794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:49.076435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:49.076900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:49.077680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:49.078132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:49.227342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:49.235453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6d22d230-db59-4c88-9399-c5350d56fb66 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.170288 Jul 25 21:20:49.236195 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3486/7026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:49 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:49.260507 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-8a34c3aa-cb58-4319-af52-57930fc5f479 req-30a0e08a-2c35-4e77-8efd-4132c52c469a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d812a301-6a3a-423e-b8fd-77c04d7dc765", "name": "network-vif-plugged", "status": "completed", "tag": "6e3ed034-7aaf-410e-927e-429303964847"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:49.271678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8a34c3aa-cb58-4319-af52-57930fc5f479 req-30a0e08a-2c35-4e77-8efd-4132c52c469a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:49.272239 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-8a34c3aa-cb58-4319-af52-57930fc5f479 req-30a0e08a-2c35-4e77-8efd-4132c52c469a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:49.284521 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-8a34c3aa-cb58-4319-af52-57930fc5f479 req-30a0e08a-2c35-4e77-8efd-4132c52c469a service nova] Creating event network-vif-plugged:6e3ed034-7aaf-410e-927e-429303964847 for instance d812a301-6a3a-423e-b8fd-77c04d7dc765 on n-h1-845775-3 Jul 25 21:20:49.289622 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-8a34c3aa-cb58-4319-af52-57930fc5f479 req-30a0e08a-2c35-4e77-8efd-4132c52c469a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Jul 25 21:20:49.290239 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3541/7027] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:20:50.258295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:50.258950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:50.266267 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:50.266736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:50.267518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:50.267990 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:50.408124 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:50.415992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0f67a8b5-2c36-49be-97c0-5be70244f5ed tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1391 microversion: 2.1 time: 0.162808 Jul 25 21:20:50.416628 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3487/7028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:50 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:51.435729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:51.436538 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:51.440995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:51.441708 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:51.443505 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:51.450653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:51.451119 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:51.451894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:51.452376 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:51.593115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:51.601705 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4426b034-bc17-4c3f-a9c5-ef105d934408 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1564 microversion: 2.1 time: 0.167697 Jul 25 21:20:51.602288 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3542/7029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:51 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:51.621665 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:51.622308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:51.624248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:20:51.632688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:51.633173 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:51.633946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:51.634397 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:51.791301 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:51.800466 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e78fd8b4-5e33-4213-b347-e728d812a21d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1564 microversion: 2.1 time: 0.182476 Jul 25 21:20:51.801104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3488/7030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:51 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:20:53.789050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:20:53.789678 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:20:53.793016 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c746ef8e-1f42-497b-9d6a-c57ae7534b1e req-67a5030e-8edf-4e3d-903c-a0c286dd5e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d812a301-6a3a-423e-b8fd-77c04d7dc765", "tag": "6e3ed034-7aaf-410e-927e-429303964847"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:20:53.797330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:53.798531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:53.799675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:53.799831 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:53.804935 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c746ef8e-1f42-497b-9d6a-c57ae7534b1e req-67a5030e-8edf-4e3d-903c-a0c286dd5e12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:20:53.805398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c746ef8e-1f42-497b-9d6a-c57ae7534b1e req-67a5030e-8edf-4e3d-903c-a0c286dd5e12 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:20:53.819885 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-c746ef8e-1f42-497b-9d6a-c57ae7534b1e req-67a5030e-8edf-4e3d-903c-a0c286dd5e12 service nova] Creating event network-changed:6e3ed034-7aaf-410e-927e-429303964847 for instance d812a301-6a3a-423e-b8fd-77c04d7dc765 on n-h1-845775-3 Jul 25 21:20:53.826306 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c746ef8e-1f42-497b-9d6a-c57ae7534b1e req-67a5030e-8edf-4e3d-903c-a0c286dd5e12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Jul 25 21:20:53.827269 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3489/7031] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:20:54.044417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:20:54.052362 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1163db3d-509e-4b9a-a3d8-4e2d1404e571 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1564 microversion: 2.1 time: 0.267251 Jul 25 21:20:54.060803 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3543/7032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:20:53 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:19.315763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:19.316560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=38 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:19.321129 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:21:19.323433 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:19.331420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:19.331887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:19.332702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:19.333157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:19.402420 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cdb24e08-1938-4707-939b-b3d0f959f4f1 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action" status: 200 len: 24566 microversion: 2.1 time: 0.087512 Jul 25 21:21:19.403452 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3490/7033] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:21:19 2022] POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:21:30.539454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e0aa99df-89f2-43d2-aca1-7246f5a157d0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:21:30.541743 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.542396 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=36 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.549157 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0aa99df-89f2-43d2-aca1-7246f5a157d0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:30.549783 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e0aa99df-89f2-43d2-aca1-7246f5a157d0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:30.573052 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e0aa99df-89f2-43d2-aca1-7246f5a157d0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Going to try to stop instance {{(pid=119724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 21:21:30.619013 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e0aa99df-89f2-43d2-aca1-7246f5a157d0 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action" status: 202 len: 0 microversion: 2.1 time: 0.083403 Jul 25 21:21:30.619568 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3544/7034] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:21:30 2022] POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:21:30.628930 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:30.629895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:30.634142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.634980 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:21:30.639484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:30.639942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:30.640872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:30.641517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:30.819617 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:30.828417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-084c9774-2609-4775-86d1-21d40c12a3eb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.204173 Jul 25 21:21:30.829003 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3491/7035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:30 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:31.852426 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:31.853140 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:31.859511 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:31.859973 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:31.861281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:31.861730 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:32.019619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:32.027860 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a4e41113-76c0-4aad-bb96-a9be37fbe181 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.180673 Jul 25 21:21:32.028498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3545/7036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:31 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:33.049896 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:33.050498 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:33.058033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:33.058496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:33.059280 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:33.059725 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:33.203858 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:33.215192 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-908ba6e2-d06d-487f-8824-6daca04414a4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.168917 Jul 25 21:21:33.216007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3492/7037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:33 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:34.243354 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:34.244203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:34.253012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:34.253562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:34.254369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:34.254862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:34.422985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:34.433892 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b93a51af-afb5-4ca0-882a-54209c446cee tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.194656 Jul 25 21:21:34.434489 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3546/7038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:34 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:35.457356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:35.458189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:35.465484 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:35.465940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:35.466732 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:35.467178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:35.619200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:35.627054 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f21c3841-e779-4e08-807d-fa94a7846f5e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.174380 Jul 25 21:21:35.627664 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3493/7039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:35 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:36.648775 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:36.649336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:36.656444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:36.656911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:36.658260 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:36.658790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:36.797799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:36.806122 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5aeb974a-c8b9-4b4a-b67e-d5d226c5bb1e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.161373 Jul 25 21:21:36.806708 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3547/7040] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:36 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:37.828218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:37.828763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:37.836071 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:37.836536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:37.837317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:37.837761 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:37.976598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:37.984385 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2b07ec23-afa2-43be-a6f5-f8897258cd0d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.160052 Jul 25 21:21:37.984990 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3494/7041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:37 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:39.007075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:39.007707 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:39.014824 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:39.015291 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:39.016428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:39.016956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:39.154233 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:39.162555 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-86b7f742-e86c-442c-8046-26155d2b9089 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.159353 Jul 25 21:21:39.163157 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3548/7042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:39 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:40.187197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:40.187197 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:40.194029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:40.194560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:40.196077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:40.196077 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:40.369344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:40.383564 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6b1b01c4-0fda-44b6-9b26-c94fc8aec9c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1692 microversion: 2.1 time: 0.201805 Jul 25 21:21:40.384554 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3495/7043] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:40 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:41.408905 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:41.409540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:41.419409 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:41.419874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:41.420706 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:41.421189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:41.558030 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:41.565843 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fa1ef7f5-bd97-448c-8c3a-c8d03372ae31 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1669 microversion: 2.1 time: 0.161671 Jul 25 21:21:41.566432 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3549/7044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:41 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:42.664947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:21:42.667091 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:42.674282 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:42.674767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:42.675536 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:42.675986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:42.737636 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-c2e06740-b4dd-44a0-95c6-769d1db24865 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action" status: 200 len: 38384 microversion: 2.1 time: 0.077186 Jul 25 21:21:42.738317 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3496/7045] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:21:42 2022] POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action => generated 38384 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:21:42.750219 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f774a54-289e-4484-ac68-931c4f98b7c2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:21:42.758593 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f774a54-289e-4484-ac68-931c4f98b7c2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:42.759065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f774a54-289e-4484-ac68-931c4f98b7c2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:42.782772 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5f774a54-289e-4484-ac68-931c4f98b7c2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Going to try to start instance {{(pid=119724) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 21:21:42.833933 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f774a54-289e-4484-ac68-931c4f98b7c2 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action" status: 202 len: 0 microversion: 2.1 time: 0.087367 Jul 25 21:21:42.834563 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3550/7046] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:21:42 2022] POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:21:42.844180 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:42.844908 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:42.855050 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:42.855517 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:42.856337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:42.856786 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:43.080295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:43.087996 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-361d7a2c-13b0-4932-9546-1da729773836 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1678 microversion: 2.1 time: 0.248716 Jul 25 21:21:43.088615 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3497/7047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:42 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:21:44.110923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:21:44.111601 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:21:44.119115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:44.119603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:44.120431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:21:44.120893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:21:44.267607 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:21:44.276447 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8d72715a-dbd1-4e13-a45e-0c0fcd48164f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1682 microversion: 2.1 time: 0.170933 Jul 25 21:21:44.277133 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3551/7048] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:21:44 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:10.476309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:10.478531 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:10.481565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.482243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=40 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:10.489274 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:10.489735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:10.490523 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:10.490973 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:10.544519 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-63c6945f-5849-4f5c-8068-f0dc29fdda89 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action" status: 200 len: 62946 microversion: 2.1 time: 0.071940 Jul 25 21:22:10.545197 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3498/7049] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:22:10 2022] POST /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765/action => generated 62946 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:22:22.732643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:22.733173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:22.736167 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=16 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.736817 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3489b3c0-f97e-4056-ae3c-3ef46598990d req-216c1764-43c8-49e4-a253-8f1d34d4403e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d812a301-6a3a-423e-b8fd-77c04d7dc765", "tag": "6e3ed034-7aaf-410e-927e-429303964847"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:22.737240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.742506 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:22.742990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:22.743833 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:22.744789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:22.746771 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.747710 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=4 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:22.750840 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3489b3c0-f97e-4056-ae3c-3ef46598990d req-216c1764-43c8-49e4-a253-8f1d34d4403e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:22.751309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3489b3c0-f97e-4056-ae3c-3ef46598990d req-216c1764-43c8-49e4-a253-8f1d34d4403e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:22.766238 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3489b3c0-f97e-4056-ae3c-3ef46598990d req-216c1764-43c8-49e4-a253-8f1d34d4403e service nova] Creating event network-changed:6e3ed034-7aaf-410e-927e-429303964847 for instance d812a301-6a3a-423e-b8fd-77c04d7dc765 on n-h1-845775-3 Jul 25 21:22:22.771835 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3489b3c0-f97e-4056-ae3c-3ef46598990d req-216c1764-43c8-49e4-a253-8f1d34d4403e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Jul 25 21:22:22.773192 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3499/7050] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:22:22.773615 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:22:22.871094 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-39bcafb6-5ccf-47f3-b4e8-518d055f0e38 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 204 len: 0 microversion: 2.1 time: 0.142266 Jul 25 21:22:22.875337 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3552/7051] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:22:22 2022] DELETE /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:22:22.886094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:22.887757 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:22.899653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:22.900657 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:22.901979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:22.902435 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:23.105226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:23.113024 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2a290fd5-7159-431b-8547-468ac184af3a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1688 microversion: 2.1 time: 0.235918 Jul 25 21:22:23.113799 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3500/7052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:22 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:24.135549 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:24.136223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:24.143223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:24.143691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:24.144548 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:24.145007 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:24.327988 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:24.337011 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3bdc210f-c88b-40d0-921d-5a88765798f4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1688 microversion: 2.1 time: 0.205791 Jul 25 21:22:24.337604 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3553/7053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:24 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:25.176253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-41d2a6e4-038e-43fb-aeb2-1afba61e1941 req-479e95d1-324b-4dc7-8497-674045b8663e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d812a301-6a3a-423e-b8fd-77c04d7dc765", "name": "network-vif-deleted", "tag": "6e3ed034-7aaf-410e-927e-429303964847"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:25.189353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-41d2a6e4-038e-43fb-aeb2-1afba61e1941 req-479e95d1-324b-4dc7-8497-674045b8663e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:25.189915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-41d2a6e4-038e-43fb-aeb2-1afba61e1941 req-479e95d1-324b-4dc7-8497-674045b8663e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:25.201920 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-41d2a6e4-038e-43fb-aeb2-1afba61e1941 req-479e95d1-324b-4dc7-8497-674045b8663e service nova] Creating event network-vif-deleted:6e3ed034-7aaf-410e-927e-429303964847 for instance d812a301-6a3a-423e-b8fd-77c04d7dc765 on n-h1-845775-3 Jul 25 21:22:25.207956 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-41d2a6e4-038e-43fb-aeb2-1afba61e1941 req-479e95d1-324b-4dc7-8497-674045b8663e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035478 Jul 25 21:22:25.208613 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3501/7054] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:22:25.359188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:25.360126 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:25.367646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:25.368161 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:25.368961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:25.369647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:25.401347 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:25.401814 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:25.402284 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lazy-loading 'fault' on Instance uuid d812a301-6a3a-423e-b8fd-77c04d7dc765 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:22:25.446089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:25.454311 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1decdcaf-d9cb-4048-a43e-8b22ce183965 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 200 len: 1356 microversion: 2.1 time: 0.099200 Jul 25 21:22:25.455208 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3554/7055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:25 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:26.477013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:26.477728 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: d812a301-6a3a-423e-b8fd-77c04d7dc765] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:26.485195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:26.486272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:26.487055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:26.487572 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:26.501768 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] HTTP exception thrown: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Request method failure captured: Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 HTTP/1.1 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wgAx5D3VJ6y7cFiKb-ztyAP3PReDzZ7ei1CItbCpQiLW3DvBusNc4WwkdC-W34G94aqGlaH6ia1etBcoAjWOzrSav5ZFCLs-vZWtVFmRCjQP8MDhO1ZVUjQsKU3H42c-oqHGn-xqP4SZf726FPtBqOz5M4ToXUValqiQe4qrzz9omY Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}] Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 19a498d1597840498123d02b586426c1 Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'd812a301-6a3a-423e-b8fd-77c04d7dc765'} Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:22:26.503843 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Returning 404 to user: Instance d812a301-6a3a-423e-b8fd-77c04d7dc765 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5837aa57-47de-41d5-811e-7ca376f9bafb tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765" status: 404 len: 111 microversion: 2.1 time: 0.032609 Jul 25 21:22:26.511286 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3502/7056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:26 2022] GET /compute/v2.1/servers/d812a301-6a3a-423e-b8fd-77c04d7dc765 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:22:29.937430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-eb062a00-375f-4845-bd64-8417abe99252 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '.version_select at 0x7f196962ddc0>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:29.962047 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-eb062a00-375f-4845-bd64-8417abe99252 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1919706562" status: 202 len: 0 microversion: 2.1 time: 0.028656 Jul 25 21:22:29.963443 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3555/7057] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 21:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1919706562 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:22:29.998027 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2f969af2-4a56-4f62-bdbb-3787908a815b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: .version_select at 0x7f1968c03430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1356903164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv3YL7cXZZA6UwiATyarlUSNQthO+uw3qFJ4tTT0FyUp+trzg7+NGa/CgTSlS/AIKk+QWARfUVyBOY0haU38hTuJ+vlPG8ORng5sT8sZdJOtfGovDPvzuEpa3k0Nnlwow=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:30.014564 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2f969af2-4a56-4f62-bdbb-3787908a815b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:22:30.020485 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-2f969af2-4a56-4f62-bdbb-3787908a815b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:22:30.049923 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2f969af2-4a56-4f62-bdbb-3787908a815b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056066 Jul 25 21:22:30.050553 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3503/7058] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:22:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:22:35.391685 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1557550638", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "networks": [{"uuid": "f9bcecc9-b002-4a5f-ae62-6af208de7271"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1356903164", "security_groups": [{"name": "tempest-secgroup-smoke-1932470929"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:35.454172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:35.519830 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] validate_networks() for [('f9bcecc9-b002-4a5f-ae62-6af208de7271', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:22:36.374490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:22:36.376677 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:22:36.377715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:22:36.378595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:22:36.379477 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:22:36.396058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:36.398189 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:36.399155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:36.399616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:36.419580 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:22:36.426355 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Getting quotas for user 19a498d1597840498123d02b586426c1 and project 7f3633bad7fb4216b6444817b8c228cc. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:22:36.442308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:22:36.444671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:22:36.511462 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88a9d51b-cfb0-4abe-8192-efef7c0f7fb4 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125538 Jul 25 21:22:36.519025 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3556/7059] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:22:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:22:36.521479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=12 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:36.526651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8f6ac5c5-fdf6-4c9c-89c2-d0cbc35d5b94 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:36.539054 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8f6ac5c5-fdf6-4c9c-89c2-d0cbc35d5b94 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:36.635210 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8f6ac5c5-fdf6-4c9c-89c2-d0cbc35d5b94 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:36.642741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8f6ac5c5-fdf6-4c9c-89c2-d0cbc35d5b94 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1267 microversion: 2.1 time: 0.122920 Jul 25 21:22:36.643434 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3504/7060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:36 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:37.668789 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:37.671281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:37.701645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:37.702739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:37.704920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:37.706069 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:37.861450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:37.874855 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2b9afe4d-c776-4a25-9336-758833187db7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1327 microversion: 2.1 time: 0.213325 Jul 25 21:22:37.877844 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3557/7061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:37 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:38.905029 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:38.905826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:38.914358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:38.914818 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:38.915604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:38.916064 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:39.144242 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:39.151816 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-77ea69bd-b7fa-4738-9581-299decfef03c tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.250757 Jul 25 21:22:39.152439 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3505/7062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:38 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:39.496450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-104d240c-22ca-43c7-be6f-dac1a1692f96 req-5d4690df-a280-40fa-b490-8925c08fc6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2356cc1d-fec8-41b0-9dae-6ab86772da83", "tag": "87b3d4c8-f922-4309-8f05-905cf623ecf5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:39.514699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-104d240c-22ca-43c7-be6f-dac1a1692f96 req-5d4690df-a280-40fa-b490-8925c08fc6ca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:39.515158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-104d240c-22ca-43c7-be6f-dac1a1692f96 req-5d4690df-a280-40fa-b490-8925c08fc6ca service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:39.538852 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-104d240c-22ca-43c7-be6f-dac1a1692f96 req-5d4690df-a280-40fa-b490-8925c08fc6ca service nova] Creating event network-changed:87b3d4c8-f922-4309-8f05-905cf623ecf5 for instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 on n-h2-845775-3 Jul 25 21:22:39.550081 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-104d240c-22ca-43c7-be6f-dac1a1692f96 req-5d4690df-a280-40fa-b490-8925c08fc6ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061907 Jul 25 21:22:39.551589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3558/7063] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:22:40.175784 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:40.176463 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:40.183956 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:40.184504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:40.185311 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:40.185730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:40.337459 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:40.347585 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1be0dcf3-30ac-4f44-8b6f-99814fca693b tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.177975 Jul 25 21:22:40.348244 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3506/7064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:40 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:41.370002 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:41.370643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:41.377697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:41.378149 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:41.378940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:41.379399 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:41.514085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:41.521761 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-80d3bfde-d772-4478-8f76-639426d42cd9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.156892 Jul 25 21:22:41.522338 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3559/7065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:41 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:42.542816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:42.543372 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:42.549998 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:42.550452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:42.551518 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:42.551960 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:42.701950 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:42.711349 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a967e245-670e-4cbf-aa36-2d249f5bcc93 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.172409 Jul 25 21:22:42.711955 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3507/7066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:42 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:43.734162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:43.734770 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:43.742404 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:43.742867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:43.743647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:43.744117 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:43.877305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:43.886388 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dc66ddd3-78b2-422a-b587-97f128e47177 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.156047 Jul 25 21:22:43.886963 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3560/7067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:43 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:44.621191 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-d3bae1bf-2668-4bb7-9e32-19113d444416 req-efac5624-29df-4477-b2e5-6e555321780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2356cc1d-fec8-41b0-9dae-6ab86772da83", "name": "network-vif-plugged", "status": "completed", "tag": "87b3d4c8-f922-4309-8f05-905cf623ecf5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:44.632610 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d3bae1bf-2668-4bb7-9e32-19113d444416 req-efac5624-29df-4477-b2e5-6e555321780a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:44.633337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-d3bae1bf-2668-4bb7-9e32-19113d444416 req-efac5624-29df-4477-b2e5-6e555321780a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:44.646278 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-d3bae1bf-2668-4bb7-9e32-19113d444416 req-efac5624-29df-4477-b2e5-6e555321780a service nova] Creating event network-vif-plugged:87b3d4c8-f922-4309-8f05-905cf623ecf5 for instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 on n-h2-845775-3 Jul 25 21:22:44.651381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-d3bae1bf-2668-4bb7-9e32-19113d444416 req-efac5624-29df-4477-b2e5-6e555321780a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Jul 25 21:22:44.652096 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3508/7068] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:22:44.906962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:44.907535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:44.914592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:44.915056 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:44.915861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:44.916496 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:45.069555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:45.078012 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-721af3d7-ee37-49cb-8926-8092a46bbdc3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1393 microversion: 2.1 time: 0.175014 Jul 25 21:22:45.078605 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3561/7069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:44 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:46.100471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:46.101212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:46.109658 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:46.110116 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:46.110891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:46.111334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:46.258383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:46.266425 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4752b209-029d-49fd-b8ae-25a094de7b98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1565 microversion: 2.1 time: 0.171266 Jul 25 21:22:46.267188 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3509/7070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:46 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:46.287840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:46.289199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:46.296282 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:46.296682 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:46.297964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:46.299258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:46.409648 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:46.434412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:46.439937 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:46.447905 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9f736ff8-147e-4fdb-a542-097ce95a120a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1565 microversion: 2.1 time: 0.164300 Jul 25 21:22:46.448515 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3562/7071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:46 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:22:48.101361 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4b4ac945-8202-4822-aaa9-ad000f4f0086 req-367899c0-cd3c-40b8-9c72-d9ff78ce64cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2356cc1d-fec8-41b0-9dae-6ab86772da83", "tag": "87b3d4c8-f922-4309-8f05-905cf623ecf5"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:22:48.104187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:22:48.104853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:22:48.111763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:22:48.121158 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:48.125377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4b4ac945-8202-4822-aaa9-ad000f4f0086 req-367899c0-cd3c-40b8-9c72-d9ff78ce64cd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:48.126704 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4b4ac945-8202-4822-aaa9-ad000f4f0086 req-367899c0-cd3c-40b8-9c72-d9ff78ce64cd service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:48.130988 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:48.132051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:22:48.132668 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:22:48.155531 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4b4ac945-8202-4822-aaa9-ad000f4f0086 req-367899c0-cd3c-40b8-9c72-d9ff78ce64cd service nova] Creating event network-changed:87b3d4c8-f922-4309-8f05-905cf623ecf5 for instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 on n-h2-845775-3 Jul 25 21:22:48.162508 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4b4ac945-8202-4822-aaa9-ad000f4f0086 req-367899c0-cd3c-40b8-9c72-d9ff78ce64cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064898 Jul 25 21:22:48.163607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3563/7072] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:22:48.613996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:22:48.622381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a04e000-6d1b-4935-b08d-05290c44de9e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1565 microversion: 2.1 time: 0.528922 Jul 25 21:22:48.622988 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3510/7073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:22:48 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1565 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:11.883074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:11.883843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=36 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:11.888861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:11.891712 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:11.899652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:11.900231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:11.901020 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:11.901471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:11.960533 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ab389228-ac52-434b-838a-3e6aabec3d40 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action" status: 200 len: 24557 microversion: 2.1 time: 0.079269 Jul 25 21:23:11.961256 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3564/7074] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:23:11 2022] POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action => generated 24557 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:23:23.033359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:23.033964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:23.036261 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:23.036986 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=32 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:23.043019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:23.043482 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:23.044318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:23.044767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:23.073340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.objects.instance [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lazy-loading 'flavor' on Instance uuid 2356cc1d-fec8-41b0-9dae-6ab86772da83 {{(pid=119723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:23:23.149392 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ec7a6f1-2c2c-43a7-8e3b-c02c9d0e6a37 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action" status: 202 len: 0 microversion: 2.1 time: 0.119897 Jul 25 21:23:23.153278 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3511/7075] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:23:23 2022] POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:23:23.160403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:23.161215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:23.164179 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:23.165963 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:23.172653 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:23.173106 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:23.173903 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:23.174357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:23.353203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:23.363844 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0f04c23c-6ce9-455c-9754-b261a4083c98 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1692 microversion: 2.1 time: 0.207919 Jul 25 21:23:23.364550 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3565/7076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:23 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:24.389576 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:24.390800 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:24.397174 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:24.397639 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:24.398420 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:24.398864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:24.539985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:24.547990 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a5bc134-f052-43c8-8e0c-f6dd0951d99e tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1675 microversion: 2.1 time: 0.163720 Jul 25 21:23:24.548606 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3512/7077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:24 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:25.645040 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:25.647155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:25.655058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.655533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:25.657151 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.658072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:25.707541 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-16ff64b5-62bc-4d8c-b3d9-17fdb3621fff tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action" status: 200 len: 38393 microversion: 2.1 time: 0.067086 Jul 25 21:23:25.708245 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3566/7078] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:23:25 2022] POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action => generated 38393 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:23:25.721293 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:25.721882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:25.728720 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.729176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:25.729939 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.730377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:25.806489 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-00c8def4-798c-4b17-8f69-cc9da951497d tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action" status: 202 len: 0 microversion: 2.1 time: 0.089962 Jul 25 21:23:25.807169 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3513/7079] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:23:25 2022] POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:23:25.818444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:25.819174 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:25.826420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.826888 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:25.828367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:25.828840 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:26.064428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:26.072321 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5f0c0afb-5e87-424a-9a6c-ccd1eea0c8d7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1681 microversion: 2.1 time: 0.258425 Jul 25 21:23:26.072910 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3567/7080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:25 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:27.097483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:27.098783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:27.107130 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:27.107594 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:27.108442 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:27.108889 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:27.275208 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:27.284379 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8a1b161a-c53b-43de-9609-949cbe571ca7 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1681 microversion: 2.1 time: 0.193509 Jul 25 21:23:27.284986 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3514/7081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:27 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:23:28.306737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:28.307289 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:28.315369 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:28.315837 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:28.316672 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:28.317131 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:28.461068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:28.469224 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5dad6b0f-a45b-49f1-8383-63396ba0c405 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1684 microversion: 2.1 time: 0.165952 Jul 25 21:23:28.469798 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3568/7082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:28 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:28.566814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:28.568984 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:28.575996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:28.576489 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:28.577272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:28.577758 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:28.621378 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4dadf515-3066-4f98-9b3f-cb04f014ced9 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action" status: 200 len: 38393 microversion: 2.1 time: 0.058343 Jul 25 21:23:28.622045 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3515/7083] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:23:28 2022] POST /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83/action => generated 38393 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 21:23:29.903773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:29.904869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:29.912987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:29.913688 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:29.915382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:29.916004 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:29.945921 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:23:29.971200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-976bafd5-6b0b-4243-9be6-8cc089665a0d req-90697ff2-dfe1-430e-a079-81fdcbac9214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2356cc1d-fec8-41b0-9dae-6ab86772da83", "tag": "87b3d4c8-f922-4309-8f05-905cf623ecf5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:29.983462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-976bafd5-6b0b-4243-9be6-8cc089665a0d req-90697ff2-dfe1-430e-a079-81fdcbac9214 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:29.984473 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-976bafd5-6b0b-4243-9be6-8cc089665a0d req-90697ff2-dfe1-430e-a079-81fdcbac9214 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:29.999153 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-976bafd5-6b0b-4243-9be6-8cc089665a0d req-90697ff2-dfe1-430e-a079-81fdcbac9214 service nova] Creating event network-changed:87b3d4c8-f922-4309-8f05-905cf623ecf5 for instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 on n-h2-845775-3 Jul 25 21:23:30.006508 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-976bafd5-6b0b-4243-9be6-8cc089665a0d req-90697ff2-dfe1-430e-a079-81fdcbac9214 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104388 Jul 25 21:23:30.007749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3516/7084] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:23:30.044593 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc828ee6-09f1-400c-adf6-12d44a249d75 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 204 len: 0 microversion: 2.1 time: 0.144815 Jul 25 21:23:30.046748 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3569/7085] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:23:29 2022] DELETE /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:23:30.055132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:30.055846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:30.063826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:30.064329 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:30.065131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:30.065566 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:30.221979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:30.232670 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9eb8c6fb-8515-4b22-80d9-f80a8c4aeb8a tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1690 microversion: 2.1 time: 0.181664 Jul 25 21:23:30.233493 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3517/7086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:30 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1690 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:31.260930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:31.261559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:31.269308 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:31.269773 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:31.270576 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:31.271025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:31.419652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:31.428529 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-55870f2c-75e3-4788-b26c-bc9587c90554 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1690 microversion: 2.1 time: 0.174270 Jul 25 21:23:31.429134 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3570/7087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:31 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:32.233562 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-936da290-02aa-4c5c-aad4-added3d8d8d1 req-c85b48dd-bfac-410c-9ba9-41eb39f32b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2356cc1d-fec8-41b0-9dae-6ab86772da83", "name": "network-vif-deleted", "tag": "87b3d4c8-f922-4309-8f05-905cf623ecf5"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:32.246337 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-936da290-02aa-4c5c-aad4-added3d8d8d1 req-c85b48dd-bfac-410c-9ba9-41eb39f32b57 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:32.246785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-936da290-02aa-4c5c-aad4-added3d8d8d1 req-c85b48dd-bfac-410c-9ba9-41eb39f32b57 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:32.258965 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-936da290-02aa-4c5c-aad4-added3d8d8d1 req-c85b48dd-bfac-410c-9ba9-41eb39f32b57 service nova] Creating event network-vif-deleted:87b3d4c8-f922-4309-8f05-905cf623ecf5 for instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 on n-h2-845775-3 Jul 25 21:23:32.264210 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-936da290-02aa-4c5c-aad4-added3d8d8d1 req-c85b48dd-bfac-410c-9ba9-41eb39f32b57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034527 Jul 25 21:23:32.265723 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3518/7088] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:23:32.451269 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:32.451828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:32.459892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:32.460391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:32.461186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:32.461633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:32.500316 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:32.500790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:32.501380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lazy-loading 'fault' on Instance uuid 2356cc1d-fec8-41b0-9dae-6ab86772da83 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:23:32.552739 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19a498d1597840498123d02b586426c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f3633bad7fb4216b6444817b8c228cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:32.561599 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-792a9d71-fd4a-41be-b7c8-46615bfe95c3 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 200 len: 1357 microversion: 2.1 time: 0.114244 Jul 25 21:23:32.562531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3571/7089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:32 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 1357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:33.587281 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:33.587985 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] [instance: 2356cc1d-fec8-41b0-9dae-6ab86772da83] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:33.594917 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:33.595316 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:33.596113 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:33.596560 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:33.610771 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] HTTP exception thrown: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Request method failure captured: Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 HTTP/1.1 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wgAx5D3VJ6y7cFiKb-ztyAP3PReDzZ7ei1CItbCpQiLW3DvBusNc4WwkdC-W34G94aqGlaH6ia1etBcoAjWOzrSav5ZFCLs-vZWtVFmRCjQP8MDhO1ZVUjQsKU3H42c-oqHGn-xqP4SZf726FPtBqOz5M4ToXUValqiQe4qrzz9omY Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f3633bad7fb4216b6444817b8c228cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f3633bad7fb4216b6444817b8c228cc"}]}] Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 7f3633bad7fb4216b6444817b8c228cc Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-457920881 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 19a498d1597840498123d02b586426c1 Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestNetworkAdvancedServerOps-457920881-project Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '2356cc1d-fec8-41b0-9dae-6ab86772da83'} Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:23:33.612479 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Returning 404 to user: Instance 2356cc1d-fec8-41b0-9dae-6ab86772da83 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a1825e36-5562-4573-97f6-7fd13c28293f tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83" status: 404 len: 111 microversion: 2.1 time: 0.031876 Jul 25 21:23:33.617483 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3519/7090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:33 2022] GET /compute/v2.1/servers/2356cc1d-fec8-41b0-9dae-6ab86772da83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:23:36.690283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-051049eb-e98c-43fd-8fdc-6f95410d4708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] Calling method '.version_select at 0x7f19680a6040>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:36.721304 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-051049eb-e98c-43fd-8fdc-6f95410d4708 tempest-TestNetworkAdvancedServerOps-457920881 tempest-TestNetworkAdvancedServerOps-457920881-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1356903164" status: 202 len: 0 microversion: 2.1 time: 0.035765 Jul 25 21:23:36.722051 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3572/7091] 10.222.0.48 () {58 vars in 1284 bytes} [Mon Jul 25 21:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1356903164 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:23:48.786414 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=18 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:48.788452 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:49.087363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d06feff-7738-436d-b9bd-b91fbf9714cf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'create', calling method: .version_select at 0x7f1968c03ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1600801106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZaQPiEQ6YQauEW2NCuczg7V2Gibo4Rp6sJ5vTWlmZ4a3Dzgijo4ejQKqxHi4p0o0I0U/1KlP/t47IsoRNrr0Ae82x7zW0VOMb+uzw8AM3r4I40NtiB4uNg13DpyVaTSw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:49.107157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0d06feff-7738-436d-b9bd-b91fbf9714cf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:23:49.118115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-0d06feff-7738-436d-b9bd-b91fbf9714cf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for user 92abfc791ac946799533a29c4e9c43d9 and project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:23:49.149072 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0d06feff-7738-436d-b9bd-b91fbf9714cf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.369040 Jul 25 21:23:49.157036 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3520/7092] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:23:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:23:50.318143 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:50.319025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:23:50.323220 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-152529798", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1600801106", "security_groups": [{"name": "tempest-secgroup-smoke-729912834"}], "networks": [{"uuid": "a773b8f5-07d8-4351-8995-cf6fe2397167"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:50.441009 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] validate_networks() for [('a773b8f5-07d8-4351-8995-cf6fe2397167', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:23:50.835594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:23:50.836120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:23:50.836562 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:23:50.836994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:23:50.837428 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:23:50.846456 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:50.846922 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:50.847737 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:50.848235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:50.865645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:23:50.870919 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for user 92abfc791ac946799533a29c4e9c43d9 and project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:23:50.891281 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:23:50.893088 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:23:50.942358 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-dd2e3ea9-0a01-4396-b247-c9e534c09b2e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.625941 Jul 25 21:23:50.943319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3573/7093] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:23:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:23:50.955595 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-048beb4c-20d6-40c3-b6e3-333cf50b4409 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:50.956362 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-048beb4c-20d6-40c3-b6e3-333cf50b4409 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:51.013279 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-048beb4c-20d6-40c3-b6e3-333cf50b4409 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:51.020823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-048beb4c-20d6-40c3-b6e3-333cf50b4409 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1246 microversion: 2.1 time: 0.070669 Jul 25 21:23:51.021419 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3521/7094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:50 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:23:52.043439 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:52.044296 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:52.051363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:52.051910 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:52.052821 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:52.053490 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:52.146061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:52.161693 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b0272c78-a925-4fba-adf2-89b3f56e1356 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1298 microversion: 2.1 time: 0.122794 Jul 25 21:23:52.162510 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3574/7095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:52 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:53.184474 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:53.185111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:53.194911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:53.195602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:53.196582 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:53.197023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:53.343949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:53.352812 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fa9e23cb-b35b-4dec-8466-97d14c948758 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.173764 Jul 25 21:23:53.353523 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3522/7096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:53 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:53.829197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-085b238a-7907-4037-aeff-98d4946d4bdb req-9f640066-2eeb-4897-bc86-a73dcd3a0206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:53.846750 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-085b238a-7907-4037-aeff-98d4946d4bdb req-9f640066-2eeb-4897-bc86-a73dcd3a0206 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:53.847531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-085b238a-7907-4037-aeff-98d4946d4bdb req-9f640066-2eeb-4897-bc86-a73dcd3a0206 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:53.862410 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-085b238a-7907-4037-aeff-98d4946d4bdb req-9f640066-2eeb-4897-bc86-a73dcd3a0206 service nova] Creating event network-changed:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h2-845775-3 Jul 25 21:23:53.869240 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-085b238a-7907-4037-aeff-98d4946d4bdb req-9f640066-2eeb-4897-bc86-a73dcd3a0206 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045464 Jul 25 21:23:53.871569 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3575/7097] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:23:54.375700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:54.376255 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:54.384182 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:54.384634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:54.385401 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:54.385839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:54.536144 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:54.546097 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-35da3b05-2589-42bc-b384-d5bbcb25c0c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.175057 Jul 25 21:23:54.546749 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3523/7098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:54 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:23:55.570541 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:55.571380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:55.579820 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:55.580322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:55.581228 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:55.581689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:55.720890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:55.728744 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a19ecba8-2ad2-4374-876d-df5934028928 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.162562 Jul 25 21:23:55.729319 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3576/7099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:55 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:56.751212 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:56.751872 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:56.758873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:56.759335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:56.760137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:56.760587 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:56.902055 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:56.910982 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d9898cad-be7e-41b2-b940-8185ac6ec241 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.164402 Jul 25 21:23:56.911591 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3524/7100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:56 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:57.932979 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:57.933861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:57.941799 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:57.942268 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:57.943063 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:57.943520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:58.083241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:58.092323 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cc50ae1a-3b7e-418e-a3a8-d272b4115061 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.163337 Jul 25 21:23:58.093045 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3577/7101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:57 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:23:59.052385 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-4ab03a01-8d48-45e9-ae59-33398c483bfa req-cf0b842f-2f81-4cad-a2fb-679cd7ba97fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:23:59.062849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4ab03a01-8d48-45e9-ae59-33398c483bfa req-cf0b842f-2f81-4cad-a2fb-679cd7ba97fa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:59.063306 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-4ab03a01-8d48-45e9-ae59-33398c483bfa req-cf0b842f-2f81-4cad-a2fb-679cd7ba97fa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:59.074335 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-4ab03a01-8d48-45e9-ae59-33398c483bfa req-cf0b842f-2f81-4cad-a2fb-679cd7ba97fa service nova] Creating event network-vif-plugged:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h2-845775-3 Jul 25 21:23:59.080261 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-4ab03a01-8d48-45e9-ae59-33398c483bfa req-cf0b842f-2f81-4cad-a2fb-679cd7ba97fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093848 Jul 25 21:23:59.080874 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3525/7102] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:23:59.114710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:23:59.115348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:23:59.122655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:59.123132 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:59.124692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:23:59.125072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:23:59.290248 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:23:59.298694 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2dd5b085-0932-43e9-bcc9-a05f9a2de166 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1371 microversion: 2.1 time: 0.188754 Jul 25 21:23:59.299296 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3578/7103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:23:59 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:24:00.322602 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:24:00.323740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:24:00.332949 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:24:00.333411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:24:00.334195 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:24:00.334922 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:24:00.474396 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:24:00.482132 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-99ce786e-1a0f-4a59-bd29-ace38649e697 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1556 microversion: 2.1 time: 0.165352 Jul 25 21:24:00.482712 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3526/7104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:24:00 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:00.503873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:24:00.504529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:24:00.511394 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:24:00.512071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:24:00.512862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:24:00.513312 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:24:00.646932 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:24:00.654671 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bbdf916f-5a2f-4291-af99-ec388a1fe78f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1556 microversion: 2.1 time: 0.154688 Jul 25 21:24:00.655254 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3579/7105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:24:00 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:02.421711 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:02.482154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-b8a23057-08ed-42e5-83d2-582db614cde1 req-0919e126-7997-4716-b402-17b37afd848b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:24:02.494632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b8a23057-08ed-42e5-83d2-582db614cde1 req-0919e126-7997-4716-b402-17b37afd848b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:24:02.495094 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-b8a23057-08ed-42e5-83d2-582db614cde1 req-0919e126-7997-4716-b402-17b37afd848b service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:24:02.507817 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-b8a23057-08ed-42e5-83d2-582db614cde1 req-0919e126-7997-4716-b402-17b37afd848b service nova] Creating event network-changed:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h2-845775-3 Jul 25 21:24:02.516364 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-b8a23057-08ed-42e5-83d2-582db614cde1 req-0919e126-7997-4716-b402-17b37afd848b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096485 Jul 25 21:24:02.516364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3527/7106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:25:02.013859 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:25:02.014545 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:25:58.753430 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2f568e-cfba-43e7-a4b1-60fbb34dadd8] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:25:58.754045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.754577 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.755563 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.756203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=34 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.761329 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:25:58.761912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:25:58.770416 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:25:58.770923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:25:58.771724 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:25:58.772240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:25:58.796619 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lazy-loading 'flavor' on Instance uuid 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:25:58.989164 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f5e9fff-f034-419e-9ec3-925c4f04bc38 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.238016 Jul 25 21:25:58.989786 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3580/7107] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:25:58 2022] POST /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:25:58.999305 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 21:25:59.000229 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:25:59.001155 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.002256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=28 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.008111 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:25:59.009228 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:25:59.018147 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:25:59.018612 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:25:59.019520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:25:59.020189 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:25:59.177320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:25:59.186743 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-2cf189ef-c54e-4502-afaa-3cea8a4c065a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.191760 Jul 25 21:25:59.187347 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3528/7108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:25:58 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:00.214401 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:00.215172 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:00.223782 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:00.224491 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:00.225209 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:00.225675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:00.231715 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2f568e-cfba-43e7-a4b1-60fbb34dadd8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33590. Jul 25 21:26:00.374925 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:00.383242 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1a29e796-d8ab-4e59-abc2-abc637a66efd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.174603 Jul 25 21:26:00.383837 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3581/7109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:00 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:01.405015 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:01.405768 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:01.418891 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:01.419345 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:01.420357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:01.420795 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:01.424911 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33594. Jul 25 21:26:01.425580 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33596. Jul 25 21:26:01.578554 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:01.586814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d493c5ad-c152-4047-955e-072ba550fac8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.186026 Jul 25 21:26:01.587941 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3529/7110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:01 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:02.610050 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:02.610631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:02.617597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:02.618074 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:02.618876 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:02.619337 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:02.760061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:02.768389 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b023dd25-67b2-4332-aee4-e987de6f07ab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.162332 Jul 25 21:26:02.768980 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3582/7111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:02 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:03.790226 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:03.790823 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:03.798528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:03.798975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:03.799740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:03.800218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:03.938142 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:03.946150 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-161b609e-b7db-47de-a4f5-1a1cfcef64fc tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.159812 Jul 25 21:26:03.946728 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3530/7112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:03 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:04.968423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:04.969034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:04.975956 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:04.976459 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:04.977241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:04.977690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:05.115862 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:05.123576 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fc27d2d4-b95d-4bc0-a357-b148b5261744 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.159081 Jul 25 21:26:05.124178 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3583/7113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:04 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:06.144975 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:06.145601 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:06.152507 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:06.152964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:06.153736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:06.154176 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:06.290178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:06.298388 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-d03c364f-e0aa-425a-9130-506be0695483 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.157287 Jul 25 21:26:06.298972 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3531/7114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:06 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:07.321303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:07.321949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:07.329931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:07.330923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:07.332266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:07.332999 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:07.485867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:07.494074 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-415853df-d200-4f53-91a1-83184241ec61 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.177165 Jul 25 21:26:07.494673 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3584/7115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:07 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:08.520856 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:08.521480 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:08.528598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:08.529060 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:08.529837 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:08.530284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:08.664447 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:08.672224 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9ac24f60-6ca2-4ae6-b710-a1b2602d046c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.155258 Jul 25 21:26:08.672801 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3532/7116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:08 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:09.694802 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:09.695449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:09.702930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:09.703397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:09.704230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:09.704683 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:09.852941 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:09.862571 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3f63947f-4a6c-4952-987d-5b0ae5bfb9bf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1701 microversion: 2.1 time: 0.171986 Jul 25 21:26:09.863196 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3585/7117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:09 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1701 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:10.885780 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:10.886415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:10.895042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:10.895504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:10.896325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:10.896773 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:11.066591 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:11.075809 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a2065796-7f15-4f8e-ad3e-4394d7f1239b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1701 microversion: 2.1 time: 0.193902 Jul 25 21:26:11.076541 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3533/7118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:10 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1701 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:12.098612 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:12.099302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:12.113794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:12.114265 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:12.119307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:12.120267 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:12.298983 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:12.308278 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ef185c94-b83c-4421-828f-d4de464a24a6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.213759 Jul 25 21:26:12.309550 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3586/7119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:12 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:13.336578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:13.338486 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:13.347471 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:13.348020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:13.349003 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:13.349465 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:13.517911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:13.526746 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dcc285ee-92e3-4fb0-8e95-b09e4ef429a4 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.196545 Jul 25 21:26:13.528364 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3534/7120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:13 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:13.831559 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b9148e9a-c4cd-42e2-a2ba-f71e3554d783 req-7f49b540-ba44-48b9-a4d1-9f26c97d5515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:26:13.843278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b9148e9a-c4cd-42e2-a2ba-f71e3554d783 req-7f49b540-ba44-48b9-a4d1-9f26c97d5515 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:13.844199 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b9148e9a-c4cd-42e2-a2ba-f71e3554d783 req-7f49b540-ba44-48b9-a4d1-9f26c97d5515 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:13.861709 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b9148e9a-c4cd-42e2-a2ba-f71e3554d783 req-7f49b540-ba44-48b9-a4d1-9f26c97d5515 service nova] Creating event network-vif-plugged:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h2-845775-3 Jul 25 21:26:13.867662 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b9148e9a-c4cd-42e2-a2ba-f71e3554d783 req-7f49b540-ba44-48b9-a4d1-9f26c97d5515 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039721 Jul 25 21:26:13.869138 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3587/7121] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:26:14.550429 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:14.551070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:14.562882 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:14.563557 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:14.566131 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:14.566598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:14.741727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:14.751960 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-69c4e1a6-1c0b-4924-908f-dc4a38ef1adb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.205455 Jul 25 21:26:14.752716 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3535/7122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:14 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:15.775350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:15.777238 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:15.785647 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:15.787127 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:15.787715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:15.788215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:15.968492 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:15.977690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1b11e0ab-8bcf-4e30-8266-1133e8548f90 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.206687 Jul 25 21:26:15.978466 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3588/7123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:15 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:17.001646 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:17.002666 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:17.011344 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:17.011879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:17.012769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:17.013216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:17.166221 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:17.175143 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a11b52d9-a8fc-4117-a7c7-7827d9afbbff tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.177441 Jul 25 21:26:17.178122 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3536/7124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:16 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:18.201309 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:18.201923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:18.212402 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:18.212748 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:18.213733 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:18.214614 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:18.388258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:18.398481 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df0a99a1-1a00-4d81-a286-b7956ffe6b3b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.201401 Jul 25 21:26:18.399121 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3589/7125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:18 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:19.425901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:19.425901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:19.434154 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:19.435019 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:19.436821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:19.436821 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:19.916894 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:19.925476 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8c6f7255-a4aa-4bfb-bdb8-bd080b18bc94 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.504900 Jul 25 21:26:19.926102 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3537/7126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:19 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:26:20.952440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:20.953197 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:20.960880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:20.961280 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:20.962083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:20.962539 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:21.106017 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:21.116607 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d1eacae2-8a70-4c4a-a996-2a4f4774c7e5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1696 microversion: 2.1 time: 0.169077 Jul 25 21:26:21.117549 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3590/7127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:20 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:22.141462 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:22.142115 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:22.149555 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:22.150013 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:22.150864 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:22.151314 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:22.292266 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:22.300121 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-fd3685ea-d217-45d7-8759-896eb9c5fce3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1678 microversion: 2.1 time: 0.162518 Jul 25 21:26:22.300747 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3538/7128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:22 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:23.322974 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:23.323592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:23.331816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:23.332302 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:23.333102 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:23.333554 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:23.474655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:23.482427 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0133be5d-7e5b-4ad6-bb72-b77bda72a74f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1678 microversion: 2.1 time: 0.163656 Jul 25 21:26:23.483018 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3591/7129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:23 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:23.785317 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-369f12f6-042d-4850-b8b3-450423f7d9a6 req-6372fb25-57a3-4921-829e-79714e6b77f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "name": "network-vif-unplugged", "status": "completed", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:26:23.796637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-369f12f6-042d-4850-b8b3-450423f7d9a6 req-6372fb25-57a3-4921-829e-79714e6b77f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:23.797303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-369f12f6-042d-4850-b8b3-450423f7d9a6 req-6372fb25-57a3-4921-829e-79714e6b77f5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:23.812648 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-369f12f6-042d-4850-b8b3-450423f7d9a6 req-6372fb25-57a3-4921-829e-79714e6b77f5 service nova] Creating event network-vif-unplugged:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h2-845775-3 Jul 25 21:26:23.818813 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-369f12f6-042d-4850-b8b3-450423f7d9a6 req-6372fb25-57a3-4921-829e-79714e6b77f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037845 Jul 25 21:26:23.820181 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3539/7130] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:26:24.504144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:24.504790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:24.512725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.513234 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:24.514065 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.514695 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:24.651713 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:24.659405 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb21d400-bb20-48df-bed9-6690c5783a07 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1621 microversion: 2.1 time: 0.159279 Jul 25 21:26:24.659987 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3592/7131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:24 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1621 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:24.690380 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:26:24.691083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:24.697520 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.697993 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:24.699774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.700259 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:24.845456 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-205e766d-4f17-4296-bd5e-6c85dc59d002 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9/action" status: 202 len: 0 microversion: 2.1 time: 0.159317 Jul 25 21:26:24.846405 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3540/7132] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:26:24 2022] POST /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 21:26:24.854528 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:24.855223 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:24.861468 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.861938 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:24.862732 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:24.863186 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:25.003235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:25.011767 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-df4baf07-4c80-42e7-bb67-2087fc1e8caf tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1629 microversion: 2.1 time: 0.161053 Jul 25 21:26:25.012412 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3593/7133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:24 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:26.033081 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:26.033731 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:26.040643 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:26.041098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:26.041931 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:26.042365 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:26.176849 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:26.185750 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-74254433-ff1e-486e-96e8-b591cfed6372 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.156578 Jul 25 21:26:26.186341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3541/7134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:26 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:27.207878 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:27.208545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:27.215531 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:27.216000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:27.216928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:27.217304 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:27.368903 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-9af55918-67e0-4ad6-9939-3157151fa1f6 req-3838ce19-25b2-4768-8915-77c3b06b9799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:26:27.376603 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:27.388430 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9af55918-67e0-4ad6-9939-3157151fa1f6 req-3838ce19-25b2-4768-8915-77c3b06b9799 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:27.389157 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-9af55918-67e0-4ad6-9939-3157151fa1f6 req-3838ce19-25b2-4768-8915-77c3b06b9799 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:27.391458 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b4532c52-bd68-4a75-89c9-d70af063cf37 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.187510 Jul 25 21:26:27.392794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3594/7135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:27 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:27.413376 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-9af55918-67e0-4ad6-9939-3157151fa1f6 req-3838ce19-25b2-4768-8915-77c3b06b9799 service nova] Creating event network-changed:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h1-845775-3 Jul 25 21:26:27.420215 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-9af55918-67e0-4ad6-9939-3157151fa1f6 req-3838ce19-25b2-4768-8915-77c3b06b9799 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056376 Jul 25 21:26:27.421336 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3542/7136] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:26:28.413955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:28.414594 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:28.425382 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:28.425995 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:28.426892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:28.427546 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:28.433575 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:28.601503 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:28.610014 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d229231d-d5df-4f58-ab68-e9cacc326921 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.199920 Jul 25 21:26:28.610727 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3595/7137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:28 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:29.637831 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:29.638634 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:29.641815 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=33 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:29.645524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:29.646694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:29.647741 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:29.648458 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:29.655030 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:29.815042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:29.823025 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a4935a6a-a6e2-47fa-bf0b-3b2a668be862 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.191826 Jul 25 21:26:29.823985 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3543/7138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:29 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:30.845262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:30.845912 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:30.847986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=33 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:30.853697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:30.854170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:30.854990 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:30.855457 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:31.033211 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:31.041126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-7d9428db-4a88-4878-9285-fb96f5e6dab1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.200277 Jul 25 21:26:31.041626 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3596/7139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:30 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:32.063826 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:32.064578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:32.070977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:32.071440 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:32.072250 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:32.072699 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:32.226798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:32.235108 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-224123dd-6cda-4614-999e-36e7435b7975 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.175456 Jul 25 21:26:32.236007 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3544/7140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:32 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:33.258419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:33.259122 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:33.267120 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:33.267535 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:33.268362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:33.268897 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:33.417252 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:33.425548 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-90424238-f4c9-4357-981c-1d3d8b533e4d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.170985 Jul 25 21:26:33.426233 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3597/7141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:33 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:34.446747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:34.447371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:34.454247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:34.454698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:34.455453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:34.455895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:34.615288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:34.623592 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b3ab1a3d-9a7c-4224-b9c2-456b8fdfbe6a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.180640 Jul 25 21:26:34.624215 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3545/7142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:34 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:35.647339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:35.648085 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:35.654986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:35.655514 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:35.665488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:35.666015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:35.826377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:35.835266 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-43e5b4c7-3a54-4435-ad22-e42e1b0856c8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.193523 Jul 25 21:26:35.836082 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3598/7143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:35 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:36.857503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:36.858227 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:36.865407 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:36.865937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:36.867020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:36.867470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:37.003966 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:37.015589 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1b7743d3-a184-49bd-96c6-f2edf6d7f040 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.161875 Jul 25 21:26:37.016238 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3546/7144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:36 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:38.039664 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:38.040334 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:38.047532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:38.048000 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:38.049424 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:38.049962 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:38.195623 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:38.204299 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-22ef034c-1863-4584-9a03-cb94bb20108d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.168641 Jul 25 21:26:38.205095 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3599/7145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:38 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:39.225478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:39.226110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:39.234006 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:39.234470 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:39.235256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:39.235707 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:39.370148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:39.377856 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3b697d02-0112-4d59-904e-aa2bbaead74c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.156283 Jul 25 21:26:39.378434 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3547/7146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:39 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:40.400675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:40.401305 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:40.408889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:40.409357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:40.410142 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:40.410597 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:40.542031 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:40.550749 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4210cbca-ee2e-4715-a363-d2a22b1d8d00 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.154074 Jul 25 21:26:40.552820 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3600/7147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:40 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:41.572363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:41.572948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:41.580472 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:41.580967 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:41.581803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:41.582251 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:41.722479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:41.730262 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-8ccbe4cb-67de-4b7e-bcc1-b8f62c5f0c8c tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.161869 Jul 25 21:26:41.730837 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3548/7148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:41 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:42.003078 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:26:42.003430 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:26:42.378279 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:26:42.378810 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:26:42.535502 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:26:42.535719 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:26:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:26:42.751357 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:42.752023 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:42.758947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:42.759417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:42.760256 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:42.760719 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:42.904072 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:42.911750 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-542dab82-55a0-4642-bdc2-51ee58367825 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.164303 Jul 25 21:26:42.912356 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3601/7149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:42 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:42.939971 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-99a2c0ce-4f59-4ff5-aef4-68cc8ecb256f req-07c83941-1c9e-4e39-b577-5f0c518d52f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "name": "network-vif-plugged", "status": "completed", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:26:42.952328 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99a2c0ce-4f59-4ff5-aef4-68cc8ecb256f req-07c83941-1c9e-4e39-b577-5f0c518d52f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:42.952792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-99a2c0ce-4f59-4ff5-aef4-68cc8ecb256f req-07c83941-1c9e-4e39-b577-5f0c518d52f9 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:42.963559 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-99a2c0ce-4f59-4ff5-aef4-68cc8ecb256f req-07c83941-1c9e-4e39-b577-5f0c518d52f9 service nova] Creating event network-vif-plugged:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h1-845775-3 Jul 25 21:26:42.969574 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-99a2c0ce-4f59-4ff5-aef4-68cc8ecb256f req-07c83941-1c9e-4e39-b577-5f0c518d52f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Jul 25 21:26:42.970183 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3549/7150] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:26:43.932961 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:43.933536 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:43.941613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:43.942079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:43.942875 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:43.943330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:44.089529 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:44.097218 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-89aa2582-b244-4318-a9f7-024f8bc04f55 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1687 microversion: 2.1 time: 0.168292 Jul 25 21:26:44.097804 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3602/7151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:43 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:26:45.122885 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:26:45.123547 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:26:45.129900 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:45.130359 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:45.131122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:26:45.131565 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:26:45.267887 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:26:45.275741 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a25c28f-061c-46ca-92a7-12f620c294a8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1674 microversion: 2.1 time: 0.158752 Jul 25 21:26:45.276349 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3550/7152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:26:45 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:04.626894 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=13 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:04.627693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=46 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:04.634163 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=15 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:04.634947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=43 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:04.638862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-190f290b-3434-4e7e-85aa-9dbbee340dd8 req-74d5c5b9-d46f-4afc-8c45-0a87a68b0a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:04.644346 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:04.644869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:04.653034 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:04.653509 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:04.654311 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:04.654768 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:04.662288 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-190f290b-3434-4e7e-85aa-9dbbee340dd8 req-74d5c5b9-d46f-4afc-8c45-0a87a68b0a5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:04.662844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-190f290b-3434-4e7e-85aa-9dbbee340dd8 req-74d5c5b9-d46f-4afc-8c45-0a87a68b0a5d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:04.679306 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-190f290b-3434-4e7e-85aa-9dbbee340dd8 req-74d5c5b9-d46f-4afc-8c45-0a87a68b0a5d service nova] Creating event network-changed:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h1-845775-3 Jul 25 21:28:04.681068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:28:04.684979 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-190f290b-3434-4e7e-85aa-9dbbee340dd8 req-74d5c5b9-d46f-4afc-8c45-0a87a68b0a5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052967 Jul 25 21:28:04.686004 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3551/7153] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:28:04.771070 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ad1c4540-e1e2-47b0-afb5-4c82924fc2d6 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 204 len: 0 microversion: 2.1 time: 0.145671 Jul 25 21:28:04.775409 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3603/7154] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:28:04 2022] DELETE /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:28:04.782049 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:04.782781 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:04.789238 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:04.789712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:04.790503 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:04.790953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:04.991354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:04.999517 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-23e3eea5-3ba3-438b-a404-ab863a006013 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.222594 Jul 25 21:28:05.007281 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3552/7155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:04 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:28:06.022522 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:06.023249 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:06.031828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:06.032336 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:06.033169 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:06.033666 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:06.226654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:06.234600 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9e5398d0-2105-4e8f-95db-21caa3a6009b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 200 len: 1680 microversion: 2.1 time: 0.216406 Jul 25 21:28:06.235183 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3604/7156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:06 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:06.756058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-bd75aaa9-6c9e-471a-87c4-75f85bc3906b req-0c5c1e7d-8151-4c73-9897-f517d197a425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea66e31-9719-4ea6-a01d-23b741cf0eb9", "name": "network-vif-deleted", "tag": "eae10166-c29c-4530-99a8-6e747dcc2ac3"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:06.772661 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bd75aaa9-6c9e-471a-87c4-75f85bc3906b req-0c5c1e7d-8151-4c73-9897-f517d197a425 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:06.772940 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-bd75aaa9-6c9e-471a-87c4-75f85bc3906b req-0c5c1e7d-8151-4c73-9897-f517d197a425 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:06.787610 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-bd75aaa9-6c9e-471a-87c4-75f85bc3906b req-0c5c1e7d-8151-4c73-9897-f517d197a425 service nova] Creating event network-vif-deleted:eae10166-c29c-4530-99a8-6e747dcc2ac3 for instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 on n-h1-845775-3 Jul 25 21:28:06.793791 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-bd75aaa9-6c9e-471a-87c4-75f85bc3906b req-0c5c1e7d-8151-4c73-9897-f517d197a425 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041423 Jul 25 21:28:06.794377 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3553/7157] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:28:07.256845 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:07.257595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: 1ea66e31-9719-4ea6-a01d-23b741cf0eb9] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:07.265877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:07.266388 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:07.267176 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:07.267625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:07.282085 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.wsgi [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] HTTP exception thrown: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Request method failure captured: Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: request: GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 HTTP/1.1 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Accept: application/json Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Accept-Encoding: identity Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Connection: close Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Content-Length: 0 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Content-Type: application/json Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Host: 10.222.0.48 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: Openstack-System-Scope: None Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: User-Agent: python-urllib3/1.26.10 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Auth-Token: gAAAAABi3wnfvHfGYGsi4JL_6h35HK_JvFEX6FQ6Xq7Up-tWXqEdwClTIw-vqcvaedWmxLvfUyYZnsirnlx9O1PpPnVUjdE9Dq0u1iAWWXSAa26ItKIBecKd0AVnwz5nT0lVFha8cJi9KsX7S2qRSOOHYYHGYvXFF3A5U77kGsWVLDcWub0KB3k Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Id: None Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Domain-Name: None Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Identity-Status: Confirmed Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Is-Admin-Project: True Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Id: default Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Domain-Name: Default Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Id: 209ca858efad4345a8c151eb3a8b5f21 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Project-Name: tempest-TestShelveInstance-1522692188 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Role: reader,member Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Roles: reader,member Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/209ca858efad4345a8c151eb3a8b5f21"}]}] Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant: tempest-TestShelveInstance-1522692188 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Id: 209ca858efad4345a8c151eb3a8b5f21 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-Tenant-Name: tempest-TestShelveInstance-1522692188 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-User: tempest-TestShelveInstance-1522692188-project Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Id: default Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Domain-Name: Default Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Id: 92abfc791ac946799533a29c4e9c43d9 Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: X-User-Name: tempest-TestShelveInstance-1522692188-project Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: method: > Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: exception: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: action_args: {'id': '1ea66e31-9719-4ea6-a01d-23b741cf0eb9'} Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:28:07.283715 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: ERROR nova.api.openstack.wsgi Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Returning 404 to user: Instance 1ea66e31-9719-4ea6-a01d-23b741cf0eb9 could not be found. {{(pid=119724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c03e833b-7432-4392-ba29-62deb0668f01 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9" status: 404 len: 111 microversion: 2.1 time: 0.032511 Jul 25 21:28:07.289259 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3605/7158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:07 2022] GET /compute/v2.1/servers/1ea66e31-9719-4ea6-a01d-23b741cf0eb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:28:07.456535 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b336e6ee-283b-47b3-b8d7-e492077449ef tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '.version_select at 0x7f19685bdca0>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:07.481289 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b336e6ee-283b-47b3-b8d7-e492077449ef tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600801106" status: 202 len: 0 microversion: 2.1 time: 0.029017 Jul 25 21:28:07.481900 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3554/7159] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Jul 25 21:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600801106 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:28:07.504893 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-14a63b39-5117-4b1f-b029-41ffff92d657 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'create', calling method: .version_select at 0x7f19681ae5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-646903194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGzoLa4YsxAGnwhxL5hVG4n65ya7Wj/dZRBG57CNg/xybSHIfI0qXUnUIiwvMu0mKs0pBB/DpHrA92nFdFcKqtlr6EShxxf7kbMVdrYpwpvr1nIrm412g2ZrrIAMESUGQ=="}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:07.520827 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-14a63b39-5117-4b1f-b029-41ffff92d657 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:28:07.526303 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-14a63b39-5117-4b1f-b029-41ffff92d657 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for user 92abfc791ac946799533a29c4e9c43d9 and project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'key_pairs'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:28:07.553948 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-14a63b39-5117-4b1f-b029-41ffff92d657 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053115 Jul 25 21:28:07.554590 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3606/7160] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:28:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:28:23.794310 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=10 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:23.795048 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:23.799415 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1853183686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-646903194", "security_groups": [{"name": "tempest-secgroup-smoke-592532197"}], "networks": [{"uuid": "a773b8f5-07d8-4351-8995-cf6fe2397167"}], "block_device_mapping_v2": [{"uuid": "2ad53f3a-0ba4-46e6-89da-019d2c1468fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:23.918383 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.network.neutron [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] validate_networks() for [('a773b8f5-07d8-4351-8995-cf6fe2397167', None, None, None, None, None)] {{(pid=119723) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:28:24.309669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Flavor limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:28:24.310098 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Image limits 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:28:24.310844 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Flavor pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:28:24.311253 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Image pref 0:0:0 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:28:24.311669 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.virt.hardware [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:28:24.320911 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:24.321357 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:24.322162 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:24.322583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:24.342082 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:28:24.347534 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Getting quotas for user 92abfc791ac946799533a29c4e9c43d9 and project 209ca858efad4345a8c151eb3a8b5f21. Resources: {'cores', 'instances', 'ram'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:28:24.407792 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Going to run 1 instances... {{(pid=119723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:28:24.410070 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ad53f3a-0ba4-46e6-89da-019d2c1468fd',volume_size=None,volume_type=None)] {{(pid=119723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:28:24.538617 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a0a930e3-aeae-4184-92fa-24a1f5132fd5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746110 Jul 25 21:28:24.540089 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3555/7161] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:28:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:28:24.550727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d77316ac-6ab9-4b01-b694-28a0a928371d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:24.551335 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d77316ac-6ab9-4b01-b694-28a0a928371d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:24.555951 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.556684 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=4 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.557578 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.620431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d77316ac-6ab9-4b01-b694-28a0a928371d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:24.631331 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d77316ac-6ab9-4b01-b694-28a0a928371d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1088 microversion: 2.1 time: 0.084697 Jul 25 21:28:24.631851 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3607/7162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:24 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:25.652702 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:25.653926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:25.663528 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:25.664213 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:25.665034 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:25.665588 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:25.736977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:25.745747 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79ae6163-a616-40e1-918c-8bc7a975dccd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1204 microversion: 2.1 time: 0.096760 Jul 25 21:28:25.746545 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3556/7163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:25 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:26.767699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:26.768667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:26.784323 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:26.785058 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:26.786066 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:26.786689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:26.957867 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:26.969241 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a6b5bdaf-1832-4dc8-94a6-c54030d84839 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1271 microversion: 2.1 time: 0.205832 Jul 25 21:28:26.970519 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3608/7164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:26 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:27.018235 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f23506af-b8b5-457a-b3d0-ed0f7b10c436 req-eb54ee4a-2854-441b-883f-c173e6126743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab73774-0243-459a-9913-35790567830d", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:27.049948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f23506af-b8b5-457a-b3d0-ed0f7b10c436 req-eb54ee4a-2854-441b-883f-c173e6126743 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:27.051067 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f23506af-b8b5-457a-b3d0-ed0f7b10c436 req-eb54ee4a-2854-441b-883f-c173e6126743 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:27.085189 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f23506af-b8b5-457a-b3d0-ed0f7b10c436 req-eb54ee4a-2854-441b-883f-c173e6126743 service nova] Creating event network-changed:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:28:27.095453 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f23506af-b8b5-457a-b3d0-ed0f7b10c436 req-eb54ee4a-2854-441b-883f-c173e6126743 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080290 Jul 25 21:28:27.098171 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3557/7165] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:28:27.991111 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:27.991747 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:27.999928 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:28.000447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:28.001242 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:28.001693 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:28.154635 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:28.167099 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-27115bd6-d353-4478-ad77-60a08d8f40d2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1271 microversion: 2.1 time: 0.179858 Jul 25 21:28:28.167705 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3609/7166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:27 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:29.188696 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:29.189543 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:29.197604 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:29.198356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:29.199355 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:29.199851 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:29.348651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:29.357714 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-79268b54-ca94-4b69-b5b2-e344b3488b76 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1271 microversion: 2.1 time: 0.173671 Jul 25 21:28:29.358495 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3558/7167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:29 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:30.379229 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:30.379952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:30.387639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:30.388208 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:30.389025 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:30.389482 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:30.539307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:30.547964 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d205cba9-a665-4be7-94e7-0b39d5de4ec8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1271 microversion: 2.1 time: 0.172565 Jul 25 21:28:30.548794 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3610/7168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:30 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:31.570613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:31.571269 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:31.577627 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:31.578086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:31.578867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:31.579348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:31.714229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:31.722091 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6868a4cf-f4cb-4364-8349-d5da6a27185b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.155588 Jul 25 21:28:31.722683 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3559/7169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:31 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:32.744358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:32.744972 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:32.751801 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:32.752307 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:32.753089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:32.753537 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:32.894520 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:32.904162 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a61c6b27-c3be-4015-9635-65d2f65d81ac tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.163601 Jul 25 21:28:32.904764 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3611/7170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:32 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:28:33.925706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:33.926376 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:33.934490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:33.934948 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:33.935996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:33.936468 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:34.074020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:34.081704 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dde4ba03-f8b2-4460-9b3a-1a0c7775e70d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.160046 Jul 25 21:28:34.082328 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3560/7171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:33 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:35.102818 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:35.103449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:35.106419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:35.111872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:35.112378 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:35.113182 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:35.113641 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:35.255259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:35.263557 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-383f64fb-76ec-41ea-94a2-302ce4b8b139 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.164674 Jul 25 21:28:35.264161 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3612/7172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:35 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:36.284921 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:36.285637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:36.287656 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.288349 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.296166 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:36.296624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:36.297390 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:36.297830 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:36.446671 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:36.454682 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1f13af9d-931f-4c21-9a36-5eefa49f8663 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.173730 Jul 25 21:28:36.455524 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3561/7173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:36 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:37.476654 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:37.477317 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:37.484890 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:37.485349 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:37.486138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:37.486598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:37.623605 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:37.631227 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-92930be8-c027-4ba0-b2d8-1db770bae16a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.158544 Jul 25 21:28:37.631798 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3613/7174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:37 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:38.652901 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:38.653522 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:38.661051 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:38.661514 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:38.662302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:38.662747 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:38.809099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:38.817227 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7665cca8-24fc-4e6b-85df-d3efe3309374 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.169100 Jul 25 21:28:38.817733 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3562/7175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:38 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:39.838796 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:39.839420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:39.846419 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:39.846887 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:39.847675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:39.848173 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:39.981381 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:39.989032 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1046a23e-e1ec-43d3-a70c-2034137533d1 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.154205 Jul 25 21:28:39.989607 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3614/7176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:39 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:40.490122 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-35a2f5f9-b94d-4a4f-bb6b-b9924fa9f8ca req-cd5eceda-e475-43fc-aeb3-302de0181cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab73774-0243-459a-9913-35790567830d", "name": "network-vif-plugged", "status": "completed", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:40.501953 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-35a2f5f9-b94d-4a4f-bb6b-b9924fa9f8ca req-cd5eceda-e475-43fc-aeb3-302de0181cfa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:40.502512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-35a2f5f9-b94d-4a4f-bb6b-b9924fa9f8ca req-cd5eceda-e475-43fc-aeb3-302de0181cfa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:40.514842 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-35a2f5f9-b94d-4a4f-bb6b-b9924fa9f8ca req-cd5eceda-e475-43fc-aeb3-302de0181cfa service nova] Creating event network-vif-plugged:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:28:40.520072 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-35a2f5f9-b94d-4a4f-bb6b-b9924fa9f8ca req-cd5eceda-e475-43fc-aeb3-302de0181cfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 Jul 25 21:28:40.521108 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3563/7177] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:28:41.011214 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:41.012124 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:41.019314 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:41.019762 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:41.020606 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:41.021061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:41.163714 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:41.174166 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-82b53714-9896-48f6-952b-94069db6ab1a tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1259 microversion: 2.1 time: 0.167561 Jul 25 21:28:41.174766 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3615/7178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:41 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:42.196688 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:42.197945 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:42.204271 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:42.204730 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:42.205496 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:42.205964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:42.344805 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:42.352423 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9d20f2be-4f53-4d60-8c61-e991bc44c4b3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1444 microversion: 2.1 time: 0.160858 Jul 25 21:28:42.353897 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3564/7179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:42 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:42.373278 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:28:42.373900 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:28:42.380595 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:42.381061 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:42.381839 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:42.382292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:42.521048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:28:42.530340 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-ede76736-82ef-4363-b338-3507d56edb7d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1444 microversion: 2.1 time: 0.160886 Jul 25 21:28:42.530932 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3616/7180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:28:42 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:28:44.441217 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-94d2a916-4058-4c3c-a825-e8a1856b17b8 req-1eff69ce-7f2c-4457-a14c-7efd44858b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab73774-0243-459a-9913-35790567830d", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:28:44.452453 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-94d2a916-4058-4c3c-a825-e8a1856b17b8 req-1eff69ce-7f2c-4457-a14c-7efd44858b66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:28:44.452899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-94d2a916-4058-4c3c-a825-e8a1856b17b8 req-1eff69ce-7f2c-4457-a14c-7efd44858b66 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:28:44.464827 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-94d2a916-4058-4c3c-a825-e8a1856b17b8 req-1eff69ce-7f2c-4457-a14c-7efd44858b66 service nova] Creating event network-changed:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:28:44.469897 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-94d2a916-4058-4c3c-a825-e8a1856b17b8 req-1eff69ce-7f2c-4457-a14c-7efd44858b66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032364 Jul 25 21:28:44.470732 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3565/7181] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:30:02.543562 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:30:02.544118 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:30:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:30:37.379475 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:30:37.380599 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=22 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:37.381371 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=54 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:37.438332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:30:37.438911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:37.445206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:37.445667 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:37.446446 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:37.446896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:37.469556 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lazy-loading 'flavor' on Instance uuid aab73774-0243-459a-9913-35790567830d {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:30:37.545173 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [c07a2b26-eadf-4ed2-ac8e-d46e0fa41c4b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:30:38.388308 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34116. Jul 25 21:30:38.552694 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [c07a2b26-eadf-4ed2-ac8e-d46e0fa41c4b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34118. Jul 25 21:30:38.556189 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-392d0224-fdf9-437a-8259-65e84aa4bbe8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d/action" status: 202 len: 0 microversion: 2.1 time: 1.178491 Jul 25 21:30:38.556806 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3617/7182] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:30:37 2022] POST /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d/action => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:30:38.568717 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 21:30:38.570101 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 21:30:38.570736 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:38.571631 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=50 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:30:38.576626 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:38.577353 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:38.586109 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:38.586663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:38.588260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:38.588712 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:38.741577 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:38.748449 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-e74dcb3a-8d80-464f-85f5-f18db5a8b0f7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.184077 Jul 25 21:30:38.749027 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3566/7183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:38 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:39.771954 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:39.772810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:39.781557 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:39.782083 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:39.782978 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:39.783433 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:39.926816 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:39.935383 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-cb0ed0ed-6be5-4269-a290-e229b8c35ed8 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.168564 Jul 25 21:30:39.935956 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3618/7184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:39 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:30:40.958460 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:40.959233 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:40.967879 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:40.968356 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:40.969697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:40.970139 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:40.977153 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34130. Jul 25 21:30:40.990902 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34132. Jul 25 21:30:41.113861 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:41.122037 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-aae1f783-ba5e-490d-98c8-5f31fd7e7ac5 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.168171 Jul 25 21:30:41.122624 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3567/7185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:40 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:42.143383 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:42.144079 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:42.151150 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:42.151620 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:42.152435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:42.152892 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:42.285842 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:42.293643 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-23c369f4-575e-4ef1-afbb-a252bc789012 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.154261 Jul 25 21:30:42.294224 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3619/7186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:42 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:43.316623 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:43.317246 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:43.324637 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:43.325101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:43.325888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:43.326334 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:43.461126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:43.468999 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-64d98106-7665-47b8-990a-890b6acb097e tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.156289 Jul 25 21:30:43.469590 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3568/7187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:43 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:44.491207 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:44.491896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:44.499232 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:44.500259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:44.501075 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:44.501517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:44.636071 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:44.643756 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-708476ed-1359-4bb0-8f55-90eba3e23713 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.156524 Jul 25 21:30:44.644348 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3620/7188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:44 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:45.667220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:45.667785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:45.674481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:45.674942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:45.675706 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:45.676187 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:45.813219 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:45.821190 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-72d2ea5d-9696-4df0-a7a3-485ac0696e7b tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.159120 Jul 25 21:30:45.821774 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3569/7189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:45 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:46.842310 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:46.842969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:46.850145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:46.850610 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:46.851393 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:46.851843 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:46.987226 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:46.995053 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2ee00350-7092-48e3-b65b-41ceae5ca9d3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.156651 Jul 25 21:30:46.995640 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3621/7190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:46 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:48.018315 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:48.018873 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:48.026220 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:48.026676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:48.027481 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:48.027924 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:48.165512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:48.173348 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1d4306e4-aaaf-4961-b7f9-35c25874e889 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.159765 Jul 25 21:30:48.173937 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3570/7191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:48 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:30:49.196699 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:49.197339 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:49.204976 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:49.205452 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:49.206250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:49.206736 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:49.353696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:49.361618 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-339e84b3-483e-4f32-b333-b3770435054f tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.169106 Jul 25 21:30:49.362215 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3622/7192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:49 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:50.382944 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:50.383618 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:50.390920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:50.391370 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:50.392171 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:50.392614 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:50.529822 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:50.538107 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a9698748-9a28-4eb4-9064-93ec8cc0c473 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.159091 Jul 25 21:30:50.538697 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3571/7193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:50 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:51.560969 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:51.561643 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:51.581471 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:51.582163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:51.582981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:51.583444 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:51.748153 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:51.757690 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-bedb671e-7dae-4214-99e9-a8beedfcc025 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.200625 Jul 25 21:30:51.758292 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3623/7194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:51 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:52.783377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:52.784183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:52.794043 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:52.794689 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:52.795229 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:52.795676 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:52.942412 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:52.950333 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-039b73db-cfe5-4321-9027-380c038325fb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1570 microversion: 2.1 time: 0.174381 Jul 25 21:30:52.950929 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3572/7195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:52 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:52.972300 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:30:52.972923 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:52.980322 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:52.980779 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:52.981581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:52.982041 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:53.149957 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-25e72bf4-650c-4cf4-adda-0525cb2c58a2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "POST /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d/action" status: 202 len: 0 microversion: 2.1 time: 0.182138 Jul 25 21:30:53.150505 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3624/7196] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:30:52 2022] POST /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:30:53.159392 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:53.160318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:53.166466 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:53.166929 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:53.167700 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:53.168168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:53.308877 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:53.317888 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-388ffba4-d871-4de4-8227-82721489f137 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1518 microversion: 2.1 time: 0.163107 Jul 25 21:30:53.318475 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3573/7197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:53 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:30:54.340817 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:54.341465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:54.348696 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:54.349178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:54.349994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:54.350454 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:54.490386 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:54.498125 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-05b90913-919e-4948-b834-b3f5a0098acd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1520 microversion: 2.1 time: 0.162125 Jul 25 21:30:54.498704 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3625/7198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:54 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:54.978663 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-c1c79d55-9257-46fb-9572-2b941a397c89 req-3023206d-7d8a-4f37-8eef-030b99b119b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab73774-0243-459a-9913-35790567830d", "name": "network-vif-unplugged", "status": "completed", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:30:54.989951 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c1c79d55-9257-46fb-9572-2b941a397c89 req-3023206d-7d8a-4f37-8eef-030b99b119b5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:54.990400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-c1c79d55-9257-46fb-9572-2b941a397c89 req-3023206d-7d8a-4f37-8eef-030b99b119b5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:55.002841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.compute.server_external_events [req-c1c79d55-9257-46fb-9572-2b941a397c89 req-3023206d-7d8a-4f37-8eef-030b99b119b5 service nova] Unable to find a host for instance aab73774-0243-459a-9913-35790567830d. Dropping event network-vif-unplugged {{(pid=119723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 21:30:55.003780 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-c1c79d55-9257-46fb-9572-2b941a397c89 req-3023206d-7d8a-4f37-8eef-030b99b119b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.123333 Jul 25 21:30:55.006226 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3574/7199] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 126 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 21:30:55.520947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:55.521540 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:55.528451 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:55.528911 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:55.529690 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:55.530139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:55.664533 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:55.672280 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-30b47c67-ab81-4aca-ab54-61be403cb629 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1520 microversion: 2.1 time: 0.156074 Jul 25 21:30:55.673055 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3626/7200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:55 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:56.694118 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:56.694841 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:56.703942 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:56.704527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:56.705411 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:56.705920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:56.858584 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:56.866823 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0e915b19-f0d6-4d8c-a290-fb4f1b7cbcab tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1520 microversion: 2.1 time: 0.176794 Jul 25 21:30:56.867426 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3575/7201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:56 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:57.888411 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:57.888992 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:57.896412 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:57.896880 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:57.897675 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:57.898130 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:58.038005 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:58.046149 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c9e78dd9-4fdd-49c7-9daa-3a4a72cfdb22 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1520 microversion: 2.1 time: 0.161813 Jul 25 21:30:58.046826 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3627/7202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:57 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:30:59.067999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:30:59.070033 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:30:59.076241 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:59.076735 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:59.077524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:30:59.077970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:30:59.213399 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:30:59.221943 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-bd338b6e-08c1-4077-98ca-7f1bf0bb9f72 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.157710 Jul 25 21:30:59.222468 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3576/7203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:30:59 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:00.243090 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:00.243725 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:00.251125 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:00.251596 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:00.252427 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:00.252889 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:00.401170 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:00.409743 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-807a99b6-ba81-4d6c-b297-ab157fa99743 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.170842 Jul 25 21:31:00.410333 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3628/7204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:00 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:01.431937 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:01.432977 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:01.442186 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:01.442749 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:01.444243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:01.444243 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:01.600368 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:01.608604 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-292e1bb0-1f31-430d-9287-8f151888a0cb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.181231 Jul 25 21:31:01.609200 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3577/7205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:01 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:02.630045 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:02.630753 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:02.637480 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:02.637955 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:02.638744 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:02.639230 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:02.779015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:02.786727 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4882077f-127f-41e8-93f6-ccabaa2d29eb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.161423 Jul 25 21:31:02.787298 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3629/7206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:02 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:03.808653 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:03.809782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:03.817509 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:03.818320 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:03.819248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:03.819883 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:03.967888 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:03.977681 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-f98bc6ca-b5a1-4376-b058-84f299399882 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.173907 Jul 25 21:31:03.979341 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3578/7207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:03 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:04.999847 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:05.001080 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:05.009164 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:05.009637 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:05.010435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:05.010896 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:05.032945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:31:05.162054 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:05.169950 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-9328e1e5-6cce-4239-bc80-e8de9cc92214 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.173957 Jul 25 21:31:05.170531 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3630/7208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:04 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:06.196072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:06.196694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:06.204455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:06.205065 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:06.205767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:06.206218 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:06.351764 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:06.359966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0d7aab81-7b1c-4195-ac13-df5a6411b694 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.167317 Jul 25 21:31:06.360586 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3579/7209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:06 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:07.381729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:07.382362 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:07.389389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:07.389865 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:07.390646 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:07.391099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:07.524057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:07.532654 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-d62b1c34-f946-4b71-b754-73edda2c32bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.155026 Jul 25 21:31:07.533232 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3631/7210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:07 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:08.554052 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:08.554685 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:08.561708 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:08.562432 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:08.563846 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:08.564324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:08.585170 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=84 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:31:08.705025 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:08.712992 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b075f46e-45d5-4518-97df-25221f5c9411 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.162833 Jul 25 21:31:08.713579 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3580/7211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:08 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:09.735231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:09.735231 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:09.737931 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=33 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:31:09.743674 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:09.744177 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:09.744987 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:09.745447 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:09.884613 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:09.894592 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-b8a3280e-e06f-4cbe-8bdf-b7a889e96cce tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.162635 Jul 25 21:31:09.894592 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3632/7212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:09 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:10.914776 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:10.915400 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:10.918099 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=31 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:31:10.923976 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:10.924455 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:10.925234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:10.925677 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:11.039235 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-4a88bd5b-8bec-44ba-9985-872b5e72fd0d req-2b1cdfa8-c4af-44a2-a5a1-20c0f62d8923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab73774-0243-459a-9913-35790567830d", "name": "network-vif-plugged", "status": "completed", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:31:11.053552 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4a88bd5b-8bec-44ba-9985-872b5e72fd0d req-2b1cdfa8-c4af-44a2-a5a1-20c0f62d8923 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:11.054015 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-4a88bd5b-8bec-44ba-9985-872b5e72fd0d req-2b1cdfa8-c4af-44a2-a5a1-20c0f62d8923 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:11.064394 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:11.072462 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0a586699-25e3-4d29-90c7-4d847b325dd3 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.161490 Jul 25 21:31:11.072745 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-4a88bd5b-8bec-44ba-9985-872b5e72fd0d req-2b1cdfa8-c4af-44a2-a5a1-20c0f62d8923 service nova] Creating event network-vif-plugged:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:31:11.073266 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3581/7213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:10 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:11.078930 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-4a88bd5b-8bec-44ba-9985-872b5e72fd0d req-2b1cdfa8-c4af-44a2-a5a1-20c0f62d8923 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042848 Jul 25 21:31:11.079859 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3633/7214] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:31:12.100467 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:12.101101 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:12.108307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:12.108770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:12.110216 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:12.110679 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:12.266190 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:12.274647 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4db1c7b4-7c51-4689-8a50-6db344ab5fc0 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1576 microversion: 2.1 time: 0.178140 Jul 25 21:31:12.275242 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3582/7215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:12 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:13.298108 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:31:13.298828 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:31:13.306144 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:13.306616 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:13.307397 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:31:13.307859 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:31:13.440262 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:31:13.448052 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-375f67fc-cd4b-4623-a6b9-c608e07e22b2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1563 microversion: 2.1 time: 0.154825 Jul 25 21:31:13.448637 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3634/7216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:31:13 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:31:42.025064 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:31:42.025669 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:32:00.524196 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:32:00.524888 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:32:27.251816 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=3 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:27.252611 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=14 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:27.256659 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=5 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:27.257727 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=22 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:27.258058 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:27.258797 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:27.267120 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:27.267579 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:27.268419 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:27.268867 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:27.298072 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:32:27.315403 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-ce7b0706-113e-4f5d-a04d-3febc14c5f1a req-4bf05b47-adb7-45cb-9a8a-15a5425fce73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab73774-0243-459a-9913-35790567830d", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:32:27.325657 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ce7b0706-113e-4f5d-a04d-3febc14c5f1a req-4bf05b47-adb7-45cb-9a8a-15a5425fce73 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:27.326435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-ce7b0706-113e-4f5d-a04d-3febc14c5f1a req-4bf05b47-adb7-45cb-9a8a-15a5425fce73 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:27.350780 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-ce7b0706-113e-4f5d-a04d-3febc14c5f1a req-4bf05b47-adb7-45cb-9a8a-15a5425fce73 service nova] Creating event network-changed:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:32:27.356063 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-ce7b0706-113e-4f5d-a04d-3febc14c5f1a req-4bf05b47-adb7-45cb-9a8a-15a5425fce73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101359 Jul 25 21:32:27.356814 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3635/7217] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:32:27.398340 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1e40484f-2765-405c-8f42-fb92879a00c9 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 204 len: 0 microversion: 2.1 time: 0.148104 Jul 25 21:32:27.399033 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3583/7218] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:32:27 2022] DELETE /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:32:27.420516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:27.420516 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:27.430644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:27.431266 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:27.432873 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:27.433720 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:27.586465 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:27.594537 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6ed8ab44-0a54-4735-b89e-e09abc2df550 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.188426 Jul 25 21:32:27.595135 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3636/7219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:27 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:28.619389 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:28.620018 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:28.630073 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:28.630524 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:28.631308 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:28.631752 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:28.791897 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:28.800415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-dc9c095f-382b-44ac-a7a6-4a5af8c36dcb tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1569 microversion: 2.1 time: 0.184700 Jul 25 21:32:28.801180 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3584/7220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:28 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:29.542162 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-9c682d8b-245b-445b-bf97-f725d96ea9c9 req-3cec5e6f-0c99-47d0-b37b-75ffcbfbca68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab73774-0243-459a-9913-35790567830d", "name": "network-vif-deleted", "tag": "b08f19e7-ff10-4764-a677-03a66d6994fb"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:32:29.553581 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9c682d8b-245b-445b-bf97-f725d96ea9c9 req-3cec5e6f-0c99-47d0-b37b-75ffcbfbca68 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:29.554138 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-9c682d8b-245b-445b-bf97-f725d96ea9c9 req-3cec5e6f-0c99-47d0-b37b-75ffcbfbca68 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:29.567146 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-9c682d8b-245b-445b-bf97-f725d96ea9c9 req-3cec5e6f-0c99-47d0-b37b-75ffcbfbca68 service nova] Creating event network-vif-deleted:b08f19e7-ff10-4764-a677-03a66d6994fb for instance aab73774-0243-459a-9913-35790567830d on n-h2-845775-3 Jul 25 21:32:29.572604 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-9c682d8b-245b-445b-bf97-f725d96ea9c9 req-3cec5e6f-0c99-47d0-b37b-75ffcbfbca68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Jul 25 21:32:29.573385 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3637/7221] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:32:29.827613 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:29.828324 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:29.836648 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:29.837106 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:29.837899 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:29.838342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:29.916464 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:29.924413 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-0fbd3020-25c6-4ef1-a2b9-aa9e54f327c2 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1219 microversion: 2.1 time: 0.100668 Jul 25 21:32:29.925937 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3585/7222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:29 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:30.948650 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:30.949358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:30.955611 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:30.956417 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:30.957206 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:30.957652 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:31.021078 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:31.028946 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5ede202a-9b8f-424e-b528-7735f3fcaa5d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1219 microversion: 2.1 time: 0.085509 Jul 25 21:32:31.029528 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3638/7223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:30 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:32.050377 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:32.051022 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:32.058042 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:32.058505 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:32.059289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:32.059737 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:32.131086 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:32.139098 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-47d7119f-ec0b-457a-8cd7-a5b4b3e393bd tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1219 microversion: 2.1 time: 0.093012 Jul 25 21:32:32.139674 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3586/7224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:32 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:33.161721 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:33.162350 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:33.169377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:33.169841 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:33.170639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:33.171068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:33.237048 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92abfc791ac946799533a29c4e9c43d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209ca858efad4345a8c151eb3a8b5f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:33.244952 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f3bd70a6-7335-4ad9-b5ec-6198915de59d tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 200 len: 1219 microversion: 2.1 time: 0.087769 Jul 25 21:32:33.245536 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3639/7225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:33 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:34.266336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:34.266947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] [instance: aab73774-0243-459a-9913-35790567830d] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:34.275074 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:34.275529 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:34.276331 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:34.276774 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:34.291873 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] HTTP exception thrown: Instance aab73774-0243-459a-9913-35790567830d could not be found. Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Request method failure captured: Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d HTTP/1.1 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wnfvHfGYGsi4JL_6h35HK_JvFEX6FQ6Xq7Up-tWXqEdwClTIw-vqcvaedWmxLvfUyYZnsirnlx9O1PpPnVUjdE9Dq0u1iAWWXSAa26ItKIBecKd0AVnwz5nT0lVFha8cJi9KsX7S2qRSOOHYYHGYvXFF3A5U77kGsWVLDcWub0KB3k Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 209ca858efad4345a8c151eb3a8b5f21 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestShelveInstance-1522692188 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/209ca858efad4345a8c151eb3a8b5f21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/209ca858efad4345a8c151eb3a8b5f21"}]}] Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestShelveInstance-1522692188 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 209ca858efad4345a8c151eb3a8b5f21 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestShelveInstance-1522692188 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestShelveInstance-1522692188-project Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 92abfc791ac946799533a29c4e9c43d9 Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestShelveInstance-1522692188-project Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance aab73774-0243-459a-9913-35790567830d could not be found. Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': 'aab73774-0243-459a-9913-35790567830d'} Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab73774-0243-459a-9913-35790567830d could not be found. Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab73774-0243-459a-9913-35790567830d could not be found. Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:32:34.293680 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab73774-0243-459a-9913-35790567830d could not be found. Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Returning 404 to user: Instance aab73774-0243-459a-9913-35790567830d could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-59afdf88-9fd5-473f-936e-b3ce73a1b8b7 tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d" status: 404 len: 111 microversion: 2.1 time: 0.032746 Jul 25 21:32:34.298558 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3587/7226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:34 2022] GET /compute/v2.1/servers/aab73774-0243-459a-9913-35790567830d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:32:34.458915 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5a57a2f1-fe3e-4225-8415-91691bcdf9ef tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] Calling method '.version_select at 0x7f19587e6430>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:34.489445 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5a57a2f1-fe3e-4225-8415-91691bcdf9ef tempest-TestShelveInstance-1522692188 tempest-TestShelveInstance-1522692188-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-646903194" status: 202 len: 0 microversion: 2.1 time: 0.029081 Jul 25 21:32:34.490414 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3640/7227] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Jul 25 21:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-646903194 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:32:52.310490 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:52.311248 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:52.520140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Action: 'create', calling method: .version_select at 0x7f19684f99d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1185296090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZiK+pSGBt2LD9qD87CetNtrV4uIDlRsjboQbeil0F8uhrCPpZKadSWHQNCA7qK1QcCHuATD11AGuZIDhR8TL5xlI2Dxsc1CMmXrkQZrAp0K1oOd9+oDXe/vPCuxWcucw=="}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:32:52.537192 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:32:52.543200 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.quota [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for user 89737ac40cbb48ba9d344b0c1ba62d7f and project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'key_pairs'} {{(pid=119723) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:32:52.557940 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [14cf18c1-82f5-4402-859d-162536b6d5f5] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:32:53.567546 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [14cf18c1-82f5-4402-859d-162536b6d5f5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34370. Jul 25 21:32:53.589013 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3eacd739-94be-4971-8351-ffe6f3e011c4 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.283613 Jul 25 21:32:53.589868 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3588/7228] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Jul 25 21:32:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:32:54.622325 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1738722031", "imageRef": "152afe05-2c67-43aa-ad3c-bacbf2d878ba", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1185296090", "security_groups": [{"name": "tempest-secgroup-smoke-1604913951"}], "networks": [{"uuid": "8bafd432-49b2-42cf-8107-fb1269ae5f91"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:32:54.632702 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=22 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:54.633377 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:32:54.740735 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] validate_networks() for [('8bafd432-49b2-42cf-8107-fb1269ae5f91', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:32:55.140014 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:32:55.140560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:32:55.141135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:32:55.141671 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:32:55.142141 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:32:55.151997 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:55.152498 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:55.153332 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:55.153861 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:55.171780 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:32:55.177196 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for user 89737ac40cbb48ba9d344b0c1ba62d7f and project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:32:55.190118 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:32:55.192483 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='152afe05-2c67-43aa-ad3c-bacbf2d878ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:32:55.241356 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-15b1914b-3ccb-4c76-800b-22c1576b4efc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.622894 Jul 25 21:32:55.242200 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3641/7229] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:32:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:32:55.253198 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-9cd5c124-68ba-42e1-8d29-69a7e41b5704 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:55.254178 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-9cd5c124-68ba-42e1-8d29-69a7e41b5704 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:55.320506 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-9cd5c124-68ba-42e1-8d29-69a7e41b5704 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:55.327709 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-9cd5c124-68ba-42e1-8d29-69a7e41b5704 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1249 microversion: 2.1 time: 0.078692 Jul 25 21:32:55.328821 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3589/7230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:55 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:32:56.353367 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:56.354012 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:56.360625 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:56.361099 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:56.362475 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:56.362964 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:56.436697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:56.445856 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f4c2e3e8-e740-44c4-a7fb-ffd542b91ef9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1301 microversion: 2.1 time: 0.097700 Jul 25 21:32:56.446527 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3642/7231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:56 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:57.467824 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:57.468704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:57.479920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:57.480028 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:57.481035 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:57.481667 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:57.849705 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:57.868766 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-cdf87503-fa36-451b-a1a7-60f62bc52075 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.405699 Jul 25 21:32:57.869940 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3590/7232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:57 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:32:58.380076 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-3975634d-f65b-4ebb-b76c-b88093bee70c req-22c982e8-fc89-443e-a345-279c696ab9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:32:58.391414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3975634d-f65b-4ebb-b76c-b88093bee70c req-22c982e8-fc89-443e-a345-279c696ab9fa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:58.391787 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-3975634d-f65b-4ebb-b76c-b88093bee70c req-22c982e8-fc89-443e-a345-279c696ab9fa service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:58.405760 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-3975634d-f65b-4ebb-b76c-b88093bee70c req-22c982e8-fc89-443e-a345-279c696ab9fa service nova] Creating event network-changed:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:32:58.412595 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-3975634d-f65b-4ebb-b76c-b88093bee70c req-22c982e8-fc89-443e-a345-279c696ab9fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039387 Jul 25 21:32:58.413669 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3643/7233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:32:58.889785 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:32:58.890393 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:32:58.897717 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:58.898167 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:58.898938 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:32:58.899382 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:32:59.040168 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:32:59.047909 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-b068ae71-eced-44af-a8a7-6d0f01e531e6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.162056 Jul 25 21:32:59.048534 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3591/7234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:32:58 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:00.071882 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:00.072644 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:00.078970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:00.079435 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:00.080965 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:00.081431 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:00.230810 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:00.239050 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-1d3234cf-c0d1-45c2-a916-a7929f991ddd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.172173 Jul 25 21:33:00.239589 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3644/7235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:00 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:01.260089 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:01.260709 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:01.267548 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:01.268569 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:01.269336 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:01.269770 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:01.408379 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:01.415900 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-31150577-d781-4bac-b55e-e6f677311c49 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.159723 Jul 25 21:33:01.417321 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3592/7236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:01 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:02.437365 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:02.438422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:02.446158 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:02.446627 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:02.447422 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:02.447877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:02.584356 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:02.592126 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2030f39f-477b-4bcc-a87a-57c33d54dfd8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.158775 Jul 25 21:33:02.592710 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3645/7237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:02 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:03.618289 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:03.618839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:03.629852 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:03.630416 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:03.632798 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:03.633527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:03.771237 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-0313ef66-63a6-42b1-bdd4-34842beb17ea req-a641d697-8d2c-4875-bf94-ab99c839fd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "name": "network-vif-plugged", "status": "completed", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:33:03.782438 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0313ef66-63a6-42b1-bdd4-34842beb17ea req-a641d697-8d2c-4875-bf94-ab99c839fd09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:03.782930 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-0313ef66-63a6-42b1-bdd4-34842beb17ea req-a641d697-8d2c-4875-bf94-ab99c839fd09 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:03.799101 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-0313ef66-63a6-42b1-bdd4-34842beb17ea req-a641d697-8d2c-4875-bf94-ab99c839fd09 service nova] Creating event network-vif-plugged:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:33:03.803256 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:03.806734 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-0313ef66-63a6-42b1-bdd4-34842beb17ea req-a641d697-8d2c-4875-bf94-ab99c839fd09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040225 Jul 25 21:33:03.807787 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3646/7238] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:33:03.816417 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-62d762ec-82cf-46eb-9dc4-8cb1fc1a9c8d tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.204465 Jul 25 21:33:03.817822 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3593/7239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:03 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:04.840848 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:04.841570 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:04.849790 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:04.850264 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:04.851067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:04.851532 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:05.003163 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:05.011267 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-6c6ae85d-ef6d-4d3b-8fdb-b0fdfb1685bc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1375 microversion: 2.1 time: 0.175428 Jul 25 21:33:05.011868 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3647/7240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:04 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:06.033793 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:06.034363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:06.037105 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=6 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:06.044020 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:06.044512 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:06.045302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:06.045756 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:06.285268 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:06.292832 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-163071d9-7807-4d99-84ae-366a9bf05189 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1560 microversion: 2.1 time: 0.263157 Jul 25 21:33:06.293408 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3594/7241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:06 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1560 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:06.314215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:33:06.315390 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:33:06.317389 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:06.318062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:33:06.324786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:06.325255 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:06.326038 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:06.326488 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:06.516190 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:33:06.524522 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-4b11d4d2-df0d-4234-87c2-a680aa9451d8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1560 microversion: 2.1 time: 0.214478 Jul 25 21:33:06.525128 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3648/7242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:33:06 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:33:08.237339 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-6258676f-18e9-40b4-969f-3bd2beb6be1a req-47a70a06-ace5-48ae-8a9f-f27392dd0c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:33:08.247742 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6258676f-18e9-40b4-969f-3bd2beb6be1a req-47a70a06-ace5-48ae-8a9f-f27392dd0c27 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:33:08.248234 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-6258676f-18e9-40b4-969f-3bd2beb6be1a req-47a70a06-ace5-48ae-8a9f-f27392dd0c27 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:33:08.259239 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-6258676f-18e9-40b4-969f-3bd2beb6be1a req-47a70a06-ace5-48ae-8a9f-f27392dd0c27 service nova] Creating event network-changed:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:33:08.264672 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-6258676f-18e9-40b4-969f-3bd2beb6be1a req-47a70a06-ace5-48ae-8a9f-f27392dd0c27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Jul 25 21:33:08.265438 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3595/7243] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:35:02.035175 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:35:02.035976 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:35:02.392640 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:35:02.393244 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:35:02.553697 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:35:02.554106 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:35:03.738856 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:35:03.740011 n-d-845775-3 devstack@n-api.service[119724]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db2f568e-cfba-43e7-a4b1-60fbb34dadd8] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 25 21:35:03.740655 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:03.741687 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=36 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:03.745849 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-66812657"}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:03.748155 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:03.755942 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:03.756423 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:03.757241 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:03.757689 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:03.953019 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e412ce0b-798d-4256-9586-bb3fa2071fde tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "POST /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e/action" status: 202 len: 0 microversion: 2.1 time: 0.215752 Jul 25 21:35:03.953654 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3649/7244] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:35:03 2022] POST /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 21:35:10.347721 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:35:10.348586 n-d-845775-3 devstack@n-api.service[119723]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 25 21:35:10.349199 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:10.349970 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=32 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:10.354488 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5404ada9-154f-4562-aa8b-215f5a6265fd req-03fc95b9-b7a3-4845-b531-9ac5167f931d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "name": "network-vif-plugged", "status": "completed", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:10.374354 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5404ada9-154f-4562-aa8b-215f5a6265fd req-03fc95b9-b7a3-4845-b531-9ac5167f931d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:10.374890 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5404ada9-154f-4562-aa8b-215f5a6265fd req-03fc95b9-b7a3-4845-b531-9ac5167f931d service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:10.393829 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5404ada9-154f-4562-aa8b-215f5a6265fd req-03fc95b9-b7a3-4845-b531-9ac5167f931d service nova] Creating event network-vif-plugged:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:35:10.397406 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5404ada9-154f-4562-aa8b-215f5a6265fd req-03fc95b9-b7a3-4845-b531-9ac5167f931d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051261 Jul 25 21:35:10.398117 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3596/7245] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:35:17.535175 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:17.535952 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:17.540986 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1560890362", "imageRef": "54829713-5b03-44d7-bb0e-0de6537fa490", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1185296090", "security_groups": [{"name": "tempest-secgroup-smoke-1604913951"}], "networks": [{"uuid": "8bafd432-49b2-42cf-8107-fb1269ae5f91"}]}} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:17.566337 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] [db2f568e-cfba-43e7-a4b1-60fbb34dadd8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34638. Jul 25 21:35:17.568391 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a53f63a-1e30-4c55-ab54-04b082e57d3b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34636. Jul 25 21:35:17.657103 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.network.neutron [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] validate_networks() for [('8bafd432-49b2-42cf-8107-fb1269ae5f91', None, None, None, None, None)] {{(pid=119724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 21:35:18.294512 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Flavor limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 21:35:18.294947 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Image limits 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 21:35:18.295440 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Flavor pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 21:35:18.295872 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Image pref 0:0:0 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 21:35:18.296364 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.virt.hardware [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 21:35:18.306128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:18.306598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:18.307420 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:18.307877 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:18.324920 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 21:35:18.330240 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.quota [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Getting quotas for user 89737ac40cbb48ba9d344b0c1ba62d7f and project 4bc300a676ae420899d8f679ac3d86ec. Resources: {'cores', 'instances', 'ram'} {{(pid=119724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 21:35:18.342949 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Going to run 1 instances... {{(pid=119724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 21:35:18.345430 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='54829713-5b03-44d7-bb0e-0de6537fa490',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 21:35:18.394964 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-88728ccc-717e-4035-9fd5-8ff057a475ee tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861800 Jul 25 21:35:18.395777 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3650/7246] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Jul 25 21:35:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 21:35:18.410095 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-ed45575a-1c05-42c0-aff4-77520876bddf tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:18.410820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-ed45575a-1c05-42c0-aff4-77520876bddf tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:18.423761 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bedcc66-1ceb-4c09-920c-0e4b9adb16e9] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34652. Jul 25 21:35:18.424553 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] [dfc1867d-6be5-4b03-8824-b1a48b29d4a8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 34650. Jul 25 21:35:18.472160 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-ed45575a-1c05-42c0-aff4-77520876bddf tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:18.487966 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-ed45575a-1c05-42c0-aff4-77520876bddf tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1249 microversion: 2.1 time: 0.084609 Jul 25 21:35:18.488585 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3597/7247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:18 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:19.510292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:19.511068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:19.520517 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:19.520994 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:19.521794 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:19.522259 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:19.938320 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:19.955972 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-f6a5a01c-18f5-4323-bc5e-16a6aad838dd tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1319 microversion: 2.1 time: 0.450321 Jul 25 21:35:19.968679 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3651/7248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:19 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:20.386947 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-f133a238-a48c-4ce6-a699-b8088600860e req-5ffec1da-7461-4bed-90df-a6f892424624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "name": "network-vif-unplugged", "status": "completed", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:20.406895 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:20.410302 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f133a238-a48c-4ce6-a699-b8088600860e req-5ffec1da-7461-4bed-90df-a6f892424624 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:20.411655 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-f133a238-a48c-4ce6-a699-b8088600860e req-5ffec1da-7461-4bed-90df-a6f892424624 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:20.432689 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-f133a238-a48c-4ce6-a699-b8088600860e req-5ffec1da-7461-4bed-90df-a6f892424624 service nova] Creating event network-vif-unplugged:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:35:20.439972 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-f133a238-a48c-4ce6-a699-b8088600860e req-5ffec1da-7461-4bed-90df-a6f892424624 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062396 Jul 25 21:35:20.441491 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3598/7249] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:35:20.982215 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:20.982752 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:20.990676 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:20.991945 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:20.992957 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:20.993574 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:21.156295 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:21.167215 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c08ec8e4-3a58-4414-b14e-1bcfd5edfaa0 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.188753 Jul 25 21:35:21.187801 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3652/7250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:20 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:22.198318 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:22.199782 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:22.206541 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:22.207001 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:22.207814 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:22.208297 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:22.377325 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:22.386019 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4c0832dc-249c-4565-a0f4-1635af1120b5 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.193369 Jul 25 21:35:22.386964 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3599/7251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:22 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:23.409764 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:23.410410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:23.418073 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:23.418551 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:23.419348 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:23.420250 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:23.555846 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:23.563339 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2c252698-fa61-482c-803a-2d953ba90e0c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.159335 Jul 25 21:35:23.563904 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3653/7252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:23 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:24.585342 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:24.585962 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:24.592964 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:24.593537 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:24.594303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:24.594740 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:24.735386 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:24.744135 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4e5c6fc7-881c-43e6-baf8-1c70a900a5da tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.163018 Jul 25 21:35:24.751976 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3600/7253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:24 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:25.766697 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:25.767345 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:25.776633 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:25.777178 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:25.778095 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:25.778558 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:25.921560 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:25.929056 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-a53fa9a5-7422-4745-9614-b1144247bd88 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.166825 Jul 25 21:35:25.929617 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3654/7254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:25 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:26.950691 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:26.951539 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:26.961309 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:26.961763 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:26.962697 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:26.963153 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:27.107272 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:27.115754 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-7a37d46e-70ff-4a68-ac43-aa35c98d1afc tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.169786 Jul 25 21:35:27.117465 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3601/7255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:26 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:35:28.140251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:28.141128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:28.148352 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:28.148822 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:28.149656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:28.150104 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:28.290981 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:28.296507 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-c0dc895a-50cd-46cd-88e9-f855d75acec6 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.161161 Jul 25 21:35:28.297099 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3655/7256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:28 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:29.323348 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:29.323999 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:29.326820 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell0:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:29.333183 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:29.333651 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:29.334546 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:29.335694 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:29.469769 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:29.477246 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-07592a1d-69b1-41a4-ab75-428dcae4e7af tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.158468 Jul 25 21:35:29.477815 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3602/7257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:29 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:30.503979 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-a777f2d0-83b6-435e-928e-fa7e81ad1c81 req-c160f221-6145-4a90-8670-7b203f98373f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:30.506380 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:30.507145 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:30.511128 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=2 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:30.512729 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell0:SELECT=6 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:30.517358 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a777f2d0-83b6-435e-928e-fa7e81ad1c81 req-c160f221-6145-4a90-8670-7b203f98373f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:30.517796 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-a777f2d0-83b6-435e-928e-fa7e81ad1c81 req-c160f221-6145-4a90-8670-7b203f98373f service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:30.531203 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:30.535631 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:30.536286 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-a777f2d0-83b6-435e-928e-fa7e81ad1c81 req-c160f221-6145-4a90-8670-7b203f98373f service nova] Creating event network-changed:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:35:30.536598 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:30.537254 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:30.541908 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-a777f2d0-83b6-435e-928e-fa7e81ad1c81 req-c160f221-6145-4a90-8670-7b203f98373f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044235 Jul 25 21:35:30.542794 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3603/7258] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:35:30.815327 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:30.823859 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-2af5f2c9-1d36-4eac-b63c-76a0fe955785 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.329137 Jul 25 21:35:30.824479 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3656/7259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:30 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:31.846369 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:31.847083 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:31.853995 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:31.854454 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:31.855260 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:31.855704 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:31.994920 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:32.002735 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-a07d4b1c-6cc4-44d2-a62e-a4f4e2c13220 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.161580 Jul 25 21:35:32.003306 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3604/7260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:31 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:33.025474 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:33.026060 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:33.032998 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:33.033472 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:33.034258 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:33.034710 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:33.167703 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:33.175271 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-3c86a5eb-689b-4a41-848d-be214633006c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.155043 Jul 25 21:35:33.175861 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3657/7261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:33 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:34.196853 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:34.198398 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:34.204916 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:34.205371 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:34.206128 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:34.206568 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:34.338132 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:34.346080 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-1596f395-dafa-4f05-b976-e6411938c020 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.153768 Jul 25 21:35:34.346654 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3605/7262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:34 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:35.368160 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:35.368826 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:35.376656 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:35.377135 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:35.377936 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:35.378414 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:35.479972 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-2199e5d0-2939-4a37-9cc2-81ecaf150f3c req-2ce4a7ef-2bce-436d-893f-bf2a9038eaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "name": "network-vif-plugged", "status": "completed", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:35.492497 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2199e5d0-2939-4a37-9cc2-81ecaf150f3c req-2ce4a7ef-2bce-436d-893f-bf2a9038eaf1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:35.493478 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-2199e5d0-2939-4a37-9cc2-81ecaf150f3c req-2ce4a7ef-2bce-436d-893f-bf2a9038eaf1 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:35.505531 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-2199e5d0-2939-4a37-9cc2-81ecaf150f3c req-2ce4a7ef-2bce-436d-893f-bf2a9038eaf1 service nova] Creating event network-vif-plugged:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:35:35.511370 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-2199e5d0-2939-4a37-9cc2-81ecaf150f3c req-2ce4a7ef-2bce-436d-893f-bf2a9038eaf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Jul 25 21:35:35.511981 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3606/7263] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:35:35.525391 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:35.535054 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5dc4a4e4-e597-4267-933e-eaa9b322300c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.171805 Jul 25 21:35:35.535758 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3658/7264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:35 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:36.557982 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:36.558687 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:36.565832 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:36.566284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:36.567041 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:36.567479 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:36.702405 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:36.709993 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-3a7d74b9-1da6-4cb8-bceb-24cf1d411103 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1375 microversion: 2.1 time: 0.157046 Jul 25 21:35:36.710599 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3607/7265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:36 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:37.731774 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:37.732436 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:37.739497 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:37.739970 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:37.740795 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:37.741273 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:37.871985 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:37.879601 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-e3aa9731-24d2-472f-ae74-c9437b9eb910 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1561 microversion: 2.1 time: 0.151813 Jul 25 21:35:37.880214 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3659/7266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:37 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:37.900092 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:35:37.900721 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:35:37.907598 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:37.908084 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:37.908862 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:37.909307 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:38.046926 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:35:38.054517 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-61101f16-2e80-47f1-bfe9-858c5c763d0f tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1561 microversion: 2.1 time: 0.158764 Jul 25 21:35:38.055104 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3608/7267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:35:37 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:35:39.924740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-e7517655-f82e-4220-9495-5a4f161a3d4e req-047ed959-a54e-49b9-bc56-525a4ff1854e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:35:39.935579 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7517655-f82e-4220-9495-5a4f161a3d4e req-047ed959-a54e-49b9-bc56-525a4ff1854e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:35:39.936057 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-e7517655-f82e-4220-9495-5a4f161a3d4e req-047ed959-a54e-49b9-bc56-525a4ff1854e service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:35:39.947669 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-e7517655-f82e-4220-9495-5a4f161a3d4e req-047ed959-a54e-49b9-bc56-525a4ff1854e service nova] Creating event network-changed:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:35:39.952872 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-e7517655-f82e-4220-9495-5a4f161a3d4e req-047ed959-a54e-49b9-bc56-525a4ff1854e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Jul 25 21:35:39.953467 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3660/7268] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:09.151504 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=28 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:09.152802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=54 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:09.156996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1488127765"}} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:09.159283 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:09.166126 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:09.166589 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:09.167364 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:09.168511 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:09.360814 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-5ac9fa1f-ce66-4bee-ad75-5bc44f3c16b7 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "POST /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376/action" status: 202 len: 0 microversion: 2.1 time: 0.211134 Jul 25 21:37:09.361783 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3609/7269] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Jul 25 21:37:09 2022] POST /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 25 21:37:13.886953 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:13.888154 n-d-845775-3 devstack@n-api.service[119724]: DEBUG dbcounter [-] [119724] Writing DB stats nova_cell1:SELECT=58 {{(pid=119724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:14.017299 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-6071da2d-f257-4f48-bc24-a4ee00afddb4 req-ac775f65-18d4-4238-b448-96d276c33d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "name": "network-vif-plugged", "status": "completed", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:14.027410 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6071da2d-f257-4f48-bc24-a4ee00afddb4 req-ac775f65-18d4-4238-b448-96d276c33d80 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:14.027879 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-6071da2d-f257-4f48-bc24-a4ee00afddb4 req-ac775f65-18d4-4238-b448-96d276c33d80 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:14.040793 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-6071da2d-f257-4f48-bc24-a4ee00afddb4 req-ac775f65-18d4-4238-b448-96d276c33d80 service nova] Creating event network-vif-plugged:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:37:14.046987 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-6071da2d-f257-4f48-bc24-a4ee00afddb4 req-ac775f65-18d4-4238-b448-96d276c33d80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162196 Jul 25 21:37:14.048242 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3661/7270] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:24.002148 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:24.002827 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:24.004823 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-5bfe7591-7d9b-4cde-b1e5-90ace040e2c1 req-6339620a-f1ce-460f-a235-cfb4c27768cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:24.006247 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_api:SELECT=2 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:24.006996 n-d-845775-3 devstack@n-api.service[119723]: DEBUG dbcounter [-] [119723] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:24.015719 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:24.016803 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:24.017218 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5bfe7591-7d9b-4cde-b1e5-90ace040e2c1 req-6339620a-f1ce-460f-a235-cfb4c27768cc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:24.017691 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-5bfe7591-7d9b-4cde-b1e5-90ace040e2c1 req-6339620a-f1ce-460f-a235-cfb4c27768cc service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:24.017794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:24.018295 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:24.029518 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-5bfe7591-7d9b-4cde-b1e5-90ace040e2c1 req-6339620a-f1ce-460f-a235-cfb4c27768cc service nova] Creating event network-changed:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:37:24.035231 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-5bfe7591-7d9b-4cde-b1e5-90ace040e2c1 req-6339620a-f1ce-460f-a235-cfb4c27768cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036179 Jul 25 21:37:24.036059 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3662/7271] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:24.047340 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Going to try to terminate instance {{(pid=119723) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:37:24.140381 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-94c7b29d-098a-437d-91ac-42f92c9e6603 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 204 len: 0 microversion: 2.1 time: 0.142445 Jul 25 21:37:24.142389 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3610/7272] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:37:23 2022] DELETE /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:37:24.151297 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:24.152084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:24.158592 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:24.159068 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:24.159869 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:24.160358 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:24.316609 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:24.324236 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-5b177bc7-7b14-4d00-8e6d-b539394fd8ab tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1685 microversion: 2.1 time: 0.177246 Jul 25 21:37:24.324820 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3663/7273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:24 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:37:25.346299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:25.347137 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:25.353915 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:25.354363 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:25.355624 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:25.356076 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:25.496303 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:25.503914 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-4f663b23-1af2-454a-bc0d-4d29825b23b8 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1685 microversion: 2.1 time: 0.161898 Jul 25 21:37:25.504512 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3611/7274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:25 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:37:25.842188 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [req-b49d1256-c2e8-4074-a5a4-f580b585aa07 req-50db6317-43a3-4e80-bb06-b448128a6311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "name": "network-vif-unplugged", "status": "completed", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:25.859330 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b49d1256-c2e8-4074-a5a4-f580b585aa07 req-50db6317-43a3-4e80-bb06-b448128a6311 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:25.859874 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [req-b49d1256-c2e8-4074-a5a4-f580b585aa07 req-50db6317-43a3-4e80-bb06-b448128a6311 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:25.875997 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.compute.server_external_events [req-b49d1256-c2e8-4074-a5a4-f580b585aa07 req-50db6317-43a3-4e80-bb06-b448128a6311 service nova] Creating event network-vif-unplugged:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:37:25.884069 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [req-b49d1256-c2e8-4074-a5a4-f580b585aa07 req-50db6317-43a3-4e80-bb06-b448128a6311 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049047 Jul 25 21:37:25.885700 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3664/7275] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 21:37:26.515327 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-41e92dd2-d3d3-44ba-abf3-7c86fb86b864 req-476ce6a0-23f3-4dd2-81e8-b81e6ac5f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c0e4c5-f66a-4e3b-8a7e-2302e7b99376", "name": "network-vif-deleted", "tag": "888ecba8-dec1-4de5-8508-8d607e907b98"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:26.525802 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-41e92dd2-d3d3-44ba-abf3-7c86fb86b864 req-476ce6a0-23f3-4dd2-81e8-b81e6ac5f625 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:26.526067 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:26.526254 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-41e92dd2-d3d3-44ba-abf3-7c86fb86b864 req-476ce6a0-23f3-4dd2-81e8-b81e6ac5f625 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:26.526545 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:26.534602 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:26.535089 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:26.536292 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:26.537315 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:26.553344 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-41e92dd2-d3d3-44ba-abf3-7c86fb86b864 req-476ce6a0-23f3-4dd2-81e8-b81e6ac5f625 service nova] Creating event network-vif-deleted:888ecba8-dec1-4de5-8508-8d607e907b98 for instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 on n-h1-845775-3 Jul 25 21:37:26.559736 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-41e92dd2-d3d3-44ba-abf3-7c86fb86b864 req-476ce6a0-23f3-4dd2-81e8-b81e6ac5f625 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109243 Jul 25 21:37:26.560581 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3612/7276] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:26.576134 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:26.576628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:26.577283 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lazy-loading 'fault' on Instance uuid 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:37:26.621740 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:26.629460 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8da2be2f-2b3c-45d8-bbd3-971d2c7a5ab3 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 200 len: 1339 microversion: 2.1 time: 0.107854 Jul 25 21:37:26.630032 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3665/7277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:26 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:37:27.653223 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:27.653839 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:27.660110 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:27.660573 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:27.661335 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:27.661783 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:27.675568 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] HTTP exception thrown: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Request method failure captured: Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 HTTP/1.1 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wv_40YpTE1VR7xirS-oftPO5UieDHvyOykAj1sOiBoWsOSkOmgr_EPxoEEraUPUKXV4AAti12xw6ayhb3-rKNulI05Mua-l20g0jchoxDtyr2IGBMP-gasiWs2e4glza6brU9ABpuqy1SVjRwvf4s08MtDPzJw5QhC7Av5tnppl6Mw Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 4bc300a676ae420899d8f679ac3d86ec Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bc300a676ae420899d8f679ac3d86ec"}]}] Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 4bc300a676ae420899d8f679ac3d86ec Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestSnapshotPattern-1018918066-project Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 89737ac40cbb48ba9d344b0c1ba62d7f Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestSnapshotPattern-1018918066-project Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '98c0e4c5-f66a-4e3b-8a7e-2302e7b99376'} Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:37:27.677194 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Returning 404 to user: Instance 98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-39a78ade-a125-4649-9abb-aab4b1e22cec tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376" status: 404 len: 111 microversion: 2.1 time: 0.031171 Jul 25 21:37:27.682578 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3613/7278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:27 2022] GET /compute/v2.1/servers/98c0e4c5-f66a-4e3b-8a7e-2302e7b99376 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:37:29.298341 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:29.299515 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:29.307287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:29.307769 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:29.309940 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:29.310449 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:29.341450 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Going to try to terminate instance {{(pid=119724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 21:37:29.373946 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-3dab8022-51d4-4421-95e6-cdaa50c950fa req-d43c4c2e-ae78-4a6a-b4d0-e6cec6cbfda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:29.385299 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3dab8022-51d4-4421-95e6-cdaa50c950fa req-d43c4c2e-ae78-4a6a-b4d0-e6cec6cbfda5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:29.385767 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-3dab8022-51d4-4421-95e6-cdaa50c950fa req-d43c4c2e-ae78-4a6a-b4d0-e6cec6cbfda5 service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:29.398256 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-3dab8022-51d4-4421-95e6-cdaa50c950fa req-d43c4c2e-ae78-4a6a-b4d0-e6cec6cbfda5 service nova] Creating event network-changed:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:37:29.405456 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-3dab8022-51d4-4421-95e6-cdaa50c950fa req-d43c4c2e-ae78-4a6a-b4d0-e6cec6cbfda5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107626 Jul 25 21:37:29.406791 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3614/7279] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:29.431501 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-253ff4b7-1293-4724-844c-77fa2a8b4b89 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 204 len: 0 microversion: 2.1 time: 0.136817 Jul 25 21:37:29.432571 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3666/7280] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Jul 25 21:37:29 2022] DELETE /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 21:37:29.443698 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:29.447046 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:29.452451 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:29.453583 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:29.454632 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:29.455121 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:29.603621 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.policy [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119723) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:29.612340 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-6214bef5-87b7-41a4-b061-e30f75438c7c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1685 microversion: 2.1 time: 0.173410 Jul 25 21:37:29.613116 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3615/7281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:29 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:37:30.636363 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:30.637084 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:30.644791 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:30.645287 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:30.646059 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:30.646645 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:30.796555 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:30.804527 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-8b07b716-92f5-48a6-a8db-42d308732446 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1685 microversion: 2.1 time: 0.172735 Jul 25 21:37:30.805116 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3667/7282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:30 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 21:37:31.570140 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [req-5715dc8a-e034-4bcf-bc6e-6e25a9cd2057 req-a64c536d-4c2e-4ba5-80c7-249bac74e93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd1690b-df9b-4f11-9481-b0a2f9bc443e", "name": "network-vif-deleted", "tag": "5adde63c-080f-4fd2-b5a6-9fa4b1073457"}]} {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 21:37:31.583527 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5715dc8a-e034-4bcf-bc6e-6e25a9cd2057 req-a64c536d-4c2e-4ba5-80c7-249bac74e93a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:31.583974 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [req-5715dc8a-e034-4bcf-bc6e-6e25a9cd2057 req-a64c536d-4c2e-4ba5-80c7-249bac74e93a service nova] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:31.596639 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.compute.server_external_events [req-5715dc8a-e034-4bcf-bc6e-6e25a9cd2057 req-a64c536d-4c2e-4ba5-80c7-249bac74e93a service nova] Creating event network-vif-deleted:5adde63c-080f-4fd2-b5a6-9fa4b1073457 for instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e on n-h2-845775-3 Jul 25 21:37:31.601657 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [req-5715dc8a-e034-4bcf-bc6e-6e25a9cd2057 req-a64c536d-4c2e-4ba5-80c7-249bac74e93a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035795 Jul 25 21:37:31.602267 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3616/7283] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Jul 25 21:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 21:37:31.828139 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:31.828786 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.compute.api [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119724) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:31.837062 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:31.837692 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:31.838628 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:31.839097 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:31.875113 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:31.875590 n-d-845775-3 devstack@n-api.service[119724]: DEBUG oslo_concurrency.lockutils [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:31.876251 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.objects.instance [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lazy-loading 'fault' on Instance uuid 3cd1690b-df9b-4f11-9481-b0a2f9bc443e {{(pid=119724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 21:37:31.925115 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.policy [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737ac40cbb48ba9d344b0c1ba62d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bc300a676ae420899d8f679ac3d86ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119724) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 21:37:31.934752 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-fba6e7fb-865b-44f0-9917-7f2845f543a9 tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 200 len: 1339 microversion: 2.1 time: 0.110314 Jul 25 21:37:31.935498 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3668/7284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:31 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 21:37:32.959079 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '>' {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:32.959794 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.compute.api [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] [instance: 3cd1690b-df9b-4f11-9481-b0a2f9bc443e] Fetching instance by UUID {{(pid=119723) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 21:37:32.965981 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:32.966438 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:32.967284 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 21:37:32.967727 n-d-845775-3 devstack@n-api.service[119723]: DEBUG oslo_concurrency.lockutils [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Lock "607c484c-f390-4dbd-9b27-5ef5ce705863" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 21:37:32.981415 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.wsgi [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] HTTP exception thrown: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Request method failure captured: Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: request: GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e HTTP/1.1 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Accept: application/json Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Accept-Encoding: identity Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Connection: close Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Content-Length: 0 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Content-Type: application/json Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Host: 10.222.0.48 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: Openstack-System-Scope: None Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: User-Agent: python-urllib3/1.26.10 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Auth-Token: gAAAAABi3wv_40YpTE1VR7xirS-oftPO5UieDHvyOykAj1sOiBoWsOSkOmgr_EPxoEEraUPUKXV4AAti12xw6ayhb3-rKNulI05Mua-l20g0jchoxDtyr2IGBMP-gasiWs2e4glza6brU9ABpuqy1SVjRwvf4s08MtDPzJw5QhC7Av5tnppl6Mw Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Id: None Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Domain-Name: None Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Identity-Status: Confirmed Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Is-Admin-Project: True Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Id: default Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Domain-Name: Default Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Id: 4bc300a676ae420899d8f679ac3d86ec Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Project-Name: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Role: reader,member Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Roles: reader,member Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bc300a676ae420899d8f679ac3d86ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bc300a676ae420899d8f679ac3d86ec"}]}] Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Id: 4bc300a676ae420899d8f679ac3d86ec Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-Tenant-Name: tempest-TestSnapshotPattern-1018918066 Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-User: tempest-TestSnapshotPattern-1018918066-project Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Id: default Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-User-Domain-Name: Default Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-User-Id: 89737ac40cbb48ba9d344b0c1ba62d7f Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: X-User-Name: tempest-TestSnapshotPattern-1018918066-project Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: method: > Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: exception: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: action_args: {'id': '3cd1690b-df9b-4f11-9481-b0a2f9bc443e'} Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: {{(pid=119723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 21:37:32.983023 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: ERROR nova.api.openstack.wsgi Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: DEBUG nova.api.openstack.wsgi [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Returning 404 to user: Instance 3cd1690b-df9b-4f11-9481-b0a2f9bc443e could not be found. {{(pid=119723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: INFO nova.api.openstack.requestlog [None req-391d0db3-a569-418d-87da-1b9ce9fac1aa tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jul 25 21:37:32.987808 n-d-845775-3 devstack@n-api.service[119723]: [pid: 119723|app: 0|req: 3617/7285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Jul 25 21:37:32 2022] GET /compute/v2.1/servers/3cd1690b-df9b-4f11-9481-b0a2f9bc443e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 21:37:33.152639 n-d-845775-3 devstack@n-api.service[119724]: DEBUG nova.api.openstack.wsgi [None req-0900cba2-29a2-41b0-8277-23131d08659c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] Calling method '.version_select at 0x7f196eae4550>' {{(pid=119724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 21:37:33.180129 n-d-845775-3 devstack@n-api.service[119724]: INFO nova.api.openstack.requestlog [None req-0900cba2-29a2-41b0-8277-23131d08659c tempest-TestSnapshotPattern-1018918066 tempest-TestSnapshotPattern-1018918066-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1185296090" status: 202 len: 0 microversion: 2.1 time: 0.031655 Jul 25 21:37:33.180730 n-d-845775-3 devstack@n-api.service[119724]: [pid: 119724|app: 0|req: 3669/7286] 10.222.0.48 () {58 vars in 1257 bytes} [Mon Jul 25 21:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1185296090 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 21:38:22.021702 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:38:22.022234 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:38:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:38:22.044489 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:38:22.044684 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:38:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:38:22.562080 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:38:22.562687 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:38:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:40:02.403515 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:40:02.404245 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:40:20.536804 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:40:20.537433 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:40:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:40:39.360579 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:40:39.361168 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:41:42.030222 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:41:42.030881 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:41:42.052228 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:41:42.052423 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:41:42.570351 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:41:42.570909 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:41:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:43:22.411764 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:43:22.412596 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:43:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:43:40.544564 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:43:40.545209 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:43:59.369476 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:43:59.369987 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:45:02.038575 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:45:02.039212 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:45:02.059571 n-d-845775-3 devstack@n-api.service[119723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:45:02.059730 n-d-845775-3 devstack@n-api.service[119723]: Mon Jul 25 21:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 21:45:02.579408 n-d-845775-3 devstack@n-api.service[119724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 21:45:02.579952 n-d-845775-3 devstack@n-api.service[119724]: Mon Jul 25 21:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!